Jun 09 13:28:12.728808 ip-10-0-131-58 systemd[1]: Starting Kubernetes Kubelet... Jun 09 13:28:13.123219 ip-10-0-131-58 kubenswrapper[2544]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 13:28:13.123219 ip-10-0-131-58 kubenswrapper[2544]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 13:28:13.123219 ip-10-0-131-58 kubenswrapper[2544]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 13:28:13.123219 ip-10-0-131-58 kubenswrapper[2544]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 13:28:13.123219 ip-10-0-131-58 kubenswrapper[2544]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 13:28:13.123897 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.123233 2544 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 13:28:13.127510 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127495 2544 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 13:28:13.127510 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127509 2544 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 13:28:13.127591 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127515 2544 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 13:28:13.127591 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127518 2544 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 13:28:13.127591 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127521 2544 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 13:28:13.127591 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127524 2544 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 13:28:13.127591 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127528 2544 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 13:28:13.127591 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127531 2544 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 13:28:13.127591 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127533 2544 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 13:28:13.127591 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127536 2544 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 13:28:13.127591 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127539 2544 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 13:28:13.127591 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127542 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 13:28:13.127591 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127558 2544 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 13:28:13.127591 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127561 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 13:28:13.127591 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127563 2544 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 13:28:13.127591 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127566 2544 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 13:28:13.127591 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127568 2544 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 13:28:13.127591 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127571 2544 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 13:28:13.127591 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127573 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 13:28:13.127591 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127576 2544 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 13:28:13.127591 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127579 2544 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 13:28:13.127591 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127582 2544 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 13:28:13.128056 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127584 2544 feature_gate.go:328] unrecognized feature gate: Example Jun 09 13:28:13.128056 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127587 2544 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 13:28:13.128056 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127590 2544 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 13:28:13.128056 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127592 2544 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 13:28:13.128056 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127595 2544 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 13:28:13.128056 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127598 2544 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 13:28:13.128056 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127600 2544 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 13:28:13.128056 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127603 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 13:28:13.128056 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127606 2544 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 13:28:13.128056 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127609 2544 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 13:28:13.128056 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127611 2544 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 13:28:13.128056 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127613 2544 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 13:28:13.128056 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127616 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 13:28:13.128056 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127619 2544 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 13:28:13.128056 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127621 2544 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 13:28:13.128056 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127624 2544 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 13:28:13.128056 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127626 2544 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 13:28:13.128056 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127629 2544 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 13:28:13.128056 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127631 2544 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 13:28:13.128056 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127634 2544 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 13:28:13.128537 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127638 2544 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 13:28:13.128537 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127642 2544 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 13:28:13.128537 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127645 2544 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 13:28:13.128537 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127647 2544 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 13:28:13.128537 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127650 2544 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 13:28:13.128537 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127652 2544 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 13:28:13.128537 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127655 2544 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 13:28:13.128537 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127658 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 13:28:13.128537 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127661 2544 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 13:28:13.128537 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127663 2544 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 13:28:13.128537 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127666 2544 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 13:28:13.128537 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127668 2544 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 13:28:13.128537 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127671 2544 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 13:28:13.128537 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127674 2544 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 13:28:13.128537 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127677 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 13:28:13.128537 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127680 2544 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 13:28:13.128537 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127682 2544 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 13:28:13.128537 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127685 2544 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 13:28:13.128537 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127687 2544 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 13:28:13.128537 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127690 2544 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 13:28:13.129082 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127693 2544 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 13:28:13.129082 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127695 2544 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 13:28:13.129082 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127698 2544 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 13:28:13.129082 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127700 2544 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 13:28:13.129082 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127703 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 13:28:13.129082 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127705 2544 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 13:28:13.129082 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127708 2544 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 13:28:13.129082 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127710 2544 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 13:28:13.129082 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127714 2544 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 13:28:13.129082 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127717 2544 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 13:28:13.129082 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127720 2544 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 13:28:13.129082 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127724 2544 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 13:28:13.129082 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127726 2544 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 13:28:13.129082 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127729 2544 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 13:28:13.129082 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127732 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 13:28:13.129082 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127734 2544 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 13:28:13.129082 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127737 2544 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 13:28:13.129082 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127739 2544 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 13:28:13.129082 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127742 2544 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 13:28:13.129082 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127746 2544 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 13:28:13.129864 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127748 2544 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 13:28:13.129864 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127751 2544 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 13:28:13.129864 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127753 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 13:28:13.129864 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127755 2544 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 13:28:13.129864 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127758 2544 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 13:28:13.129864 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127762 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 13:28:13.129864 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127765 2544 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 13:28:13.129864 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127767 2544 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 13:28:13.129864 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127770 2544 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 13:28:13.129864 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127773 2544 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 13:28:13.129864 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127775 2544 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 13:28:13.129864 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127778 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 13:28:13.129864 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127780 2544 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 13:28:13.129864 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127783 2544 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 13:28:13.129864 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127785 2544 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 13:28:13.129864 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127788 2544 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 13:28:13.129864 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.127792 2544 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 13:28:13.129864 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128465 2544 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 13:28:13.129864 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128472 2544 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 13:28:13.130342 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128475 2544 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 13:28:13.130342 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128478 2544 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 13:28:13.130342 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128481 2544 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 13:28:13.130342 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128484 2544 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 13:28:13.130342 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128487 2544 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 13:28:13.130342 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128490 2544 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 13:28:13.130342 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128493 2544 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 13:28:13.130342 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128495 2544 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 13:28:13.130342 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128498 2544 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 13:28:13.130342 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128500 2544 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 13:28:13.130342 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128503 2544 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 13:28:13.130342 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128506 2544 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 13:28:13.130342 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128510 2544 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 13:28:13.130342 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128513 2544 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 13:28:13.130342 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128516 2544 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 13:28:13.130342 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128519 2544 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 13:28:13.130342 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128522 2544 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 13:28:13.130342 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128525 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 13:28:13.130342 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128529 2544 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 13:28:13.130863 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128533 2544 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 13:28:13.130863 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128536 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 13:28:13.130863 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128538 2544 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 13:28:13.130863 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128541 2544 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 13:28:13.130863 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128572 2544 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 13:28:13.130863 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128577 2544 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 13:28:13.130863 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128580 2544 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 13:28:13.130863 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128583 2544 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 13:28:13.130863 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128586 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 13:28:13.130863 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128588 2544 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 13:28:13.130863 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128591 2544 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 13:28:13.130863 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128594 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 13:28:13.130863 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128597 2544 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 13:28:13.130863 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128599 2544 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 13:28:13.130863 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128601 2544 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 13:28:13.130863 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128604 2544 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 13:28:13.130863 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128607 2544 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 13:28:13.130863 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128610 2544 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 13:28:13.130863 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128613 2544 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 13:28:13.130863 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128615 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 13:28:13.131347 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128618 2544 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 13:28:13.131347 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128621 2544 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 13:28:13.131347 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128623 2544 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 13:28:13.131347 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128626 2544 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 13:28:13.131347 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128629 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 13:28:13.131347 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128631 2544 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 13:28:13.131347 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128634 2544 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 13:28:13.131347 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128637 2544 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 13:28:13.131347 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128640 2544 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 13:28:13.131347 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128643 2544 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 13:28:13.131347 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128645 2544 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 13:28:13.131347 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128648 2544 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 13:28:13.131347 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128651 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 13:28:13.131347 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128654 2544 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 13:28:13.131347 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128657 2544 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 13:28:13.131347 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128659 2544 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 13:28:13.131347 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128662 2544 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 13:28:13.131347 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128664 2544 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 13:28:13.131347 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128667 2544 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 13:28:13.131347 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128669 2544 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 13:28:13.131857 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128672 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 13:28:13.131857 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128674 2544 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 13:28:13.131857 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128677 2544 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 13:28:13.131857 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128679 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 13:28:13.131857 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128682 2544 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 13:28:13.131857 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128684 2544 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 13:28:13.131857 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128687 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 13:28:13.131857 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128689 2544 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 13:28:13.131857 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128692 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 13:28:13.131857 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128695 2544 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 13:28:13.131857 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128698 2544 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 13:28:13.131857 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128701 2544 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 13:28:13.131857 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128704 2544 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 13:28:13.131857 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128706 2544 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 13:28:13.131857 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128709 2544 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 13:28:13.131857 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128714 2544 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 13:28:13.131857 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128718 2544 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 13:28:13.131857 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128721 2544 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 13:28:13.131857 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128723 2544 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 13:28:13.131857 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128726 2544 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 13:28:13.132337 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128728 2544 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 13:28:13.132337 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128731 2544 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 13:28:13.132337 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128734 2544 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 13:28:13.132337 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128737 2544 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 13:28:13.132337 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128740 2544 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 13:28:13.132337 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128742 2544 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 13:28:13.132337 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128745 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 13:28:13.132337 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128749 2544 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 13:28:13.132337 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128752 2544 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 13:28:13.132337 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128755 2544 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 13:28:13.132337 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128758 2544 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 13:28:13.132337 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128761 2544 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 13:28:13.132337 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128763 2544 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 13:28:13.132337 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128766 2544 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 13:28:13.132337 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128769 2544 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 13:28:13.132337 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128771 2544 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 13:28:13.132337 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128774 2544 feature_gate.go:328] unrecognized feature gate: Example Jun 09 13:28:13.132337 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.128777 2544 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 13:28:13.132337 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130846 2544 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 13:28:13.132337 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130860 2544 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 13:28:13.132831 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130865 2544 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 13:28:13.132831 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130869 2544 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 13:28:13.132831 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130872 2544 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 13:28:13.132831 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130875 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 13:28:13.132831 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130879 2544 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 13:28:13.132831 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130882 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 13:28:13.132831 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130885 2544 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 13:28:13.132831 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130888 2544 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 13:28:13.132831 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130891 2544 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 13:28:13.132831 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130894 2544 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 13:28:13.132831 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130896 2544 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 13:28:13.132831 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130899 2544 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 13:28:13.132831 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130902 2544 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 13:28:13.132831 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130905 2544 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 13:28:13.132831 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130907 2544 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 13:28:13.132831 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130910 2544 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 13:28:13.132831 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130918 2544 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 13:28:13.132831 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130921 2544 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 13:28:13.132831 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130924 2544 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 13:28:13.132831 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130926 2544 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 13:28:13.133308 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130929 2544 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 13:28:13.133308 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130932 2544 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 13:28:13.133308 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130934 2544 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 13:28:13.133308 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130937 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 13:28:13.133308 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130939 2544 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 13:28:13.133308 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130942 2544 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 13:28:13.133308 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130944 2544 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 13:28:13.133308 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130947 2544 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 13:28:13.133308 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130950 2544 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 13:28:13.133308 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130952 2544 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 13:28:13.133308 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130955 2544 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 13:28:13.133308 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130958 2544 feature_gate.go:328] unrecognized feature gate: Example Jun 09 13:28:13.133308 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130961 2544 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 13:28:13.133308 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130964 2544 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 13:28:13.133308 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130967 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 13:28:13.133308 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130970 2544 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 13:28:13.133308 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130972 2544 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 13:28:13.133308 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130975 2544 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 13:28:13.133308 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130978 2544 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 13:28:13.133308 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130980 2544 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 13:28:13.133809 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130982 2544 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 13:28:13.133809 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130985 2544 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 13:28:13.133809 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130988 2544 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 13:28:13.133809 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130990 2544 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 13:28:13.133809 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130993 2544 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 13:28:13.133809 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130995 2544 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 13:28:13.133809 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.130998 2544 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 13:28:13.133809 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131000 2544 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 13:28:13.133809 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131004 2544 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 13:28:13.133809 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131006 2544 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 13:28:13.133809 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131009 2544 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 13:28:13.133809 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131011 2544 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 13:28:13.133809 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131014 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 13:28:13.133809 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131016 2544 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 13:28:13.133809 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131019 2544 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 13:28:13.133809 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131021 2544 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 13:28:13.133809 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131033 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 13:28:13.133809 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131037 2544 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 13:28:13.133809 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131041 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 13:28:13.133809 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131044 2544 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 13:28:13.134335 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131047 2544 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 13:28:13.134335 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131050 2544 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 13:28:13.134335 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131053 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 13:28:13.134335 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131057 2544 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 13:28:13.134335 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131060 2544 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 13:28:13.134335 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131063 2544 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 13:28:13.134335 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131066 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 13:28:13.134335 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131069 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 13:28:13.134335 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131071 2544 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 13:28:13.134335 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131074 2544 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 13:28:13.134335 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131078 2544 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 13:28:13.134335 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131082 2544 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 13:28:13.134335 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131087 2544 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 13:28:13.134335 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131090 2544 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 13:28:13.134335 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131093 2544 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 13:28:13.134335 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131096 2544 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 13:28:13.134335 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131098 2544 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 13:28:13.134335 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131101 2544 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 13:28:13.134335 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131103 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 13:28:13.134804 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131106 2544 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 13:28:13.134804 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131109 2544 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 13:28:13.134804 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131112 2544 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 13:28:13.134804 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131114 2544 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 13:28:13.134804 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131117 2544 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 13:28:13.134804 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131119 2544 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 13:28:13.134804 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131122 2544 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 13:28:13.134804 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131125 2544 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 13:28:13.134804 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131127 2544 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 13:28:13.134804 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131130 2544 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 13:28:13.134804 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131132 2544 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 13:28:13.134804 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131135 2544 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 13:28:13.134804 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131137 2544 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 13:28:13.134804 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131140 2544 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 13:28:13.134804 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131143 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 13:28:13.134804 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131145 2544 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 13:28:13.134804 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131148 2544 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 13:28:13.134804 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131151 2544 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 13:28:13.134804 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131218 2544 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 13:28:13.134804 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131225 2544 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 13:28:13.134804 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131231 2544 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 13:28:13.135376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131236 2544 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 13:28:13.135376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131240 2544 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 13:28:13.135376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131243 2544 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 13:28:13.135376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131247 2544 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 13:28:13.135376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131251 2544 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 13:28:13.135376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131254 2544 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 13:28:13.135376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131257 2544 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 13:28:13.135376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131260 2544 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 13:28:13.135376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131264 2544 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 13:28:13.135376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131267 2544 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 13:28:13.135376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131270 2544 flags.go:64] FLAG: --cgroup-root="" Jun 09 13:28:13.135376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131272 2544 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 13:28:13.135376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131275 2544 flags.go:64] FLAG: --client-ca-file="" Jun 09 13:28:13.135376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131278 2544 flags.go:64] FLAG: --cloud-provider="external" Jun 09 13:28:13.135376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131282 2544 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 13:28:13.135376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131287 2544 flags.go:64] FLAG: --cluster-domain="" Jun 09 13:28:13.135376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131290 2544 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 13:28:13.135376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131293 2544 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 13:28:13.135376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131296 2544 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 13:28:13.135376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131299 2544 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 13:28:13.135376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131302 2544 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 13:28:13.135376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131305 2544 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 13:28:13.135376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131308 2544 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 13:28:13.135936 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131312 2544 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 13:28:13.135936 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131315 2544 flags.go:64] FLAG: --contention-profiling="false" Jun 09 13:28:13.135936 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131318 2544 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 13:28:13.135936 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131321 2544 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 13:28:13.135936 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131324 2544 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 13:28:13.135936 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131327 2544 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 13:28:13.135936 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131331 2544 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 13:28:13.135936 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131334 2544 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 13:28:13.135936 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131337 2544 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 13:28:13.135936 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131339 2544 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 13:28:13.135936 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131342 2544 flags.go:64] FLAG: --enable-server="true" Jun 09 13:28:13.135936 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131345 2544 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 13:28:13.135936 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131350 2544 flags.go:64] FLAG: --event-burst="100" Jun 09 13:28:13.135936 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131353 2544 flags.go:64] FLAG: --event-qps="50" Jun 09 13:28:13.135936 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131356 2544 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 13:28:13.135936 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131359 2544 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 13:28:13.135936 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131362 2544 flags.go:64] FLAG: --eviction-hard="" Jun 09 13:28:13.135936 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131366 2544 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 13:28:13.135936 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131369 2544 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 13:28:13.135936 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131372 2544 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 13:28:13.135936 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131375 2544 flags.go:64] FLAG: --eviction-soft="" Jun 09 13:28:13.135936 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131378 2544 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 13:28:13.135936 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131381 2544 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 13:28:13.135936 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131384 2544 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 13:28:13.135936 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131387 2544 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 13:28:13.136565 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131390 2544 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 13:28:13.136565 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131393 2544 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 13:28:13.136565 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131396 2544 flags.go:64] FLAG: --feature-gates="" Jun 09 13:28:13.136565 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131399 2544 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 13:28:13.136565 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131402 2544 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 13:28:13.136565 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131405 2544 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 13:28:13.136565 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131408 2544 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 13:28:13.136565 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131411 2544 flags.go:64] FLAG: --healthz-port="10248" Jun 09 13:28:13.136565 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131414 2544 flags.go:64] FLAG: --help="false" Jun 09 13:28:13.136565 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131417 2544 flags.go:64] FLAG: --hostname-override="ip-10-0-131-58.ec2.internal" Jun 09 13:28:13.136565 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131420 2544 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 13:28:13.136565 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131423 2544 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 13:28:13.136565 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131425 2544 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 13:28:13.136565 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131429 2544 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 13:28:13.136565 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131432 2544 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 13:28:13.136565 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131435 2544 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 13:28:13.136565 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131438 2544 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 13:28:13.136565 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131441 2544 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 13:28:13.136565 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131444 2544 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 13:28:13.136565 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131446 2544 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 13:28:13.136565 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131450 2544 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 13:28:13.136565 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131452 2544 flags.go:64] FLAG: --kube-reserved="" Jun 09 13:28:13.136565 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131455 2544 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 13:28:13.136565 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131458 2544 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 13:28:13.137153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131461 2544 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 13:28:13.137153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131464 2544 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 13:28:13.137153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131466 2544 flags.go:64] FLAG: --lock-file="" Jun 09 13:28:13.137153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131469 2544 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 13:28:13.137153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131472 2544 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 13:28:13.137153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131474 2544 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 13:28:13.137153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131480 2544 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 13:28:13.137153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131483 2544 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 13:28:13.137153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131486 2544 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 13:28:13.137153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131489 2544 flags.go:64] FLAG: --logging-format="text" Jun 09 13:28:13.137153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131491 2544 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 13:28:13.137153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131495 2544 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 13:28:13.137153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131497 2544 flags.go:64] FLAG: --manifest-url="" Jun 09 13:28:13.137153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131500 2544 flags.go:64] FLAG: --manifest-url-header="" Jun 09 13:28:13.137153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131505 2544 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 13:28:13.137153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131507 2544 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 13:28:13.137153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131511 2544 flags.go:64] FLAG: --max-pods="110" Jun 09 13:28:13.137153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131517 2544 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 13:28:13.137153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131520 2544 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 13:28:13.137153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131522 2544 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 13:28:13.137153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131525 2544 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 13:28:13.137153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131528 2544 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 13:28:13.137153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131531 2544 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 13:28:13.137153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131534 2544 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 13:28:13.137153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131559 2544 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 13:28:13.137810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131562 2544 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 13:28:13.137810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131565 2544 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 13:28:13.137810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131568 2544 flags.go:64] FLAG: --pod-cidr="" Jun 09 13:28:13.137810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131571 2544 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 13:28:13.137810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131576 2544 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 13:28:13.137810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131579 2544 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 13:28:13.137810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131582 2544 flags.go:64] FLAG: --pods-per-core="0" Jun 09 13:28:13.137810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131585 2544 flags.go:64] FLAG: --port="10250" Jun 09 13:28:13.137810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131588 2544 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 13:28:13.137810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131591 2544 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07a13e0b2558d1550" Jun 09 13:28:13.137810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131594 2544 flags.go:64] FLAG: --qos-reserved="" Jun 09 13:28:13.137810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131596 2544 flags.go:64] FLAG: --read-only-port="10255" Jun 09 13:28:13.137810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131599 2544 flags.go:64] FLAG: --register-node="true" Jun 09 13:28:13.137810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131602 2544 flags.go:64] FLAG: --register-with-taints="" Jun 09 13:28:13.137810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131605 2544 flags.go:64] FLAG: --registry-burst="10" Jun 09 13:28:13.137810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131608 2544 flags.go:64] FLAG: --registry-qps="5" Jun 09 13:28:13.137810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131611 2544 flags.go:64] FLAG: --reserved-cpus="" Jun 09 13:28:13.137810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131614 2544 flags.go:64] FLAG: --reserved-memory="" Jun 09 13:28:13.137810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131617 2544 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 13:28:13.137810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131621 2544 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 13:28:13.137810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131624 2544 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 13:28:13.137810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131626 2544 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 13:28:13.137810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131629 2544 flags.go:64] FLAG: --runonce="false" Jun 09 13:28:13.137810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131632 2544 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 13:28:13.137810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131634 2544 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 13:28:13.138427 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131639 2544 flags.go:64] FLAG: --seccomp-default="false" Jun 09 13:28:13.138427 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131642 2544 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 13:28:13.138427 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131644 2544 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 13:28:13.138427 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131647 2544 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 13:28:13.138427 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131650 2544 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 13:28:13.138427 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131653 2544 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 13:28:13.138427 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131656 2544 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 13:28:13.138427 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131659 2544 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 13:28:13.138427 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131662 2544 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 13:28:13.138427 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131664 2544 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 13:28:13.138427 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131668 2544 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 13:28:13.138427 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131671 2544 flags.go:64] FLAG: --system-cgroups="" Jun 09 13:28:13.138427 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131673 2544 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 13:28:13.138427 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131679 2544 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 13:28:13.138427 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131681 2544 flags.go:64] FLAG: --tls-cert-file="" Jun 09 13:28:13.138427 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131684 2544 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 13:28:13.138427 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131688 2544 flags.go:64] FLAG: --tls-min-version="" Jun 09 13:28:13.138427 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131691 2544 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 13:28:13.138427 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131694 2544 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 13:28:13.138427 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131696 2544 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 13:28:13.138427 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131699 2544 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 13:28:13.138427 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131702 2544 flags.go:64] FLAG: --v="2" Jun 09 13:28:13.138427 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131707 2544 flags.go:64] FLAG: --version="false" Jun 09 13:28:13.138427 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131710 2544 flags.go:64] FLAG: --vmodule="" Jun 09 13:28:13.138427 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131714 2544 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 13:28:13.139057 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.131718 2544 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 13:28:13.139057 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131827 2544 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 13:28:13.139057 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131831 2544 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 13:28:13.139057 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131834 2544 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 13:28:13.139057 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131837 2544 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 13:28:13.139057 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131839 2544 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 13:28:13.139057 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131843 2544 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 13:28:13.139057 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131847 2544 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 13:28:13.139057 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131850 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 13:28:13.139057 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131852 2544 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 13:28:13.139057 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131856 2544 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 13:28:13.139057 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131860 2544 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 13:28:13.139057 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131863 2544 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 13:28:13.139057 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131866 2544 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 13:28:13.139057 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131869 2544 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 13:28:13.139057 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131872 2544 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 13:28:13.139057 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131877 2544 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 13:28:13.139057 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131880 2544 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 13:28:13.139057 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131883 2544 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 13:28:13.139526 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131885 2544 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 13:28:13.139526 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131888 2544 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 13:28:13.139526 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131891 2544 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 13:28:13.139526 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131894 2544 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 13:28:13.139526 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131896 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 13:28:13.139526 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131899 2544 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 13:28:13.139526 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131901 2544 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 13:28:13.139526 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131904 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 13:28:13.139526 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131907 2544 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 13:28:13.139526 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131910 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 13:28:13.139526 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131912 2544 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 13:28:13.139526 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131915 2544 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 13:28:13.139526 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131917 2544 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 13:28:13.139526 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131921 2544 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 13:28:13.139526 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131923 2544 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 13:28:13.139526 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131928 2544 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 13:28:13.139526 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131931 2544 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 13:28:13.139526 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131934 2544 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 13:28:13.139526 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131937 2544 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 13:28:13.140032 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131939 2544 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 13:28:13.140032 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131943 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 13:28:13.140032 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131946 2544 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 13:28:13.140032 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131948 2544 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 13:28:13.140032 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131951 2544 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 13:28:13.140032 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131953 2544 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 13:28:13.140032 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131956 2544 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 13:28:13.140032 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131959 2544 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 13:28:13.140032 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131961 2544 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 13:28:13.140032 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131964 2544 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 13:28:13.140032 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131968 2544 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 13:28:13.140032 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131970 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 13:28:13.140032 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131973 2544 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 13:28:13.140032 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131976 2544 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 13:28:13.140032 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131978 2544 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 13:28:13.140032 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131981 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 13:28:13.140032 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131984 2544 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 13:28:13.140032 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131987 2544 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 13:28:13.140032 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131990 2544 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 13:28:13.140032 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131992 2544 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 13:28:13.140513 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131995 2544 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 13:28:13.140513 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.131997 2544 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 13:28:13.140513 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132000 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 13:28:13.140513 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132003 2544 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 13:28:13.140513 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132005 2544 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 13:28:13.140513 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132008 2544 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 13:28:13.140513 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132011 2544 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 13:28:13.140513 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132014 2544 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 13:28:13.140513 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132016 2544 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 13:28:13.140513 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132019 2544 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 13:28:13.140513 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132022 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 13:28:13.140513 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132024 2544 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 13:28:13.140513 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132027 2544 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 13:28:13.140513 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132031 2544 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 13:28:13.140513 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132034 2544 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 13:28:13.140513 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132036 2544 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 13:28:13.140513 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132039 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 13:28:13.140513 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132041 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 13:28:13.140513 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132044 2544 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 13:28:13.140513 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132046 2544 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 13:28:13.141048 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132049 2544 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 13:28:13.141048 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132052 2544 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 13:28:13.141048 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132056 2544 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 13:28:13.141048 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132058 2544 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 13:28:13.141048 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132061 2544 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 13:28:13.141048 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132063 2544 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 13:28:13.141048 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132066 2544 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 13:28:13.141048 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132069 2544 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 13:28:13.141048 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132071 2544 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 13:28:13.141048 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132074 2544 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 13:28:13.141048 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132076 2544 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 13:28:13.141048 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132079 2544 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 13:28:13.141048 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132081 2544 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 13:28:13.141048 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132084 2544 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 13:28:13.141048 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132086 2544 feature_gate.go:328] unrecognized feature gate: Example Jun 09 13:28:13.141048 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132089 2544 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 13:28:13.141048 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132093 2544 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 13:28:13.141048 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132096 2544 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 13:28:13.141048 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132099 2544 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 13:28:13.141505 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132102 2544 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 13:28:13.141505 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132105 2544 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 13:28:13.141505 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.132108 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 13:28:13.141505 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.132117 2544 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 13:28:13.141505 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.138623 2544 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 13:28:13.141505 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.138637 2544 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 13:28:13.141505 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.138650 2544 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 13:28:13.141505 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.138656 2544 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 13:28:13.141505 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138707 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 13:28:13.141505 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138712 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 13:28:13.141505 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138715 2544 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 13:28:13.141505 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138718 2544 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 13:28:13.141505 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138722 2544 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 13:28:13.141505 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138725 2544 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 13:28:13.141505 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138728 2544 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 13:28:13.141893 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138731 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 13:28:13.141893 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138734 2544 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 13:28:13.141893 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138737 2544 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 13:28:13.141893 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138740 2544 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 13:28:13.141893 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138742 2544 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 13:28:13.141893 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138745 2544 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 13:28:13.141893 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138748 2544 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 13:28:13.141893 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138751 2544 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 13:28:13.141893 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138754 2544 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 13:28:13.141893 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138757 2544 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 13:28:13.141893 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138760 2544 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 13:28:13.141893 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138763 2544 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 13:28:13.141893 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138765 2544 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 13:28:13.141893 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138768 2544 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 13:28:13.141893 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138771 2544 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 13:28:13.141893 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138773 2544 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 13:28:13.141893 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138776 2544 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 13:28:13.141893 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138778 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 13:28:13.141893 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138781 2544 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 13:28:13.141893 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138784 2544 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 13:28:13.142381 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138786 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 13:28:13.142381 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138789 2544 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 13:28:13.142381 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138793 2544 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 13:28:13.142381 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138796 2544 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 13:28:13.142381 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138798 2544 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 13:28:13.142381 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138801 2544 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 13:28:13.142381 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138804 2544 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 13:28:13.142381 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138806 2544 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 13:28:13.142381 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138809 2544 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 13:28:13.142381 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138811 2544 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 13:28:13.142381 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138814 2544 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 13:28:13.142381 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138816 2544 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 13:28:13.142381 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138819 2544 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 13:28:13.142381 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138822 2544 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 13:28:13.142381 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138824 2544 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 13:28:13.142381 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138827 2544 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 13:28:13.142381 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138829 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 13:28:13.142381 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138832 2544 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 13:28:13.142381 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138834 2544 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 13:28:13.142381 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138837 2544 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 13:28:13.142888 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138839 2544 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 13:28:13.142888 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138842 2544 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 13:28:13.142888 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138844 2544 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 13:28:13.142888 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138847 2544 feature_gate.go:328] unrecognized feature gate: Example Jun 09 13:28:13.142888 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138849 2544 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 13:28:13.142888 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138852 2544 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 13:28:13.142888 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138854 2544 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 13:28:13.142888 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138857 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 13:28:13.142888 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138859 2544 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 13:28:13.142888 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138862 2544 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 13:28:13.142888 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138864 2544 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 13:28:13.142888 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138867 2544 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 13:28:13.142888 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138870 2544 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 13:28:13.142888 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138872 2544 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 13:28:13.142888 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138875 2544 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 13:28:13.142888 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138878 2544 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 13:28:13.142888 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138881 2544 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 13:28:13.142888 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138884 2544 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 13:28:13.142888 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138886 2544 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 13:28:13.142888 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138889 2544 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 13:28:13.143361 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138891 2544 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 13:28:13.143361 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138894 2544 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 13:28:13.143361 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138896 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 13:28:13.143361 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138899 2544 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 13:28:13.143361 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138901 2544 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 13:28:13.143361 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138904 2544 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 13:28:13.143361 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138906 2544 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 13:28:13.143361 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138909 2544 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 13:28:13.143361 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138911 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 13:28:13.143361 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138914 2544 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 13:28:13.143361 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138916 2544 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 13:28:13.143361 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138919 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 13:28:13.143361 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138923 2544 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 13:28:13.143361 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138927 2544 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 13:28:13.143361 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138931 2544 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 13:28:13.143361 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138934 2544 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 13:28:13.143361 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138937 2544 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 13:28:13.143361 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138939 2544 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 13:28:13.143361 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138942 2544 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 13:28:13.143919 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138946 2544 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 13:28:13.143919 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138949 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 13:28:13.143919 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138952 2544 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 13:28:13.143919 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138955 2544 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 13:28:13.143919 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138957 2544 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 13:28:13.143919 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138960 2544 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 13:28:13.143919 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138963 2544 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 13:28:13.143919 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138966 2544 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 13:28:13.143919 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138968 2544 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 13:28:13.143919 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138971 2544 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 13:28:13.143919 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138974 2544 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 13:28:13.143919 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138976 2544 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 13:28:13.143919 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.138979 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 13:28:13.143919 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.138984 2544 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 13:28:13.143919 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139083 2544 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 13:28:13.144281 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139088 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 13:28:13.144281 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139091 2544 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 13:28:13.144281 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139095 2544 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 13:28:13.144281 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139097 2544 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 13:28:13.144281 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139100 2544 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 13:28:13.144281 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139103 2544 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 13:28:13.144281 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139106 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 13:28:13.144281 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139109 2544 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 13:28:13.144281 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139111 2544 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 13:28:13.144281 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139114 2544 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 13:28:13.144281 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139116 2544 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 13:28:13.144281 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139119 2544 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 13:28:13.144281 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139121 2544 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 13:28:13.144281 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139124 2544 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 13:28:13.144281 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139126 2544 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 13:28:13.144281 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139129 2544 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 13:28:13.144281 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139131 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 13:28:13.144281 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139134 2544 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 13:28:13.144281 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139137 2544 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 13:28:13.144281 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139142 2544 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 13:28:13.144767 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139144 2544 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 13:28:13.144767 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139147 2544 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 13:28:13.144767 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139149 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 13:28:13.144767 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139152 2544 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 13:28:13.144767 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139155 2544 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 13:28:13.144767 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139157 2544 feature_gate.go:328] unrecognized feature gate: Example Jun 09 13:28:13.144767 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139160 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 13:28:13.144767 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139163 2544 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 13:28:13.144767 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139166 2544 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 13:28:13.144767 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139168 2544 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 13:28:13.144767 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139171 2544 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 13:28:13.144767 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139173 2544 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 13:28:13.144767 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139176 2544 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 13:28:13.144767 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139178 2544 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 13:28:13.144767 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139181 2544 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 13:28:13.144767 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139183 2544 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 13:28:13.144767 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139186 2544 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 13:28:13.144767 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139188 2544 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 13:28:13.144767 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139191 2544 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 13:28:13.144767 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139193 2544 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 13:28:13.145234 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139196 2544 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 13:28:13.145234 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139198 2544 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 13:28:13.145234 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139201 2544 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 13:28:13.145234 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139204 2544 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 13:28:13.145234 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139206 2544 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 13:28:13.145234 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139209 2544 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 13:28:13.145234 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139211 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 13:28:13.145234 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139213 2544 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 13:28:13.145234 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139216 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 13:28:13.145234 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139218 2544 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 13:28:13.145234 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139221 2544 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 13:28:13.145234 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139224 2544 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 13:28:13.145234 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139226 2544 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 13:28:13.145234 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139228 2544 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 13:28:13.145234 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139231 2544 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 13:28:13.145234 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139234 2544 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 13:28:13.145234 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139237 2544 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 13:28:13.145234 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139240 2544 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 13:28:13.145234 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139242 2544 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 13:28:13.145234 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139245 2544 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 13:28:13.145729 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139248 2544 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 13:28:13.145729 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139251 2544 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 13:28:13.145729 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139253 2544 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 13:28:13.145729 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139256 2544 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 13:28:13.145729 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139258 2544 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 13:28:13.145729 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139262 2544 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 13:28:13.145729 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139266 2544 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 13:28:13.145729 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139269 2544 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 13:28:13.145729 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139271 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 13:28:13.145729 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139274 2544 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 13:28:13.145729 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139278 2544 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 13:28:13.145729 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139282 2544 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 13:28:13.145729 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139284 2544 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 13:28:13.145729 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139287 2544 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 13:28:13.145729 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139290 2544 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 13:28:13.145729 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139292 2544 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 13:28:13.145729 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139295 2544 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 13:28:13.145729 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139298 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 13:28:13.145729 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139300 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 13:28:13.146182 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139303 2544 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 13:28:13.146182 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139305 2544 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 13:28:13.146182 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139308 2544 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 13:28:13.146182 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139310 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 13:28:13.146182 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139313 2544 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 13:28:13.146182 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139315 2544 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 13:28:13.146182 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139317 2544 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 13:28:13.146182 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139320 2544 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 13:28:13.146182 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139323 2544 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 13:28:13.146182 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139326 2544 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 13:28:13.146182 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139328 2544 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 13:28:13.146182 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139331 2544 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 13:28:13.146182 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139333 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 13:28:13.146182 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139335 2544 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 13:28:13.146182 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139338 2544 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 13:28:13.146182 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139341 2544 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 13:28:13.146182 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139343 2544 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 13:28:13.146182 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139346 2544 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 13:28:13.146182 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:13.139349 2544 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 13:28:13.146696 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.139353 2544 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 13:28:13.146696 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.139441 2544 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 13:28:13.146696 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.142641 2544 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 13:28:13.146696 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.143854 2544 server.go:1019] "Starting client certificate rotation" Jun 09 13:28:13.146696 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.143950 2544 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 13:28:13.146696 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.143982 2544 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 13:28:13.146696 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.146354 2544 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 13:28:13.152351 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.152332 2544 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 13:28:13.160780 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.160766 2544 log.go:25] "Validated CRI v1 runtime API" Jun 09 13:28:13.163359 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.163300 2544 log.go:25] "Validated CRI v1 image API" Jun 09 13:28:13.164955 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.164939 2544 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 13:28:13.167709 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.167687 2544 fs.go:135] Filesystem UUIDs: map[5de5e81b-d525-4497-9e84-83e6200da5f6:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b830656a-526f-403c-aabb-13be4594a2ef:/dev/nvme0n1p4] Jun 09 13:28:13.167780 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.167708 2544 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 13:28:13.172887 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.172781 2544 manager.go:216] Machine: {Timestamp:2026-06-09 13:28:13.171498309 +0000 UTC m=+0.326770512 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100482 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fef37e667488ec34e0eb8b4b2bb78 SystemUUID:ec2fef37-e667-488e-c34e-0eb8b4b2bb78 BootID:661e6f7c-2647-476f-9999-2f2ec441d531 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:81:5b:ea:3d:bf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:81:5b:ea:3d:bf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:e7:46:c1:64:af Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 13:28:13.172887 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.172879 2544 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 13:28:13.173036 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.172971 2544 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 13:28:13.174620 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.174594 2544 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 13:28:13.174755 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.174623 2544 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-58.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 13:28:13.174878 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.174862 2544 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 13:28:13.175359 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.175349 2544 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 13:28:13.175359 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.175361 2544 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 13:28:13.175430 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.175368 2544 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 13:28:13.176012 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.176001 2544 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 13:28:13.176759 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.176750 2544 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 13:28:13.179338 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.179327 2544 state_mem.go:36] "Initialized new in-memory state store" Jun 09 13:28:13.179466 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.179457 2544 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 13:28:13.179506 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.179498 2544 kubelet.go:486] "Attempting to sync node with API server" Jun 09 13:28:13.179537 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.179514 2544 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 13:28:13.179537 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.179523 2544 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 13:28:13.179537 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.179534 2544 kubelet.go:398] "Adding apiserver pod source" Jun 09 13:28:13.179688 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.179563 2544 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 13:28:13.179833 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.179823 2544 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 13:28:13.179865 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.179841 2544 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 13:28:13.181949 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.181933 2544 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 13:28:13.183145 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.183129 2544 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 13:28:13.183218 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.183161 2544 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 13:28:13.184268 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.184251 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 13:28:13.184308 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.184282 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 13:28:13.184308 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.184296 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 13:28:13.184308 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.184306 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 13:28:13.184393 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.184325 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 13:28:13.184393 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.184335 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 13:28:13.184393 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.184347 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 13:28:13.184393 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.184353 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 13:28:13.184393 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.184359 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 13:28:13.184393 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.184364 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 13:28:13.184393 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.184378 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 13:28:13.184393 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.184383 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 13:28:13.185106 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.185095 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 13:28:13.185106 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.185105 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 13:28:13.188139 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.188125 2544 server.go:1268] "Started kubelet" Jun 09 13:28:13.188233 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.188208 2544 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 13:28:13.188299 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.188220 2544 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 13:28:13.188346 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.188333 2544 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 13:28:13.188670 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.188637 2544 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-58.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 13:28:13.188808 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:13.188784 2544 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-58.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 13:28:13.188963 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:13.188934 2544 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 13:28:13.188983 ip-10-0-131-58 systemd[1]: Started Kubernetes Kubelet. Jun 09 13:28:13.190050 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.190031 2544 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 13:28:13.190375 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.190363 2544 server.go:310] "Adding debug handlers to kubelet server" Jun 09 13:28:13.195100 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.195075 2544 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s46kh" Jun 09 13:28:13.196519 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:13.196489 2544 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 13:28:13.197659 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:13.195692 2544 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-58.ec2.internal.18b76cb2e14b2508 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-58.ec2.internal,UID:ip-10-0-131-58.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-58.ec2.internal,},FirstTimestamp:2026-06-09 13:28:13.188097288 +0000 UTC m=+0.343369490,LastTimestamp:2026-06-09 13:28:13.188097288 +0000 UTC m=+0.343369490,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-58.ec2.internal,}" Jun 09 13:28:13.198471 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.198457 2544 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 13:28:13.198471 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.198465 2544 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 13:28:13.198588 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:13.198530 2544 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-58.ec2.internal\" not found" Jun 09 13:28:13.199112 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.199075 2544 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 13:28:13.199112 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.199095 2544 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 13:28:13.199250 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.199083 2544 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 13:28:13.199298 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.199276 2544 reconstruct.go:97] "Volume reconstruction finished" Jun 09 13:28:13.199298 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.199285 2544 reconciler.go:29] "Reconciler: start to sync state" Jun 09 13:28:13.199383 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.199339 2544 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 13:28:13.199383 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.199352 2544 factory.go:55] Registering systemd factory Jun 09 13:28:13.199383 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.199358 2544 factory.go:223] Registration of the systemd container factory successfully Jun 09 13:28:13.199661 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.199646 2544 factory.go:153] Registering CRI-O factory Jun 09 13:28:13.199746 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.199665 2544 factory.go:223] Registration of the crio container factory successfully Jun 09 13:28:13.199746 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.199687 2544 factory.go:103] Registering Raw factory Jun 09 13:28:13.199746 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.199701 2544 manager.go:1196] Started watching for new ooms in manager Jun 09 13:28:13.200236 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.200221 2544 manager.go:349] Starting recovery of all containers Jun 09 13:28:13.200478 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:13.200451 2544 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-58.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 13:28:13.200662 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:13.200637 2544 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 13:28:13.203128 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.203106 2544 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s46kh" Jun 09 13:28:13.211964 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.211828 2544 manager.go:354] Recovery completed Jun 09 13:28:13.216164 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.216153 2544 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:28:13.217721 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.217703 2544 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:28:13.217808 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.217729 2544 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:28:13.217808 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.217739 2544 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:28:13.218242 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.218224 2544 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 13:28:13.218242 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.218240 2544 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 13:28:13.218338 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.218251 2544 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:28:13.218338 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.218259 2544 state_mem.go:36] "Initialized new in-memory state store" Jun 09 13:28:13.218906 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.218892 2544 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:28:13.218973 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.218916 2544 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:28:13.218973 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.218940 2544 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:28:13.219356 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.219345 2544 policy_none.go:49] "None policy: Start" Jun 09 13:28:13.219396 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.219359 2544 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 13:28:13.219396 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.219369 2544 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 13:28:13.220346 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.220332 2544 policy_none.go:47] "Start" Jun 09 13:28:13.259127 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.259108 2544 manager.go:337] "Starting Device Plugin manager" Jun 09 13:28:13.269617 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:13.259144 2544 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 13:28:13.269617 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.259157 2544 server.go:87] "Starting device plugin registration server" Jun 09 13:28:13.269617 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.259383 2544 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 13:28:13.269617 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.259395 2544 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 13:28:13.269617 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.259471 2544 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 13:28:13.269617 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.259540 2544 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 13:28:13.269617 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.259561 2544 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 13:28:13.269617 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:13.260058 2544 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 13:28:13.269617 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:13.260105 2544 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-58.ec2.internal\" not found" Jun 09 13:28:13.269617 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.268616 2544 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 13:28:13.269993 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.269753 2544 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 13:28:13.269993 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.269782 2544 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 13:28:13.269993 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.269800 2544 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 13:28:13.269993 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:13.269827 2544 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 13:28:13.271455 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.271440 2544 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 13:28:13.360511 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.360481 2544 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:28:13.361409 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.361391 2544 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:28:13.361476 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.361422 2544 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:28:13.361476 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.361433 2544 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:28:13.361476 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.361457 2544 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-58.ec2.internal" Jun 09 13:28:13.368898 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.368883 2544 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-58.ec2.internal" Jun 09 13:28:13.368985 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:13.368907 2544 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-58.ec2.internal\": node \"ip-10-0-131-58.ec2.internal\" not found" Jun 09 13:28:13.370685 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.370665 2544 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-58.ec2.internal"] Jun 09 13:28:13.370732 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.370725 2544 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:28:13.371498 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.371477 2544 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:28:13.371597 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.371503 2544 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:28:13.371597 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.371514 2544 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:28:13.372616 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.372605 2544 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:28:13.372750 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.372736 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal" Jun 09 13:28:13.372806 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.372770 2544 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:28:13.373355 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.373304 2544 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:28:13.373355 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.373333 2544 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:28:13.373355 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.373347 2544 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:28:13.373355 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.373350 2544 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:28:13.373524 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.373370 2544 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:28:13.373524 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.373382 2544 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:28:13.374459 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.374443 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-58.ec2.internal" Jun 09 13:28:13.374532 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.374490 2544 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:28:13.375135 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.375120 2544 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:28:13.375219 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.375144 2544 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:28:13.375219 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.375157 2544 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:28:13.384232 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:13.384219 2544 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-58.ec2.internal\" not found" Jun 09 13:28:13.394078 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:13.394062 2544 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-58.ec2.internal\" not found" node="ip-10-0-131-58.ec2.internal" Jun 09 13:28:13.398413 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:13.398400 2544 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-58.ec2.internal\" not found" node="ip-10-0-131-58.ec2.internal" Jun 09 13:28:13.484906 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:13.484883 2544 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-58.ec2.internal\" not found" Jun 09 13:28:13.499499 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.499479 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a46f85e07e28570b49a6c61a063ac368-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal\" (UID: \"a46f85e07e28570b49a6c61a063ac368\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal" Jun 09 13:28:13.499579 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.499504 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a46f85e07e28570b49a6c61a063ac368-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal\" (UID: \"a46f85e07e28570b49a6c61a063ac368\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal" Jun 09 13:28:13.499579 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.499521 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/404401a3bc64135c3d2334b8265bc10b-config\") pod \"kube-apiserver-proxy-ip-10-0-131-58.ec2.internal\" (UID: \"404401a3bc64135c3d2334b8265bc10b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-58.ec2.internal" Jun 09 13:28:13.585155 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:13.585125 2544 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-58.ec2.internal\" not found" Jun 09 13:28:13.600406 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.600388 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a46f85e07e28570b49a6c61a063ac368-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal\" (UID: \"a46f85e07e28570b49a6c61a063ac368\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal" Jun 09 13:28:13.600459 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.600410 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a46f85e07e28570b49a6c61a063ac368-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal\" (UID: \"a46f85e07e28570b49a6c61a063ac368\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal" Jun 09 13:28:13.600459 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.600426 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/404401a3bc64135c3d2334b8265bc10b-config\") pod \"kube-apiserver-proxy-ip-10-0-131-58.ec2.internal\" (UID: \"404401a3bc64135c3d2334b8265bc10b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-58.ec2.internal" Jun 09 13:28:13.600532 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.600461 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/404401a3bc64135c3d2334b8265bc10b-config\") pod \"kube-apiserver-proxy-ip-10-0-131-58.ec2.internal\" (UID: \"404401a3bc64135c3d2334b8265bc10b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-58.ec2.internal" Jun 09 13:28:13.600532 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.600482 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a46f85e07e28570b49a6c61a063ac368-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal\" (UID: \"a46f85e07e28570b49a6c61a063ac368\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal" Jun 09 13:28:13.600532 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.600490 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a46f85e07e28570b49a6c61a063ac368-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal\" (UID: \"a46f85e07e28570b49a6c61a063ac368\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal" Jun 09 13:28:13.685862 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:13.685785 2544 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-58.ec2.internal\" not found" Jun 09 13:28:13.697943 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.697925 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal" Jun 09 13:28:13.702340 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:13.702326 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-58.ec2.internal" Jun 09 13:28:13.786103 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:13.786076 2544 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-58.ec2.internal\" not found" Jun 09 13:28:13.886503 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:13.886474 2544 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-58.ec2.internal\" not found" Jun 09 13:28:13.987019 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:13.986967 2544 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-58.ec2.internal\" not found" Jun 09 13:28:14.087575 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:14.087537 2544 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-58.ec2.internal\" not found" Jun 09 13:28:14.142923 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:14.142899 2544 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 13:28:14.143465 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:14.143030 2544 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 13:28:14.162538 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:14.162506 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda46f85e07e28570b49a6c61a063ac368.slice/crio-e366d19e2d9a689d57b3c886d497ea812e68da451ae1468f6b2d62520367a758 WatchSource:0}: Error finding container e366d19e2d9a689d57b3c886d497ea812e68da451ae1468f6b2d62520367a758: Status 404 returned error can't find the container with id e366d19e2d9a689d57b3c886d497ea812e68da451ae1468f6b2d62520367a758 Jun 09 13:28:14.162749 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:14.162730 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod404401a3bc64135c3d2334b8265bc10b.slice/crio-4335e12fbb3b1958c95034e8c3ba1f64ec5e1a21efe1bd082d3d048e49ed90be WatchSource:0}: Error finding container 4335e12fbb3b1958c95034e8c3ba1f64ec5e1a21efe1bd082d3d048e49ed90be: Status 404 returned error can't find the container with id 4335e12fbb3b1958c95034e8c3ba1f64ec5e1a21efe1bd082d3d048e49ed90be Jun 09 13:28:14.167223 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:14.167209 2544 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 13:28:14.187699 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:14.187664 2544 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-58.ec2.internal\" not found" Jun 09 13:28:14.196220 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:14.196204 2544 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 13:28:14.207054 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:14.207027 2544 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 13:23:13 +0000 UTC" deadline="2028-02-27 22:26:47.69537672 +0000 UTC" Jun 09 13:28:14.207054 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:14.207050 2544 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15080h58m33.488330145s" Jun 09 13:28:14.273356 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:14.273285 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-58.ec2.internal" event={"ID":"404401a3bc64135c3d2334b8265bc10b","Type":"ContainerStarted","Data":"4335e12fbb3b1958c95034e8c3ba1f64ec5e1a21efe1bd082d3d048e49ed90be"} Jun 09 13:28:14.274193 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:14.274174 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal" event={"ID":"a46f85e07e28570b49a6c61a063ac368","Type":"ContainerStarted","Data":"e366d19e2d9a689d57b3c886d497ea812e68da451ae1468f6b2d62520367a758"} Jun 09 13:28:14.288309 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:14.288287 2544 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-58.ec2.internal\" not found" Jun 09 13:28:14.388797 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:14.388773 2544 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-58.ec2.internal\" not found" Jun 09 13:28:14.435672 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:14.435652 2544 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 13:28:14.470904 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:14.470886 2544 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 13:28:14.498829 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:14.498808 2544 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal" Jun 09 13:28:14.511337 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:14.511322 2544 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 13:28:14.512452 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:14.512435 2544 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-58.ec2.internal" Jun 09 13:28:14.519017 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:14.518996 2544 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 13:28:15.181056 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.181024 2544 apiserver.go:52] "Watching apiserver" Jun 09 13:28:15.190171 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.190148 2544 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 13:28:15.190627 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.190600 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-2z65b","openshift-network-operator/iptables-alerter-jfpd5","openshift-ovn-kubernetes/ovnkube-node-b6mtj","kube-system/global-pull-secret-syncer-lm86k","kube-system/kube-apiserver-proxy-ip-10-0-131-58.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg","openshift-dns/node-resolver-9vxbd","openshift-image-registry/node-ca-dppgq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal","openshift-multus/multus-additional-cni-plugins-bdhxc","openshift-multus/network-metrics-daemon-wkwcl","kube-system/konnectivity-agent-v9p5z","openshift-cluster-node-tuning-operator/tuned-kdlwn","openshift-multus/multus-zfkgb"] Jun 09 13:28:15.192399 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.192355 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9vxbd" Jun 09 13:28:15.193656 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.193570 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:15.193656 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:15.193644 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwcl" podUID="a7641f4a-8124-4524-ab0a-34dfebafe183" Jun 09 13:28:15.194956 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.194938 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 13:28:15.194956 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.194951 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.195100 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.194955 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dmqlt\"" Jun 09 13:28:15.195423 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.195403 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 13:28:15.196285 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.196265 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:15.196362 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:15.196334 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm86k" podUID="20644c8b-cdf0-49f4-920a-5975ca9a0175" Jun 09 13:28:15.197541 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.197521 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 13:28:15.197789 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.197771 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 13:28:15.198004 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.197986 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 13:28:15.198079 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.198004 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.199083 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.199054 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 13:28:15.199083 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.199079 2544 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 13:28:15.199430 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.199412 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 13:28:15.199864 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.199671 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 13:28:15.199864 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.199804 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-scgg6\"" Jun 09 13:28:15.200186 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.200167 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" Jun 09 13:28:15.200721 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.200704 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 13:28:15.200809 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.200725 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 13:28:15.200866 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.200838 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 13:28:15.201536 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.200950 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-grczb\"" Jun 09 13:28:15.201536 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.201037 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 13:28:15.201906 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.201890 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dppgq" Jun 09 13:28:15.202887 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.202816 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qp2tm\"" Jun 09 13:28:15.202976 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.202821 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 13:28:15.202976 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.202948 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 13:28:15.203086 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.203071 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 13:28:15.203614 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.203520 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.204470 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.204292 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 13:28:15.204470 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.204332 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 13:28:15.204470 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.204292 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tqg85\"" Jun 09 13:28:15.204778 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.204616 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 13:28:15.205124 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.205090 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jfpd5" Jun 09 13:28:15.206238 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.206216 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 13:28:15.206755 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.206562 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 13:28:15.206853 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.206761 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gqrh9\"" Jun 09 13:28:15.207163 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.207146 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bdhxc" Jun 09 13:28:15.207720 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.207698 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 13:28:15.207795 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.207758 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsvgz\" (UniqueName: \"kubernetes.io/projected/a7641f4a-8124-4524-ab0a-34dfebafe183-kube-api-access-nsvgz\") pod \"network-metrics-daemon-wkwcl\" (UID: \"a7641f4a-8124-4524-ab0a-34dfebafe183\") " pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:15.207795 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.207788 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-systemd-units\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.207905 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.207810 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-log-socket\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.207905 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.207837 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7381675c-6391-4629-b62d-973846b1dd42-env-overrides\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.207905 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.207861 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20644c8b-cdf0-49f4-920a-5975ca9a0175-dbus\") pod \"global-pull-secret-syncer-lm86k\" (UID: \"20644c8b-cdf0-49f4-920a-5975ca9a0175\") " pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:15.207905 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.207879 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 13:28:15.207905 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.207884 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-host-var-lib-cni-multus\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.208171 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.207907 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-multus-conf-dir\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.208171 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.207931 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-host-run-ovn-kubernetes\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.208171 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.207879 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lmltb\"" Jun 09 13:28:15.208171 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.207979 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 13:28:15.208171 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.207970 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20644c8b-cdf0-49f4-920a-5975ca9a0175-original-pull-secret\") pod \"global-pull-secret-syncer-lm86k\" (UID: \"20644c8b-cdf0-49f4-920a-5975ca9a0175\") " pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:15.208171 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208034 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-host-run-k8s-cni-cncf-io\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.208171 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208057 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-host-var-lib-cni-bin\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.208171 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208080 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-host-var-lib-kubelet\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.208171 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208103 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67-registration-dir\") pod \"aws-ebs-csi-driver-node-5gqxg\" (UID: \"f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" Jun 09 13:28:15.208171 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208155 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-run-openvswitch\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.208171 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208172 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-run-ovn\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.208718 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208186 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7381675c-6391-4629-b62d-973846b1dd42-ovn-node-metrics-cert\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.208718 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208200 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-system-cni-dir\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.208718 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208224 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-cnibin\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.208718 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208246 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-multus-socket-dir-parent\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.208718 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208268 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-etc-kubernetes\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.208718 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208294 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zfq6\" (UniqueName: \"kubernetes.io/projected/f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67-kube-api-access-5zfq6\") pod \"aws-ebs-csi-driver-node-5gqxg\" (UID: \"f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" Jun 09 13:28:15.208718 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208333 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-host-slash\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.208718 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208372 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-host-run-netns\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.208718 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208411 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20644c8b-cdf0-49f4-920a-5975ca9a0175-kubelet-config\") pod \"global-pull-secret-syncer-lm86k\" (UID: \"20644c8b-cdf0-49f4-920a-5975ca9a0175\") " pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:15.208718 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208433 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-multus-cni-dir\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.208718 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208456 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qw7v\" (UniqueName: \"kubernetes.io/projected/00be3040-8a59-4576-bf4a-46f26dd612bf-kube-api-access-4qw7v\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.208718 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208478 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-run-systemd\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.208718 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208498 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-os-release\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.208718 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208524 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-host-run-multus-certs\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.208718 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208627 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67-etc-selinux\") pod \"aws-ebs-csi-driver-node-5gqxg\" (UID: \"f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" Jun 09 13:28:15.208718 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208654 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7eadc018-78fa-404b-9a37-6f86d44ce1af-tmp-dir\") pod \"node-resolver-9vxbd\" (UID: \"7eadc018-78fa-404b-9a37-6f86d44ce1af\") " pod="openshift-dns/node-resolver-9vxbd" Jun 09 13:28:15.208718 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208703 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs\") pod \"network-metrics-daemon-wkwcl\" (UID: \"a7641f4a-8124-4524-ab0a-34dfebafe183\") " pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:15.209476 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208724 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-host-kubelet\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.209476 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208748 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-etc-openvswitch\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.209476 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208770 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7381675c-6391-4629-b62d-973846b1dd42-ovnkube-config\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.209476 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208791 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/00be3040-8a59-4576-bf4a-46f26dd612bf-multus-daemon-config\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.209476 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208814 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67-socket-dir\") pod \"aws-ebs-csi-driver-node-5gqxg\" (UID: \"f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" Jun 09 13:28:15.209476 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208836 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67-device-dir\") pod \"aws-ebs-csi-driver-node-5gqxg\" (UID: \"f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" Jun 09 13:28:15.209476 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208860 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67-sys-fs\") pod \"aws-ebs-csi-driver-node-5gqxg\" (UID: \"f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" Jun 09 13:28:15.209476 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208880 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7eadc018-78fa-404b-9a37-6f86d44ce1af-hosts-file\") pod \"node-resolver-9vxbd\" (UID: \"7eadc018-78fa-404b-9a37-6f86d44ce1af\") " pod="openshift-dns/node-resolver-9vxbd" Jun 09 13:28:15.209476 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208900 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-var-lib-openvswitch\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.209476 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208933 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:28:15.209476 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208935 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7381675c-6391-4629-b62d-973846b1dd42-ovnkube-script-lib\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.209476 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.208980 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsdwx\" (UniqueName: \"kubernetes.io/projected/7381675c-6391-4629-b62d-973846b1dd42-kube-api-access-zsdwx\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.209476 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:15.208998 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2z65b" podUID="6859f54c-fedb-4cb2-a49a-967b308d6688" Jun 09 13:28:15.209476 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.209025 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-hostroot\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.209476 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.209054 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2glsz\" (UniqueName: \"kubernetes.io/projected/7eadc018-78fa-404b-9a37-6f86d44ce1af-kube-api-access-2glsz\") pod \"node-resolver-9vxbd\" (UID: \"7eadc018-78fa-404b-9a37-6f86d44ce1af\") " pod="openshift-dns/node-resolver-9vxbd" Jun 09 13:28:15.209476 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.209108 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-node-log\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.209476 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.209141 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-host-cni-bin\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.210267 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.209164 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-host-cni-netd\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.210267 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.209186 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.210267 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.209209 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5gqxg\" (UID: \"f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" Jun 09 13:28:15.210267 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.209244 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-host-run-netns\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.210267 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.209273 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/00be3040-8a59-4576-bf4a-46f26dd612bf-cni-binary-copy\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.210267 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.209855 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 13:28:15.210267 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.209886 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 13:28:15.210267 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.209950 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wt92l\"" Jun 09 13:28:15.210267 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.210247 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v9p5z" Jun 09 13:28:15.212588 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.212497 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jpb9c\"" Jun 09 13:28:15.212588 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.212575 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 13:28:15.212728 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.212576 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 13:28:15.213883 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.213864 2544 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 13:28:15.239679 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.239660 2544 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6mtmn" Jun 09 13:28:15.247461 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.247440 2544 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6mtmn" Jun 09 13:28:15.285237 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.285211 2544 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 13:28:15.300195 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.300179 2544 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 13:28:15.309990 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.309969 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20644c8b-cdf0-49f4-920a-5975ca9a0175-original-pull-secret\") pod \"global-pull-secret-syncer-lm86k\" (UID: \"20644c8b-cdf0-49f4-920a-5975ca9a0175\") " pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:15.310092 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310002 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-host-run-k8s-cni-cncf-io\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.310092 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310026 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-host-var-lib-kubelet\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.310092 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310081 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-host-var-lib-kubelet\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.310205 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310087 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-host-run-k8s-cni-cncf-io\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.310205 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:15.310127 2544 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:28:15.310205 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310130 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7381675c-6391-4629-b62d-973846b1dd42-ovn-node-metrics-cert\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.310205 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310174 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9841f4d8-0a3f-4c94-8b0f-eede32071a6b-cnibin\") pod \"multus-additional-cni-plugins-bdhxc\" (UID: \"9841f4d8-0a3f-4c94-8b0f-eede32071a6b\") " pod="openshift-multus/multus-additional-cni-plugins-bdhxc" Jun 09 13:28:15.310205 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:15.310201 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20644c8b-cdf0-49f4-920a-5975ca9a0175-original-pull-secret podName:20644c8b-cdf0-49f4-920a-5975ca9a0175 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:15.810165236 +0000 UTC m=+2.965437442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20644c8b-cdf0-49f4-920a-5975ca9a0175-original-pull-secret") pod "global-pull-secret-syncer-lm86k" (UID: "20644c8b-cdf0-49f4-920a-5975ca9a0175") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:28:15.310534 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310274 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9841f4d8-0a3f-4c94-8b0f-eede32071a6b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bdhxc\" (UID: \"9841f4d8-0a3f-4c94-8b0f-eede32071a6b\") " pod="openshift-multus/multus-additional-cni-plugins-bdhxc" Jun 09 13:28:15.310534 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310303 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-etc-sysctl-conf\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.310534 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310330 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-system-cni-dir\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.310534 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310365 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-multus-socket-dir-parent\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.310534 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310390 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zfq6\" (UniqueName: \"kubernetes.io/projected/f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67-kube-api-access-5zfq6\") pod \"aws-ebs-csi-driver-node-5gqxg\" (UID: \"f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" Jun 09 13:28:15.310534 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310404 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-system-cni-dir\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.310534 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310424 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-host-run-netns\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.310534 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310442 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-multus-socket-dir-parent\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.310534 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310450 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/481755af-8bd5-44a8-9caf-8d3b591bfa57-host-slash\") pod \"iptables-alerter-jfpd5\" (UID: \"481755af-8bd5-44a8-9caf-8d3b591bfa57\") " pod="openshift-network-operator/iptables-alerter-jfpd5" Jun 09 13:28:15.310534 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310458 2544 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 13:28:15.310534 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310491 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9841f4d8-0a3f-4c94-8b0f-eede32071a6b-cni-binary-copy\") pod \"multus-additional-cni-plugins-bdhxc\" (UID: \"9841f4d8-0a3f-4c94-8b0f-eede32071a6b\") " pod="openshift-multus/multus-additional-cni-plugins-bdhxc" Jun 09 13:28:15.310534 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310520 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e58c726-0ea9-468c-bf8a-589ca1378f36-tmp\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.310534 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310521 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-host-run-netns\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.311016 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310585 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhmxr\" (UniqueName: \"kubernetes.io/projected/2e58c726-0ea9-468c-bf8a-589ca1378f36-kube-api-access-jhmxr\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.311016 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310622 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-multus-cni-dir\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.311016 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310646 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qw7v\" (UniqueName: \"kubernetes.io/projected/00be3040-8a59-4576-bf4a-46f26dd612bf-kube-api-access-4qw7v\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.311016 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310666 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-run-systemd\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.311016 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310684 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5crb4\" (UniqueName: \"kubernetes.io/projected/9841f4d8-0a3f-4c94-8b0f-eede32071a6b-kube-api-access-5crb4\") pod \"multus-additional-cni-plugins-bdhxc\" (UID: \"9841f4d8-0a3f-4c94-8b0f-eede32071a6b\") " pod="openshift-multus/multus-additional-cni-plugins-bdhxc" Jun 09 13:28:15.311016 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310700 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-lib-modules\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.311016 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310716 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e58c726-0ea9-468c-bf8a-589ca1378f36-etc-tuned\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.311016 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310752 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-os-release\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.311016 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310764 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-run-systemd\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.311016 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310768 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-multus-cni-dir\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.311016 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310834 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-host-run-multus-certs\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.311016 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310864 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs\") pod \"network-metrics-daemon-wkwcl\" (UID: \"a7641f4a-8124-4524-ab0a-34dfebafe183\") " pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:15.311016 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310881 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7381675c-6391-4629-b62d-973846b1dd42-ovnkube-config\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.311016 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310913 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-os-release\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.311016 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310926 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9841f4d8-0a3f-4c94-8b0f-eede32071a6b-system-cni-dir\") pod \"multus-additional-cni-plugins-bdhxc\" (UID: \"9841f4d8-0a3f-4c94-8b0f-eede32071a6b\") " pod="openshift-multus/multus-additional-cni-plugins-bdhxc" Jun 09 13:28:15.311016 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310948 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-etc-modprobe-d\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.311016 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310956 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-host-run-multus-certs\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.311622 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.310964 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4b282799-7abc-42f2-bc74-9da3ee15b65a-konnectivity-ca\") pod \"konnectivity-agent-v9p5z\" (UID: \"4b282799-7abc-42f2-bc74-9da3ee15b65a\") " pod="kube-system/konnectivity-agent-v9p5z" Jun 09 13:28:15.311622 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311001 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/00be3040-8a59-4576-bf4a-46f26dd612bf-multus-daemon-config\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.311622 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311037 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67-socket-dir\") pod \"aws-ebs-csi-driver-node-5gqxg\" (UID: \"f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" Jun 09 13:28:15.311622 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311057 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67-device-dir\") pod \"aws-ebs-csi-driver-node-5gqxg\" (UID: \"f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" Jun 09 13:28:15.311622 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311075 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67-sys-fs\") pod \"aws-ebs-csi-driver-node-5gqxg\" (UID: \"f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" Jun 09 13:28:15.311622 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311094 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-var-lib-openvswitch\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.311622 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311114 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7381675c-6391-4629-b62d-973846b1dd42-ovnkube-script-lib\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.311622 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311145 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsdwx\" (UniqueName: \"kubernetes.io/projected/7381675c-6391-4629-b62d-973846b1dd42-kube-api-access-zsdwx\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.311622 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311166 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-etc-sysconfig\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.311622 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311185 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2glsz\" (UniqueName: \"kubernetes.io/projected/7eadc018-78fa-404b-9a37-6f86d44ce1af-kube-api-access-2glsz\") pod \"node-resolver-9vxbd\" (UID: \"7eadc018-78fa-404b-9a37-6f86d44ce1af\") " pod="openshift-dns/node-resolver-9vxbd" Jun 09 13:28:15.311622 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311220 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-host-cni-bin\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.311622 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311259 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-host-cni-bin\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.311622 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311263 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-var-lib-openvswitch\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.311622 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311302 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/481755af-8bd5-44a8-9caf-8d3b591bfa57-iptables-alerter-script\") pod \"iptables-alerter-jfpd5\" (UID: \"481755af-8bd5-44a8-9caf-8d3b591bfa57\") " pod="openshift-network-operator/iptables-alerter-jfpd5" Jun 09 13:28:15.311622 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311330 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-etc-kubernetes\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.311622 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311355 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-run\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.311622 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311378 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-var-lib-kubelet\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.312359 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311403 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-host-run-netns\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.312359 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311431 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsvgz\" (UniqueName: \"kubernetes.io/projected/a7641f4a-8124-4524-ab0a-34dfebafe183-kube-api-access-nsvgz\") pod \"network-metrics-daemon-wkwcl\" (UID: \"a7641f4a-8124-4524-ab0a-34dfebafe183\") " pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:15.312359 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311455 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-systemd-units\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.312359 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311478 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-log-socket\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.312359 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311519 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7381675c-6391-4629-b62d-973846b1dd42-env-overrides\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.312359 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311562 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-host\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.312359 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311577 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/00be3040-8a59-4576-bf4a-46f26dd612bf-multus-daemon-config\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.312359 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:15.311606 2544 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:28:15.312359 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311519 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7381675c-6391-4629-b62d-973846b1dd42-ovnkube-config\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.312359 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311617 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20644c8b-cdf0-49f4-920a-5975ca9a0175-dbus\") pod \"global-pull-secret-syncer-lm86k\" (UID: \"20644c8b-cdf0-49f4-920a-5975ca9a0175\") " pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:15.312359 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311680 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67-sys-fs\") pod \"aws-ebs-csi-driver-node-5gqxg\" (UID: \"f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" Jun 09 13:28:15.312359 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311688 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67-device-dir\") pod \"aws-ebs-csi-driver-node-5gqxg\" (UID: \"f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" Jun 09 13:28:15.312359 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311726 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-log-socket\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.312359 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:15.311734 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs podName:a7641f4a-8124-4524-ab0a-34dfebafe183 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:15.811718571 +0000 UTC m=+2.966990765 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs") pod "network-metrics-daemon-wkwcl" (UID: "a7641f4a-8124-4524-ab0a-34dfebafe183") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:28:15.312359 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311743 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67-socket-dir\") pod \"aws-ebs-csi-driver-node-5gqxg\" (UID: \"f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" Jun 09 13:28:15.312359 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311776 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7381675c-6391-4629-b62d-973846b1dd42-ovnkube-script-lib\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.312359 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311788 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-host-var-lib-cni-multus\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.313095 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311920 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-host-run-netns\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.313095 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311968 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-multus-conf-dir\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.313095 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311963 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-systemd-units\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.313095 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311993 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-host-var-lib-cni-multus\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.313095 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.311998 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-host-run-ovn-kubernetes\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.313095 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312026 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-multus-conf-dir\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.313095 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312043 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-host-run-ovn-kubernetes\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.313095 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312045 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7381675c-6391-4629-b62d-973846b1dd42-env-overrides\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.313095 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312097 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9841f4d8-0a3f-4c94-8b0f-eede32071a6b-os-release\") pod \"multus-additional-cni-plugins-bdhxc\" (UID: \"9841f4d8-0a3f-4c94-8b0f-eede32071a6b\") " pod="openshift-multus/multus-additional-cni-plugins-bdhxc" Jun 09 13:28:15.313095 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312127 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-etc-systemd\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.313095 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312149 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20644c8b-cdf0-49f4-920a-5975ca9a0175-dbus\") pod \"global-pull-secret-syncer-lm86k\" (UID: \"20644c8b-cdf0-49f4-920a-5975ca9a0175\") " pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:15.313095 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312159 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-sys\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.313095 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312185 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-host-var-lib-cni-bin\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.313095 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312206 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67-registration-dir\") pod \"aws-ebs-csi-driver-node-5gqxg\" (UID: \"f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" Jun 09 13:28:15.313095 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312222 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-run-openvswitch\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.313095 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312239 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-run-ovn\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.313095 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312262 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9841f4d8-0a3f-4c94-8b0f-eede32071a6b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bdhxc\" (UID: \"9841f4d8-0a3f-4c94-8b0f-eede32071a6b\") " pod="openshift-multus/multus-additional-cni-plugins-bdhxc" Jun 09 13:28:15.313802 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312264 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-host-var-lib-cni-bin\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.313802 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312288 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z4jt\" (UniqueName: \"kubernetes.io/projected/6859f54c-fedb-4cb2-a49a-967b308d6688-kube-api-access-2z4jt\") pod \"network-check-target-2z65b\" (UID: \"6859f54c-fedb-4cb2-a49a-967b308d6688\") " pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:28:15.313802 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312290 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67-registration-dir\") pod \"aws-ebs-csi-driver-node-5gqxg\" (UID: \"f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" Jun 09 13:28:15.313802 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312290 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-run-openvswitch\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.313802 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312309 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-run-ovn\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.313802 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312311 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4b282799-7abc-42f2-bc74-9da3ee15b65a-agent-certs\") pod \"konnectivity-agent-v9p5z\" (UID: \"4b282799-7abc-42f2-bc74-9da3ee15b65a\") " pod="kube-system/konnectivity-agent-v9p5z" Jun 09 13:28:15.313802 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312370 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-cnibin\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.313802 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312396 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-etc-kubernetes\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.313802 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312419 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-host-slash\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.313802 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312444 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg8pk\" (UniqueName: \"kubernetes.io/projected/481755af-8bd5-44a8-9caf-8d3b591bfa57-kube-api-access-bg8pk\") pod \"iptables-alerter-jfpd5\" (UID: \"481755af-8bd5-44a8-9caf-8d3b591bfa57\") " pod="openshift-network-operator/iptables-alerter-jfpd5" Jun 09 13:28:15.313802 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312467 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-etc-kubernetes\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.313802 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312470 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20644c8b-cdf0-49f4-920a-5975ca9a0175-kubelet-config\") pod \"global-pull-secret-syncer-lm86k\" (UID: \"20644c8b-cdf0-49f4-920a-5975ca9a0175\") " pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:15.313802 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312514 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-cnibin\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.313802 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312517 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-host-slash\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.313802 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312538 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9841f4d8-0a3f-4c94-8b0f-eede32071a6b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bdhxc\" (UID: \"9841f4d8-0a3f-4c94-8b0f-eede32071a6b\") " pod="openshift-multus/multus-additional-cni-plugins-bdhxc" Jun 09 13:28:15.313802 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312584 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20644c8b-cdf0-49f4-920a-5975ca9a0175-kubelet-config\") pod \"global-pull-secret-syncer-lm86k\" (UID: \"20644c8b-cdf0-49f4-920a-5975ca9a0175\") " pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:15.313802 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312608 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-etc-sysctl-d\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.314312 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312632 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67-etc-selinux\") pod \"aws-ebs-csi-driver-node-5gqxg\" (UID: \"f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" Jun 09 13:28:15.314312 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312656 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7eadc018-78fa-404b-9a37-6f86d44ce1af-tmp-dir\") pod \"node-resolver-9vxbd\" (UID: \"7eadc018-78fa-404b-9a37-6f86d44ce1af\") " pod="openshift-dns/node-resolver-9vxbd" Jun 09 13:28:15.314312 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312671 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-host-kubelet\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.314312 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312720 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-etc-openvswitch\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.314312 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312733 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-host-kubelet\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.314312 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312745 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7eadc018-78fa-404b-9a37-6f86d44ce1af-hosts-file\") pod \"node-resolver-9vxbd\" (UID: \"7eadc018-78fa-404b-9a37-6f86d44ce1af\") " pod="openshift-dns/node-resolver-9vxbd" Jun 09 13:28:15.314312 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312763 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67-etc-selinux\") pod \"aws-ebs-csi-driver-node-5gqxg\" (UID: \"f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" Jun 09 13:28:15.314312 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312771 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-etc-openvswitch\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.314312 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312827 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwn9j\" (UniqueName: \"kubernetes.io/projected/abe91674-8930-4d3e-b6d0-4fe9234121a5-kube-api-access-bwn9j\") pod \"node-ca-dppgq\" (UID: \"abe91674-8930-4d3e-b6d0-4fe9234121a5\") " pod="openshift-image-registry/node-ca-dppgq" Jun 09 13:28:15.314312 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312855 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7eadc018-78fa-404b-9a37-6f86d44ce1af-hosts-file\") pod \"node-resolver-9vxbd\" (UID: \"7eadc018-78fa-404b-9a37-6f86d44ce1af\") " pod="openshift-dns/node-resolver-9vxbd" Jun 09 13:28:15.314312 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312879 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-hostroot\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.314312 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312909 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-node-log\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.314312 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312919 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/00be3040-8a59-4576-bf4a-46f26dd612bf-hostroot\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.314312 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312938 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7eadc018-78fa-404b-9a37-6f86d44ce1af-tmp-dir\") pod \"node-resolver-9vxbd\" (UID: \"7eadc018-78fa-404b-9a37-6f86d44ce1af\") " pod="openshift-dns/node-resolver-9vxbd" Jun 09 13:28:15.314312 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312947 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-host-cni-netd\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.314312 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312954 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-node-log\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.314312 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.312986 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.314312 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.313003 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-host-cni-netd\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.314802 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.313036 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5gqxg\" (UID: \"f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" Jun 09 13:28:15.314802 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.313049 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7381675c-6391-4629-b62d-973846b1dd42-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.314802 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.313075 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/00be3040-8a59-4576-bf4a-46f26dd612bf-cni-binary-copy\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.314802 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.313098 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5gqxg\" (UID: \"f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" Jun 09 13:28:15.314802 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.313126 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/abe91674-8930-4d3e-b6d0-4fe9234121a5-serviceca\") pod \"node-ca-dppgq\" (UID: \"abe91674-8930-4d3e-b6d0-4fe9234121a5\") " pod="openshift-image-registry/node-ca-dppgq" Jun 09 13:28:15.314802 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.313173 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/abe91674-8930-4d3e-b6d0-4fe9234121a5-host\") pod \"node-ca-dppgq\" (UID: \"abe91674-8930-4d3e-b6d0-4fe9234121a5\") " pod="openshift-image-registry/node-ca-dppgq" Jun 09 13:28:15.314802 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.313542 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/00be3040-8a59-4576-bf4a-46f26dd612bf-cni-binary-copy\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.314802 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.313898 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7381675c-6391-4629-b62d-973846b1dd42-ovn-node-metrics-cert\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.320586 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.320509 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zfq6\" (UniqueName: \"kubernetes.io/projected/f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67-kube-api-access-5zfq6\") pod \"aws-ebs-csi-driver-node-5gqxg\" (UID: \"f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" Jun 09 13:28:15.321707 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.321683 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsvgz\" (UniqueName: \"kubernetes.io/projected/a7641f4a-8124-4524-ab0a-34dfebafe183-kube-api-access-nsvgz\") pod \"network-metrics-daemon-wkwcl\" (UID: \"a7641f4a-8124-4524-ab0a-34dfebafe183\") " pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:15.321815 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.321794 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2glsz\" (UniqueName: \"kubernetes.io/projected/7eadc018-78fa-404b-9a37-6f86d44ce1af-kube-api-access-2glsz\") pod \"node-resolver-9vxbd\" (UID: \"7eadc018-78fa-404b-9a37-6f86d44ce1af\") " pod="openshift-dns/node-resolver-9vxbd" Jun 09 13:28:15.322458 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.322439 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qw7v\" (UniqueName: \"kubernetes.io/projected/00be3040-8a59-4576-bf4a-46f26dd612bf-kube-api-access-4qw7v\") pod \"multus-zfkgb\" (UID: \"00be3040-8a59-4576-bf4a-46f26dd612bf\") " pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.322620 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.322601 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsdwx\" (UniqueName: \"kubernetes.io/projected/7381675c-6391-4629-b62d-973846b1dd42-kube-api-access-zsdwx\") pod \"ovnkube-node-b6mtj\" (UID: \"7381675c-6391-4629-b62d-973846b1dd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.413447 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.413416 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-etc-systemd\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.413447 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.413456 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-sys\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.413670 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.413486 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9841f4d8-0a3f-4c94-8b0f-eede32071a6b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bdhxc\" (UID: \"9841f4d8-0a3f-4c94-8b0f-eede32071a6b\") " pod="openshift-multus/multus-additional-cni-plugins-bdhxc" Jun 09 13:28:15.413670 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.413512 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z4jt\" (UniqueName: \"kubernetes.io/projected/6859f54c-fedb-4cb2-a49a-967b308d6688-kube-api-access-2z4jt\") pod \"network-check-target-2z65b\" (UID: \"6859f54c-fedb-4cb2-a49a-967b308d6688\") " pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:28:15.413670 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.413564 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-etc-systemd\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.413670 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.413606 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-sys\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.413670 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.413655 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4b282799-7abc-42f2-bc74-9da3ee15b65a-agent-certs\") pod \"konnectivity-agent-v9p5z\" (UID: \"4b282799-7abc-42f2-bc74-9da3ee15b65a\") " pod="kube-system/konnectivity-agent-v9p5z" Jun 09 13:28:15.413892 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.413690 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg8pk\" (UniqueName: \"kubernetes.io/projected/481755af-8bd5-44a8-9caf-8d3b591bfa57-kube-api-access-bg8pk\") pod \"iptables-alerter-jfpd5\" (UID: \"481755af-8bd5-44a8-9caf-8d3b591bfa57\") " pod="openshift-network-operator/iptables-alerter-jfpd5" Jun 09 13:28:15.413892 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.413715 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9841f4d8-0a3f-4c94-8b0f-eede32071a6b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bdhxc\" (UID: \"9841f4d8-0a3f-4c94-8b0f-eede32071a6b\") " pod="openshift-multus/multus-additional-cni-plugins-bdhxc" Jun 09 13:28:15.413892 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.413741 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-etc-sysctl-d\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.413892 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.413767 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwn9j\" (UniqueName: \"kubernetes.io/projected/abe91674-8930-4d3e-b6d0-4fe9234121a5-kube-api-access-bwn9j\") pod \"node-ca-dppgq\" (UID: \"abe91674-8930-4d3e-b6d0-4fe9234121a5\") " pod="openshift-image-registry/node-ca-dppgq" Jun 09 13:28:15.413892 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.413795 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/abe91674-8930-4d3e-b6d0-4fe9234121a5-serviceca\") pod \"node-ca-dppgq\" (UID: \"abe91674-8930-4d3e-b6d0-4fe9234121a5\") " pod="openshift-image-registry/node-ca-dppgq" Jun 09 13:28:15.413892 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.413815 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/abe91674-8930-4d3e-b6d0-4fe9234121a5-host\") pod \"node-ca-dppgq\" (UID: \"abe91674-8930-4d3e-b6d0-4fe9234121a5\") " pod="openshift-image-registry/node-ca-dppgq" Jun 09 13:28:15.413892 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.413853 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9841f4d8-0a3f-4c94-8b0f-eede32071a6b-cnibin\") pod \"multus-additional-cni-plugins-bdhxc\" (UID: \"9841f4d8-0a3f-4c94-8b0f-eede32071a6b\") " pod="openshift-multus/multus-additional-cni-plugins-bdhxc" Jun 09 13:28:15.413892 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.413873 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9841f4d8-0a3f-4c94-8b0f-eede32071a6b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bdhxc\" (UID: \"9841f4d8-0a3f-4c94-8b0f-eede32071a6b\") " pod="openshift-multus/multus-additional-cni-plugins-bdhxc" Jun 09 13:28:15.414271 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.413900 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-etc-sysctl-conf\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.414271 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.413935 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/481755af-8bd5-44a8-9caf-8d3b591bfa57-host-slash\") pod \"iptables-alerter-jfpd5\" (UID: \"481755af-8bd5-44a8-9caf-8d3b591bfa57\") " pod="openshift-network-operator/iptables-alerter-jfpd5" Jun 09 13:28:15.414271 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.413957 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9841f4d8-0a3f-4c94-8b0f-eede32071a6b-cni-binary-copy\") pod \"multus-additional-cni-plugins-bdhxc\" (UID: \"9841f4d8-0a3f-4c94-8b0f-eede32071a6b\") " pod="openshift-multus/multus-additional-cni-plugins-bdhxc" Jun 09 13:28:15.414271 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.413981 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e58c726-0ea9-468c-bf8a-589ca1378f36-tmp\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.414271 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414005 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhmxr\" (UniqueName: \"kubernetes.io/projected/2e58c726-0ea9-468c-bf8a-589ca1378f36-kube-api-access-jhmxr\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.414271 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414033 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5crb4\" (UniqueName: \"kubernetes.io/projected/9841f4d8-0a3f-4c94-8b0f-eede32071a6b-kube-api-access-5crb4\") pod \"multus-additional-cni-plugins-bdhxc\" (UID: \"9841f4d8-0a3f-4c94-8b0f-eede32071a6b\") " pod="openshift-multus/multus-additional-cni-plugins-bdhxc" Jun 09 13:28:15.414271 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414056 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-lib-modules\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.414271 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414077 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e58c726-0ea9-468c-bf8a-589ca1378f36-etc-tuned\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.414271 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414115 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9841f4d8-0a3f-4c94-8b0f-eede32071a6b-system-cni-dir\") pod \"multus-additional-cni-plugins-bdhxc\" (UID: \"9841f4d8-0a3f-4c94-8b0f-eede32071a6b\") " pod="openshift-multus/multus-additional-cni-plugins-bdhxc" Jun 09 13:28:15.414271 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414136 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-etc-modprobe-d\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.414271 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414143 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-etc-sysctl-d\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.414271 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414160 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4b282799-7abc-42f2-bc74-9da3ee15b65a-konnectivity-ca\") pod \"konnectivity-agent-v9p5z\" (UID: \"4b282799-7abc-42f2-bc74-9da3ee15b65a\") " pod="kube-system/konnectivity-agent-v9p5z" Jun 09 13:28:15.414271 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414163 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9841f4d8-0a3f-4c94-8b0f-eede32071a6b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bdhxc\" (UID: \"9841f4d8-0a3f-4c94-8b0f-eede32071a6b\") " pod="openshift-multus/multus-additional-cni-plugins-bdhxc" Jun 09 13:28:15.414271 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414192 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-etc-sysconfig\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.414271 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414219 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/481755af-8bd5-44a8-9caf-8d3b591bfa57-iptables-alerter-script\") pod \"iptables-alerter-jfpd5\" (UID: \"481755af-8bd5-44a8-9caf-8d3b591bfa57\") " pod="openshift-network-operator/iptables-alerter-jfpd5" Jun 09 13:28:15.414271 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414266 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9841f4d8-0a3f-4c94-8b0f-eede32071a6b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bdhxc\" (UID: \"9841f4d8-0a3f-4c94-8b0f-eede32071a6b\") " pod="openshift-multus/multus-additional-cni-plugins-bdhxc" Jun 09 13:28:15.415032 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414306 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-lib-modules\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.415032 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414380 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-etc-modprobe-d\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.415032 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414415 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9841f4d8-0a3f-4c94-8b0f-eede32071a6b-cnibin\") pod \"multus-additional-cni-plugins-bdhxc\" (UID: \"9841f4d8-0a3f-4c94-8b0f-eede32071a6b\") " pod="openshift-multus/multus-additional-cni-plugins-bdhxc" Jun 09 13:28:15.415032 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414429 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9841f4d8-0a3f-4c94-8b0f-eede32071a6b-system-cni-dir\") pod \"multus-additional-cni-plugins-bdhxc\" (UID: \"9841f4d8-0a3f-4c94-8b0f-eede32071a6b\") " pod="openshift-multus/multus-additional-cni-plugins-bdhxc" Jun 09 13:28:15.415032 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414450 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-etc-kubernetes\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.415032 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414484 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-run\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.415032 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414509 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-var-lib-kubelet\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.415032 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414516 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/abe91674-8930-4d3e-b6d0-4fe9234121a5-host\") pod \"node-ca-dppgq\" (UID: \"abe91674-8930-4d3e-b6d0-4fe9234121a5\") " pod="openshift-image-registry/node-ca-dppgq" Jun 09 13:28:15.415032 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414540 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-host\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.415032 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414586 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-etc-kubernetes\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.415032 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414587 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9841f4d8-0a3f-4c94-8b0f-eede32071a6b-os-release\") pod \"multus-additional-cni-plugins-bdhxc\" (UID: \"9841f4d8-0a3f-4c94-8b0f-eede32071a6b\") " pod="openshift-multus/multus-additional-cni-plugins-bdhxc" Jun 09 13:28:15.415032 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414633 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-var-lib-kubelet\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.415032 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414675 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-run\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.415032 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414676 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9841f4d8-0a3f-4c94-8b0f-eede32071a6b-os-release\") pod \"multus-additional-cni-plugins-bdhxc\" (UID: \"9841f4d8-0a3f-4c94-8b0f-eede32071a6b\") " pod="openshift-multus/multus-additional-cni-plugins-bdhxc" Jun 09 13:28:15.415032 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414722 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-host\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.415032 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414754 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/481755af-8bd5-44a8-9caf-8d3b591bfa57-iptables-alerter-script\") pod \"iptables-alerter-jfpd5\" (UID: \"481755af-8bd5-44a8-9caf-8d3b591bfa57\") " pod="openshift-network-operator/iptables-alerter-jfpd5" Jun 09 13:28:15.415032 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414770 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-etc-sysconfig\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.415032 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414821 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/abe91674-8930-4d3e-b6d0-4fe9234121a5-serviceca\") pod \"node-ca-dppgq\" (UID: \"abe91674-8930-4d3e-b6d0-4fe9234121a5\") " pod="openshift-image-registry/node-ca-dppgq" Jun 09 13:28:15.415952 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414865 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/481755af-8bd5-44a8-9caf-8d3b591bfa57-host-slash\") pod \"iptables-alerter-jfpd5\" (UID: \"481755af-8bd5-44a8-9caf-8d3b591bfa57\") " pod="openshift-network-operator/iptables-alerter-jfpd5" Jun 09 13:28:15.415952 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414895 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e58c726-0ea9-468c-bf8a-589ca1378f36-etc-sysctl-conf\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.415952 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.414900 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9841f4d8-0a3f-4c94-8b0f-eede32071a6b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bdhxc\" (UID: \"9841f4d8-0a3f-4c94-8b0f-eede32071a6b\") " pod="openshift-multus/multus-additional-cni-plugins-bdhxc" Jun 09 13:28:15.415952 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.415186 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4b282799-7abc-42f2-bc74-9da3ee15b65a-konnectivity-ca\") pod \"konnectivity-agent-v9p5z\" (UID: \"4b282799-7abc-42f2-bc74-9da3ee15b65a\") " pod="kube-system/konnectivity-agent-v9p5z" Jun 09 13:28:15.415952 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.415206 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9841f4d8-0a3f-4c94-8b0f-eede32071a6b-cni-binary-copy\") pod \"multus-additional-cni-plugins-bdhxc\" (UID: \"9841f4d8-0a3f-4c94-8b0f-eede32071a6b\") " pod="openshift-multus/multus-additional-cni-plugins-bdhxc" Jun 09 13:28:15.416741 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.416711 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4b282799-7abc-42f2-bc74-9da3ee15b65a-agent-certs\") pod \"konnectivity-agent-v9p5z\" (UID: \"4b282799-7abc-42f2-bc74-9da3ee15b65a\") " pod="kube-system/konnectivity-agent-v9p5z" Jun 09 13:28:15.416901 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.416880 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e58c726-0ea9-468c-bf8a-589ca1378f36-tmp\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.417148 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.417128 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e58c726-0ea9-468c-bf8a-589ca1378f36-etc-tuned\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.419798 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:15.419774 2544 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:28:15.419798 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:15.419800 2544 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:28:15.419984 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:15.419812 2544 projected.go:196] Error preparing data for projected volume kube-api-access-2z4jt for pod openshift-network-diagnostics/network-check-target-2z65b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:28:15.419984 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:15.419898 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6859f54c-fedb-4cb2-a49a-967b308d6688-kube-api-access-2z4jt podName:6859f54c-fedb-4cb2-a49a-967b308d6688 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:15.919881131 +0000 UTC m=+3.075153341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2z4jt" (UniqueName: "kubernetes.io/projected/6859f54c-fedb-4cb2-a49a-967b308d6688-kube-api-access-2z4jt") pod "network-check-target-2z65b" (UID: "6859f54c-fedb-4cb2-a49a-967b308d6688") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:28:15.421814 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.421794 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg8pk\" (UniqueName: \"kubernetes.io/projected/481755af-8bd5-44a8-9caf-8d3b591bfa57-kube-api-access-bg8pk\") pod \"iptables-alerter-jfpd5\" (UID: \"481755af-8bd5-44a8-9caf-8d3b591bfa57\") " pod="openshift-network-operator/iptables-alerter-jfpd5" Jun 09 13:28:15.421967 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.421931 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwn9j\" (UniqueName: \"kubernetes.io/projected/abe91674-8930-4d3e-b6d0-4fe9234121a5-kube-api-access-bwn9j\") pod \"node-ca-dppgq\" (UID: \"abe91674-8930-4d3e-b6d0-4fe9234121a5\") " pod="openshift-image-registry/node-ca-dppgq" Jun 09 13:28:15.422516 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.422489 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5crb4\" (UniqueName: \"kubernetes.io/projected/9841f4d8-0a3f-4c94-8b0f-eede32071a6b-kube-api-access-5crb4\") pod \"multus-additional-cni-plugins-bdhxc\" (UID: \"9841f4d8-0a3f-4c94-8b0f-eede32071a6b\") " pod="openshift-multus/multus-additional-cni-plugins-bdhxc" Jun 09 13:28:15.422644 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.422622 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhmxr\" (UniqueName: \"kubernetes.io/projected/2e58c726-0ea9-468c-bf8a-589ca1378f36-kube-api-access-jhmxr\") pod \"tuned-kdlwn\" (UID: \"2e58c726-0ea9-468c-bf8a-589ca1378f36\") " pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.505874 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.505784 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9vxbd" Jun 09 13:28:15.514625 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.514601 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:15.524267 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.524238 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zfkgb" Jun 09 13:28:15.531753 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.531722 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" Jun 09 13:28:15.539280 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.539261 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dppgq" Jun 09 13:28:15.546781 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.546764 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" Jun 09 13:28:15.555278 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.555261 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jfpd5" Jun 09 13:28:15.562647 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.562629 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bdhxc" Jun 09 13:28:15.569144 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.569127 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v9p5z" Jun 09 13:28:15.817001 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.816927 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20644c8b-cdf0-49f4-920a-5975ca9a0175-original-pull-secret\") pod \"global-pull-secret-syncer-lm86k\" (UID: \"20644c8b-cdf0-49f4-920a-5975ca9a0175\") " pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:15.817001 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:15.816980 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs\") pod \"network-metrics-daemon-wkwcl\" (UID: \"a7641f4a-8124-4524-ab0a-34dfebafe183\") " pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:15.817203 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:15.817058 2544 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:28:15.817203 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:15.817083 2544 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:28:15.817203 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:15.817139 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20644c8b-cdf0-49f4-920a-5975ca9a0175-original-pull-secret podName:20644c8b-cdf0-49f4-920a-5975ca9a0175 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:16.817116334 +0000 UTC m=+3.972388529 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20644c8b-cdf0-49f4-920a-5975ca9a0175-original-pull-secret") pod "global-pull-secret-syncer-lm86k" (UID: "20644c8b-cdf0-49f4-920a-5975ca9a0175") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:28:15.817203 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:15.817164 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs podName:a7641f4a-8124-4524-ab0a-34dfebafe183 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:16.817153328 +0000 UTC m=+3.972425521 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs") pod "network-metrics-daemon-wkwcl" (UID: "a7641f4a-8124-4524-ab0a-34dfebafe183") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:28:15.965199 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:15.965175 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7381675c_6391_4629_b62d_973846b1dd42.slice/crio-46de0bcd00fc9713c021f4462f4d3a8708266fa6d0455ff8751d7246ee91f057 WatchSource:0}: Error finding container 46de0bcd00fc9713c021f4462f4d3a8708266fa6d0455ff8751d7246ee91f057: Status 404 returned error can't find the container with id 46de0bcd00fc9713c021f4462f4d3a8708266fa6d0455ff8751d7246ee91f057 Jun 09 13:28:15.966077 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:15.966041 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod481755af_8bd5_44a8_9caf_8d3b591bfa57.slice/crio-d3e60fcacb28603472db4263034aab3aa565a39cfeee270adfea34adf46472bf WatchSource:0}: Error finding container d3e60fcacb28603472db4263034aab3aa565a39cfeee270adfea34adf46472bf: Status 404 returned error can't find the container with id d3e60fcacb28603472db4263034aab3aa565a39cfeee270adfea34adf46472bf Jun 09 13:28:15.966900 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:15.966755 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e58c726_0ea9_468c_bf8a_589ca1378f36.slice/crio-373710bd8960532daf1ffeddf0ee70cf9805a420de9760072e34880f9c1aa2a4 WatchSource:0}: Error finding container 373710bd8960532daf1ffeddf0ee70cf9805a420de9760072e34880f9c1aa2a4: Status 404 returned error can't find the container with id 373710bd8960532daf1ffeddf0ee70cf9805a420de9760072e34880f9c1aa2a4 Jun 09 13:28:15.971606 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:15.971588 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00be3040_8a59_4576_bf4a_46f26dd612bf.slice/crio-9783b381c96cef83b3e4188481a42190d2a11269adb951bf5100dbf5803f2f7d WatchSource:0}: Error finding container 9783b381c96cef83b3e4188481a42190d2a11269adb951bf5100dbf5803f2f7d: Status 404 returned error can't find the container with id 9783b381c96cef83b3e4188481a42190d2a11269adb951bf5100dbf5803f2f7d Jun 09 13:28:15.972613 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:15.972593 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe91674_8930_4d3e_b6d0_4fe9234121a5.slice/crio-1c9e9c710b3a6fbc66b651a2bf984aad201a67d09ab23b1ecf1a2b80c191bfb6 WatchSource:0}: Error finding container 1c9e9c710b3a6fbc66b651a2bf984aad201a67d09ab23b1ecf1a2b80c191bfb6: Status 404 returned error can't find the container with id 1c9e9c710b3a6fbc66b651a2bf984aad201a67d09ab23b1ecf1a2b80c191bfb6 Jun 09 13:28:15.973978 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:15.973957 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0da2b61_39a7_46fb_bd9d_ee1ed77a9c67.slice/crio-bc63b8a7604b40046be9073dbb88515c8875811796670b0f2caf77670f7b9fc9 WatchSource:0}: Error finding container bc63b8a7604b40046be9073dbb88515c8875811796670b0f2caf77670f7b9fc9: Status 404 returned error can't find the container with id bc63b8a7604b40046be9073dbb88515c8875811796670b0f2caf77670f7b9fc9 Jun 09 13:28:15.975076 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:15.975055 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eadc018_78fa_404b_9a37_6f86d44ce1af.slice/crio-ee2c39409b32a5f37bc1cc69f6e69e72d04de9546cd3df1f995b0604300f5583 WatchSource:0}: Error finding container ee2c39409b32a5f37bc1cc69f6e69e72d04de9546cd3df1f995b0604300f5583: Status 404 returned error can't find the container with id ee2c39409b32a5f37bc1cc69f6e69e72d04de9546cd3df1f995b0604300f5583 Jun 09 13:28:16.018343 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:16.018211 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z4jt\" (UniqueName: \"kubernetes.io/projected/6859f54c-fedb-4cb2-a49a-967b308d6688-kube-api-access-2z4jt\") pod \"network-check-target-2z65b\" (UID: \"6859f54c-fedb-4cb2-a49a-967b308d6688\") " pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:28:16.018413 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:16.018319 2544 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:28:16.018413 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:16.018380 2544 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:28:16.018413 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:16.018391 2544 projected.go:196] Error preparing data for projected volume kube-api-access-2z4jt for pod openshift-network-diagnostics/network-check-target-2z65b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:28:16.018509 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:16.018430 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6859f54c-fedb-4cb2-a49a-967b308d6688-kube-api-access-2z4jt podName:6859f54c-fedb-4cb2-a49a-967b308d6688 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:17.018417875 +0000 UTC m=+4.173690064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2z4jt" (UniqueName: "kubernetes.io/projected/6859f54c-fedb-4cb2-a49a-967b308d6688-kube-api-access-2z4jt") pod "network-check-target-2z65b" (UID: "6859f54c-fedb-4cb2-a49a-967b308d6688") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:28:16.250088 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:16.250056 2544 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 13:23:15 +0000 UTC" deadline="2027-12-22 09:48:25.60328512 +0000 UTC" Jun 09 13:28:16.250088 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:16.250081 2544 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13460h20m9.353207382s" Jun 09 13:28:16.270455 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:16.270435 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:16.270540 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:16.270527 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm86k" podUID="20644c8b-cdf0-49f4-920a-5975ca9a0175" Jun 09 13:28:16.277934 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:16.277900 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" event={"ID":"f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67","Type":"ContainerStarted","Data":"bc63b8a7604b40046be9073dbb88515c8875811796670b0f2caf77670f7b9fc9"} Jun 09 13:28:16.278938 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:16.278909 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" event={"ID":"2e58c726-0ea9-468c-bf8a-589ca1378f36","Type":"ContainerStarted","Data":"373710bd8960532daf1ffeddf0ee70cf9805a420de9760072e34880f9c1aa2a4"} Jun 09 13:28:16.280098 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:16.280073 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jfpd5" event={"ID":"481755af-8bd5-44a8-9caf-8d3b591bfa57","Type":"ContainerStarted","Data":"d3e60fcacb28603472db4263034aab3aa565a39cfeee270adfea34adf46472bf"} Jun 09 13:28:16.281204 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:16.281185 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" event={"ID":"7381675c-6391-4629-b62d-973846b1dd42","Type":"ContainerStarted","Data":"46de0bcd00fc9713c021f4462f4d3a8708266fa6d0455ff8751d7246ee91f057"} Jun 09 13:28:16.282809 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:16.282782 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-58.ec2.internal" event={"ID":"404401a3bc64135c3d2334b8265bc10b","Type":"ContainerStarted","Data":"531bfde8fb26261ba088328d40a3489ccf7de713631b959c505aa7a9d37ea3dd"} Jun 09 13:28:16.284044 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:16.284028 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v9p5z" event={"ID":"4b282799-7abc-42f2-bc74-9da3ee15b65a","Type":"ContainerStarted","Data":"b55f1a3638baabed9ba9a035d5df82ffe15efc9a92301aaadca4364214a4d1a8"} Jun 09 13:28:16.285090 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:16.285061 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zfkgb" event={"ID":"00be3040-8a59-4576-bf4a-46f26dd612bf","Type":"ContainerStarted","Data":"9783b381c96cef83b3e4188481a42190d2a11269adb951bf5100dbf5803f2f7d"} Jun 09 13:28:16.287063 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:16.287038 2544 generic.go:356] "Generic (PLEG): container finished" podID="a46f85e07e28570b49a6c61a063ac368" containerID="ac2e226039158bef04a5c01a965fe82eba6bd399455c73663e81ac6d47ca7d2d" exitCode=0 Jun 09 13:28:16.287255 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:16.287234 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal" event={"ID":"a46f85e07e28570b49a6c61a063ac368","Type":"ContainerDied","Data":"ac2e226039158bef04a5c01a965fe82eba6bd399455c73663e81ac6d47ca7d2d"} Jun 09 13:28:16.289100 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:16.289041 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bdhxc" event={"ID":"9841f4d8-0a3f-4c94-8b0f-eede32071a6b","Type":"ContainerStarted","Data":"7687ab55c226a6f8f80885bfe85efd1b8c9a02173de4caa249b2c5dc5231e9d0"} Jun 09 13:28:16.290702 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:16.290670 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9vxbd" event={"ID":"7eadc018-78fa-404b-9a37-6f86d44ce1af","Type":"ContainerStarted","Data":"ee2c39409b32a5f37bc1cc69f6e69e72d04de9546cd3df1f995b0604300f5583"} Jun 09 13:28:16.292142 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:16.292117 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dppgq" event={"ID":"abe91674-8930-4d3e-b6d0-4fe9234121a5","Type":"ContainerStarted","Data":"1c9e9c710b3a6fbc66b651a2bf984aad201a67d09ab23b1ecf1a2b80c191bfb6"} Jun 09 13:28:16.297206 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:16.297157 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-58.ec2.internal" podStartSLOduration=2.297140468 podStartE2EDuration="2.297140468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:28:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:28:16.29593346 +0000 UTC m=+3.451205667" watchObservedRunningTime="2026-06-09 13:28:16.297140468 +0000 UTC m=+3.452412682" Jun 09 13:28:16.825042 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:16.824998 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20644c8b-cdf0-49f4-920a-5975ca9a0175-original-pull-secret\") pod \"global-pull-secret-syncer-lm86k\" (UID: \"20644c8b-cdf0-49f4-920a-5975ca9a0175\") " pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:16.825230 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:16.825077 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs\") pod \"network-metrics-daemon-wkwcl\" (UID: \"a7641f4a-8124-4524-ab0a-34dfebafe183\") " pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:16.825291 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:16.825277 2544 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:28:16.825349 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:16.825343 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs podName:a7641f4a-8124-4524-ab0a-34dfebafe183 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:18.825323925 +0000 UTC m=+5.980596118 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs") pod "network-metrics-daemon-wkwcl" (UID: "a7641f4a-8124-4524-ab0a-34dfebafe183") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:28:16.825784 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:16.825762 2544 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:28:16.825892 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:16.825819 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20644c8b-cdf0-49f4-920a-5975ca9a0175-original-pull-secret podName:20644c8b-cdf0-49f4-920a-5975ca9a0175 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:18.825803885 +0000 UTC m=+5.981076089 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20644c8b-cdf0-49f4-920a-5975ca9a0175-original-pull-secret") pod "global-pull-secret-syncer-lm86k" (UID: "20644c8b-cdf0-49f4-920a-5975ca9a0175") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:28:17.028257 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:17.027609 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z4jt\" (UniqueName: \"kubernetes.io/projected/6859f54c-fedb-4cb2-a49a-967b308d6688-kube-api-access-2z4jt\") pod \"network-check-target-2z65b\" (UID: \"6859f54c-fedb-4cb2-a49a-967b308d6688\") " pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:28:17.028257 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:17.027789 2544 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:28:17.028257 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:17.027810 2544 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:28:17.028257 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:17.027822 2544 projected.go:196] Error preparing data for projected volume kube-api-access-2z4jt for pod openshift-network-diagnostics/network-check-target-2z65b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:28:17.028257 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:17.027878 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6859f54c-fedb-4cb2-a49a-967b308d6688-kube-api-access-2z4jt podName:6859f54c-fedb-4cb2-a49a-967b308d6688 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:19.027861486 +0000 UTC m=+6.183133680 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2z4jt" (UniqueName: "kubernetes.io/projected/6859f54c-fedb-4cb2-a49a-967b308d6688-kube-api-access-2z4jt") pod "network-check-target-2z65b" (UID: "6859f54c-fedb-4cb2-a49a-967b308d6688") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:28:17.250969 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:17.250856 2544 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 13:23:15 +0000 UTC" deadline="2027-11-03 06:59:13.556709084 +0000 UTC" Jun 09 13:28:17.250969 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:17.250918 2544 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12281h30m56.305794991s" Jun 09 13:28:17.273084 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:17.272412 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:17.273084 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:17.272562 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwcl" podUID="a7641f4a-8124-4524-ab0a-34dfebafe183" Jun 09 13:28:17.273084 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:17.272922 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:28:17.273084 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:17.273005 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2z65b" podUID="6859f54c-fedb-4cb2-a49a-967b308d6688" Jun 09 13:28:17.319424 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:17.319357 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal" event={"ID":"a46f85e07e28570b49a6c61a063ac368","Type":"ContainerStarted","Data":"27727a163186c8b99a7c80ee14b401772ec5353c0499be68e7d0189c8ffe63d9"} Jun 09 13:28:17.335536 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:17.334637 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal" podStartSLOduration=3.334619702 podStartE2EDuration="3.334619702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:28:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:28:17.334166493 +0000 UTC m=+4.489438706" watchObservedRunningTime="2026-06-09 13:28:17.334619702 +0000 UTC m=+4.489891915" Jun 09 13:28:18.270153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:18.270095 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:18.270641 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:18.270217 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm86k" podUID="20644c8b-cdf0-49f4-920a-5975ca9a0175" Jun 09 13:28:18.843725 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:18.843684 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20644c8b-cdf0-49f4-920a-5975ca9a0175-original-pull-secret\") pod \"global-pull-secret-syncer-lm86k\" (UID: \"20644c8b-cdf0-49f4-920a-5975ca9a0175\") " pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:18.843921 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:18.843752 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs\") pod \"network-metrics-daemon-wkwcl\" (UID: \"a7641f4a-8124-4524-ab0a-34dfebafe183\") " pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:18.843921 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:18.843876 2544 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:28:18.844029 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:18.843947 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs podName:a7641f4a-8124-4524-ab0a-34dfebafe183 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:22.843928777 +0000 UTC m=+9.999200980 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs") pod "network-metrics-daemon-wkwcl" (UID: "a7641f4a-8124-4524-ab0a-34dfebafe183") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:28:18.844345 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:18.844326 2544 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:28:18.844420 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:18.844384 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20644c8b-cdf0-49f4-920a-5975ca9a0175-original-pull-secret podName:20644c8b-cdf0-49f4-920a-5975ca9a0175 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:22.84436757 +0000 UTC m=+9.999639765 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20644c8b-cdf0-49f4-920a-5975ca9a0175-original-pull-secret") pod "global-pull-secret-syncer-lm86k" (UID: "20644c8b-cdf0-49f4-920a-5975ca9a0175") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:28:19.045103 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:19.045066 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z4jt\" (UniqueName: \"kubernetes.io/projected/6859f54c-fedb-4cb2-a49a-967b308d6688-kube-api-access-2z4jt\") pod \"network-check-target-2z65b\" (UID: \"6859f54c-fedb-4cb2-a49a-967b308d6688\") " pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:28:19.045266 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:19.045239 2544 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:28:19.045266 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:19.045261 2544 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:28:19.045386 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:19.045274 2544 projected.go:196] Error preparing data for projected volume kube-api-access-2z4jt for pod openshift-network-diagnostics/network-check-target-2z65b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:28:19.045386 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:19.045333 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6859f54c-fedb-4cb2-a49a-967b308d6688-kube-api-access-2z4jt podName:6859f54c-fedb-4cb2-a49a-967b308d6688 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:23.045314976 +0000 UTC m=+10.200587185 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2z4jt" (UniqueName: "kubernetes.io/projected/6859f54c-fedb-4cb2-a49a-967b308d6688-kube-api-access-2z4jt") pod "network-check-target-2z65b" (UID: "6859f54c-fedb-4cb2-a49a-967b308d6688") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:28:19.270936 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:19.270861 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:28:19.271378 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:19.270867 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:19.271378 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:19.270967 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2z65b" podUID="6859f54c-fedb-4cb2-a49a-967b308d6688" Jun 09 13:28:19.271378 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:19.271071 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwcl" podUID="a7641f4a-8124-4524-ab0a-34dfebafe183" Jun 09 13:28:20.270956 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:20.270926 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:20.271417 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:20.271073 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm86k" podUID="20644c8b-cdf0-49f4-920a-5975ca9a0175" Jun 09 13:28:21.270950 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:21.270448 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:21.270950 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:21.270599 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwcl" podUID="a7641f4a-8124-4524-ab0a-34dfebafe183" Jun 09 13:28:21.271474 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:21.271054 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:28:21.271474 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:21.271160 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2z65b" podUID="6859f54c-fedb-4cb2-a49a-967b308d6688" Jun 09 13:28:22.270638 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:22.270603 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:22.270814 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:22.270740 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm86k" podUID="20644c8b-cdf0-49f4-920a-5975ca9a0175" Jun 09 13:28:22.877979 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:22.877367 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20644c8b-cdf0-49f4-920a-5975ca9a0175-original-pull-secret\") pod \"global-pull-secret-syncer-lm86k\" (UID: \"20644c8b-cdf0-49f4-920a-5975ca9a0175\") " pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:22.877979 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:22.877434 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs\") pod \"network-metrics-daemon-wkwcl\" (UID: \"a7641f4a-8124-4524-ab0a-34dfebafe183\") " pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:22.877979 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:22.877585 2544 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:28:22.877979 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:22.877650 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs podName:a7641f4a-8124-4524-ab0a-34dfebafe183 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:30.877631181 +0000 UTC m=+18.032903392 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs") pod "network-metrics-daemon-wkwcl" (UID: "a7641f4a-8124-4524-ab0a-34dfebafe183") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:28:22.877979 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:22.877751 2544 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:28:22.877979 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:22.877794 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20644c8b-cdf0-49f4-920a-5975ca9a0175-original-pull-secret podName:20644c8b-cdf0-49f4-920a-5975ca9a0175 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:30.877780946 +0000 UTC m=+18.033053152 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20644c8b-cdf0-49f4-920a-5975ca9a0175-original-pull-secret") pod "global-pull-secret-syncer-lm86k" (UID: "20644c8b-cdf0-49f4-920a-5975ca9a0175") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:28:23.078715 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:23.078675 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z4jt\" (UniqueName: \"kubernetes.io/projected/6859f54c-fedb-4cb2-a49a-967b308d6688-kube-api-access-2z4jt\") pod \"network-check-target-2z65b\" (UID: \"6859f54c-fedb-4cb2-a49a-967b308d6688\") " pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:28:23.078884 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:23.078832 2544 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:28:23.078884 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:23.078854 2544 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:28:23.078884 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:23.078867 2544 projected.go:196] Error preparing data for projected volume kube-api-access-2z4jt for pod openshift-network-diagnostics/network-check-target-2z65b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:28:23.079036 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:23.078930 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6859f54c-fedb-4cb2-a49a-967b308d6688-kube-api-access-2z4jt podName:6859f54c-fedb-4cb2-a49a-967b308d6688 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:31.078912223 +0000 UTC m=+18.234184435 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2z4jt" (UniqueName: "kubernetes.io/projected/6859f54c-fedb-4cb2-a49a-967b308d6688-kube-api-access-2z4jt") pod "network-check-target-2z65b" (UID: "6859f54c-fedb-4cb2-a49a-967b308d6688") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:28:23.273223 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:23.272672 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:23.273223 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:23.272800 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwcl" podUID="a7641f4a-8124-4524-ab0a-34dfebafe183" Jun 09 13:28:23.274376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:23.273500 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:28:23.274376 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:23.273633 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2z65b" podUID="6859f54c-fedb-4cb2-a49a-967b308d6688" Jun 09 13:28:24.270101 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:24.269928 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:24.270101 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:24.270054 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm86k" podUID="20644c8b-cdf0-49f4-920a-5975ca9a0175" Jun 09 13:28:25.270098 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:25.270059 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:28:25.270527 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:25.270198 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2z65b" podUID="6859f54c-fedb-4cb2-a49a-967b308d6688" Jun 09 13:28:25.270625 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:25.270582 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:25.270705 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:25.270684 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwcl" podUID="a7641f4a-8124-4524-ab0a-34dfebafe183" Jun 09 13:28:26.270954 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:26.270918 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:26.271360 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:26.271058 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm86k" podUID="20644c8b-cdf0-49f4-920a-5975ca9a0175" Jun 09 13:28:27.270460 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:27.270417 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:27.270648 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:27.270465 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:28:27.270648 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:27.270581 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwcl" podUID="a7641f4a-8124-4524-ab0a-34dfebafe183" Jun 09 13:28:27.270749 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:27.270652 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2z65b" podUID="6859f54c-fedb-4cb2-a49a-967b308d6688" Jun 09 13:28:28.270728 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:28.270696 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:28.271194 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:28.270823 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm86k" podUID="20644c8b-cdf0-49f4-920a-5975ca9a0175" Jun 09 13:28:29.270965 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:29.270934 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:28:29.271455 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:29.270948 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:29.271455 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:29.271061 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2z65b" podUID="6859f54c-fedb-4cb2-a49a-967b308d6688" Jun 09 13:28:29.271455 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:29.271118 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwcl" podUID="a7641f4a-8124-4524-ab0a-34dfebafe183" Jun 09 13:28:30.270361 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:30.270335 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:30.270513 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:30.270455 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm86k" podUID="20644c8b-cdf0-49f4-920a-5975ca9a0175" Jun 09 13:28:30.938243 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:30.938204 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20644c8b-cdf0-49f4-920a-5975ca9a0175-original-pull-secret\") pod \"global-pull-secret-syncer-lm86k\" (UID: \"20644c8b-cdf0-49f4-920a-5975ca9a0175\") " pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:30.938793 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:30.938263 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs\") pod \"network-metrics-daemon-wkwcl\" (UID: \"a7641f4a-8124-4524-ab0a-34dfebafe183\") " pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:30.938793 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:30.938351 2544 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:28:30.938793 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:30.938406 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs podName:a7641f4a-8124-4524-ab0a-34dfebafe183 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:46.93839327 +0000 UTC m=+34.093665474 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs") pod "network-metrics-daemon-wkwcl" (UID: "a7641f4a-8124-4524-ab0a-34dfebafe183") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:28:30.938793 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:30.938352 2544 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:28:30.938793 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:30.938457 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20644c8b-cdf0-49f4-920a-5975ca9a0175-original-pull-secret podName:20644c8b-cdf0-49f4-920a-5975ca9a0175 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:46.938436431 +0000 UTC m=+34.093708636 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20644c8b-cdf0-49f4-920a-5975ca9a0175-original-pull-secret") pod "global-pull-secret-syncer-lm86k" (UID: "20644c8b-cdf0-49f4-920a-5975ca9a0175") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:28:31.139642 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:31.139594 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z4jt\" (UniqueName: \"kubernetes.io/projected/6859f54c-fedb-4cb2-a49a-967b308d6688-kube-api-access-2z4jt\") pod \"network-check-target-2z65b\" (UID: \"6859f54c-fedb-4cb2-a49a-967b308d6688\") " pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:28:31.139815 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:31.139749 2544 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:28:31.139815 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:31.139763 2544 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:28:31.139815 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:31.139776 2544 projected.go:196] Error preparing data for projected volume kube-api-access-2z4jt for pod openshift-network-diagnostics/network-check-target-2z65b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:28:31.139933 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:31.139845 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6859f54c-fedb-4cb2-a49a-967b308d6688-kube-api-access-2z4jt podName:6859f54c-fedb-4cb2-a49a-967b308d6688 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:47.139825528 +0000 UTC m=+34.295097738 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2z4jt" (UniqueName: "kubernetes.io/projected/6859f54c-fedb-4cb2-a49a-967b308d6688-kube-api-access-2z4jt") pod "network-check-target-2z65b" (UID: "6859f54c-fedb-4cb2-a49a-967b308d6688") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:28:31.270736 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:31.270697 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:28:31.270920 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:31.270697 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:31.270920 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:31.270835 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2z65b" podUID="6859f54c-fedb-4cb2-a49a-967b308d6688" Jun 09 13:28:31.271039 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:31.270913 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwcl" podUID="a7641f4a-8124-4524-ab0a-34dfebafe183" Jun 09 13:28:32.270518 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:32.270480 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:32.270945 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:32.270614 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm86k" podUID="20644c8b-cdf0-49f4-920a-5975ca9a0175" Jun 09 13:28:33.271077 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:33.271046 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:33.271540 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:33.271166 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwcl" podUID="a7641f4a-8124-4524-ab0a-34dfebafe183" Jun 09 13:28:33.271540 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:33.271212 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:28:33.271540 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:33.271321 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2z65b" podUID="6859f54c-fedb-4cb2-a49a-967b308d6688" Jun 09 13:28:34.270677 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:34.270634 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:34.270872 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:34.270761 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm86k" podUID="20644c8b-cdf0-49f4-920a-5975ca9a0175" Jun 09 13:28:35.271258 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:35.270883 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:35.272157 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:35.270901 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:28:35.272157 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:35.271427 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2z65b" podUID="6859f54c-fedb-4cb2-a49a-967b308d6688" Jun 09 13:28:35.272157 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:35.271423 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwcl" podUID="a7641f4a-8124-4524-ab0a-34dfebafe183" Jun 09 13:28:35.359960 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:35.359879 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" event={"ID":"7381675c-6391-4629-b62d-973846b1dd42","Type":"ContainerStarted","Data":"58539de446f8aa6a1e82f91e281aad216c10b66dc5a344eb5b0baa9a2473ed66"} Jun 09 13:28:35.360118 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:35.359964 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" event={"ID":"7381675c-6391-4629-b62d-973846b1dd42","Type":"ContainerStarted","Data":"07e7afc324ad510bce8750da5f3a5bc109554cc9c221b82ff279e5dadd4895ee"} Jun 09 13:28:35.360118 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:35.360007 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" event={"ID":"7381675c-6391-4629-b62d-973846b1dd42","Type":"ContainerStarted","Data":"04c0e52f6756108a7e0e0a3be62bbec2f196e3fe1c12910e767462b99175167c"} Jun 09 13:28:35.360118 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:35.360048 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" event={"ID":"7381675c-6391-4629-b62d-973846b1dd42","Type":"ContainerStarted","Data":"b97b6f5685a7f4014ff8b1fc59a532eb86e731807a6c15625244a5defd989d28"} Jun 09 13:28:35.360118 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:35.360091 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" event={"ID":"7381675c-6391-4629-b62d-973846b1dd42","Type":"ContainerStarted","Data":"35c31634043cfcab4dadf7af9574723e7446e59d1fe1fde8a3af8421b94fd5d5"} Jun 09 13:28:35.360281 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:35.360134 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" event={"ID":"7381675c-6391-4629-b62d-973846b1dd42","Type":"ContainerStarted","Data":"063b33b4e298350cbc07a693253634801d073e77e206c16a08ea180dbb54539b"} Jun 09 13:28:35.361132 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:35.361110 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v9p5z" event={"ID":"4b282799-7abc-42f2-bc74-9da3ee15b65a","Type":"ContainerStarted","Data":"321393307c3f8640daf646958c131c5d954ebf5bf5ded894af3466165c8bee5a"} Jun 09 13:28:35.362364 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:35.362342 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zfkgb" event={"ID":"00be3040-8a59-4576-bf4a-46f26dd612bf","Type":"ContainerStarted","Data":"429e04e89058129484aa16f734ae7217a209ac6c17d3a80c01d0061be07680be"} Jun 09 13:28:35.363595 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:35.363575 2544 generic.go:356] "Generic (PLEG): container finished" podID="9841f4d8-0a3f-4c94-8b0f-eede32071a6b" containerID="a73b1a4a4376f2f49b60016d571dc71f8dc0754de57205086c69bf9ff42818f7" exitCode=0 Jun 09 13:28:35.363693 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:35.363632 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bdhxc" event={"ID":"9841f4d8-0a3f-4c94-8b0f-eede32071a6b","Type":"ContainerDied","Data":"a73b1a4a4376f2f49b60016d571dc71f8dc0754de57205086c69bf9ff42818f7"} Jun 09 13:28:35.365014 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:35.364996 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9vxbd" event={"ID":"7eadc018-78fa-404b-9a37-6f86d44ce1af","Type":"ContainerStarted","Data":"bd1b5a743ca4aad19274e9447c3ad4b222e286acd91f9f38c5eb5fcffc036256"} Jun 09 13:28:35.366470 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:35.366449 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dppgq" event={"ID":"abe91674-8930-4d3e-b6d0-4fe9234121a5","Type":"ContainerStarted","Data":"fc5ff52738efb0944b6d3ff67f46938234f605a709683f82f57accd696861f16"} Jun 09 13:28:35.367749 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:35.367731 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" event={"ID":"f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67","Type":"ContainerStarted","Data":"d40968430b1468bf51bf80b2ceb1dd70aa4da175806ad912c2c500c7f2d8045c"} Jun 09 13:28:35.368934 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:35.368917 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" event={"ID":"2e58c726-0ea9-468c-bf8a-589ca1378f36","Type":"ContainerStarted","Data":"cd261ee18e4852b61901d7f089a66779a575db75c750af9d37bc1a0571be69bb"} Jun 09 13:28:35.377338 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:35.377302 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-v9p5z" podStartSLOduration=3.848099051 podStartE2EDuration="22.377289568s" totalImagesPullingTime="18.529190517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:28:35.376767922 +0000 UTC m=+22.532040135" watchObservedRunningTime="2026-06-09 13:28:35.377289568 +0000 UTC m=+22.532561779" Jun 09 13:28:35.406292 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:35.406245 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9vxbd" podStartSLOduration=3.874241376 podStartE2EDuration="22.406231771s" totalImagesPullingTime="18.531990395s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:28:35.390920845 +0000 UTC m=+22.546193057" watchObservedRunningTime="2026-06-09 13:28:35.406231771 +0000 UTC m=+22.561503982" Jun 09 13:28:35.406453 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:35.406328 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dppgq" podStartSLOduration=3.867856563 podStartE2EDuration="22.406321798s" totalImagesPullingTime="18.538465235s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:28:35.40597715 +0000 UTC m=+22.561249364" watchObservedRunningTime="2026-06-09 13:28:35.406321798 +0000 UTC m=+22.561594011" Jun 09 13:28:35.422970 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:35.422925 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zfkgb" podStartSLOduration=3.835702248 podStartE2EDuration="22.422912102s" totalImagesPullingTime="18.587209854s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:28:35.42257907 +0000 UTC m=+22.577851282" watchObservedRunningTime="2026-06-09 13:28:35.422912102 +0000 UTC m=+22.578184314" Jun 09 13:28:35.443112 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:35.443069 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kdlwn" podStartSLOduration=3.8782504810000002 podStartE2EDuration="22.44305845s" totalImagesPullingTime="18.564807969s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:28:35.442833046 +0000 UTC m=+22.598105259" watchObservedRunningTime="2026-06-09 13:28:35.44305845 +0000 UTC m=+22.598330662" Jun 09 13:28:35.977789 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:35.977768 2544 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 13:28:36.270632 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:36.270607 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:36.270830 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:36.270699 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm86k" podUID="20644c8b-cdf0-49f4-920a-5975ca9a0175" Jun 09 13:28:36.270873 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:36.270793 2544 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T13:28:35.977785605Z","UUID":"4f038d52-a5f6-4c78-b65b-54bcdf4fd285","Handler":null,"Name":"","Endpoint":""} Jun 09 13:28:36.272175 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:36.272159 2544 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 13:28:36.272524 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:36.272190 2544 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 13:28:36.373279 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:36.373242 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" event={"ID":"f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67","Type":"ContainerStarted","Data":"080e12d419db4549b8e1cb2494b97bb06021710636b9d76437c6b4d715be25a4"} Jun 09 13:28:36.374938 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:36.374898 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jfpd5" event={"ID":"481755af-8bd5-44a8-9caf-8d3b591bfa57","Type":"ContainerStarted","Data":"f601699d379d6d7fe070b4d07c56110b6f8d161bcca05709308accab201c5b54"} Jun 09 13:28:36.389993 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:36.389942 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jfpd5" podStartSLOduration=4.846722894 podStartE2EDuration="23.389921838s" totalImagesPullingTime="18.543198944s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:28:36.389361409 +0000 UTC m=+23.544633624" watchObservedRunningTime="2026-06-09 13:28:36.389921838 +0000 UTC m=+23.545194028" Jun 09 13:28:37.270711 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:37.270685 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:37.270841 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:37.270791 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwcl" podUID="a7641f4a-8124-4524-ab0a-34dfebafe183" Jun 09 13:28:37.270906 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:37.270852 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:28:37.270978 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:37.270958 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2z65b" podUID="6859f54c-fedb-4cb2-a49a-967b308d6688" Jun 09 13:28:37.378773 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:37.378739 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" event={"ID":"f0da2b61-39a7-46fb-bd9d-ee1ed77a9c67","Type":"ContainerStarted","Data":"050387f0024f513b9c32206e55b66a4493642b609ca6cc7348a9193c4cf51a10"} Jun 09 13:28:37.382069 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:37.382038 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" event={"ID":"7381675c-6391-4629-b62d-973846b1dd42","Type":"ContainerStarted","Data":"22f95cabde109fcc7b5b264f2604e7b7eae78d5630b8a6ef96c04728ed42109e"} Jun 09 13:28:37.395611 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:37.395572 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gqxg" podStartSLOduration=3.754135506 podStartE2EDuration="24.395542704s" totalImagesPullingTime="20.641407198s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:28:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:28:37.395107996 +0000 UTC m=+24.550380199" watchObservedRunningTime="2026-06-09 13:28:37.395542704 +0000 UTC m=+24.550814916" Jun 09 13:28:38.270889 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:38.270861 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:38.271034 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:38.270985 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm86k" podUID="20644c8b-cdf0-49f4-920a-5975ca9a0175" Jun 09 13:28:39.270523 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:39.270239 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:39.270995 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:39.270252 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:28:39.270995 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:39.270658 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwcl" podUID="a7641f4a-8124-4524-ab0a-34dfebafe183" Jun 09 13:28:39.270995 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:39.270781 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2z65b" podUID="6859f54c-fedb-4cb2-a49a-967b308d6688" Jun 09 13:28:40.270687 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:40.270652 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:40.271273 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:40.270754 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm86k" podUID="20644c8b-cdf0-49f4-920a-5975ca9a0175" Jun 09 13:28:40.282643 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:40.282619 2544 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-v9p5z" Jun 09 13:28:40.283106 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:40.283087 2544 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-v9p5z" Jun 09 13:28:40.390819 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:40.390778 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" event={"ID":"7381675c-6391-4629-b62d-973846b1dd42","Type":"ContainerStarted","Data":"38b929b7cff54f763b61fa016fb8327085cfef524e003acdf162c8bc5f7370f3"} Jun 09 13:28:40.391013 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:40.390994 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-v9p5z" Jun 09 13:28:40.391505 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:40.391485 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-v9p5z" Jun 09 13:28:40.417847 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:40.417801 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" podStartSLOduration=8.778124428 podStartE2EDuration="27.417786812s" totalImagesPullingTime="18.639662384s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:28:40.416368653 +0000 UTC m=+27.571640865" watchObservedRunningTime="2026-06-09 13:28:40.417786812 +0000 UTC m=+27.573059023" Jun 09 13:28:41.270987 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:41.270690 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:28:41.271438 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:41.270693 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:41.271438 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:41.271110 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2z65b" podUID="6859f54c-fedb-4cb2-a49a-967b308d6688" Jun 09 13:28:41.271438 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:41.271245 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwcl" podUID="a7641f4a-8124-4524-ab0a-34dfebafe183" Jun 09 13:28:41.393807 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:41.393767 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:41.393978 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:41.393854 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:41.393978 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:41.393893 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:41.410955 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:41.410932 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:41.411072 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:41.411053 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:28:41.733708 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:41.733676 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lm86k"] Jun 09 13:28:41.733859 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:41.733809 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:41.733959 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:41.733927 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm86k" podUID="20644c8b-cdf0-49f4-920a-5975ca9a0175" Jun 09 13:28:41.736289 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:41.736187 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2z65b"] Jun 09 13:28:41.736289 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:41.736272 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:28:41.736465 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:41.736356 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2z65b" podUID="6859f54c-fedb-4cb2-a49a-967b308d6688" Jun 09 13:28:41.745895 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:41.745870 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wkwcl"] Jun 09 13:28:41.746021 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:41.745965 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:41.746085 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:41.746058 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwcl" podUID="a7641f4a-8124-4524-ab0a-34dfebafe183" Jun 09 13:28:42.397830 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:42.397799 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bdhxc" event={"ID":"9841f4d8-0a3f-4c94-8b0f-eede32071a6b","Type":"ContainerStarted","Data":"feb7541556169a8e8b09659c9a192ce4253f42f67551ea2d23d70d6bf7b9f190"} Jun 09 13:28:43.273393 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:43.273361 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:28:43.273523 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:43.273454 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:43.273523 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:43.273467 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2z65b" podUID="6859f54c-fedb-4cb2-a49a-967b308d6688" Jun 09 13:28:43.273523 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:43.273482 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:43.273643 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:43.273577 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwcl" podUID="a7641f4a-8124-4524-ab0a-34dfebafe183" Jun 09 13:28:43.273678 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:43.273645 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm86k" podUID="20644c8b-cdf0-49f4-920a-5975ca9a0175" Jun 09 13:28:43.401233 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:43.401194 2544 generic.go:356] "Generic (PLEG): container finished" podID="9841f4d8-0a3f-4c94-8b0f-eede32071a6b" containerID="feb7541556169a8e8b09659c9a192ce4253f42f67551ea2d23d70d6bf7b9f190" exitCode=0 Jun 09 13:28:43.401651 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:43.401279 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bdhxc" event={"ID":"9841f4d8-0a3f-4c94-8b0f-eede32071a6b","Type":"ContainerDied","Data":"feb7541556169a8e8b09659c9a192ce4253f42f67551ea2d23d70d6bf7b9f190"} Jun 09 13:28:44.405333 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:44.405107 2544 generic.go:356] "Generic (PLEG): container finished" podID="9841f4d8-0a3f-4c94-8b0f-eede32071a6b" containerID="203a98d8e90928661af5e7280182bbb1a18ba5d02c966e440e179669b6dcae1f" exitCode=0 Jun 09 13:28:44.405333 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:44.405184 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bdhxc" event={"ID":"9841f4d8-0a3f-4c94-8b0f-eede32071a6b","Type":"ContainerDied","Data":"203a98d8e90928661af5e7280182bbb1a18ba5d02c966e440e179669b6dcae1f"} Jun 09 13:28:45.270840 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:45.270808 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:45.270978 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:45.270808 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:45.270978 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:45.270915 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm86k" podUID="20644c8b-cdf0-49f4-920a-5975ca9a0175" Jun 09 13:28:45.270978 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:45.270922 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:28:45.271139 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:45.270994 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wkwcl" podUID="a7641f4a-8124-4524-ab0a-34dfebafe183" Jun 09 13:28:45.271139 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:45.271052 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2z65b" podUID="6859f54c-fedb-4cb2-a49a-967b308d6688" Jun 09 13:28:45.409856 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:45.409772 2544 generic.go:356] "Generic (PLEG): container finished" podID="9841f4d8-0a3f-4c94-8b0f-eede32071a6b" containerID="b0f9e38282c54656a9c7eaf8902e38f4e56e84b4cfb1e49338db5f0c1cd92a4e" exitCode=0 Jun 09 13:28:45.409856 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:45.409807 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bdhxc" event={"ID":"9841f4d8-0a3f-4c94-8b0f-eede32071a6b","Type":"ContainerDied","Data":"b0f9e38282c54656a9c7eaf8902e38f4e56e84b4cfb1e49338db5f0c1cd92a4e"} Jun 09 13:28:46.965602 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:46.965571 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20644c8b-cdf0-49f4-920a-5975ca9a0175-original-pull-secret\") pod \"global-pull-secret-syncer-lm86k\" (UID: \"20644c8b-cdf0-49f4-920a-5975ca9a0175\") " pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:46.966062 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:46.965623 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs\") pod \"network-metrics-daemon-wkwcl\" (UID: \"a7641f4a-8124-4524-ab0a-34dfebafe183\") " pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:46.966062 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:46.965743 2544 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:28:46.966062 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:46.965806 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs podName:a7641f4a-8124-4524-ab0a-34dfebafe183 nodeName:}" failed. No retries permitted until 2026-06-09 13:29:18.965787239 +0000 UTC m=+66.121059432 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs") pod "network-metrics-daemon-wkwcl" (UID: "a7641f4a-8124-4524-ab0a-34dfebafe183") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:28:46.966062 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:46.965744 2544 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:28:46.966062 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:46.965877 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20644c8b-cdf0-49f4-920a-5975ca9a0175-original-pull-secret podName:20644c8b-cdf0-49f4-920a-5975ca9a0175 nodeName:}" failed. No retries permitted until 2026-06-09 13:29:18.965862674 +0000 UTC m=+66.121134884 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20644c8b-cdf0-49f4-920a-5975ca9a0175-original-pull-secret") pod "global-pull-secret-syncer-lm86k" (UID: "20644c8b-cdf0-49f4-920a-5975ca9a0175") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:28:47.118422 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.118395 2544 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeReady" Jun 09 13:28:47.118579 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.118526 2544 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 13:28:47.151265 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.151238 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b47cf97bc-4z48b"] Jun 09 13:28:47.154251 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.154230 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:47.156616 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.156596 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 13:28:47.156722 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.156613 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 13:28:47.156722 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.156630 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 13:28:47.156722 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.156615 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4lrrc\"" Jun 09 13:28:47.161693 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.161673 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 13:28:47.162402 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.162384 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bf4sh"] Jun 09 13:28:47.166176 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.166158 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8xvj9"] Jun 09 13:28:47.166291 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.166274 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bf4sh" Jun 09 13:28:47.170493 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:47.168532 2544 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:28:47.170493 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:47.168588 2544 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:28:47.170493 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:47.168601 2544 projected.go:196] Error preparing data for projected volume kube-api-access-2z4jt for pod openshift-network-diagnostics/network-check-target-2z65b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:28:47.170493 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:47.168659 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6859f54c-fedb-4cb2-a49a-967b308d6688-kube-api-access-2z4jt podName:6859f54c-fedb-4cb2-a49a-967b308d6688 nodeName:}" failed. No retries permitted until 2026-06-09 13:29:19.16864391 +0000 UTC m=+66.323916126 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2z4jt" (UniqueName: "kubernetes.io/projected/6859f54c-fedb-4cb2-a49a-967b308d6688-kube-api-access-2z4jt") pod "network-check-target-2z65b" (UID: "6859f54c-fedb-4cb2-a49a-967b308d6688") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:28:47.170493 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.167822 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z4jt\" (UniqueName: \"kubernetes.io/projected/6859f54c-fedb-4cb2-a49a-967b308d6688-kube-api-access-2z4jt\") pod \"network-check-target-2z65b\" (UID: \"6859f54c-fedb-4cb2-a49a-967b308d6688\") " pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:28:47.170493 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.169327 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b47cf97bc-4z48b"] Jun 09 13:28:47.170493 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.169340 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zls7s\"" Jun 09 13:28:47.170493 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.169663 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 13:28:47.170493 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.170248 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8xvj9" Jun 09 13:28:47.170493 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.170455 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 13:28:47.174389 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.174365 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 13:28:47.174582 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.174561 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 13:28:47.174651 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.174613 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 13:28:47.174799 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.174741 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zk45d\"" Jun 09 13:28:47.175855 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.175834 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8xvj9"] Jun 09 13:28:47.176522 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.176502 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bf4sh"] Jun 09 13:28:47.271198 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.271156 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:47.271372 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.271201 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3f532cd-176b-4271-b61c-8169febf3a46-config-volume\") pod \"dns-default-bf4sh\" (UID: \"d3f532cd-176b-4271-b61c-8169febf3a46\") " pod="openshift-dns/dns-default-bf4sh" Jun 09 13:28:47.271372 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.271228 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/523c3745-7477-40d1-98c3-61849a65a105-registry-certificates\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:47.271372 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.271273 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9nk2\" (UniqueName: \"kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-kube-api-access-p9nk2\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:47.271372 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.271356 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/523c3745-7477-40d1-98c3-61849a65a105-image-registry-private-configuration\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:47.271677 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.271402 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wv44\" (UniqueName: \"kubernetes.io/projected/d3f532cd-176b-4271-b61c-8169febf3a46-kube-api-access-4wv44\") pod \"dns-default-bf4sh\" (UID: \"d3f532cd-176b-4271-b61c-8169febf3a46\") " pod="openshift-dns/dns-default-bf4sh" Jun 09 13:28:47.271677 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.271427 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/523c3745-7477-40d1-98c3-61849a65a105-ca-trust-extracted\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:47.271677 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.271467 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/523c3745-7477-40d1-98c3-61849a65a105-trusted-ca\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:47.271677 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.271497 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/523c3745-7477-40d1-98c3-61849a65a105-installation-pull-secrets\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:47.271677 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.271562 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27kfb\" (UniqueName: \"kubernetes.io/projected/7a7966ab-4a03-4d00-a421-5d347ad36262-kube-api-access-27kfb\") pod \"ingress-canary-8xvj9\" (UID: \"7a7966ab-4a03-4d00-a421-5d347ad36262\") " pod="openshift-ingress-canary/ingress-canary-8xvj9" Jun 09 13:28:47.271677 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.271606 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls\") pod \"dns-default-bf4sh\" (UID: \"d3f532cd-176b-4271-b61c-8169febf3a46\") " pod="openshift-dns/dns-default-bf4sh" Jun 09 13:28:47.271677 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.271634 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3f532cd-176b-4271-b61c-8169febf3a46-tmp-dir\") pod \"dns-default-bf4sh\" (UID: \"d3f532cd-176b-4271-b61c-8169febf3a46\") " pod="openshift-dns/dns-default-bf4sh" Jun 09 13:28:47.271677 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.271655 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-bound-sa-token\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:47.271677 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.271677 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a7966ab-4a03-4d00-a421-5d347ad36262-cert\") pod \"ingress-canary-8xvj9\" (UID: \"7a7966ab-4a03-4d00-a421-5d347ad36262\") " pod="openshift-ingress-canary/ingress-canary-8xvj9" Jun 09 13:28:47.273738 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.273718 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:28:47.273864 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.273820 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:28:47.273864 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.273842 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:28:47.276332 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.276308 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mb9fc\"" Jun 09 13:28:47.276485 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.276456 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 13:28:47.276485 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.276469 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 13:28:47.276637 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.276588 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 13:28:47.276637 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.276598 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 13:28:47.276790 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.276733 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vwqsn\"" Jun 09 13:28:47.372002 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.371969 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/523c3745-7477-40d1-98c3-61849a65a105-image-registry-private-configuration\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:47.372212 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.372023 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wv44\" (UniqueName: \"kubernetes.io/projected/d3f532cd-176b-4271-b61c-8169febf3a46-kube-api-access-4wv44\") pod \"dns-default-bf4sh\" (UID: \"d3f532cd-176b-4271-b61c-8169febf3a46\") " pod="openshift-dns/dns-default-bf4sh" Jun 09 13:28:47.372212 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.372050 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/523c3745-7477-40d1-98c3-61849a65a105-ca-trust-extracted\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:47.372212 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.372079 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/523c3745-7477-40d1-98c3-61849a65a105-trusted-ca\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:47.372212 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.372107 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/523c3745-7477-40d1-98c3-61849a65a105-installation-pull-secrets\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:47.372212 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.372143 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27kfb\" (UniqueName: \"kubernetes.io/projected/7a7966ab-4a03-4d00-a421-5d347ad36262-kube-api-access-27kfb\") pod \"ingress-canary-8xvj9\" (UID: \"7a7966ab-4a03-4d00-a421-5d347ad36262\") " pod="openshift-ingress-canary/ingress-canary-8xvj9" Jun 09 13:28:47.372212 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.372169 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls\") pod \"dns-default-bf4sh\" (UID: \"d3f532cd-176b-4271-b61c-8169febf3a46\") " pod="openshift-dns/dns-default-bf4sh" Jun 09 13:28:47.372212 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.372194 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3f532cd-176b-4271-b61c-8169febf3a46-tmp-dir\") pod \"dns-default-bf4sh\" (UID: \"d3f532cd-176b-4271-b61c-8169febf3a46\") " pod="openshift-dns/dns-default-bf4sh" Jun 09 13:28:47.372632 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.372221 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-bound-sa-token\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:47.372632 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.372252 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a7966ab-4a03-4d00-a421-5d347ad36262-cert\") pod \"ingress-canary-8xvj9\" (UID: \"7a7966ab-4a03-4d00-a421-5d347ad36262\") " pod="openshift-ingress-canary/ingress-canary-8xvj9" Jun 09 13:28:47.372632 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.372280 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:47.372632 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.372308 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3f532cd-176b-4271-b61c-8169febf3a46-config-volume\") pod \"dns-default-bf4sh\" (UID: \"d3f532cd-176b-4271-b61c-8169febf3a46\") " pod="openshift-dns/dns-default-bf4sh" Jun 09 13:28:47.372632 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.372335 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/523c3745-7477-40d1-98c3-61849a65a105-registry-certificates\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:47.372632 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.372360 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9nk2\" (UniqueName: \"kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-kube-api-access-p9nk2\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:47.372632 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:47.372485 2544 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:28:47.372632 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:47.372507 2544 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b47cf97bc-4z48b: secret "image-registry-tls" not found Jun 09 13:28:47.372632 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.372581 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3f532cd-176b-4271-b61c-8169febf3a46-tmp-dir\") pod \"dns-default-bf4sh\" (UID: \"d3f532cd-176b-4271-b61c-8169febf3a46\") " pod="openshift-dns/dns-default-bf4sh" Jun 09 13:28:47.372632 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:47.372609 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls podName:523c3745-7477-40d1-98c3-61849a65a105 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:47.872565895 +0000 UTC m=+35.027838103 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls") pod "image-registry-5b47cf97bc-4z48b" (UID: "523c3745-7477-40d1-98c3-61849a65a105") : secret "image-registry-tls" not found Jun 09 13:28:47.372632 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:47.372625 2544 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:28:47.373233 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:47.372696 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls podName:d3f532cd-176b-4271-b61c-8169febf3a46 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:47.872671221 +0000 UTC m=+35.027943412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls") pod "dns-default-bf4sh" (UID: "d3f532cd-176b-4271-b61c-8169febf3a46") : secret "dns-default-metrics-tls" not found Jun 09 13:28:47.373233 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.372849 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/523c3745-7477-40d1-98c3-61849a65a105-ca-trust-extracted\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:47.373233 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.373082 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3f532cd-176b-4271-b61c-8169febf3a46-config-volume\") pod \"dns-default-bf4sh\" (UID: \"d3f532cd-176b-4271-b61c-8169febf3a46\") " pod="openshift-dns/dns-default-bf4sh" Jun 09 13:28:47.373233 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.373136 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/523c3745-7477-40d1-98c3-61849a65a105-registry-certificates\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:47.373597 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.373577 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/523c3745-7477-40d1-98c3-61849a65a105-trusted-ca\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:47.376655 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.376635 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/523c3745-7477-40d1-98c3-61849a65a105-image-registry-private-configuration\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:47.376769 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.376682 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/523c3745-7477-40d1-98c3-61849a65a105-installation-pull-secrets\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:47.376769 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.376726 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a7966ab-4a03-4d00-a421-5d347ad36262-cert\") pod \"ingress-canary-8xvj9\" (UID: \"7a7966ab-4a03-4d00-a421-5d347ad36262\") " pod="openshift-ingress-canary/ingress-canary-8xvj9" Jun 09 13:28:47.381343 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.381318 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9nk2\" (UniqueName: \"kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-kube-api-access-p9nk2\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:47.381487 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.381463 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wv44\" (UniqueName: \"kubernetes.io/projected/d3f532cd-176b-4271-b61c-8169febf3a46-kube-api-access-4wv44\") pod \"dns-default-bf4sh\" (UID: \"d3f532cd-176b-4271-b61c-8169febf3a46\") " pod="openshift-dns/dns-default-bf4sh" Jun 09 13:28:47.381581 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.381521 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-bound-sa-token\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:47.382107 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.382068 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27kfb\" (UniqueName: \"kubernetes.io/projected/7a7966ab-4a03-4d00-a421-5d347ad36262-kube-api-access-27kfb\") pod \"ingress-canary-8xvj9\" (UID: \"7a7966ab-4a03-4d00-a421-5d347ad36262\") " pod="openshift-ingress-canary/ingress-canary-8xvj9" Jun 09 13:28:47.487297 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.487272 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8xvj9" Jun 09 13:28:47.629812 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.629455 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8xvj9"] Jun 09 13:28:47.633650 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:28:47.633619 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a7966ab_4a03_4d00_a421_5d347ad36262.slice/crio-f27be6fb9dd146f4b6bab60dbfdb811ceebbe621489b03fd4cc7d7b78a866ebe WatchSource:0}: Error finding container f27be6fb9dd146f4b6bab60dbfdb811ceebbe621489b03fd4cc7d7b78a866ebe: Status 404 returned error can't find the container with id f27be6fb9dd146f4b6bab60dbfdb811ceebbe621489b03fd4cc7d7b78a866ebe Jun 09 13:28:47.876649 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.876526 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls\") pod \"dns-default-bf4sh\" (UID: \"d3f532cd-176b-4271-b61c-8169febf3a46\") " pod="openshift-dns/dns-default-bf4sh" Jun 09 13:28:47.876649 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:47.876604 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:47.876827 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:47.876678 2544 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:28:47.876827 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:47.876758 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls podName:d3f532cd-176b-4271-b61c-8169febf3a46 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:48.876736727 +0000 UTC m=+36.032008932 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls") pod "dns-default-bf4sh" (UID: "d3f532cd-176b-4271-b61c-8169febf3a46") : secret "dns-default-metrics-tls" not found Jun 09 13:28:47.876827 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:47.876682 2544 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:28:47.876827 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:47.876790 2544 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b47cf97bc-4z48b: secret "image-registry-tls" not found Jun 09 13:28:47.876988 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:47.876837 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls podName:523c3745-7477-40d1-98c3-61849a65a105 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:48.87682196 +0000 UTC m=+36.032094162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls") pod "image-registry-5b47cf97bc-4z48b" (UID: "523c3745-7477-40d1-98c3-61849a65a105") : secret "image-registry-tls" not found Jun 09 13:28:48.417851 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:48.417815 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8xvj9" event={"ID":"7a7966ab-4a03-4d00-a421-5d347ad36262","Type":"ContainerStarted","Data":"f27be6fb9dd146f4b6bab60dbfdb811ceebbe621489b03fd4cc7d7b78a866ebe"} Jun 09 13:28:48.884120 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:48.884084 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls\") pod \"dns-default-bf4sh\" (UID: \"d3f532cd-176b-4271-b61c-8169febf3a46\") " pod="openshift-dns/dns-default-bf4sh" Jun 09 13:28:48.884120 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:48.884126 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:48.884347 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:48.884243 2544 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:28:48.884347 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:48.884250 2544 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:28:48.884347 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:48.884256 2544 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b47cf97bc-4z48b: secret "image-registry-tls" not found Jun 09 13:28:48.884347 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:48.884321 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls podName:d3f532cd-176b-4271-b61c-8169febf3a46 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:50.88430083 +0000 UTC m=+38.039573026 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls") pod "dns-default-bf4sh" (UID: "d3f532cd-176b-4271-b61c-8169febf3a46") : secret "dns-default-metrics-tls" not found Jun 09 13:28:48.884504 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:48.884364 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls podName:523c3745-7477-40d1-98c3-61849a65a105 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:50.88434828 +0000 UTC m=+38.039620483 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls") pod "image-registry-5b47cf97bc-4z48b" (UID: "523c3745-7477-40d1-98c3-61849a65a105") : secret "image-registry-tls" not found Jun 09 13:28:50.428977 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:50.428896 2544 generic.go:356] "Generic (PLEG): container finished" podID="9841f4d8-0a3f-4c94-8b0f-eede32071a6b" containerID="5ef3f55f0201cf4ee61f6b4864e9c9efd9c462131395e2067e7067a407f79f53" exitCode=0 Jun 09 13:28:50.429383 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:50.428982 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bdhxc" event={"ID":"9841f4d8-0a3f-4c94-8b0f-eede32071a6b","Type":"ContainerDied","Data":"5ef3f55f0201cf4ee61f6b4864e9c9efd9c462131395e2067e7067a407f79f53"} Jun 09 13:28:50.896796 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:50.896768 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls\") pod \"dns-default-bf4sh\" (UID: \"d3f532cd-176b-4271-b61c-8169febf3a46\") " pod="openshift-dns/dns-default-bf4sh" Jun 09 13:28:50.896930 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:50.896807 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:50.896930 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:50.896916 2544 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:28:50.897030 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:50.896937 2544 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:28:50.897030 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:50.896947 2544 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b47cf97bc-4z48b: secret "image-registry-tls" not found Jun 09 13:28:50.897030 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:50.896989 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls podName:523c3745-7477-40d1-98c3-61849a65a105 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:54.89697341 +0000 UTC m=+42.052245614 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls") pod "image-registry-5b47cf97bc-4z48b" (UID: "523c3745-7477-40d1-98c3-61849a65a105") : secret "image-registry-tls" not found Jun 09 13:28:50.897030 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:50.897007 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls podName:d3f532cd-176b-4271-b61c-8169febf3a46 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:54.896998072 +0000 UTC m=+42.052270264 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls") pod "dns-default-bf4sh" (UID: "d3f532cd-176b-4271-b61c-8169febf3a46") : secret "dns-default-metrics-tls" not found Jun 09 13:28:51.434058 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:51.433833 2544 generic.go:356] "Generic (PLEG): container finished" podID="9841f4d8-0a3f-4c94-8b0f-eede32071a6b" containerID="511a3f868b9211e2b1135bb3ab07649232257427cfa5e2c8822a7f651537a0d5" exitCode=0 Jun 09 13:28:51.434476 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:51.433921 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bdhxc" event={"ID":"9841f4d8-0a3f-4c94-8b0f-eede32071a6b","Type":"ContainerDied","Data":"511a3f868b9211e2b1135bb3ab07649232257427cfa5e2c8822a7f651537a0d5"} Jun 09 13:28:51.435601 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:51.435581 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8xvj9" event={"ID":"7a7966ab-4a03-4d00-a421-5d347ad36262","Type":"ContainerStarted","Data":"9a074f074e4fc1ab3e1de78edae4d06534c328b869f6f1e60ec66e181dbd1de8"} Jun 09 13:28:51.469415 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:51.469358 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8xvj9" podStartSLOduration=1.0731460369999999 podStartE2EDuration="4.469339597s" totalImagesPullingTime="3.39619356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:28:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:28:51.469203357 +0000 UTC m=+38.624475570" watchObservedRunningTime="2026-06-09 13:28:51.469339597 +0000 UTC m=+38.624611809" Jun 09 13:28:52.440767 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:52.440734 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bdhxc" event={"ID":"9841f4d8-0a3f-4c94-8b0f-eede32071a6b","Type":"ContainerStarted","Data":"31edd3a3af2745b33a1e1ae620716a2da200259821d9c7a72c467fccb3486a9c"} Jun 09 13:28:52.465078 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:52.465028 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bdhxc" podStartSLOduration=8.426472009 podStartE2EDuration="39.465011395s" totalImagesPullingTime="31.038539386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:28:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:28:52.463442745 +0000 UTC m=+39.618714956" watchObservedRunningTime="2026-06-09 13:28:52.465011395 +0000 UTC m=+39.620283608" Jun 09 13:28:54.922492 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:54.922458 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls\") pod \"dns-default-bf4sh\" (UID: \"d3f532cd-176b-4271-b61c-8169febf3a46\") " pod="openshift-dns/dns-default-bf4sh" Jun 09 13:28:54.922492 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:54.922497 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:28:54.922904 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:54.922614 2544 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:28:54.922904 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:54.922618 2544 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:28:54.922904 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:54.922682 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls podName:d3f532cd-176b-4271-b61c-8169febf3a46 nodeName:}" failed. No retries permitted until 2026-06-09 13:29:02.922668133 +0000 UTC m=+50.077940323 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls") pod "dns-default-bf4sh" (UID: "d3f532cd-176b-4271-b61c-8169febf3a46") : secret "dns-default-metrics-tls" not found Jun 09 13:28:54.922904 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:54.922626 2544 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b47cf97bc-4z48b: secret "image-registry-tls" not found Jun 09 13:28:54.922904 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:28:54.922769 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls podName:523c3745-7477-40d1-98c3-61849a65a105 nodeName:}" failed. No retries permitted until 2026-06-09 13:29:02.922756755 +0000 UTC m=+50.078028945 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls") pod "image-registry-5b47cf97bc-4z48b" (UID: "523c3745-7477-40d1-98c3-61849a65a105") : secret "image-registry-tls" not found Jun 09 13:28:59.683653 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:59.683618 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-577f4fcb56-tf8th"] Jun 09 13:28:59.702695 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:59.702670 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-577f4fcb56-tf8th"] Jun 09 13:28:59.702863 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:59.702764 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-577f4fcb56-tf8th" Jun 09 13:28:59.705828 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:59.705775 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 13:28:59.705987 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:59.705840 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-mxph5\"" Jun 09 13:28:59.706142 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:59.706125 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 13:28:59.706959 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:59.706942 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 09 13:28:59.707031 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:59.706945 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 13:28:59.857448 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:59.857423 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1979240d-0c56-402a-b99f-bb143e577881-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-577f4fcb56-tf8th\" (UID: \"1979240d-0c56-402a-b99f-bb143e577881\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-577f4fcb56-tf8th" Jun 09 13:28:59.857564 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:59.857462 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plxcp\" (UniqueName: \"kubernetes.io/projected/1979240d-0c56-402a-b99f-bb143e577881-kube-api-access-plxcp\") pod \"managed-serviceaccount-addon-agent-577f4fcb56-tf8th\" (UID: \"1979240d-0c56-402a-b99f-bb143e577881\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-577f4fcb56-tf8th" Jun 09 13:28:59.958750 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:59.958677 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1979240d-0c56-402a-b99f-bb143e577881-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-577f4fcb56-tf8th\" (UID: \"1979240d-0c56-402a-b99f-bb143e577881\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-577f4fcb56-tf8th" Jun 09 13:28:59.958750 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:59.958728 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plxcp\" (UniqueName: \"kubernetes.io/projected/1979240d-0c56-402a-b99f-bb143e577881-kube-api-access-plxcp\") pod \"managed-serviceaccount-addon-agent-577f4fcb56-tf8th\" (UID: \"1979240d-0c56-402a-b99f-bb143e577881\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-577f4fcb56-tf8th" Jun 09 13:28:59.962871 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:59.962845 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1979240d-0c56-402a-b99f-bb143e577881-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-577f4fcb56-tf8th\" (UID: \"1979240d-0c56-402a-b99f-bb143e577881\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-577f4fcb56-tf8th" Jun 09 13:28:59.967604 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:28:59.967584 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plxcp\" (UniqueName: \"kubernetes.io/projected/1979240d-0c56-402a-b99f-bb143e577881-kube-api-access-plxcp\") pod \"managed-serviceaccount-addon-agent-577f4fcb56-tf8th\" (UID: \"1979240d-0c56-402a-b99f-bb143e577881\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-577f4fcb56-tf8th" Jun 09 13:29:00.026496 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:00.026468 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-577f4fcb56-tf8th" Jun 09 13:29:00.171946 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:00.171916 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-577f4fcb56-tf8th"] Jun 09 13:29:00.175447 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:29:00.175424 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1979240d_0c56_402a_b99f_bb143e577881.slice/crio-999011ce1f044415128e75eb227b2b71ff568318f177218c9a470950e5df85fd WatchSource:0}: Error finding container 999011ce1f044415128e75eb227b2b71ff568318f177218c9a470950e5df85fd: Status 404 returned error can't find the container with id 999011ce1f044415128e75eb227b2b71ff568318f177218c9a470950e5df85fd Jun 09 13:29:00.459509 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:00.459476 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-577f4fcb56-tf8th" event={"ID":"1979240d-0c56-402a-b99f-bb143e577881","Type":"ContainerStarted","Data":"999011ce1f044415128e75eb227b2b71ff568318f177218c9a470950e5df85fd"} Jun 09 13:29:02.984015 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:02.983977 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:29:02.984438 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:02.984069 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls\") pod \"dns-default-bf4sh\" (UID: \"d3f532cd-176b-4271-b61c-8169febf3a46\") " pod="openshift-dns/dns-default-bf4sh" Jun 09 13:29:02.984438 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:29:02.984138 2544 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:29:02.984438 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:29:02.984156 2544 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:29:02.984438 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:29:02.984160 2544 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b47cf97bc-4z48b: secret "image-registry-tls" not found Jun 09 13:29:02.984438 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:29:02.984207 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls podName:d3f532cd-176b-4271-b61c-8169febf3a46 nodeName:}" failed. No retries permitted until 2026-06-09 13:29:18.984194949 +0000 UTC m=+66.139467139 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls") pod "dns-default-bf4sh" (UID: "d3f532cd-176b-4271-b61c-8169febf3a46") : secret "dns-default-metrics-tls" not found Jun 09 13:29:02.984438 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:29:02.984220 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls podName:523c3745-7477-40d1-98c3-61849a65a105 nodeName:}" failed. No retries permitted until 2026-06-09 13:29:18.984213972 +0000 UTC m=+66.139486161 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls") pod "image-registry-5b47cf97bc-4z48b" (UID: "523c3745-7477-40d1-98c3-61849a65a105") : secret "image-registry-tls" not found Jun 09 13:29:03.469431 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:03.469399 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-577f4fcb56-tf8th" event={"ID":"1979240d-0c56-402a-b99f-bb143e577881","Type":"ContainerStarted","Data":"629adab61d2b2de26535f82bf0984c523195de6c6b3a22acefd85e51c862cafd"} Jun 09 13:29:03.486236 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:03.486191 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-577f4fcb56-tf8th" podStartSLOduration=1.3743329229999999 podStartE2EDuration="4.486171875s" totalImagesPullingTime="3.111838952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:29:03.485801238 +0000 UTC m=+50.641073452" watchObservedRunningTime="2026-06-09 13:29:03.486171875 +0000 UTC m=+50.641444088" Jun 09 13:29:13.422742 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:13.422716 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b6mtj" Jun 09 13:29:19.000226 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:19.000179 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20644c8b-cdf0-49f4-920a-5975ca9a0175-original-pull-secret\") pod \"global-pull-secret-syncer-lm86k\" (UID: \"20644c8b-cdf0-49f4-920a-5975ca9a0175\") " pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:29:19.000226 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:19.000234 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs\") pod \"network-metrics-daemon-wkwcl\" (UID: \"a7641f4a-8124-4524-ab0a-34dfebafe183\") " pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:29:19.000771 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:19.000299 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls\") pod \"dns-default-bf4sh\" (UID: \"d3f532cd-176b-4271-b61c-8169febf3a46\") " pod="openshift-dns/dns-default-bf4sh" Jun 09 13:29:19.000771 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:29:19.000384 2544 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:29:19.000771 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:19.000431 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:29:19.000771 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:29:19.000444 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls podName:d3f532cd-176b-4271-b61c-8169febf3a46 nodeName:}" failed. No retries permitted until 2026-06-09 13:29:51.000425947 +0000 UTC m=+98.155698162 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls") pod "dns-default-bf4sh" (UID: "d3f532cd-176b-4271-b61c-8169febf3a46") : secret "dns-default-metrics-tls" not found Jun 09 13:29:19.000771 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:29:19.000561 2544 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:29:19.000771 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:29:19.000580 2544 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b47cf97bc-4z48b: secret "image-registry-tls" not found Jun 09 13:29:19.000771 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:29:19.000621 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls podName:523c3745-7477-40d1-98c3-61849a65a105 nodeName:}" failed. No retries permitted until 2026-06-09 13:29:51.000606756 +0000 UTC m=+98.155878979 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls") pod "image-registry-5b47cf97bc-4z48b" (UID: "523c3745-7477-40d1-98c3-61849a65a105") : secret "image-registry-tls" not found Jun 09 13:29:19.003067 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:19.003048 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 13:29:19.003151 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:19.003136 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 13:29:19.011225 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:29:19.011206 2544 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 13:29:19.011344 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:29:19.011256 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs podName:a7641f4a-8124-4524-ab0a-34dfebafe183 nodeName:}" failed. No retries permitted until 2026-06-09 13:30:23.011243776 +0000 UTC m=+130.166515967 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs") pod "network-metrics-daemon-wkwcl" (UID: "a7641f4a-8124-4524-ab0a-34dfebafe183") : secret "metrics-daemon-secret" not found Jun 09 13:29:19.013424 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:19.013396 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20644c8b-cdf0-49f4-920a-5975ca9a0175-original-pull-secret\") pod \"global-pull-secret-syncer-lm86k\" (UID: \"20644c8b-cdf0-49f4-920a-5975ca9a0175\") " pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:29:19.092355 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:19.092331 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm86k" Jun 09 13:29:19.202238 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:19.202209 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z4jt\" (UniqueName: \"kubernetes.io/projected/6859f54c-fedb-4cb2-a49a-967b308d6688-kube-api-access-2z4jt\") pod \"network-check-target-2z65b\" (UID: \"6859f54c-fedb-4cb2-a49a-967b308d6688\") " pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:29:19.204615 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:19.204598 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 13:29:19.212974 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:19.212940 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lm86k"] Jun 09 13:29:19.215082 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:19.215062 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 13:29:19.215728 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:29:19.215711 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20644c8b_cdf0_49f4_920a_5975ca9a0175.slice/crio-a7ad34a49c0068fe20fa5bd7b06e2436cb36c50c652d10c6b3eec7dc6e45b496 WatchSource:0}: Error finding container a7ad34a49c0068fe20fa5bd7b06e2436cb36c50c652d10c6b3eec7dc6e45b496: Status 404 returned error can't find the container with id a7ad34a49c0068fe20fa5bd7b06e2436cb36c50c652d10c6b3eec7dc6e45b496 Jun 09 13:29:19.225943 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:19.225922 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z4jt\" (UniqueName: \"kubernetes.io/projected/6859f54c-fedb-4cb2-a49a-967b308d6688-kube-api-access-2z4jt\") pod \"network-check-target-2z65b\" (UID: \"6859f54c-fedb-4cb2-a49a-967b308d6688\") " pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:29:19.387318 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:19.387241 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mb9fc\"" Jun 09 13:29:19.395243 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:19.395227 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:29:19.508461 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:19.508425 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lm86k" event={"ID":"20644c8b-cdf0-49f4-920a-5975ca9a0175","Type":"ContainerStarted","Data":"a7ad34a49c0068fe20fa5bd7b06e2436cb36c50c652d10c6b3eec7dc6e45b496"} Jun 09 13:29:19.541788 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:19.541756 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2z65b"] Jun 09 13:29:19.544939 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:29:19.544913 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6859f54c_fedb_4cb2_a49a_967b308d6688.slice/crio-b202dafe61a4449dce8034e761d911651bd3cb1ddaec1e6fe64ceda7dd9c2c0c WatchSource:0}: Error finding container b202dafe61a4449dce8034e761d911651bd3cb1ddaec1e6fe64ceda7dd9c2c0c: Status 404 returned error can't find the container with id b202dafe61a4449dce8034e761d911651bd3cb1ddaec1e6fe64ceda7dd9c2c0c Jun 09 13:29:20.512852 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:20.512812 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2z65b" event={"ID":"6859f54c-fedb-4cb2-a49a-967b308d6688","Type":"ContainerStarted","Data":"b202dafe61a4449dce8034e761d911651bd3cb1ddaec1e6fe64ceda7dd9c2c0c"} Jun 09 13:29:24.524293 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:24.524252 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2z65b" event={"ID":"6859f54c-fedb-4cb2-a49a-967b308d6688","Type":"ContainerStarted","Data":"32c942e868de1779b25f014c994bff7a7f91fb1219c1ee7b07a7a4a55f8b9e08"} Jun 09 13:29:24.524780 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:24.524373 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:29:24.525758 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:24.525736 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lm86k" event={"ID":"20644c8b-cdf0-49f4-920a-5975ca9a0175","Type":"ContainerStarted","Data":"8ecb6776f44baba6e32f840dd63e37cde05e1e5af27d83d6fb728e44e63a5f55"} Jun 09 13:29:24.540834 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:24.540783 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2z65b" podStartSLOduration=67.244412051 podStartE2EDuration="1m11.540771622s" totalImagesPullingTime="4.296359571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:29:24.539331352 +0000 UTC m=+71.694603564" watchObservedRunningTime="2026-06-09 13:29:24.540771622 +0000 UTC m=+71.696043834" Jun 09 13:29:24.553635 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:24.553593 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lm86k" podStartSLOduration=66.923635568 podStartE2EDuration="1m11.553582216s" totalImagesPullingTime="4.629946648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:29:24.553292174 +0000 UTC m=+71.708564388" watchObservedRunningTime="2026-06-09 13:29:24.553582216 +0000 UTC m=+71.708854463" Jun 09 13:29:51.032772 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:51.032716 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls\") pod \"dns-default-bf4sh\" (UID: \"d3f532cd-176b-4271-b61c-8169febf3a46\") " pod="openshift-dns/dns-default-bf4sh" Jun 09 13:29:51.032772 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:51.032776 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:29:51.033296 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:29:51.032865 2544 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:29:51.033296 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:29:51.032866 2544 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:29:51.033296 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:29:51.032931 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls podName:d3f532cd-176b-4271-b61c-8169febf3a46 nodeName:}" failed. No retries permitted until 2026-06-09 13:30:55.032915224 +0000 UTC m=+162.188187418 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls") pod "dns-default-bf4sh" (UID: "d3f532cd-176b-4271-b61c-8169febf3a46") : secret "dns-default-metrics-tls" not found Jun 09 13:29:51.033296 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:29:51.032876 2544 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b47cf97bc-4z48b: secret "image-registry-tls" not found Jun 09 13:29:51.033296 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:29:51.033020 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls podName:523c3745-7477-40d1-98c3-61849a65a105 nodeName:}" failed. No retries permitted until 2026-06-09 13:30:55.033006561 +0000 UTC m=+162.188278752 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls") pod "image-registry-5b47cf97bc-4z48b" (UID: "523c3745-7477-40d1-98c3-61849a65a105") : secret "image-registry-tls" not found Jun 09 13:29:55.531034 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:29:55.530999 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2z65b" Jun 09 13:30:23.051182 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:30:23.051131 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs\") pod \"network-metrics-daemon-wkwcl\" (UID: \"a7641f4a-8124-4524-ab0a-34dfebafe183\") " pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:30:23.051701 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:30:23.051274 2544 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 13:30:23.051701 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:30:23.051349 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs podName:a7641f4a-8124-4524-ab0a-34dfebafe183 nodeName:}" failed. No retries permitted until 2026-06-09 13:32:25.051334102 +0000 UTC m=+252.206606293 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs") pod "network-metrics-daemon-wkwcl" (UID: "a7641f4a-8124-4524-ab0a-34dfebafe183") : secret "metrics-daemon-secret" not found Jun 09 13:30:50.165723 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:30:50.165676 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" podUID="523c3745-7477-40d1-98c3-61849a65a105" Jun 09 13:30:50.182417 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:30:50.182391 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bf4sh" podUID="d3f532cd-176b-4271-b61c-8169febf3a46" Jun 09 13:30:50.298105 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:30:50.298053 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-wkwcl" podUID="a7641f4a-8124-4524-ab0a-34dfebafe183" Jun 09 13:30:50.721150 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:30:50.721124 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:30:50.721334 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:30:50.721124 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bf4sh" Jun 09 13:30:55.059871 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:30:55.059833 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls\") pod \"dns-default-bf4sh\" (UID: \"d3f532cd-176b-4271-b61c-8169febf3a46\") " pod="openshift-dns/dns-default-bf4sh" Jun 09 13:30:55.059871 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:30:55.059873 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls\") pod \"image-registry-5b47cf97bc-4z48b\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:30:55.060284 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:30:55.059993 2544 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:30:55.060284 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:30:55.060010 2544 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b47cf97bc-4z48b: secret "image-registry-tls" not found Jun 09 13:30:55.060284 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:30:55.060058 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls podName:523c3745-7477-40d1-98c3-61849a65a105 nodeName:}" failed. No retries permitted until 2026-06-09 13:32:57.060044213 +0000 UTC m=+284.215316403 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls") pod "image-registry-5b47cf97bc-4z48b" (UID: "523c3745-7477-40d1-98c3-61849a65a105") : secret "image-registry-tls" not found Jun 09 13:30:55.060284 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:30:55.059993 2544 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:30:55.060284 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:30:55.060143 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls podName:d3f532cd-176b-4271-b61c-8169febf3a46 nodeName:}" failed. No retries permitted until 2026-06-09 13:32:57.060127435 +0000 UTC m=+284.215399625 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls") pod "dns-default-bf4sh" (UID: "d3f532cd-176b-4271-b61c-8169febf3a46") : secret "dns-default-metrics-tls" not found Jun 09 13:31:02.270268 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:31:02.270185 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:31:03.752832 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:31:03.752802 2544 generic.go:356] "Generic (PLEG): container finished" podID="1979240d-0c56-402a-b99f-bb143e577881" containerID="629adab61d2b2de26535f82bf0984c523195de6c6b3a22acefd85e51c862cafd" exitCode=255 Jun 09 13:31:03.753273 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:31:03.752860 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-577f4fcb56-tf8th" event={"ID":"1979240d-0c56-402a-b99f-bb143e577881","Type":"ContainerDied","Data":"629adab61d2b2de26535f82bf0984c523195de6c6b3a22acefd85e51c862cafd"} Jun 09 13:31:03.758226 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:31:03.758209 2544 scope.go:117] "RemoveContainer" containerID="629adab61d2b2de26535f82bf0984c523195de6c6b3a22acefd85e51c862cafd" Jun 09 13:31:04.757017 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:31:04.756985 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-577f4fcb56-tf8th" event={"ID":"1979240d-0c56-402a-b99f-bb143e577881","Type":"ContainerStarted","Data":"25a9822a404ef87f19ac10fee0b0fa105338dec28c7d42d35ae497ba11b065ce"} Jun 09 13:32:16.307235 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.307204 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qpf72"] Jun 09 13:32:16.310105 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.310079 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qpf72" Jun 09 13:32:16.313076 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.313055 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 09 13:32:16.313184 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.313094 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 09 13:32:16.314180 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.314167 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-wsq8k\"" Jun 09 13:32:16.322320 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.322297 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qpf72"] Jun 09 13:32:16.404012 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.403983 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xkvf7"] Jun 09 13:32:16.406812 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.406792 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-sbrmf"] Jun 09 13:32:16.406935 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.406904 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xkvf7" Jun 09 13:32:16.409252 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.409231 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 09 13:32:16.409252 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.409249 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-mjcxh\"" Jun 09 13:32:16.409446 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.409405 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-sz7qz"] Jun 09 13:32:16.409529 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.409518 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-sbrmf" Jun 09 13:32:16.409598 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.409526 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 13:32:16.410712 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.410696 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 09 13:32:16.410817 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.410697 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 13:32:16.412055 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.412035 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-rqqkq\"" Jun 09 13:32:16.412167 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.412062 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-sz7qz" Jun 09 13:32:16.414091 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.414074 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 09 13:32:16.414193 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.414103 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-n4cjv\"" Jun 09 13:32:16.414438 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.414405 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 09 13:32:16.414766 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.414410 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 09 13:32:16.416278 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.416242 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xkvf7"] Jun 09 13:32:16.417423 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.417383 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-sbrmf"] Jun 09 13:32:16.418351 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.418332 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-sz7qz"] Jun 09 13:32:16.427401 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.427382 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbx52\" (UniqueName: \"kubernetes.io/projected/58cd5e68-2c3c-4353-a5b9-3ee4845283e0-kube-api-access-nbx52\") pod \"volume-data-source-validator-78dd696465-qpf72\" (UID: \"58cd5e68-2c3c-4353-a5b9-3ee4845283e0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qpf72" Jun 09 13:32:16.528401 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.528371 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gbfl\" (UniqueName: \"kubernetes.io/projected/294de5cc-ea4f-4e27-a10d-bf343fbab6f6-kube-api-access-8gbfl\") pod \"cluster-samples-operator-854f8b96b6-sz7qz\" (UID: \"294de5cc-ea4f-4e27-a10d-bf343fbab6f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-sz7qz" Jun 09 13:32:16.528531 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.528406 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/294de5cc-ea4f-4e27-a10d-bf343fbab6f6-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-sz7qz\" (UID: \"294de5cc-ea4f-4e27-a10d-bf343fbab6f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-sz7qz" Jun 09 13:32:16.528531 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.528444 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbx52\" (UniqueName: \"kubernetes.io/projected/58cd5e68-2c3c-4353-a5b9-3ee4845283e0-kube-api-access-nbx52\") pod \"volume-data-source-validator-78dd696465-qpf72\" (UID: \"58cd5e68-2c3c-4353-a5b9-3ee4845283e0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qpf72" Jun 09 13:32:16.528531 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.528468 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjbdg\" (UniqueName: \"kubernetes.io/projected/a1a0c383-e2b9-498c-a33d-0aac98ea7825-kube-api-access-qjbdg\") pod \"network-check-source-dbd9cf844-sbrmf\" (UID: \"a1a0c383-e2b9-498c-a33d-0aac98ea7825\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-sbrmf" Jun 09 13:32:16.528727 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.528589 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/85779f48-91b4-4298-8e90-f9574514984c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xkvf7\" (UID: \"85779f48-91b4-4298-8e90-f9574514984c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xkvf7" Jun 09 13:32:16.528727 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.528623 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mrtm\" (UniqueName: \"kubernetes.io/projected/85779f48-91b4-4298-8e90-f9574514984c-kube-api-access-5mrtm\") pod \"cluster-monitoring-operator-74bbf69bbb-xkvf7\" (UID: \"85779f48-91b4-4298-8e90-f9574514984c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xkvf7" Jun 09 13:32:16.528727 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.528641 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/85779f48-91b4-4298-8e90-f9574514984c-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-xkvf7\" (UID: \"85779f48-91b4-4298-8e90-f9574514984c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xkvf7" Jun 09 13:32:16.538929 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.538904 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbx52\" (UniqueName: \"kubernetes.io/projected/58cd5e68-2c3c-4353-a5b9-3ee4845283e0-kube-api-access-nbx52\") pod \"volume-data-source-validator-78dd696465-qpf72\" (UID: \"58cd5e68-2c3c-4353-a5b9-3ee4845283e0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qpf72" Jun 09 13:32:16.618834 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.618776 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qpf72" Jun 09 13:32:16.629818 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.629792 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjbdg\" (UniqueName: \"kubernetes.io/projected/a1a0c383-e2b9-498c-a33d-0aac98ea7825-kube-api-access-qjbdg\") pod \"network-check-source-dbd9cf844-sbrmf\" (UID: \"a1a0c383-e2b9-498c-a33d-0aac98ea7825\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-sbrmf" Jun 09 13:32:16.629902 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.629836 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/85779f48-91b4-4298-8e90-f9574514984c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xkvf7\" (UID: \"85779f48-91b4-4298-8e90-f9574514984c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xkvf7" Jun 09 13:32:16.629902 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.629871 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mrtm\" (UniqueName: \"kubernetes.io/projected/85779f48-91b4-4298-8e90-f9574514984c-kube-api-access-5mrtm\") pod \"cluster-monitoring-operator-74bbf69bbb-xkvf7\" (UID: \"85779f48-91b4-4298-8e90-f9574514984c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xkvf7" Jun 09 13:32:16.629902 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.629896 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/85779f48-91b4-4298-8e90-f9574514984c-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-xkvf7\" (UID: \"85779f48-91b4-4298-8e90-f9574514984c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xkvf7" Jun 09 13:32:16.630079 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.629988 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gbfl\" (UniqueName: \"kubernetes.io/projected/294de5cc-ea4f-4e27-a10d-bf343fbab6f6-kube-api-access-8gbfl\") pod \"cluster-samples-operator-854f8b96b6-sz7qz\" (UID: \"294de5cc-ea4f-4e27-a10d-bf343fbab6f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-sz7qz" Jun 09 13:32:16.630079 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.630016 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/294de5cc-ea4f-4e27-a10d-bf343fbab6f6-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-sz7qz\" (UID: \"294de5cc-ea4f-4e27-a10d-bf343fbab6f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-sz7qz" Jun 09 13:32:16.630079 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:32:16.630033 2544 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 13:32:16.630218 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:32:16.630121 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85779f48-91b4-4298-8e90-f9574514984c-cluster-monitoring-operator-tls podName:85779f48-91b4-4298-8e90-f9574514984c nodeName:}" failed. No retries permitted until 2026-06-09 13:32:17.130100376 +0000 UTC m=+244.285372567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/85779f48-91b4-4298-8e90-f9574514984c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xkvf7" (UID: "85779f48-91b4-4298-8e90-f9574514984c") : secret "cluster-monitoring-operator-tls" not found Jun 09 13:32:16.630218 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:32:16.630145 2544 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 13:32:16.630218 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:32:16.630215 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/294de5cc-ea4f-4e27-a10d-bf343fbab6f6-samples-operator-tls podName:294de5cc-ea4f-4e27-a10d-bf343fbab6f6 nodeName:}" failed. No retries permitted until 2026-06-09 13:32:17.130197574 +0000 UTC m=+244.285469764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/294de5cc-ea4f-4e27-a10d-bf343fbab6f6-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-sz7qz" (UID: "294de5cc-ea4f-4e27-a10d-bf343fbab6f6") : secret "samples-operator-tls" not found Jun 09 13:32:16.630691 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.630675 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/85779f48-91b4-4298-8e90-f9574514984c-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-xkvf7\" (UID: \"85779f48-91b4-4298-8e90-f9574514984c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xkvf7" Jun 09 13:32:16.640681 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.640660 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjbdg\" (UniqueName: \"kubernetes.io/projected/a1a0c383-e2b9-498c-a33d-0aac98ea7825-kube-api-access-qjbdg\") pod \"network-check-source-dbd9cf844-sbrmf\" (UID: \"a1a0c383-e2b9-498c-a33d-0aac98ea7825\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-sbrmf" Jun 09 13:32:16.640765 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.640663 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gbfl\" (UniqueName: \"kubernetes.io/projected/294de5cc-ea4f-4e27-a10d-bf343fbab6f6-kube-api-access-8gbfl\") pod \"cluster-samples-operator-854f8b96b6-sz7qz\" (UID: \"294de5cc-ea4f-4e27-a10d-bf343fbab6f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-sz7qz" Jun 09 13:32:16.641017 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.640997 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mrtm\" (UniqueName: \"kubernetes.io/projected/85779f48-91b4-4298-8e90-f9574514984c-kube-api-access-5mrtm\") pod \"cluster-monitoring-operator-74bbf69bbb-xkvf7\" (UID: \"85779f48-91b4-4298-8e90-f9574514984c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xkvf7" Jun 09 13:32:16.724973 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.724944 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-sbrmf" Jun 09 13:32:16.737042 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.737017 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qpf72"] Jun 09 13:32:16.739325 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:32:16.739302 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58cd5e68_2c3c_4353_a5b9_3ee4845283e0.slice/crio-0b2874ad48287d60de60ccae8ce764c1d07e32cf3c75452a8553e76547aeecd5 WatchSource:0}: Error finding container 0b2874ad48287d60de60ccae8ce764c1d07e32cf3c75452a8553e76547aeecd5: Status 404 returned error can't find the container with id 0b2874ad48287d60de60ccae8ce764c1d07e32cf3c75452a8553e76547aeecd5 Jun 09 13:32:16.842827 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.842797 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-sbrmf"] Jun 09 13:32:16.845312 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:32:16.845281 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1a0c383_e2b9_498c_a33d_0aac98ea7825.slice/crio-f638e3c55dcdc4d7f04b93bb8e3876d82150edd3af0ebef7b221d87b1d2d8be4 WatchSource:0}: Error finding container f638e3c55dcdc4d7f04b93bb8e3876d82150edd3af0ebef7b221d87b1d2d8be4: Status 404 returned error can't find the container with id f638e3c55dcdc4d7f04b93bb8e3876d82150edd3af0ebef7b221d87b1d2d8be4 Jun 09 13:32:16.925840 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.925794 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-sbrmf" event={"ID":"a1a0c383-e2b9-498c-a33d-0aac98ea7825","Type":"ContainerStarted","Data":"dba9642c19ffcd3de59f0fdc9780e7baaf01c35804817c4c5fc5aebe589a75e1"} Jun 09 13:32:16.925840 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.925858 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-sbrmf" event={"ID":"a1a0c383-e2b9-498c-a33d-0aac98ea7825","Type":"ContainerStarted","Data":"f638e3c55dcdc4d7f04b93bb8e3876d82150edd3af0ebef7b221d87b1d2d8be4"} Jun 09 13:32:16.927081 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.927051 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qpf72" event={"ID":"58cd5e68-2c3c-4353-a5b9-3ee4845283e0","Type":"ContainerStarted","Data":"0b2874ad48287d60de60ccae8ce764c1d07e32cf3c75452a8553e76547aeecd5"} Jun 09 13:32:16.941238 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:16.941188 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-sbrmf" podStartSLOduration=0.941171285 podStartE2EDuration="941.171285ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:32:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:32:16.940755354 +0000 UTC m=+244.096027565" watchObservedRunningTime="2026-06-09 13:32:16.941171285 +0000 UTC m=+244.096443497" Jun 09 13:32:17.134647 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:17.134571 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/294de5cc-ea4f-4e27-a10d-bf343fbab6f6-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-sz7qz\" (UID: \"294de5cc-ea4f-4e27-a10d-bf343fbab6f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-sz7qz" Jun 09 13:32:17.134647 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:17.134620 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/85779f48-91b4-4298-8e90-f9574514984c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xkvf7\" (UID: \"85779f48-91b4-4298-8e90-f9574514984c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xkvf7" Jun 09 13:32:17.134818 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:32:17.134714 2544 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 13:32:17.134818 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:32:17.134737 2544 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 13:32:17.134818 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:32:17.134781 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/294de5cc-ea4f-4e27-a10d-bf343fbab6f6-samples-operator-tls podName:294de5cc-ea4f-4e27-a10d-bf343fbab6f6 nodeName:}" failed. No retries permitted until 2026-06-09 13:32:18.134762175 +0000 UTC m=+245.290034366 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/294de5cc-ea4f-4e27-a10d-bf343fbab6f6-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-sz7qz" (UID: "294de5cc-ea4f-4e27-a10d-bf343fbab6f6") : secret "samples-operator-tls" not found Jun 09 13:32:17.134818 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:32:17.134795 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85779f48-91b4-4298-8e90-f9574514984c-cluster-monitoring-operator-tls podName:85779f48-91b4-4298-8e90-f9574514984c nodeName:}" failed. No retries permitted until 2026-06-09 13:32:18.13478833 +0000 UTC m=+245.290060520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/85779f48-91b4-4298-8e90-f9574514984c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xkvf7" (UID: "85779f48-91b4-4298-8e90-f9574514984c") : secret "cluster-monitoring-operator-tls" not found Jun 09 13:32:17.931101 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:17.931064 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qpf72" event={"ID":"58cd5e68-2c3c-4353-a5b9-3ee4845283e0","Type":"ContainerStarted","Data":"26626c2332034fa044b54580c92f7f7fa60baa599f81420d284cc8f015908c8b"} Jun 09 13:32:17.947561 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:17.947504 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qpf72" podStartSLOduration=0.924085761 podStartE2EDuration="1.947489866s" totalImagesPullingTime="1.023404105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:32:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:32:17.946813065 +0000 UTC m=+245.102085276" watchObservedRunningTime="2026-06-09 13:32:17.947489866 +0000 UTC m=+245.102762078" Jun 09 13:32:18.141884 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:18.141798 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/294de5cc-ea4f-4e27-a10d-bf343fbab6f6-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-sz7qz\" (UID: \"294de5cc-ea4f-4e27-a10d-bf343fbab6f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-sz7qz" Jun 09 13:32:18.141884 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:18.141847 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/85779f48-91b4-4298-8e90-f9574514984c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xkvf7\" (UID: \"85779f48-91b4-4298-8e90-f9574514984c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xkvf7" Jun 09 13:32:18.142066 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:32:18.141949 2544 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 13:32:18.142066 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:32:18.141965 2544 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 13:32:18.142066 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:32:18.142015 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/294de5cc-ea4f-4e27-a10d-bf343fbab6f6-samples-operator-tls podName:294de5cc-ea4f-4e27-a10d-bf343fbab6f6 nodeName:}" failed. No retries permitted until 2026-06-09 13:32:20.142000125 +0000 UTC m=+247.297272320 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/294de5cc-ea4f-4e27-a10d-bf343fbab6f6-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-sz7qz" (UID: "294de5cc-ea4f-4e27-a10d-bf343fbab6f6") : secret "samples-operator-tls" not found Jun 09 13:32:18.142066 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:32:18.142033 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85779f48-91b4-4298-8e90-f9574514984c-cluster-monitoring-operator-tls podName:85779f48-91b4-4298-8e90-f9574514984c nodeName:}" failed. No retries permitted until 2026-06-09 13:32:20.142024265 +0000 UTC m=+247.297296455 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/85779f48-91b4-4298-8e90-f9574514984c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xkvf7" (UID: "85779f48-91b4-4298-8e90-f9574514984c") : secret "cluster-monitoring-operator-tls" not found Jun 09 13:32:20.157588 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:20.157519 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/294de5cc-ea4f-4e27-a10d-bf343fbab6f6-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-sz7qz\" (UID: \"294de5cc-ea4f-4e27-a10d-bf343fbab6f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-sz7qz" Jun 09 13:32:20.157588 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:20.157600 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/85779f48-91b4-4298-8e90-f9574514984c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xkvf7\" (UID: \"85779f48-91b4-4298-8e90-f9574514984c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xkvf7" Jun 09 13:32:20.158095 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:32:20.157668 2544 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 13:32:20.158095 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:32:20.157680 2544 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 13:32:20.158095 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:32:20.157731 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85779f48-91b4-4298-8e90-f9574514984c-cluster-monitoring-operator-tls podName:85779f48-91b4-4298-8e90-f9574514984c nodeName:}" failed. No retries permitted until 2026-06-09 13:32:24.157716335 +0000 UTC m=+251.312988524 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/85779f48-91b4-4298-8e90-f9574514984c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xkvf7" (UID: "85779f48-91b4-4298-8e90-f9574514984c") : secret "cluster-monitoring-operator-tls" not found Jun 09 13:32:20.158095 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:32:20.157744 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/294de5cc-ea4f-4e27-a10d-bf343fbab6f6-samples-operator-tls podName:294de5cc-ea4f-4e27-a10d-bf343fbab6f6 nodeName:}" failed. No retries permitted until 2026-06-09 13:32:24.157738207 +0000 UTC m=+251.313010397 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/294de5cc-ea4f-4e27-a10d-bf343fbab6f6-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-sz7qz" (UID: "294de5cc-ea4f-4e27-a10d-bf343fbab6f6") : secret "samples-operator-tls" not found Jun 09 13:32:21.640122 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:21.640088 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-xpfdf"] Jun 09 13:32:21.643099 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:21.643082 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-xpfdf" Jun 09 13:32:21.645577 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:21.645539 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 09 13:32:21.646690 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:21.646675 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 09 13:32:21.646788 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:21.646675 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-zp85k\"" Jun 09 13:32:21.653023 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:21.653001 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-xpfdf"] Jun 09 13:32:21.773059 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:21.773019 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg96c\" (UniqueName: \"kubernetes.io/projected/759a0c70-17ef-45d5-9c85-6720795bd969-kube-api-access-sg96c\") pod \"migrator-955ffdf5f-xpfdf\" (UID: \"759a0c70-17ef-45d5-9c85-6720795bd969\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-xpfdf" Jun 09 13:32:21.874306 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:21.874274 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg96c\" (UniqueName: \"kubernetes.io/projected/759a0c70-17ef-45d5-9c85-6720795bd969-kube-api-access-sg96c\") pod \"migrator-955ffdf5f-xpfdf\" (UID: \"759a0c70-17ef-45d5-9c85-6720795bd969\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-xpfdf" Jun 09 13:32:21.882881 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:21.882850 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg96c\" (UniqueName: \"kubernetes.io/projected/759a0c70-17ef-45d5-9c85-6720795bd969-kube-api-access-sg96c\") pod \"migrator-955ffdf5f-xpfdf\" (UID: \"759a0c70-17ef-45d5-9c85-6720795bd969\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-xpfdf" Jun 09 13:32:21.951900 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:21.951834 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-xpfdf" Jun 09 13:32:22.069593 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:22.069559 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-xpfdf"] Jun 09 13:32:22.072179 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:32:22.072150 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod759a0c70_17ef_45d5_9c85_6720795bd969.slice/crio-0c909337268ac59d831c6d6304dc529597dd816af024099c9f69c14cdfc4fcc2 WatchSource:0}: Error finding container 0c909337268ac59d831c6d6304dc529597dd816af024099c9f69c14cdfc4fcc2: Status 404 returned error can't find the container with id 0c909337268ac59d831c6d6304dc529597dd816af024099c9f69c14cdfc4fcc2 Jun 09 13:32:22.948668 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:22.948625 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-xpfdf" event={"ID":"759a0c70-17ef-45d5-9c85-6720795bd969","Type":"ContainerStarted","Data":"0c909337268ac59d831c6d6304dc529597dd816af024099c9f69c14cdfc4fcc2"} Jun 09 13:32:23.273220 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:23.273196 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9vxbd_7eadc018-78fa-404b-9a37-6f86d44ce1af/dns-node-resolver/0.log" Jun 09 13:32:23.957560 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:23.957511 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-xpfdf" event={"ID":"759a0c70-17ef-45d5-9c85-6720795bd969","Type":"ContainerStarted","Data":"7b4ef083c9d1c2f7b93bc5a0323164922ef0ecf3bd46e446a6f2db632f7f62df"} Jun 09 13:32:23.957920 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:23.957621 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-xpfdf" event={"ID":"759a0c70-17ef-45d5-9c85-6720795bd969","Type":"ContainerStarted","Data":"761b2108e3295238fc999b80e11271c49bfa98d2924d1767becc78e007b8a915"} Jun 09 13:32:23.974431 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:23.974388 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-xpfdf" podStartSLOduration=2.027876423 podStartE2EDuration="2.974374981s" totalImagesPullingTime="946.498558ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:32:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:32:23.973888607 +0000 UTC m=+251.129160820" watchObservedRunningTime="2026-06-09 13:32:23.974374981 +0000 UTC m=+251.129647209" Jun 09 13:32:24.078459 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:24.078434 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dppgq_abe91674-8930-4d3e-b6d0-4fe9234121a5/node-ca/0.log" Jun 09 13:32:24.192594 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:24.192541 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/294de5cc-ea4f-4e27-a10d-bf343fbab6f6-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-sz7qz\" (UID: \"294de5cc-ea4f-4e27-a10d-bf343fbab6f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-sz7qz" Jun 09 13:32:24.192762 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:24.192604 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/85779f48-91b4-4298-8e90-f9574514984c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xkvf7\" (UID: \"85779f48-91b4-4298-8e90-f9574514984c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xkvf7" Jun 09 13:32:24.192762 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:32:24.192682 2544 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 13:32:24.192762 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:32:24.192758 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85779f48-91b4-4298-8e90-f9574514984c-cluster-monitoring-operator-tls podName:85779f48-91b4-4298-8e90-f9574514984c nodeName:}" failed. No retries permitted until 2026-06-09 13:32:32.192743146 +0000 UTC m=+259.348015336 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/85779f48-91b4-4298-8e90-f9574514984c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xkvf7" (UID: "85779f48-91b4-4298-8e90-f9574514984c") : secret "cluster-monitoring-operator-tls" not found Jun 09 13:32:24.192894 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:32:24.192682 2544 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 13:32:24.192894 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:32:24.192831 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/294de5cc-ea4f-4e27-a10d-bf343fbab6f6-samples-operator-tls podName:294de5cc-ea4f-4e27-a10d-bf343fbab6f6 nodeName:}" failed. No retries permitted until 2026-06-09 13:32:32.192818582 +0000 UTC m=+259.348090772 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/294de5cc-ea4f-4e27-a10d-bf343fbab6f6-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-sz7qz" (UID: "294de5cc-ea4f-4e27-a10d-bf343fbab6f6") : secret "samples-operator-tls" not found Jun 09 13:32:24.672415 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:24.672388 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8xvj9_7a7966ab-4a03-4d00-a421-5d347ad36262/serve-healthcheck-canary/0.log" Jun 09 13:32:25.099315 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:25.099276 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs\") pod \"network-metrics-daemon-wkwcl\" (UID: \"a7641f4a-8124-4524-ab0a-34dfebafe183\") " pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:32:25.099723 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:32:25.099397 2544 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 13:32:25.099723 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:32:25.099464 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs podName:a7641f4a-8124-4524-ab0a-34dfebafe183 nodeName:}" failed. No retries permitted until 2026-06-09 13:34:27.099445688 +0000 UTC m=+374.254717882 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs") pod "network-metrics-daemon-wkwcl" (UID: "a7641f4a-8124-4524-ab0a-34dfebafe183") : secret "metrics-daemon-secret" not found Jun 09 13:32:32.252342 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:32.252285 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/294de5cc-ea4f-4e27-a10d-bf343fbab6f6-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-sz7qz\" (UID: \"294de5cc-ea4f-4e27-a10d-bf343fbab6f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-sz7qz" Jun 09 13:32:32.252342 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:32.252353 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/85779f48-91b4-4298-8e90-f9574514984c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xkvf7\" (UID: \"85779f48-91b4-4298-8e90-f9574514984c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xkvf7" Jun 09 13:32:32.252910 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:32:32.252468 2544 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 13:32:32.252910 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:32:32.252541 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85779f48-91b4-4298-8e90-f9574514984c-cluster-monitoring-operator-tls podName:85779f48-91b4-4298-8e90-f9574514984c nodeName:}" failed. No retries permitted until 2026-06-09 13:32:48.25252129 +0000 UTC m=+275.407793480 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/85779f48-91b4-4298-8e90-f9574514984c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xkvf7" (UID: "85779f48-91b4-4298-8e90-f9574514984c") : secret "cluster-monitoring-operator-tls" not found Jun 09 13:32:32.254802 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:32.254778 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/294de5cc-ea4f-4e27-a10d-bf343fbab6f6-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-sz7qz\" (UID: \"294de5cc-ea4f-4e27-a10d-bf343fbab6f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-sz7qz" Jun 09 13:32:32.329607 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:32.329584 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-sz7qz" Jun 09 13:32:32.449457 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:32.449429 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-sz7qz"] Jun 09 13:32:32.985454 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:32.985416 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-sz7qz" event={"ID":"294de5cc-ea4f-4e27-a10d-bf343fbab6f6","Type":"ContainerStarted","Data":"5f294ccf76d85b76501fcf10c530273c87ff14098917f94f53e063acbd993fc7"} Jun 09 13:32:33.993202 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:33.993173 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-sz7qz" event={"ID":"294de5cc-ea4f-4e27-a10d-bf343fbab6f6","Type":"ContainerStarted","Data":"978efdc8c2f18ae0911fc248f2e8eeb0910e4576fe91e3ee7066fc9f04cb8eeb"} Jun 09 13:32:34.997584 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:34.997534 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-sz7qz" event={"ID":"294de5cc-ea4f-4e27-a10d-bf343fbab6f6","Type":"ContainerStarted","Data":"f19a3eb7d830fbaf08b6ca61154778bcb973dd64d558015a93c91dc151aec4b5"} Jun 09 13:32:35.016688 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:35.016645 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-sz7qz" podStartSLOduration=17.613356641 podStartE2EDuration="19.016630777s" totalImagesPullingTime="1.403274136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:32:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:32:35.015820373 +0000 UTC m=+262.171092587" watchObservedRunningTime="2026-06-09 13:32:35.016630777 +0000 UTC m=+262.171902989" Jun 09 13:32:48.106327 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.106291 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vwwnb"] Jun 09 13:32:48.110336 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.110316 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vwwnb" Jun 09 13:32:48.112871 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.112847 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 13:32:48.113039 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.113019 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 13:32:48.113129 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.113064 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 13:32:48.114234 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.114217 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 13:32:48.114322 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.114280 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zslht\"" Jun 09 13:32:48.117054 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.117031 2544 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b47cf97bc-4z48b"] Jun 09 13:32:48.117481 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:32:48.117244 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" podUID="523c3745-7477-40d1-98c3-61849a65a105" Jun 09 13:32:48.122376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.122359 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vwwnb"] Jun 09 13:32:48.156605 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.156580 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqglv\" (UniqueName: \"kubernetes.io/projected/657d935b-62ff-43d0-b647-e9212e4c0bef-kube-api-access-hqglv\") pod \"insights-runtime-extractor-vwwnb\" (UID: \"657d935b-62ff-43d0-b647-e9212e4c0bef\") " pod="openshift-insights/insights-runtime-extractor-vwwnb" Jun 09 13:32:48.156696 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.156608 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/657d935b-62ff-43d0-b647-e9212e4c0bef-crio-socket\") pod \"insights-runtime-extractor-vwwnb\" (UID: \"657d935b-62ff-43d0-b647-e9212e4c0bef\") " pod="openshift-insights/insights-runtime-extractor-vwwnb" Jun 09 13:32:48.156696 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.156644 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/657d935b-62ff-43d0-b647-e9212e4c0bef-data-volume\") pod \"insights-runtime-extractor-vwwnb\" (UID: \"657d935b-62ff-43d0-b647-e9212e4c0bef\") " pod="openshift-insights/insights-runtime-extractor-vwwnb" Jun 09 13:32:48.156774 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.156725 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/657d935b-62ff-43d0-b647-e9212e4c0bef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwwnb\" (UID: \"657d935b-62ff-43d0-b647-e9212e4c0bef\") " pod="openshift-insights/insights-runtime-extractor-vwwnb" Jun 09 13:32:48.156774 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.156762 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/657d935b-62ff-43d0-b647-e9212e4c0bef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vwwnb\" (UID: \"657d935b-62ff-43d0-b647-e9212e4c0bef\") " pod="openshift-insights/insights-runtime-extractor-vwwnb" Jun 09 13:32:48.196258 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.196235 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78d5b497d5-w7n4x"] Jun 09 13:32:48.198683 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.198669 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:32:48.212672 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.212654 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78d5b497d5-w7n4x"] Jun 09 13:32:48.257428 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.257406 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b474320b-22ac-4a52-896c-b89367de8abb-registry-tls\") pod \"image-registry-78d5b497d5-w7n4x\" (UID: \"b474320b-22ac-4a52-896c-b89367de8abb\") " pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:32:48.257515 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.257434 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b474320b-22ac-4a52-896c-b89367de8abb-registry-certificates\") pod \"image-registry-78d5b497d5-w7n4x\" (UID: \"b474320b-22ac-4a52-896c-b89367de8abb\") " pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:32:48.257515 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.257451 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b474320b-22ac-4a52-896c-b89367de8abb-trusted-ca\") pod \"image-registry-78d5b497d5-w7n4x\" (UID: \"b474320b-22ac-4a52-896c-b89367de8abb\") " pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:32:48.257515 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.257478 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/657d935b-62ff-43d0-b647-e9212e4c0bef-data-volume\") pod \"insights-runtime-extractor-vwwnb\" (UID: \"657d935b-62ff-43d0-b647-e9212e4c0bef\") " pod="openshift-insights/insights-runtime-extractor-vwwnb" Jun 09 13:32:48.257640 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.257539 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/85779f48-91b4-4298-8e90-f9574514984c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xkvf7\" (UID: \"85779f48-91b4-4298-8e90-f9574514984c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xkvf7" Jun 09 13:32:48.257640 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.257591 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/657d935b-62ff-43d0-b647-e9212e4c0bef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwwnb\" (UID: \"657d935b-62ff-43d0-b647-e9212e4c0bef\") " pod="openshift-insights/insights-runtime-extractor-vwwnb" Jun 09 13:32:48.257640 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.257615 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b474320b-22ac-4a52-896c-b89367de8abb-ca-trust-extracted\") pod \"image-registry-78d5b497d5-w7n4x\" (UID: \"b474320b-22ac-4a52-896c-b89367de8abb\") " pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:32:48.257755 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.257640 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgd4m\" (UniqueName: \"kubernetes.io/projected/b474320b-22ac-4a52-896c-b89367de8abb-kube-api-access-xgd4m\") pod \"image-registry-78d5b497d5-w7n4x\" (UID: \"b474320b-22ac-4a52-896c-b89367de8abb\") " pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:32:48.257755 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.257693 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/657d935b-62ff-43d0-b647-e9212e4c0bef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vwwnb\" (UID: \"657d935b-62ff-43d0-b647-e9212e4c0bef\") " pod="openshift-insights/insights-runtime-extractor-vwwnb" Jun 09 13:32:48.257755 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.257714 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b474320b-22ac-4a52-896c-b89367de8abb-installation-pull-secrets\") pod \"image-registry-78d5b497d5-w7n4x\" (UID: \"b474320b-22ac-4a52-896c-b89367de8abb\") " pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:32:48.257858 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.257764 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqglv\" (UniqueName: \"kubernetes.io/projected/657d935b-62ff-43d0-b647-e9212e4c0bef-kube-api-access-hqglv\") pod \"insights-runtime-extractor-vwwnb\" (UID: \"657d935b-62ff-43d0-b647-e9212e4c0bef\") " pod="openshift-insights/insights-runtime-extractor-vwwnb" Jun 09 13:32:48.257858 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.257762 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/657d935b-62ff-43d0-b647-e9212e4c0bef-data-volume\") pod \"insights-runtime-extractor-vwwnb\" (UID: \"657d935b-62ff-43d0-b647-e9212e4c0bef\") " pod="openshift-insights/insights-runtime-extractor-vwwnb" Jun 09 13:32:48.257858 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.257818 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/657d935b-62ff-43d0-b647-e9212e4c0bef-crio-socket\") pod \"insights-runtime-extractor-vwwnb\" (UID: \"657d935b-62ff-43d0-b647-e9212e4c0bef\") " pod="openshift-insights/insights-runtime-extractor-vwwnb" Jun 09 13:32:48.257990 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.257863 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b474320b-22ac-4a52-896c-b89367de8abb-bound-sa-token\") pod \"image-registry-78d5b497d5-w7n4x\" (UID: \"b474320b-22ac-4a52-896c-b89367de8abb\") " pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:32:48.257990 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.257915 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b474320b-22ac-4a52-896c-b89367de8abb-image-registry-private-configuration\") pod \"image-registry-78d5b497d5-w7n4x\" (UID: \"b474320b-22ac-4a52-896c-b89367de8abb\") " pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:32:48.257990 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.257938 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/657d935b-62ff-43d0-b647-e9212e4c0bef-crio-socket\") pod \"insights-runtime-extractor-vwwnb\" (UID: \"657d935b-62ff-43d0-b647-e9212e4c0bef\") " pod="openshift-insights/insights-runtime-extractor-vwwnb" Jun 09 13:32:48.258186 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.258169 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/657d935b-62ff-43d0-b647-e9212e4c0bef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vwwnb\" (UID: \"657d935b-62ff-43d0-b647-e9212e4c0bef\") " pod="openshift-insights/insights-runtime-extractor-vwwnb" Jun 09 13:32:48.259748 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.259729 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/657d935b-62ff-43d0-b647-e9212e4c0bef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwwnb\" (UID: \"657d935b-62ff-43d0-b647-e9212e4c0bef\") " pod="openshift-insights/insights-runtime-extractor-vwwnb" Jun 09 13:32:48.259921 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.259905 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/85779f48-91b4-4298-8e90-f9574514984c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xkvf7\" (UID: \"85779f48-91b4-4298-8e90-f9574514984c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xkvf7" Jun 09 13:32:48.266304 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.266282 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqglv\" (UniqueName: \"kubernetes.io/projected/657d935b-62ff-43d0-b647-e9212e4c0bef-kube-api-access-hqglv\") pod \"insights-runtime-extractor-vwwnb\" (UID: \"657d935b-62ff-43d0-b647-e9212e4c0bef\") " pod="openshift-insights/insights-runtime-extractor-vwwnb" Jun 09 13:32:48.359077 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.359020 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b474320b-22ac-4a52-896c-b89367de8abb-ca-trust-extracted\") pod \"image-registry-78d5b497d5-w7n4x\" (UID: \"b474320b-22ac-4a52-896c-b89367de8abb\") " pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:32:48.359077 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.359052 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgd4m\" (UniqueName: \"kubernetes.io/projected/b474320b-22ac-4a52-896c-b89367de8abb-kube-api-access-xgd4m\") pod \"image-registry-78d5b497d5-w7n4x\" (UID: \"b474320b-22ac-4a52-896c-b89367de8abb\") " pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:32:48.359234 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.359082 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b474320b-22ac-4a52-896c-b89367de8abb-installation-pull-secrets\") pod \"image-registry-78d5b497d5-w7n4x\" (UID: \"b474320b-22ac-4a52-896c-b89367de8abb\") " pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:32:48.359234 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.359138 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b474320b-22ac-4a52-896c-b89367de8abb-bound-sa-token\") pod \"image-registry-78d5b497d5-w7n4x\" (UID: \"b474320b-22ac-4a52-896c-b89367de8abb\") " pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:32:48.359234 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.359176 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b474320b-22ac-4a52-896c-b89367de8abb-image-registry-private-configuration\") pod \"image-registry-78d5b497d5-w7n4x\" (UID: \"b474320b-22ac-4a52-896c-b89367de8abb\") " pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:32:48.359234 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.359215 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b474320b-22ac-4a52-896c-b89367de8abb-registry-tls\") pod \"image-registry-78d5b497d5-w7n4x\" (UID: \"b474320b-22ac-4a52-896c-b89367de8abb\") " pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:32:48.359435 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.359242 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b474320b-22ac-4a52-896c-b89367de8abb-registry-certificates\") pod \"image-registry-78d5b497d5-w7n4x\" (UID: \"b474320b-22ac-4a52-896c-b89367de8abb\") " pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:32:48.359435 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.359268 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b474320b-22ac-4a52-896c-b89367de8abb-trusted-ca\") pod \"image-registry-78d5b497d5-w7n4x\" (UID: \"b474320b-22ac-4a52-896c-b89367de8abb\") " pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:32:48.359537 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.359464 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b474320b-22ac-4a52-896c-b89367de8abb-ca-trust-extracted\") pod \"image-registry-78d5b497d5-w7n4x\" (UID: \"b474320b-22ac-4a52-896c-b89367de8abb\") " pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:32:48.359977 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.359958 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b474320b-22ac-4a52-896c-b89367de8abb-registry-certificates\") pod \"image-registry-78d5b497d5-w7n4x\" (UID: \"b474320b-22ac-4a52-896c-b89367de8abb\") " pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:32:48.360202 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.360179 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b474320b-22ac-4a52-896c-b89367de8abb-trusted-ca\") pod \"image-registry-78d5b497d5-w7n4x\" (UID: \"b474320b-22ac-4a52-896c-b89367de8abb\") " pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:32:48.361468 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.361448 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b474320b-22ac-4a52-896c-b89367de8abb-image-registry-private-configuration\") pod \"image-registry-78d5b497d5-w7n4x\" (UID: \"b474320b-22ac-4a52-896c-b89367de8abb\") " pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:32:48.361468 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.361472 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b474320b-22ac-4a52-896c-b89367de8abb-installation-pull-secrets\") pod \"image-registry-78d5b497d5-w7n4x\" (UID: \"b474320b-22ac-4a52-896c-b89367de8abb\") " pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:32:48.361644 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.361628 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b474320b-22ac-4a52-896c-b89367de8abb-registry-tls\") pod \"image-registry-78d5b497d5-w7n4x\" (UID: \"b474320b-22ac-4a52-896c-b89367de8abb\") " pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:32:48.367287 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.367265 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b474320b-22ac-4a52-896c-b89367de8abb-bound-sa-token\") pod \"image-registry-78d5b497d5-w7n4x\" (UID: \"b474320b-22ac-4a52-896c-b89367de8abb\") " pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:32:48.367642 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.367624 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgd4m\" (UniqueName: \"kubernetes.io/projected/b474320b-22ac-4a52-896c-b89367de8abb-kube-api-access-xgd4m\") pod \"image-registry-78d5b497d5-w7n4x\" (UID: \"b474320b-22ac-4a52-896c-b89367de8abb\") " pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:32:48.419909 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.419892 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vwwnb" Jun 09 13:32:48.509690 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.509446 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4lrrc\"" Jun 09 13:32:48.517765 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.517745 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:32:48.518953 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.518930 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xkvf7" Jun 09 13:32:48.539722 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.539699 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vwwnb"] Jun 09 13:32:48.542413 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:32:48.542382 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod657d935b_62ff_43d0_b647_e9212e4c0bef.slice/crio-07417ed1e9baf6d4b298d733699d4878cfa03017c79ae553b17352c05f137555 WatchSource:0}: Error finding container 07417ed1e9baf6d4b298d733699d4878cfa03017c79ae553b17352c05f137555: Status 404 returned error can't find the container with id 07417ed1e9baf6d4b298d733699d4878cfa03017c79ae553b17352c05f137555 Jun 09 13:32:48.662073 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.662041 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78d5b497d5-w7n4x"] Jun 09 13:32:48.665129 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:32:48.665105 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb474320b_22ac_4a52_896c_b89367de8abb.slice/crio-8f978cb53c57a0794ef9fdc3388e5d84e5a803862e30e8f0e044a954332ab5e6 WatchSource:0}: Error finding container 8f978cb53c57a0794ef9fdc3388e5d84e5a803862e30e8f0e044a954332ab5e6: Status 404 returned error can't find the container with id 8f978cb53c57a0794ef9fdc3388e5d84e5a803862e30e8f0e044a954332ab5e6 Jun 09 13:32:48.674858 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:48.674839 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xkvf7"] Jun 09 13:32:48.679087 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:32:48.679063 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85779f48_91b4_4298_8e90_f9574514984c.slice/crio-c0cfee2eb0facccf33a8dbff4f87daa10e3ed8a681340d779aee97224ea45c7c WatchSource:0}: Error finding container c0cfee2eb0facccf33a8dbff4f87daa10e3ed8a681340d779aee97224ea45c7c: Status 404 returned error can't find the container with id c0cfee2eb0facccf33a8dbff4f87daa10e3ed8a681340d779aee97224ea45c7c Jun 09 13:32:49.040026 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.039991 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" event={"ID":"b474320b-22ac-4a52-896c-b89367de8abb","Type":"ContainerStarted","Data":"502a6c0108249165ea3cf5d0ffaaa0ed9215834f9ac54dc78b05f34ea2e17ddb"} Jun 09 13:32:49.040247 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.040062 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:32:49.040247 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.040087 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" event={"ID":"b474320b-22ac-4a52-896c-b89367de8abb","Type":"ContainerStarted","Data":"8f978cb53c57a0794ef9fdc3388e5d84e5a803862e30e8f0e044a954332ab5e6"} Jun 09 13:32:49.041500 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.041479 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vwwnb" event={"ID":"657d935b-62ff-43d0-b647-e9212e4c0bef","Type":"ContainerStarted","Data":"b9737ba9312565b1b7b1b2ea522b3f138220bb84fc72ad6de335b64083f6f959"} Jun 09 13:32:49.041647 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.041528 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vwwnb" event={"ID":"657d935b-62ff-43d0-b647-e9212e4c0bef","Type":"ContainerStarted","Data":"07417ed1e9baf6d4b298d733699d4878cfa03017c79ae553b17352c05f137555"} Jun 09 13:32:49.042492 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.042477 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:32:49.042593 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.042519 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xkvf7" event={"ID":"85779f48-91b4-4298-8e90-f9574514984c","Type":"ContainerStarted","Data":"c0cfee2eb0facccf33a8dbff4f87daa10e3ed8a681340d779aee97224ea45c7c"} Jun 09 13:32:49.050095 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.050075 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:32:49.061217 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.061176 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" podStartSLOduration=1.061163412 podStartE2EDuration="1.061163412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:32:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:32:49.059335954 +0000 UTC m=+276.214608181" watchObservedRunningTime="2026-06-09 13:32:49.061163412 +0000 UTC m=+276.216435623" Jun 09 13:32:49.064803 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.064785 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/523c3745-7477-40d1-98c3-61849a65a105-ca-trust-extracted\") pod \"523c3745-7477-40d1-98c3-61849a65a105\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " Jun 09 13:32:49.064905 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.064828 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-bound-sa-token\") pod \"523c3745-7477-40d1-98c3-61849a65a105\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " Jun 09 13:32:49.064905 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.064873 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9nk2\" (UniqueName: \"kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-kube-api-access-p9nk2\") pod \"523c3745-7477-40d1-98c3-61849a65a105\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " Jun 09 13:32:49.064905 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.064904 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/523c3745-7477-40d1-98c3-61849a65a105-registry-certificates\") pod \"523c3745-7477-40d1-98c3-61849a65a105\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " Jun 09 13:32:49.065073 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.064919 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/523c3745-7477-40d1-98c3-61849a65a105-trusted-ca\") pod \"523c3745-7477-40d1-98c3-61849a65a105\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " Jun 09 13:32:49.065073 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.064943 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/523c3745-7477-40d1-98c3-61849a65a105-image-registry-private-configuration\") pod \"523c3745-7477-40d1-98c3-61849a65a105\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " Jun 09 13:32:49.065073 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.065038 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/523c3745-7477-40d1-98c3-61849a65a105-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "523c3745-7477-40d1-98c3-61849a65a105" (UID: "523c3745-7477-40d1-98c3-61849a65a105"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:32:49.065376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.065351 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/523c3745-7477-40d1-98c3-61849a65a105-installation-pull-secrets\") pod \"523c3745-7477-40d1-98c3-61849a65a105\" (UID: \"523c3745-7477-40d1-98c3-61849a65a105\") " Jun 09 13:32:49.066805 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.065710 2544 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/523c3745-7477-40d1-98c3-61849a65a105-ca-trust-extracted\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:32:49.066805 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.065348 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/523c3745-7477-40d1-98c3-61849a65a105-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "523c3745-7477-40d1-98c3-61849a65a105" (UID: "523c3745-7477-40d1-98c3-61849a65a105"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:32:49.066805 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.065680 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/523c3745-7477-40d1-98c3-61849a65a105-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "523c3745-7477-40d1-98c3-61849a65a105" (UID: "523c3745-7477-40d1-98c3-61849a65a105"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:32:49.067720 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.067690 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-kube-api-access-p9nk2" (OuterVolumeSpecName: "kube-api-access-p9nk2") pod "523c3745-7477-40d1-98c3-61849a65a105" (UID: "523c3745-7477-40d1-98c3-61849a65a105"). InnerVolumeSpecName "kube-api-access-p9nk2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:32:49.067822 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.067779 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/523c3745-7477-40d1-98c3-61849a65a105-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "523c3745-7477-40d1-98c3-61849a65a105" (UID: "523c3745-7477-40d1-98c3-61849a65a105"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:32:49.068025 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.067985 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/523c3745-7477-40d1-98c3-61849a65a105-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "523c3745-7477-40d1-98c3-61849a65a105" (UID: "523c3745-7477-40d1-98c3-61849a65a105"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:32:49.069134 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.069114 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "523c3745-7477-40d1-98c3-61849a65a105" (UID: "523c3745-7477-40d1-98c3-61849a65a105"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:32:49.166512 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.166485 2544 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-bound-sa-token\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:32:49.166512 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.166513 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9nk2\" (UniqueName: \"kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-kube-api-access-p9nk2\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:32:49.167007 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.166526 2544 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/523c3745-7477-40d1-98c3-61849a65a105-registry-certificates\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:32:49.167007 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.166538 2544 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/523c3745-7477-40d1-98c3-61849a65a105-trusted-ca\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:32:49.167007 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.166563 2544 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/523c3745-7477-40d1-98c3-61849a65a105-image-registry-private-configuration\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:32:49.167007 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:49.166572 2544 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/523c3745-7477-40d1-98c3-61849a65a105-installation-pull-secrets\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:32:50.048194 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:50.048162 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b47cf97bc-4z48b" Jun 09 13:32:50.048380 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:50.048148 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vwwnb" event={"ID":"657d935b-62ff-43d0-b647-e9212e4c0bef","Type":"ContainerStarted","Data":"a9bd65316af7f3ccbe8b29c7099357eb174db7ff95a55f44095b94056af07309"} Jun 09 13:32:50.103675 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:50.103627 2544 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b47cf97bc-4z48b"] Jun 09 13:32:50.109493 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:50.109465 2544 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5b47cf97bc-4z48b"] Jun 09 13:32:50.174300 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:50.174270 2544 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/523c3745-7477-40d1-98c3-61849a65a105-registry-tls\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:32:50.884283 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:50.884256 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bwlq6"] Jun 09 13:32:50.886977 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:50.886957 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bwlq6" Jun 09 13:32:50.889309 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:50.889287 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-5tjnq\"" Jun 09 13:32:50.889394 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:50.889291 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 09 13:32:50.896970 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:50.896950 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bwlq6"] Jun 09 13:32:50.980518 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:50.980488 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f66f3033-7f07-4722-b45f-fff03ce605fa-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-bwlq6\" (UID: \"f66f3033-7f07-4722-b45f-fff03ce605fa\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bwlq6" Jun 09 13:32:51.053337 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:51.053307 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vwwnb" event={"ID":"657d935b-62ff-43d0-b647-e9212e4c0bef","Type":"ContainerStarted","Data":"907c0399e238b409d02547b8d034f872f7a10da017ff9d74a9a7eb2356a7f6e1"} Jun 09 13:32:51.054803 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:51.054774 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xkvf7" event={"ID":"85779f48-91b4-4298-8e90-f9574514984c","Type":"ContainerStarted","Data":"3e08e85bf2cdb5af05898937625f370ded9b179fc88509898e78743129f65fdd"} Jun 09 13:32:51.073911 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:51.073862 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vwwnb" podStartSLOduration=0.831427149 podStartE2EDuration="3.073839266s" totalImagesPullingTime="2.242412117s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:32:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:32:51.073839243 +0000 UTC m=+278.229111456" watchObservedRunningTime="2026-06-09 13:32:51.073839266 +0000 UTC m=+278.229111478" Jun 09 13:32:51.080935 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:51.080910 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f66f3033-7f07-4722-b45f-fff03ce605fa-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-bwlq6\" (UID: \"f66f3033-7f07-4722-b45f-fff03ce605fa\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bwlq6" Jun 09 13:32:51.083382 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:51.083362 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f66f3033-7f07-4722-b45f-fff03ce605fa-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-bwlq6\" (UID: \"f66f3033-7f07-4722-b45f-fff03ce605fa\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bwlq6" Jun 09 13:32:51.094011 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:51.093964 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xkvf7" podStartSLOduration=33.473362902 podStartE2EDuration="35.093950959s" totalImagesPullingTime="1.620588057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:32:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:32:51.092134901 +0000 UTC m=+278.247407110" watchObservedRunningTime="2026-06-09 13:32:51.093950959 +0000 UTC m=+278.249223172" Jun 09 13:32:51.197669 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:51.197605 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bwlq6" Jun 09 13:32:51.276541 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:51.276365 2544 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="523c3745-7477-40d1-98c3-61849a65a105" path="/var/lib/kubelet/pods/523c3745-7477-40d1-98c3-61849a65a105/volumes" Jun 09 13:32:51.321316 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:51.320998 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bwlq6"] Jun 09 13:32:51.324044 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:32:51.324013 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf66f3033_7f07_4722_b45f_fff03ce605fa.slice/crio-7f66879998dd9ca9aac18e1aca8ade5c3cd866624242cf10914c4485f2bb8cc7 WatchSource:0}: Error finding container 7f66879998dd9ca9aac18e1aca8ade5c3cd866624242cf10914c4485f2bb8cc7: Status 404 returned error can't find the container with id 7f66879998dd9ca9aac18e1aca8ade5c3cd866624242cf10914c4485f2bb8cc7 Jun 09 13:32:52.059475 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:52.059429 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bwlq6" event={"ID":"f66f3033-7f07-4722-b45f-fff03ce605fa","Type":"ContainerStarted","Data":"7f66879998dd9ca9aac18e1aca8ade5c3cd866624242cf10914c4485f2bb8cc7"} Jun 09 13:32:53.069717 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:53.069681 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bwlq6" event={"ID":"f66f3033-7f07-4722-b45f-fff03ce605fa","Type":"ContainerStarted","Data":"524cb01c0f7042193e0822508ec45b1f24ccb3c3e5d1b0613af25ed1a5ea1c50"} Jun 09 13:32:53.070107 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:53.069880 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bwlq6" Jun 09 13:32:53.074480 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:53.074457 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bwlq6" Jun 09 13:32:53.085668 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:53.085630 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bwlq6" podStartSLOduration=2.035589045 podStartE2EDuration="3.085615737s" totalImagesPullingTime="1.050026692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:32:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:32:53.084447223 +0000 UTC m=+280.239719434" watchObservedRunningTime="2026-06-09 13:32:53.085615737 +0000 UTC m=+280.240887943" Jun 09 13:32:53.722053 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:32:53.722017 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bf4sh" podUID="d3f532cd-176b-4271-b61c-8169febf3a46" Jun 09 13:32:54.073023 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:54.072998 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bf4sh" Jun 09 13:32:57.122658 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:57.122629 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls\") pod \"dns-default-bf4sh\" (UID: \"d3f532cd-176b-4271-b61c-8169febf3a46\") " pod="openshift-dns/dns-default-bf4sh" Jun 09 13:32:57.124876 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:57.124854 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f532cd-176b-4271-b61c-8169febf3a46-metrics-tls\") pod \"dns-default-bf4sh\" (UID: \"d3f532cd-176b-4271-b61c-8169febf3a46\") " pod="openshift-dns/dns-default-bf4sh" Jun 09 13:32:57.377163 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:57.377085 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zls7s\"" Jun 09 13:32:57.385062 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:57.385045 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bf4sh" Jun 09 13:32:57.505007 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:57.504986 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bf4sh"] Jun 09 13:32:57.507282 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:32:57.507255 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3f532cd_176b_4271_b61c_8169febf3a46.slice/crio-9f42cc2900b51789b1f7c1090da15320621cfffad8434cade1676c723fe4dc1e WatchSource:0}: Error finding container 9f42cc2900b51789b1f7c1090da15320621cfffad8434cade1676c723fe4dc1e: Status 404 returned error can't find the container with id 9f42cc2900b51789b1f7c1090da15320621cfffad8434cade1676c723fe4dc1e Jun 09 13:32:58.086576 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:58.086527 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bf4sh" event={"ID":"d3f532cd-176b-4271-b61c-8169febf3a46","Type":"ContainerStarted","Data":"9f42cc2900b51789b1f7c1090da15320621cfffad8434cade1676c723fe4dc1e"} Jun 09 13:32:59.091070 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.091048 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bf4sh" event={"ID":"d3f532cd-176b-4271-b61c-8169febf3a46","Type":"ContainerStarted","Data":"163e4ac8487039cd1c024edd3429b680fe2c30606262474b4f5c2beb7b3ef041"} Jun 09 13:32:59.300177 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.300147 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-tbk9v"] Jun 09 13:32:59.303255 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.303236 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gdpkn"] Jun 09 13:32:59.303366 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.303349 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tbk9v" Jun 09 13:32:59.306012 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.305987 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 09 13:32:59.306012 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.305999 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-qq528\"" Jun 09 13:32:59.306199 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.306026 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 13:32:59.306199 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.306104 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 09 13:32:59.306199 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.306149 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.309337 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.309319 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 13:32:59.309490 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.309337 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-r79z2\"" Jun 09 13:32:59.309490 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.309337 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 13:32:59.309613 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.309567 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 13:32:59.314988 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.314968 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-tbk9v"] Jun 09 13:32:59.341034 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.341007 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2-metrics-client-ca\") pod \"node-exporter-gdpkn\" (UID: \"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2\") " pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.341034 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.341035 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gdpkn\" (UID: \"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2\") " pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.341174 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.341053 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2-node-exporter-wtmp\") pod \"node-exporter-gdpkn\" (UID: \"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2\") " pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.341174 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.341107 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2-sys\") pod \"node-exporter-gdpkn\" (UID: \"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2\") " pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.341174 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.341143 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9kfm\" (UniqueName: \"kubernetes.io/projected/6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2-kube-api-access-x9kfm\") pod \"node-exporter-gdpkn\" (UID: \"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2\") " pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.341174 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.341170 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f34cca9-2073-4001-8c2c-8fbd09435265-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-tbk9v\" (UID: \"1f34cca9-2073-4001-8c2c-8fbd09435265\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tbk9v" Jun 09 13:32:59.341346 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.341189 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f34cca9-2073-4001-8c2c-8fbd09435265-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-tbk9v\" (UID: \"1f34cca9-2073-4001-8c2c-8fbd09435265\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tbk9v" Jun 09 13:32:59.341346 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.341210 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ssgd\" (UniqueName: \"kubernetes.io/projected/1f34cca9-2073-4001-8c2c-8fbd09435265-kube-api-access-9ssgd\") pod \"openshift-state-metrics-65f78d5c66-tbk9v\" (UID: \"1f34cca9-2073-4001-8c2c-8fbd09435265\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tbk9v" Jun 09 13:32:59.341346 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.341305 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2-node-exporter-textfile\") pod \"node-exporter-gdpkn\" (UID: \"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2\") " pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.341506 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.341354 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2-node-exporter-tls\") pod \"node-exporter-gdpkn\" (UID: \"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2\") " pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.341506 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.341383 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2-node-exporter-accelerators-collector-config\") pod \"node-exporter-gdpkn\" (UID: \"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2\") " pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.341506 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.341426 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2-root\") pod \"node-exporter-gdpkn\" (UID: \"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2\") " pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.341506 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.341459 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f34cca9-2073-4001-8c2c-8fbd09435265-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-tbk9v\" (UID: \"1f34cca9-2073-4001-8c2c-8fbd09435265\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tbk9v" Jun 09 13:32:59.442163 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.442135 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2-node-exporter-textfile\") pod \"node-exporter-gdpkn\" (UID: \"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2\") " pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.442309 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.442178 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2-node-exporter-tls\") pod \"node-exporter-gdpkn\" (UID: \"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2\") " pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.442309 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.442201 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2-node-exporter-accelerators-collector-config\") pod \"node-exporter-gdpkn\" (UID: \"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2\") " pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.442309 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.442236 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2-root\") pod \"node-exporter-gdpkn\" (UID: \"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2\") " pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.442309 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.442261 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f34cca9-2073-4001-8c2c-8fbd09435265-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-tbk9v\" (UID: \"1f34cca9-2073-4001-8c2c-8fbd09435265\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tbk9v" Jun 09 13:32:59.442515 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.442287 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2-metrics-client-ca\") pod \"node-exporter-gdpkn\" (UID: \"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2\") " pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.442515 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.442342 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2-root\") pod \"node-exporter-gdpkn\" (UID: \"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2\") " pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.442515 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.442353 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gdpkn\" (UID: \"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2\") " pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.442515 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.442394 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2-node-exporter-wtmp\") pod \"node-exporter-gdpkn\" (UID: \"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2\") " pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.442515 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.442438 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2-sys\") pod \"node-exporter-gdpkn\" (UID: \"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2\") " pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.442515 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.442466 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9kfm\" (UniqueName: \"kubernetes.io/projected/6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2-kube-api-access-x9kfm\") pod \"node-exporter-gdpkn\" (UID: \"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2\") " pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.442835 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.442517 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f34cca9-2073-4001-8c2c-8fbd09435265-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-tbk9v\" (UID: \"1f34cca9-2073-4001-8c2c-8fbd09435265\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tbk9v" Jun 09 13:32:59.442835 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.442526 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2-node-exporter-textfile\") pod \"node-exporter-gdpkn\" (UID: \"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2\") " pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.442835 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.442573 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f34cca9-2073-4001-8c2c-8fbd09435265-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-tbk9v\" (UID: \"1f34cca9-2073-4001-8c2c-8fbd09435265\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tbk9v" Jun 09 13:32:59.442835 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.442604 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ssgd\" (UniqueName: \"kubernetes.io/projected/1f34cca9-2073-4001-8c2c-8fbd09435265-kube-api-access-9ssgd\") pod \"openshift-state-metrics-65f78d5c66-tbk9v\" (UID: \"1f34cca9-2073-4001-8c2c-8fbd09435265\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tbk9v" Jun 09 13:32:59.442835 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.442614 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2-sys\") pod \"node-exporter-gdpkn\" (UID: \"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2\") " pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.443107 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.442939 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2-node-exporter-accelerators-collector-config\") pod \"node-exporter-gdpkn\" (UID: \"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2\") " pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.443107 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.442984 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2-metrics-client-ca\") pod \"node-exporter-gdpkn\" (UID: \"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2\") " pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.443107 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.443067 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2-node-exporter-wtmp\") pod \"node-exporter-gdpkn\" (UID: \"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2\") " pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.443107 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.443075 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f34cca9-2073-4001-8c2c-8fbd09435265-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-tbk9v\" (UID: \"1f34cca9-2073-4001-8c2c-8fbd09435265\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tbk9v" Jun 09 13:32:59.444759 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.444738 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2-node-exporter-tls\") pod \"node-exporter-gdpkn\" (UID: \"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2\") " pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.445037 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.445019 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gdpkn\" (UID: \"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2\") " pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.445398 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.445382 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f34cca9-2073-4001-8c2c-8fbd09435265-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-tbk9v\" (UID: \"1f34cca9-2073-4001-8c2c-8fbd09435265\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tbk9v" Jun 09 13:32:59.445514 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.445419 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f34cca9-2073-4001-8c2c-8fbd09435265-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-tbk9v\" (UID: \"1f34cca9-2073-4001-8c2c-8fbd09435265\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tbk9v" Jun 09 13:32:59.451397 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.451378 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9kfm\" (UniqueName: \"kubernetes.io/projected/6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2-kube-api-access-x9kfm\") pod \"node-exporter-gdpkn\" (UID: \"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2\") " pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.451397 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.451390 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ssgd\" (UniqueName: \"kubernetes.io/projected/1f34cca9-2073-4001-8c2c-8fbd09435265-kube-api-access-9ssgd\") pod \"openshift-state-metrics-65f78d5c66-tbk9v\" (UID: \"1f34cca9-2073-4001-8c2c-8fbd09435265\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tbk9v" Jun 09 13:32:59.613918 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.613839 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tbk9v" Jun 09 13:32:59.619977 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.619955 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gdpkn" Jun 09 13:32:59.630199 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:32:59.630178 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ebe1f14_02c1_4aad_8a0c_66ba1c4e6bb2.slice/crio-ba7f0905e9403a0b68fc3c763cf5b56ba18b2e70caeca789366ae39d4112454d WatchSource:0}: Error finding container ba7f0905e9403a0b68fc3c763cf5b56ba18b2e70caeca789366ae39d4112454d: Status 404 returned error can't find the container with id ba7f0905e9403a0b68fc3c763cf5b56ba18b2e70caeca789366ae39d4112454d Jun 09 13:32:59.738022 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:32:59.737990 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-tbk9v"] Jun 09 13:32:59.740452 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:32:59.740427 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f34cca9_2073_4001_8c2c_8fbd09435265.slice/crio-d5d064f3011295e5b2b0b6df66b1a29a918678344e32c851290366c1a0b44a4d WatchSource:0}: Error finding container d5d064f3011295e5b2b0b6df66b1a29a918678344e32c851290366c1a0b44a4d: Status 404 returned error can't find the container with id d5d064f3011295e5b2b0b6df66b1a29a918678344e32c851290366c1a0b44a4d Jun 09 13:33:00.098080 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.098035 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bf4sh" event={"ID":"d3f532cd-176b-4271-b61c-8169febf3a46","Type":"ContainerStarted","Data":"4bc0221e4716bbd29d96d0a7d7a0488b4ada4d321ea31e93a38e8141789ef9ef"} Jun 09 13:33:00.098542 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.098104 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bf4sh" Jun 09 13:33:00.099334 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.099302 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gdpkn" event={"ID":"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2","Type":"ContainerStarted","Data":"ba7f0905e9403a0b68fc3c763cf5b56ba18b2e70caeca789366ae39d4112454d"} Jun 09 13:33:00.101268 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.101238 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tbk9v" event={"ID":"1f34cca9-2073-4001-8c2c-8fbd09435265","Type":"ContainerStarted","Data":"9524e21730370ae85aecd639b97641ca7ba56219706991ff22bfeb61d9c1505b"} Jun 09 13:33:00.101391 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.101328 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tbk9v" event={"ID":"1f34cca9-2073-4001-8c2c-8fbd09435265","Type":"ContainerStarted","Data":"ffb0a63fff95ec7972ffe806d650f13755325183c82f6a23d5724dbe5570f24a"} Jun 09 13:33:00.101391 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.101359 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tbk9v" event={"ID":"1f34cca9-2073-4001-8c2c-8fbd09435265","Type":"ContainerStarted","Data":"d5d064f3011295e5b2b0b6df66b1a29a918678344e32c851290366c1a0b44a4d"} Jun 09 13:33:00.116905 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.116857 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bf4sh" podStartSLOduration=251.638468604 podStartE2EDuration="4m13.11683752s" totalImagesPullingTime="1.478368916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:28:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:33:00.116360612 +0000 UTC m=+287.271632855" watchObservedRunningTime="2026-06-09 13:33:00.11683752 +0000 UTC m=+287.272109732" Jun 09 13:33:00.438587 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.438489 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 13:33:00.443531 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.443496 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.446486 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.446225 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 13:33:00.446486 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.446265 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 13:33:00.446486 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.446276 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vknpl\"" Jun 09 13:33:00.446486 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.446228 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 13:33:00.446799 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.446507 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 13:33:00.446799 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.446564 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 13:33:00.446799 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.446611 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 13:33:00.446799 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.446618 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 13:33:00.447009 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.446834 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 13:33:00.447009 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.446872 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 13:33:00.457007 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.456983 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 13:33:00.551662 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.551639 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8e2420ba-627c-4c4d-9018-16db9b8d2938-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.551779 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.551667 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-web-config\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.551779 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.551712 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e2420ba-627c-4c4d-9018-16db9b8d2938-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.551909 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.551791 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-config-volume\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.551909 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.551831 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8e2420ba-627c-4c4d-9018-16db9b8d2938-config-out\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.551909 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.551857 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e2420ba-627c-4c4d-9018-16db9b8d2938-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.551909 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.551895 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.552059 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.551921 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8e2420ba-627c-4c4d-9018-16db9b8d2938-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.552059 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.551975 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.552059 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.552014 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.552173 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.552067 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.552173 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.552083 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.552173 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.552097 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgkdx\" (UniqueName: \"kubernetes.io/projected/8e2420ba-627c-4c4d-9018-16db9b8d2938-kube-api-access-sgkdx\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.653044 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.653010 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8e2420ba-627c-4c4d-9018-16db9b8d2938-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.653200 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.653058 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-web-config\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.653200 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.653116 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e2420ba-627c-4c4d-9018-16db9b8d2938-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.653200 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.653147 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-config-volume\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.653200 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.653174 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8e2420ba-627c-4c4d-9018-16db9b8d2938-config-out\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.653407 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.653280 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e2420ba-627c-4c4d-9018-16db9b8d2938-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.653407 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.653334 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.653407 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.653364 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8e2420ba-627c-4c4d-9018-16db9b8d2938-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.653407 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.653398 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.653635 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.653434 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.653635 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.653486 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.653635 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.653511 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.653635 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.653538 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgkdx\" (UniqueName: \"kubernetes.io/projected/8e2420ba-627c-4c4d-9018-16db9b8d2938-kube-api-access-sgkdx\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.653820 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.653801 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8e2420ba-627c-4c4d-9018-16db9b8d2938-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.654212 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:33:00.653957 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e2420ba-627c-4c4d-9018-16db9b8d2938-alertmanager-trusted-ca-bundle podName:8e2420ba-627c-4c4d-9018-16db9b8d2938 nodeName:}" failed. No retries permitted until 2026-06-09 13:33:01.153936589 +0000 UTC m=+288.309208784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/8e2420ba-627c-4c4d-9018-16db9b8d2938-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "8e2420ba-627c-4c4d-9018-16db9b8d2938") : configmap references non-existent config key: ca-bundle.crt Jun 09 13:33:00.654212 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.654113 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e2420ba-627c-4c4d-9018-16db9b8d2938-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.656540 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.656471 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-web-config\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.657074 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.657033 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-config-volume\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.657648 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.657604 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8e2420ba-627c-4c4d-9018-16db9b8d2938-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.657748 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.657655 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.657748 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.657717 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.658529 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.658507 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.658642 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.658576 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.658950 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.658911 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8e2420ba-627c-4c4d-9018-16db9b8d2938-config-out\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.659404 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.659377 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:00.662698 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:00.662673 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgkdx\" (UniqueName: \"kubernetes.io/projected/8e2420ba-627c-4c4d-9018-16db9b8d2938-kube-api-access-sgkdx\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:01.105857 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:01.105816 2544 generic.go:356] "Generic (PLEG): container finished" podID="6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2" containerID="55f99818a3773dd0c9cf0b0c21b348469a84b6ebd7d90f3c73231e982ff025a8" exitCode=0 Jun 09 13:33:01.106274 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:01.105910 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gdpkn" event={"ID":"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2","Type":"ContainerDied","Data":"55f99818a3773dd0c9cf0b0c21b348469a84b6ebd7d90f3c73231e982ff025a8"} Jun 09 13:33:01.108094 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:01.108065 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tbk9v" event={"ID":"1f34cca9-2073-4001-8c2c-8fbd09435265","Type":"ContainerStarted","Data":"6e08843e59f8f475c7e4eec4686330dbf58a860dbce734001e3174b52b1e8b52"} Jun 09 13:33:01.140888 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:01.140845 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tbk9v" podStartSLOduration=1.20978738 podStartE2EDuration="2.140831787s" totalImagesPullingTime="931.044407ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:33:01.139709207 +0000 UTC m=+288.294981418" watchObservedRunningTime="2026-06-09 13:33:01.140831787 +0000 UTC m=+288.296103999" Jun 09 13:33:01.157875 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:01.157851 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e2420ba-627c-4c4d-9018-16db9b8d2938-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:01.159240 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:01.159211 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e2420ba-627c-4c4d-9018-16db9b8d2938-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:01.355846 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:01.355816 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:33:01.485982 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:01.485961 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 13:33:01.488230 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:33:01.488206 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e2420ba_627c_4c4d_9018_16db9b8d2938.slice/crio-8913279abb20de39d72fa8b52ee52e0b0f0e25260bbdcb865a7d79ef07788a1d WatchSource:0}: Error finding container 8913279abb20de39d72fa8b52ee52e0b0f0e25260bbdcb865a7d79ef07788a1d: Status 404 returned error can't find the container with id 8913279abb20de39d72fa8b52ee52e0b0f0e25260bbdcb865a7d79ef07788a1d Jun 09 13:33:02.113870 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:02.113830 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gdpkn" event={"ID":"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2","Type":"ContainerStarted","Data":"fe3c292cd823b00a30457f04be9a1aa0e0262d4ba0d675d6947590898f2dc0a3"} Jun 09 13:33:02.114298 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:02.113908 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gdpkn" event={"ID":"6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2","Type":"ContainerStarted","Data":"17939a852c533100c835e20ac9878914b58abed9f761d9e60f474997c76ea38e"} Jun 09 13:33:02.114993 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:02.114965 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e2420ba-627c-4c4d-9018-16db9b8d2938","Type":"ContainerStarted","Data":"8913279abb20de39d72fa8b52ee52e0b0f0e25260bbdcb865a7d79ef07788a1d"} Jun 09 13:33:02.135195 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:02.135139 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gdpkn" podStartSLOduration=1.972145211 podStartE2EDuration="3.135121901s" totalImagesPullingTime="1.096623534s" totalInitContainerRuntime="66.353156ms" isStatefulPod=true podCreationTimestamp="2026-06-09 13:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:33:02.132783563 +0000 UTC m=+289.288055776" watchObservedRunningTime="2026-06-09 13:33:02.135121901 +0000 UTC m=+289.290394113" Jun 09 13:33:03.119902 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:03.119866 2544 generic.go:356] "Generic (PLEG): container finished" podID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerID="4f4216f1292d764a4c52d252c0808215aac951ec97ea683fcdfd389d587550d0" exitCode=0 Jun 09 13:33:03.120303 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:03.119948 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e2420ba-627c-4c4d-9018-16db9b8d2938","Type":"ContainerDied","Data":"4f4216f1292d764a4c52d252c0808215aac951ec97ea683fcdfd389d587550d0"} Jun 09 13:33:03.884277 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:33:03.884230 2544 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1979240d_0c56_402a_b99f_bb143e577881.slice/crio-conmon-25a9822a404ef87f19ac10fee0b0fa105338dec28c7d42d35ae497ba11b065ce.scope\": RecentStats: unable to find data in memory cache]" Jun 09 13:33:04.124654 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.124574 2544 generic.go:356] "Generic (PLEG): container finished" podID="1979240d-0c56-402a-b99f-bb143e577881" containerID="25a9822a404ef87f19ac10fee0b0fa105338dec28c7d42d35ae497ba11b065ce" exitCode=255 Jun 09 13:33:04.124654 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.124642 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-577f4fcb56-tf8th" event={"ID":"1979240d-0c56-402a-b99f-bb143e577881","Type":"ContainerDied","Data":"25a9822a404ef87f19ac10fee0b0fa105338dec28c7d42d35ae497ba11b065ce"} Jun 09 13:33:04.125099 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.124686 2544 scope.go:117] "RemoveContainer" containerID="629adab61d2b2de26535f82bf0984c523195de6c6b3a22acefd85e51c862cafd" Jun 09 13:33:04.131511 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.131492 2544 scope.go:117] "RemoveContainer" containerID="25a9822a404ef87f19ac10fee0b0fa105338dec28c7d42d35ae497ba11b065ce" Jun 09 13:33:04.131722 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:33:04.131703 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-577f4fcb56-tf8th_open-cluster-management-agent-addon(1979240d-0c56-402a-b99f-bb143e577881)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-577f4fcb56-tf8th" podUID="1979240d-0c56-402a-b99f-bb143e577881" Jun 09 13:33:04.506558 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.506516 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6595769959-dfbfg"] Jun 09 13:33:04.511984 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.510593 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" Jun 09 13:33:04.514987 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.514828 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 09 13:33:04.515122 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.515104 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 09 13:33:04.515190 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.515121 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 09 13:33:04.515237 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.515186 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 09 13:33:04.515237 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.515121 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 09 13:33:04.515332 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.515265 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9h7jq\"" Jun 09 13:33:04.520036 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.520016 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 09 13:33:04.526566 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.526531 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6595769959-dfbfg"] Jun 09 13:33:04.583524 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.583502 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47c59023-c371-4b24-bead-1aa73b6c2365-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6595769959-dfbfg\" (UID: \"47c59023-c371-4b24-bead-1aa73b6c2365\") " pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" Jun 09 13:33:04.583629 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.583531 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbz48\" (UniqueName: \"kubernetes.io/projected/47c59023-c371-4b24-bead-1aa73b6c2365-kube-api-access-lbz48\") pod \"telemeter-client-6595769959-dfbfg\" (UID: \"47c59023-c371-4b24-bead-1aa73b6c2365\") " pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" Jun 09 13:33:04.583629 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.583567 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47c59023-c371-4b24-bead-1aa73b6c2365-serving-certs-ca-bundle\") pod \"telemeter-client-6595769959-dfbfg\" (UID: \"47c59023-c371-4b24-bead-1aa73b6c2365\") " pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" Jun 09 13:33:04.583629 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.583603 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/47c59023-c371-4b24-bead-1aa73b6c2365-secret-telemeter-client\") pod \"telemeter-client-6595769959-dfbfg\" (UID: \"47c59023-c371-4b24-bead-1aa73b6c2365\") " pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" Jun 09 13:33:04.583731 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.583672 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47c59023-c371-4b24-bead-1aa73b6c2365-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6595769959-dfbfg\" (UID: \"47c59023-c371-4b24-bead-1aa73b6c2365\") " pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" Jun 09 13:33:04.583765 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.583747 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/47c59023-c371-4b24-bead-1aa73b6c2365-federate-client-tls\") pod \"telemeter-client-6595769959-dfbfg\" (UID: \"47c59023-c371-4b24-bead-1aa73b6c2365\") " pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" Jun 09 13:33:04.583801 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.583769 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47c59023-c371-4b24-bead-1aa73b6c2365-metrics-client-ca\") pod \"telemeter-client-6595769959-dfbfg\" (UID: \"47c59023-c371-4b24-bead-1aa73b6c2365\") " pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" Jun 09 13:33:04.583801 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.583786 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/47c59023-c371-4b24-bead-1aa73b6c2365-telemeter-client-tls\") pod \"telemeter-client-6595769959-dfbfg\" (UID: \"47c59023-c371-4b24-bead-1aa73b6c2365\") " pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" Jun 09 13:33:04.684993 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.684967 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47c59023-c371-4b24-bead-1aa73b6c2365-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6595769959-dfbfg\" (UID: \"47c59023-c371-4b24-bead-1aa73b6c2365\") " pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" Jun 09 13:33:04.685086 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.684999 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbz48\" (UniqueName: \"kubernetes.io/projected/47c59023-c371-4b24-bead-1aa73b6c2365-kube-api-access-lbz48\") pod \"telemeter-client-6595769959-dfbfg\" (UID: \"47c59023-c371-4b24-bead-1aa73b6c2365\") " pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" Jun 09 13:33:04.685086 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.685021 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47c59023-c371-4b24-bead-1aa73b6c2365-serving-certs-ca-bundle\") pod \"telemeter-client-6595769959-dfbfg\" (UID: \"47c59023-c371-4b24-bead-1aa73b6c2365\") " pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" Jun 09 13:33:04.685086 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.685060 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/47c59023-c371-4b24-bead-1aa73b6c2365-secret-telemeter-client\") pod \"telemeter-client-6595769959-dfbfg\" (UID: \"47c59023-c371-4b24-bead-1aa73b6c2365\") " pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" Jun 09 13:33:04.685252 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.685093 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47c59023-c371-4b24-bead-1aa73b6c2365-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6595769959-dfbfg\" (UID: \"47c59023-c371-4b24-bead-1aa73b6c2365\") " pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" Jun 09 13:33:04.685252 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.685191 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/47c59023-c371-4b24-bead-1aa73b6c2365-federate-client-tls\") pod \"telemeter-client-6595769959-dfbfg\" (UID: \"47c59023-c371-4b24-bead-1aa73b6c2365\") " pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" Jun 09 13:33:04.685252 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.685220 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47c59023-c371-4b24-bead-1aa73b6c2365-metrics-client-ca\") pod \"telemeter-client-6595769959-dfbfg\" (UID: \"47c59023-c371-4b24-bead-1aa73b6c2365\") " pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" Jun 09 13:33:04.685412 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.685358 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/47c59023-c371-4b24-bead-1aa73b6c2365-telemeter-client-tls\") pod \"telemeter-client-6595769959-dfbfg\" (UID: \"47c59023-c371-4b24-bead-1aa73b6c2365\") " pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" Jun 09 13:33:04.685868 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.685833 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47c59023-c371-4b24-bead-1aa73b6c2365-serving-certs-ca-bundle\") pod \"telemeter-client-6595769959-dfbfg\" (UID: \"47c59023-c371-4b24-bead-1aa73b6c2365\") " pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" Jun 09 13:33:04.685958 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.685898 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47c59023-c371-4b24-bead-1aa73b6c2365-metrics-client-ca\") pod \"telemeter-client-6595769959-dfbfg\" (UID: \"47c59023-c371-4b24-bead-1aa73b6c2365\") " pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" Jun 09 13:33:04.686022 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.685968 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47c59023-c371-4b24-bead-1aa73b6c2365-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6595769959-dfbfg\" (UID: \"47c59023-c371-4b24-bead-1aa73b6c2365\") " pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" Jun 09 13:33:04.687669 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.687622 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47c59023-c371-4b24-bead-1aa73b6c2365-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6595769959-dfbfg\" (UID: \"47c59023-c371-4b24-bead-1aa73b6c2365\") " pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" Jun 09 13:33:04.687758 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.687700 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/47c59023-c371-4b24-bead-1aa73b6c2365-telemeter-client-tls\") pod \"telemeter-client-6595769959-dfbfg\" (UID: \"47c59023-c371-4b24-bead-1aa73b6c2365\") " pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" Jun 09 13:33:04.687840 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.687822 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/47c59023-c371-4b24-bead-1aa73b6c2365-federate-client-tls\") pod \"telemeter-client-6595769959-dfbfg\" (UID: \"47c59023-c371-4b24-bead-1aa73b6c2365\") " pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" Jun 09 13:33:04.687877 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.687862 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/47c59023-c371-4b24-bead-1aa73b6c2365-secret-telemeter-client\") pod \"telemeter-client-6595769959-dfbfg\" (UID: \"47c59023-c371-4b24-bead-1aa73b6c2365\") " pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" Jun 09 13:33:04.696916 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.696897 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbz48\" (UniqueName: \"kubernetes.io/projected/47c59023-c371-4b24-bead-1aa73b6c2365-kube-api-access-lbz48\") pod \"telemeter-client-6595769959-dfbfg\" (UID: \"47c59023-c371-4b24-bead-1aa73b6c2365\") " pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" Jun 09 13:33:04.834847 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.834820 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" Jun 09 13:33:04.962520 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:04.962490 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6595769959-dfbfg"] Jun 09 13:33:04.966014 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:33:04.965985 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47c59023_c371_4b24_bead_1aa73b6c2365.slice/crio-0fb58998e21308179bb15dfd2d31ba78afa7d8fd2e7633fdb67245ce53a60c74 WatchSource:0}: Error finding container 0fb58998e21308179bb15dfd2d31ba78afa7d8fd2e7633fdb67245ce53a60c74: Status 404 returned error can't find the container with id 0fb58998e21308179bb15dfd2d31ba78afa7d8fd2e7633fdb67245ce53a60c74 Jun 09 13:33:05.135355 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.135274 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e2420ba-627c-4c4d-9018-16db9b8d2938","Type":"ContainerStarted","Data":"fb9b05bb8039e63ad40772d3681c66e5fa805ff5a6e952056b3203a3447b9541"} Jun 09 13:33:05.135355 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.135352 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e2420ba-627c-4c4d-9018-16db9b8d2938","Type":"ContainerStarted","Data":"ad29fa1b06a3ef2c427c625ad3c0f700b704f22466794a3d7a2b5054717702ef"} Jun 09 13:33:05.135797 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.135385 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e2420ba-627c-4c4d-9018-16db9b8d2938","Type":"ContainerStarted","Data":"28539d027d6635950d5bb039f45a7c848c57b53355987f1761ecae015ca65deb"} Jun 09 13:33:05.135797 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.135422 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e2420ba-627c-4c4d-9018-16db9b8d2938","Type":"ContainerStarted","Data":"60698c3b007118750ba4c7f9243c772f83256f6d112bf7f1a4e0c83663466687"} Jun 09 13:33:05.135797 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.135457 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e2420ba-627c-4c4d-9018-16db9b8d2938","Type":"ContainerStarted","Data":"9b43d6a84f89c6ebc41fffc9f1cdff4a276ca4271565d575d7a4028f6ea51f6d"} Jun 09 13:33:05.136447 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.136422 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" event={"ID":"47c59023-c371-4b24-bead-1aa73b6c2365","Type":"ContainerStarted","Data":"0fb58998e21308179bb15dfd2d31ba78afa7d8fd2e7633fdb67245ce53a60c74"} Jun 09 13:33:05.271124 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:33:05.271090 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-wkwcl" podUID="a7641f4a-8124-4524-ab0a-34dfebafe183" Jun 09 13:33:05.551297 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.551266 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 13:33:05.555188 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.555168 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.557945 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.557753 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 13:33:05.557945 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.557852 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-nwtmm\"" Jun 09 13:33:05.558135 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.557958 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 13:33:05.558135 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.558072 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 13:33:05.558236 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.558141 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 13:33:05.558315 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.558299 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 13:33:05.558380 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.558345 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 13:33:05.558805 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.558789 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 13:33:05.558900 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.558805 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-d9ieli5ffn8cd\"" Jun 09 13:33:05.558900 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.558829 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 13:33:05.559140 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.559123 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 13:33:05.560139 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.560120 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 13:33:05.560597 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.560387 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 13:33:05.560597 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.560440 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 13:33:05.560597 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.560440 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 13:33:05.563051 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.562872 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 13:33:05.565178 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.565157 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 13:33:05.570376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.570358 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 13:33:05.593355 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.593332 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.593440 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.593366 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.593440 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.593392 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/308c72de-4700-42d8-967f-4a6da4d570dd-config-out\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.593440 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.593413 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/308c72de-4700-42d8-967f-4a6da4d570dd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.593591 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.593452 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.593591 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.593484 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.593591 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.593529 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-config\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.593729 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.593582 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.593729 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.593613 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.593729 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.593631 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.593729 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.593654 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.593729 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.593698 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.593946 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.593755 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.593946 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.593778 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.593946 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.593792 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.593946 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.593808 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzr6k\" (UniqueName: \"kubernetes.io/projected/308c72de-4700-42d8-967f-4a6da4d570dd-kube-api-access-xzr6k\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.593946 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.593843 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.593946 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.593888 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.593946 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.593912 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.593946 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.593943 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-web-config\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.694325 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.694270 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.694325 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.694299 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.694325 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.694314 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.694521 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.694329 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzr6k\" (UniqueName: \"kubernetes.io/projected/308c72de-4700-42d8-967f-4a6da4d570dd-kube-api-access-xzr6k\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.694521 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.694346 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.694521 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.694400 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.694521 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.694418 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.694521 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.694441 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-web-config\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.694521 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.694473 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.694521 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.694519 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.694891 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.694571 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/308c72de-4700-42d8-967f-4a6da4d570dd-config-out\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.694891 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.694608 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/308c72de-4700-42d8-967f-4a6da4d570dd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.694891 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.694631 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.694891 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.694660 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.694891 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.694690 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-config\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.694891 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.694737 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.694891 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.694769 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.694891 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.694792 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.694891 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.694807 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.694891 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.694824 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.694891 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.694880 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.695363 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.695089 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.695363 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.695196 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.696775 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.696434 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.696775 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.696480 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.699655 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.697650 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.699655 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.698240 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.699655 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.699053 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.699655 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.699430 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.699655 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.699583 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.699655 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.699616 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/308c72de-4700-42d8-967f-4a6da4d570dd-config-out\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.699999 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.699788 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.699999 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.699848 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/308c72de-4700-42d8-967f-4a6da4d570dd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.699999 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.699890 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-config\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.700645 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.700621 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.701265 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.701242 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-web-config\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.701381 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.701253 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.701785 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.701766 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.701878 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.701772 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.703542 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.703526 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzr6k\" (UniqueName: \"kubernetes.io/projected/308c72de-4700-42d8-967f-4a6da4d570dd-kube-api-access-xzr6k\") pod \"prometheus-k8s-0\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:05.867181 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:05.867156 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:06.009831 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:06.009801 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 13:33:06.013222 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:33:06.013198 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod308c72de_4700_42d8_967f_4a6da4d570dd.slice/crio-54247c1dc18d7d1eda2458ef99d8855c06b281cb61650fb22095345616d7108d WatchSource:0}: Error finding container 54247c1dc18d7d1eda2458ef99d8855c06b281cb61650fb22095345616d7108d: Status 404 returned error can't find the container with id 54247c1dc18d7d1eda2458ef99d8855c06b281cb61650fb22095345616d7108d Jun 09 13:33:06.145092 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:06.145063 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e2420ba-627c-4c4d-9018-16db9b8d2938","Type":"ContainerStarted","Data":"c6388d5ab8aeb43bdc885f8166e4d2063ae04fb74a68392d94ec30ee113e2169"} Jun 09 13:33:06.146499 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:06.146476 2544 generic.go:356] "Generic (PLEG): container finished" podID="308c72de-4700-42d8-967f-4a6da4d570dd" containerID="6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7" exitCode=0 Jun 09 13:33:06.146608 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:06.146512 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"308c72de-4700-42d8-967f-4a6da4d570dd","Type":"ContainerDied","Data":"6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7"} Jun 09 13:33:06.146608 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:06.146575 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"308c72de-4700-42d8-967f-4a6da4d570dd","Type":"ContainerStarted","Data":"54247c1dc18d7d1eda2458ef99d8855c06b281cb61650fb22095345616d7108d"} Jun 09 13:33:06.173485 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:06.173444 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.145740381 podStartE2EDuration="6.173429754s" totalImagesPullingTime="3.00934422s" totalInitContainerRuntime="18.345153ms" isStatefulPod=false podCreationTimestamp="2026-06-09 13:33:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:33:06.171764364 +0000 UTC m=+293.327036578" watchObservedRunningTime="2026-06-09 13:33:06.173429754 +0000 UTC m=+293.328701966" Jun 09 13:33:08.522853 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:08.522814 2544 patch_prober.go:28] interesting pod/image-registry-78d5b497d5-w7n4x container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 13:33:08.523282 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:08.522879 2544 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" podUID="b474320b-22ac-4a52-896c-b89367de8abb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 13:33:10.027665 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:10.027625 2544 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-577f4fcb56-tf8th" Jun 09 13:33:10.033710 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:10.033693 2544 scope.go:117] "RemoveContainer" containerID="25a9822a404ef87f19ac10fee0b0fa105338dec28c7d42d35ae497ba11b065ce" Jun 09 13:33:10.033863 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:33:10.033844 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-577f4fcb56-tf8th_open-cluster-management-agent-addon(1979240d-0c56-402a-b99f-bb143e577881)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-577f4fcb56-tf8th" podUID="1979240d-0c56-402a-b99f-bb143e577881" Jun 09 13:33:10.052795 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:10.052766 2544 patch_prober.go:28] interesting pod/image-registry-78d5b497d5-w7n4x container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 13:33:10.052905 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:10.052803 2544 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" podUID="b474320b-22ac-4a52-896c-b89367de8abb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 13:33:10.110456 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:10.110427 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bf4sh" Jun 09 13:33:10.168836 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:10.168804 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"308c72de-4700-42d8-967f-4a6da4d570dd","Type":"ContainerStarted","Data":"dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b"} Jun 09 13:33:10.168998 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:10.168884 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"308c72de-4700-42d8-967f-4a6da4d570dd","Type":"ContainerStarted","Data":"7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade"} Jun 09 13:33:10.171296 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:10.171266 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" event={"ID":"47c59023-c371-4b24-bead-1aa73b6c2365","Type":"ContainerStarted","Data":"177eb6464dd9360d10b7200a5de6bc11b1ab4c535cd647ac3efeeced12c98ccf"} Jun 09 13:33:10.171442 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:10.171324 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" event={"ID":"47c59023-c371-4b24-bead-1aa73b6c2365","Type":"ContainerStarted","Data":"ab343b02600bfae0754c9776f4456e43e6ac717e50efaff5fe0a093b45d76116"} Jun 09 13:33:10.171442 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:10.171354 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" event={"ID":"47c59023-c371-4b24-bead-1aa73b6c2365","Type":"ContainerStarted","Data":"129fa879c05104833ea4ed004f0a0027487a19467e4729f8a5cc375c8b2220c0"} Jun 09 13:33:10.193714 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:10.193667 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6595769959-dfbfg" podStartSLOduration=1.783450861 podStartE2EDuration="6.193649919s" totalImagesPullingTime="4.410199058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:33:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:33:10.191473855 +0000 UTC m=+297.346746089" watchObservedRunningTime="2026-06-09 13:33:10.193649919 +0000 UTC m=+297.348922131" Jun 09 13:33:12.187848 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:12.187824 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"308c72de-4700-42d8-967f-4a6da4d570dd","Type":"ContainerStarted","Data":"cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535"} Jun 09 13:33:12.188104 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:12.187905 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"308c72de-4700-42d8-967f-4a6da4d570dd","Type":"ContainerStarted","Data":"1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92"} Jun 09 13:33:12.188104 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:12.187929 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"308c72de-4700-42d8-967f-4a6da4d570dd","Type":"ContainerStarted","Data":"fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105"} Jun 09 13:33:13.194905 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:13.194869 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"308c72de-4700-42d8-967f-4a6da4d570dd","Type":"ContainerStarted","Data":"c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306"} Jun 09 13:33:13.227617 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:13.227504 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.545636715 podStartE2EDuration="8.227484451s" totalImagesPullingTime="5.663262415s" totalInitContainerRuntime="18.585321ms" isStatefulPod=false podCreationTimestamp="2026-06-09 13:33:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:33:13.226070589 +0000 UTC m=+300.381342802" watchObservedRunningTime="2026-06-09 13:33:13.227484451 +0000 UTC m=+300.382756667" Jun 09 13:33:13.242064 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:13.242040 2544 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 13:33:15.868145 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:15.868105 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:33:17.276176 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:17.276140 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:33:18.522171 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:18.522145 2544 patch_prober.go:28] interesting pod/image-registry-78d5b497d5-w7n4x container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 13:33:18.522540 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:18.522185 2544 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" podUID="b474320b-22ac-4a52-896c-b89367de8abb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 13:33:20.052793 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:20.052767 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-78d5b497d5-w7n4x" Jun 09 13:33:22.277026 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:22.277000 2544 scope.go:117] "RemoveContainer" containerID="25a9822a404ef87f19ac10fee0b0fa105338dec28c7d42d35ae497ba11b065ce" Jun 09 13:33:23.236168 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:33:23.236132 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-577f4fcb56-tf8th" event={"ID":"1979240d-0c56-402a-b99f-bb143e577881","Type":"ContainerStarted","Data":"ae191ade51eb2d92daa8b56ab578f3a051a9e6f4a1f19390cdb14c4be8fe9f0a"} Jun 09 13:34:05.867411 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:05.867320 2544 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:05.886280 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:05.886252 2544 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:06.422321 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:06.422290 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:19.657630 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:19.657599 2544 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 13:34:19.658134 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:19.657880 2544 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerName="alertmanager" containerID="cri-o://9b43d6a84f89c6ebc41fffc9f1cdff4a276ca4271565d575d7a4028f6ea51f6d" gracePeriod=120 Jun 09 13:34:19.658134 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:19.657955 2544 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerName="kube-rbac-proxy-metric" containerID="cri-o://fb9b05bb8039e63ad40772d3681c66e5fa805ff5a6e952056b3203a3447b9541" gracePeriod=120 Jun 09 13:34:19.658134 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:19.657982 2544 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerName="kube-rbac-proxy-web" containerID="cri-o://28539d027d6635950d5bb039f45a7c848c57b53355987f1761ecae015ca65deb" gracePeriod=120 Jun 09 13:34:19.658134 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:19.658009 2544 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerName="prom-label-proxy" containerID="cri-o://c6388d5ab8aeb43bdc885f8166e4d2063ae04fb74a68392d94ec30ee113e2169" gracePeriod=120 Jun 09 13:34:19.658134 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:19.658035 2544 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerName="config-reloader" containerID="cri-o://60698c3b007118750ba4c7f9243c772f83256f6d112bf7f1a4e0c83663466687" gracePeriod=120 Jun 09 13:34:19.658396 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:19.658152 2544 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerName="kube-rbac-proxy" containerID="cri-o://ad29fa1b06a3ef2c427c625ad3c0f700b704f22466794a3d7a2b5054717702ef" gracePeriod=120 Jun 09 13:34:20.460521 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:20.460490 2544 generic.go:356] "Generic (PLEG): container finished" podID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerID="c6388d5ab8aeb43bdc885f8166e4d2063ae04fb74a68392d94ec30ee113e2169" exitCode=0 Jun 09 13:34:20.460521 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:20.460515 2544 generic.go:356] "Generic (PLEG): container finished" podID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerID="ad29fa1b06a3ef2c427c625ad3c0f700b704f22466794a3d7a2b5054717702ef" exitCode=0 Jun 09 13:34:20.460521 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:20.460524 2544 generic.go:356] "Generic (PLEG): container finished" podID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerID="60698c3b007118750ba4c7f9243c772f83256f6d112bf7f1a4e0c83663466687" exitCode=0 Jun 09 13:34:20.460521 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:20.460534 2544 generic.go:356] "Generic (PLEG): container finished" podID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerID="9b43d6a84f89c6ebc41fffc9f1cdff4a276ca4271565d575d7a4028f6ea51f6d" exitCode=0 Jun 09 13:34:20.460808 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:20.460586 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e2420ba-627c-4c4d-9018-16db9b8d2938","Type":"ContainerDied","Data":"c6388d5ab8aeb43bdc885f8166e4d2063ae04fb74a68392d94ec30ee113e2169"} Jun 09 13:34:20.460808 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:20.460647 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e2420ba-627c-4c4d-9018-16db9b8d2938","Type":"ContainerDied","Data":"ad29fa1b06a3ef2c427c625ad3c0f700b704f22466794a3d7a2b5054717702ef"} Jun 09 13:34:20.460808 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:20.460676 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e2420ba-627c-4c4d-9018-16db9b8d2938","Type":"ContainerDied","Data":"60698c3b007118750ba4c7f9243c772f83256f6d112bf7f1a4e0c83663466687"} Jun 09 13:34:20.460808 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:20.460702 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e2420ba-627c-4c4d-9018-16db9b8d2938","Type":"ContainerDied","Data":"9b43d6a84f89c6ebc41fffc9f1cdff4a276ca4271565d575d7a4028f6ea51f6d"} Jun 09 13:34:20.900483 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:20.900459 2544 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.055703 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.055674 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8e2420ba-627c-4c4d-9018-16db9b8d2938\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " Jun 09 13:34:21.055874 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.055731 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8e2420ba-627c-4c4d-9018-16db9b8d2938-config-out\") pod \"8e2420ba-627c-4c4d-9018-16db9b8d2938\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " Jun 09 13:34:21.055874 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.055757 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-web-config\") pod \"8e2420ba-627c-4c4d-9018-16db9b8d2938\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " Jun 09 13:34:21.055874 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.055779 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8e2420ba-627c-4c4d-9018-16db9b8d2938-alertmanager-main-db\") pod \"8e2420ba-627c-4c4d-9018-16db9b8d2938\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " Jun 09 13:34:21.055874 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.055796 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-secret-alertmanager-kube-rbac-proxy\") pod \"8e2420ba-627c-4c4d-9018-16db9b8d2938\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " Jun 09 13:34:21.055874 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.055819 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgkdx\" (UniqueName: \"kubernetes.io/projected/8e2420ba-627c-4c4d-9018-16db9b8d2938-kube-api-access-sgkdx\") pod \"8e2420ba-627c-4c4d-9018-16db9b8d2938\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " Jun 09 13:34:21.055874 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.055843 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8e2420ba-627c-4c4d-9018-16db9b8d2938-tls-assets\") pod \"8e2420ba-627c-4c4d-9018-16db9b8d2938\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " Jun 09 13:34:21.055874 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.055876 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e2420ba-627c-4c4d-9018-16db9b8d2938-alertmanager-trusted-ca-bundle\") pod \"8e2420ba-627c-4c4d-9018-16db9b8d2938\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " Jun 09 13:34:21.056233 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.055906 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e2420ba-627c-4c4d-9018-16db9b8d2938-metrics-client-ca\") pod \"8e2420ba-627c-4c4d-9018-16db9b8d2938\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " Jun 09 13:34:21.056233 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.055928 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-config-volume\") pod \"8e2420ba-627c-4c4d-9018-16db9b8d2938\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " Jun 09 13:34:21.056233 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.055951 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-secret-alertmanager-kube-rbac-proxy-web\") pod \"8e2420ba-627c-4c4d-9018-16db9b8d2938\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " Jun 09 13:34:21.056233 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.055975 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-secret-alertmanager-main-tls\") pod \"8e2420ba-627c-4c4d-9018-16db9b8d2938\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " Jun 09 13:34:21.056233 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.055993 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-cluster-tls-config\") pod \"8e2420ba-627c-4c4d-9018-16db9b8d2938\" (UID: \"8e2420ba-627c-4c4d-9018-16db9b8d2938\") " Jun 09 13:34:21.056513 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.056485 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e2420ba-627c-4c4d-9018-16db9b8d2938-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8e2420ba-627c-4c4d-9018-16db9b8d2938" (UID: "8e2420ba-627c-4c4d-9018-16db9b8d2938"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:34:21.056889 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.056853 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e2420ba-627c-4c4d-9018-16db9b8d2938-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8e2420ba-627c-4c4d-9018-16db9b8d2938" (UID: "8e2420ba-627c-4c4d-9018-16db9b8d2938"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:34:21.057296 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.057270 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e2420ba-627c-4c4d-9018-16db9b8d2938-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8e2420ba-627c-4c4d-9018-16db9b8d2938" (UID: "8e2420ba-627c-4c4d-9018-16db9b8d2938"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:34:21.058645 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.058610 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e2420ba-627c-4c4d-9018-16db9b8d2938-config-out" (OuterVolumeSpecName: "config-out") pod "8e2420ba-627c-4c4d-9018-16db9b8d2938" (UID: "8e2420ba-627c-4c4d-9018-16db9b8d2938"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:34:21.058953 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.058913 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e2420ba-627c-4c4d-9018-16db9b8d2938-kube-api-access-sgkdx" (OuterVolumeSpecName: "kube-api-access-sgkdx") pod "8e2420ba-627c-4c4d-9018-16db9b8d2938" (UID: "8e2420ba-627c-4c4d-9018-16db9b8d2938"). InnerVolumeSpecName "kube-api-access-sgkdx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:34:21.059215 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.059190 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e2420ba-627c-4c4d-9018-16db9b8d2938-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8e2420ba-627c-4c4d-9018-16db9b8d2938" (UID: "8e2420ba-627c-4c4d-9018-16db9b8d2938"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:34:21.060002 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.059970 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8e2420ba-627c-4c4d-9018-16db9b8d2938" (UID: "8e2420ba-627c-4c4d-9018-16db9b8d2938"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:34:21.060103 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.060078 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8e2420ba-627c-4c4d-9018-16db9b8d2938" (UID: "8e2420ba-627c-4c4d-9018-16db9b8d2938"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:34:21.060174 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.060104 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8e2420ba-627c-4c4d-9018-16db9b8d2938" (UID: "8e2420ba-627c-4c4d-9018-16db9b8d2938"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:34:21.060370 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.060345 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-config-volume" (OuterVolumeSpecName: "config-volume") pod "8e2420ba-627c-4c4d-9018-16db9b8d2938" (UID: "8e2420ba-627c-4c4d-9018-16db9b8d2938"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:34:21.060703 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.060678 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8e2420ba-627c-4c4d-9018-16db9b8d2938" (UID: "8e2420ba-627c-4c4d-9018-16db9b8d2938"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:34:21.063315 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.063200 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8e2420ba-627c-4c4d-9018-16db9b8d2938" (UID: "8e2420ba-627c-4c4d-9018-16db9b8d2938"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:34:21.069325 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.069305 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-web-config" (OuterVolumeSpecName: "web-config") pod "8e2420ba-627c-4c4d-9018-16db9b8d2938" (UID: "8e2420ba-627c-4c4d-9018-16db9b8d2938"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:34:21.157117 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.157078 2544 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:21.157117 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.157111 2544 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8e2420ba-627c-4c4d-9018-16db9b8d2938-config-out\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:21.157117 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.157122 2544 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-web-config\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:21.157337 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.157131 2544 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8e2420ba-627c-4c4d-9018-16db9b8d2938-alertmanager-main-db\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:21.157337 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.157142 2544 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:21.157337 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.157151 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgkdx\" (UniqueName: \"kubernetes.io/projected/8e2420ba-627c-4c4d-9018-16db9b8d2938-kube-api-access-sgkdx\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:21.157337 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.157161 2544 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8e2420ba-627c-4c4d-9018-16db9b8d2938-tls-assets\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:21.157337 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.157169 2544 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e2420ba-627c-4c4d-9018-16db9b8d2938-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:21.157337 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.157177 2544 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e2420ba-627c-4c4d-9018-16db9b8d2938-metrics-client-ca\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:21.157337 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.157185 2544 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-config-volume\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:21.157337 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.157194 2544 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:21.157337 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.157202 2544 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-secret-alertmanager-main-tls\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:21.157337 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.157210 2544 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8e2420ba-627c-4c4d-9018-16db9b8d2938-cluster-tls-config\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:21.469493 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.469417 2544 generic.go:356] "Generic (PLEG): container finished" podID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerID="fb9b05bb8039e63ad40772d3681c66e5fa805ff5a6e952056b3203a3447b9541" exitCode=0 Jun 09 13:34:21.469493 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.469437 2544 generic.go:356] "Generic (PLEG): container finished" podID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerID="28539d027d6635950d5bb039f45a7c848c57b53355987f1761ecae015ca65deb" exitCode=0 Jun 09 13:34:21.469691 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.469501 2544 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.469691 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.469495 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e2420ba-627c-4c4d-9018-16db9b8d2938","Type":"ContainerDied","Data":"fb9b05bb8039e63ad40772d3681c66e5fa805ff5a6e952056b3203a3447b9541"} Jun 09 13:34:21.474956 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.469884 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e2420ba-627c-4c4d-9018-16db9b8d2938","Type":"ContainerDied","Data":"28539d027d6635950d5bb039f45a7c848c57b53355987f1761ecae015ca65deb"} Jun 09 13:34:21.474956 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.470007 2544 scope.go:117] "RemoveContainer" containerID="c6388d5ab8aeb43bdc885f8166e4d2063ae04fb74a68392d94ec30ee113e2169" Jun 09 13:34:21.474956 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.470042 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e2420ba-627c-4c4d-9018-16db9b8d2938","Type":"ContainerDied","Data":"8913279abb20de39d72fa8b52ee52e0b0f0e25260bbdcb865a7d79ef07788a1d"} Jun 09 13:34:21.482417 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.482391 2544 scope.go:117] "RemoveContainer" containerID="fb9b05bb8039e63ad40772d3681c66e5fa805ff5a6e952056b3203a3447b9541" Jun 09 13:34:21.489670 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.489648 2544 scope.go:117] "RemoveContainer" containerID="ad29fa1b06a3ef2c427c625ad3c0f700b704f22466794a3d7a2b5054717702ef" Jun 09 13:34:21.492753 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.492733 2544 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 13:34:21.496492 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.496465 2544 scope.go:117] "RemoveContainer" containerID="28539d027d6635950d5bb039f45a7c848c57b53355987f1761ecae015ca65deb" Jun 09 13:34:21.499515 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.499495 2544 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 13:34:21.503724 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.503707 2544 scope.go:117] "RemoveContainer" containerID="60698c3b007118750ba4c7f9243c772f83256f6d112bf7f1a4e0c83663466687" Jun 09 13:34:21.510252 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.510235 2544 scope.go:117] "RemoveContainer" containerID="9b43d6a84f89c6ebc41fffc9f1cdff4a276ca4271565d575d7a4028f6ea51f6d" Jun 09 13:34:21.517624 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.517603 2544 scope.go:117] "RemoveContainer" containerID="4f4216f1292d764a4c52d252c0808215aac951ec97ea683fcdfd389d587550d0" Jun 09 13:34:21.524338 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.524313 2544 scope.go:117] "RemoveContainer" containerID="c6388d5ab8aeb43bdc885f8166e4d2063ae04fb74a68392d94ec30ee113e2169" Jun 09 13:34:21.524614 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:34:21.524592 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6388d5ab8aeb43bdc885f8166e4d2063ae04fb74a68392d94ec30ee113e2169\": container with ID starting with c6388d5ab8aeb43bdc885f8166e4d2063ae04fb74a68392d94ec30ee113e2169 not found: ID does not exist" containerID="c6388d5ab8aeb43bdc885f8166e4d2063ae04fb74a68392d94ec30ee113e2169" Jun 09 13:34:21.524674 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.524623 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6388d5ab8aeb43bdc885f8166e4d2063ae04fb74a68392d94ec30ee113e2169"} err="failed to get container status \"c6388d5ab8aeb43bdc885f8166e4d2063ae04fb74a68392d94ec30ee113e2169\": rpc error: code = NotFound desc = could not find container \"c6388d5ab8aeb43bdc885f8166e4d2063ae04fb74a68392d94ec30ee113e2169\": container with ID starting with c6388d5ab8aeb43bdc885f8166e4d2063ae04fb74a68392d94ec30ee113e2169 not found: ID does not exist" Jun 09 13:34:21.524674 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.524655 2544 scope.go:117] "RemoveContainer" containerID="fb9b05bb8039e63ad40772d3681c66e5fa805ff5a6e952056b3203a3447b9541" Jun 09 13:34:21.524889 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:34:21.524874 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb9b05bb8039e63ad40772d3681c66e5fa805ff5a6e952056b3203a3447b9541\": container with ID starting with fb9b05bb8039e63ad40772d3681c66e5fa805ff5a6e952056b3203a3447b9541 not found: ID does not exist" containerID="fb9b05bb8039e63ad40772d3681c66e5fa805ff5a6e952056b3203a3447b9541" Jun 09 13:34:21.524966 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.524894 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb9b05bb8039e63ad40772d3681c66e5fa805ff5a6e952056b3203a3447b9541"} err="failed to get container status \"fb9b05bb8039e63ad40772d3681c66e5fa805ff5a6e952056b3203a3447b9541\": rpc error: code = NotFound desc = could not find container \"fb9b05bb8039e63ad40772d3681c66e5fa805ff5a6e952056b3203a3447b9541\": container with ID starting with fb9b05bb8039e63ad40772d3681c66e5fa805ff5a6e952056b3203a3447b9541 not found: ID does not exist" Jun 09 13:34:21.524966 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.524909 2544 scope.go:117] "RemoveContainer" containerID="ad29fa1b06a3ef2c427c625ad3c0f700b704f22466794a3d7a2b5054717702ef" Jun 09 13:34:21.525139 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:34:21.525124 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad29fa1b06a3ef2c427c625ad3c0f700b704f22466794a3d7a2b5054717702ef\": container with ID starting with ad29fa1b06a3ef2c427c625ad3c0f700b704f22466794a3d7a2b5054717702ef not found: ID does not exist" containerID="ad29fa1b06a3ef2c427c625ad3c0f700b704f22466794a3d7a2b5054717702ef" Jun 09 13:34:21.525174 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.525144 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad29fa1b06a3ef2c427c625ad3c0f700b704f22466794a3d7a2b5054717702ef"} err="failed to get container status \"ad29fa1b06a3ef2c427c625ad3c0f700b704f22466794a3d7a2b5054717702ef\": rpc error: code = NotFound desc = could not find container \"ad29fa1b06a3ef2c427c625ad3c0f700b704f22466794a3d7a2b5054717702ef\": container with ID starting with ad29fa1b06a3ef2c427c625ad3c0f700b704f22466794a3d7a2b5054717702ef not found: ID does not exist" Jun 09 13:34:21.525174 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.525162 2544 scope.go:117] "RemoveContainer" containerID="28539d027d6635950d5bb039f45a7c848c57b53355987f1761ecae015ca65deb" Jun 09 13:34:21.525379 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:34:21.525365 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28539d027d6635950d5bb039f45a7c848c57b53355987f1761ecae015ca65deb\": container with ID starting with 28539d027d6635950d5bb039f45a7c848c57b53355987f1761ecae015ca65deb not found: ID does not exist" containerID="28539d027d6635950d5bb039f45a7c848c57b53355987f1761ecae015ca65deb" Jun 09 13:34:21.525415 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.525382 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28539d027d6635950d5bb039f45a7c848c57b53355987f1761ecae015ca65deb"} err="failed to get container status \"28539d027d6635950d5bb039f45a7c848c57b53355987f1761ecae015ca65deb\": rpc error: code = NotFound desc = could not find container \"28539d027d6635950d5bb039f45a7c848c57b53355987f1761ecae015ca65deb\": container with ID starting with 28539d027d6635950d5bb039f45a7c848c57b53355987f1761ecae015ca65deb not found: ID does not exist" Jun 09 13:34:21.525415 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.525403 2544 scope.go:117] "RemoveContainer" containerID="60698c3b007118750ba4c7f9243c772f83256f6d112bf7f1a4e0c83663466687" Jun 09 13:34:21.525642 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:34:21.525626 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60698c3b007118750ba4c7f9243c772f83256f6d112bf7f1a4e0c83663466687\": container with ID starting with 60698c3b007118750ba4c7f9243c772f83256f6d112bf7f1a4e0c83663466687 not found: ID does not exist" containerID="60698c3b007118750ba4c7f9243c772f83256f6d112bf7f1a4e0c83663466687" Jun 09 13:34:21.525689 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.525646 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60698c3b007118750ba4c7f9243c772f83256f6d112bf7f1a4e0c83663466687"} err="failed to get container status \"60698c3b007118750ba4c7f9243c772f83256f6d112bf7f1a4e0c83663466687\": rpc error: code = NotFound desc = could not find container \"60698c3b007118750ba4c7f9243c772f83256f6d112bf7f1a4e0c83663466687\": container with ID starting with 60698c3b007118750ba4c7f9243c772f83256f6d112bf7f1a4e0c83663466687 not found: ID does not exist" Jun 09 13:34:21.525689 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.525659 2544 scope.go:117] "RemoveContainer" containerID="9b43d6a84f89c6ebc41fffc9f1cdff4a276ca4271565d575d7a4028f6ea51f6d" Jun 09 13:34:21.525846 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:34:21.525832 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b43d6a84f89c6ebc41fffc9f1cdff4a276ca4271565d575d7a4028f6ea51f6d\": container with ID starting with 9b43d6a84f89c6ebc41fffc9f1cdff4a276ca4271565d575d7a4028f6ea51f6d not found: ID does not exist" containerID="9b43d6a84f89c6ebc41fffc9f1cdff4a276ca4271565d575d7a4028f6ea51f6d" Jun 09 13:34:21.525889 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.525848 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b43d6a84f89c6ebc41fffc9f1cdff4a276ca4271565d575d7a4028f6ea51f6d"} err="failed to get container status \"9b43d6a84f89c6ebc41fffc9f1cdff4a276ca4271565d575d7a4028f6ea51f6d\": rpc error: code = NotFound desc = could not find container \"9b43d6a84f89c6ebc41fffc9f1cdff4a276ca4271565d575d7a4028f6ea51f6d\": container with ID starting with 9b43d6a84f89c6ebc41fffc9f1cdff4a276ca4271565d575d7a4028f6ea51f6d not found: ID does not exist" Jun 09 13:34:21.525889 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.525859 2544 scope.go:117] "RemoveContainer" containerID="4f4216f1292d764a4c52d252c0808215aac951ec97ea683fcdfd389d587550d0" Jun 09 13:34:21.526049 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:34:21.526035 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f4216f1292d764a4c52d252c0808215aac951ec97ea683fcdfd389d587550d0\": container with ID starting with 4f4216f1292d764a4c52d252c0808215aac951ec97ea683fcdfd389d587550d0 not found: ID does not exist" containerID="4f4216f1292d764a4c52d252c0808215aac951ec97ea683fcdfd389d587550d0" Jun 09 13:34:21.526088 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.526052 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f4216f1292d764a4c52d252c0808215aac951ec97ea683fcdfd389d587550d0"} err="failed to get container status \"4f4216f1292d764a4c52d252c0808215aac951ec97ea683fcdfd389d587550d0\": rpc error: code = NotFound desc = could not find container \"4f4216f1292d764a4c52d252c0808215aac951ec97ea683fcdfd389d587550d0\": container with ID starting with 4f4216f1292d764a4c52d252c0808215aac951ec97ea683fcdfd389d587550d0 not found: ID does not exist" Jun 09 13:34:21.526088 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.526063 2544 scope.go:117] "RemoveContainer" containerID="c6388d5ab8aeb43bdc885f8166e4d2063ae04fb74a68392d94ec30ee113e2169" Jun 09 13:34:21.526299 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.526284 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6388d5ab8aeb43bdc885f8166e4d2063ae04fb74a68392d94ec30ee113e2169"} err="failed to get container status \"c6388d5ab8aeb43bdc885f8166e4d2063ae04fb74a68392d94ec30ee113e2169\": rpc error: code = NotFound desc = could not find container \"c6388d5ab8aeb43bdc885f8166e4d2063ae04fb74a68392d94ec30ee113e2169\": container with ID starting with c6388d5ab8aeb43bdc885f8166e4d2063ae04fb74a68392d94ec30ee113e2169 not found: ID does not exist" Jun 09 13:34:21.526339 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.526298 2544 scope.go:117] "RemoveContainer" containerID="fb9b05bb8039e63ad40772d3681c66e5fa805ff5a6e952056b3203a3447b9541" Jun 09 13:34:21.526476 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.526461 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb9b05bb8039e63ad40772d3681c66e5fa805ff5a6e952056b3203a3447b9541"} err="failed to get container status \"fb9b05bb8039e63ad40772d3681c66e5fa805ff5a6e952056b3203a3447b9541\": rpc error: code = NotFound desc = could not find container \"fb9b05bb8039e63ad40772d3681c66e5fa805ff5a6e952056b3203a3447b9541\": container with ID starting with fb9b05bb8039e63ad40772d3681c66e5fa805ff5a6e952056b3203a3447b9541 not found: ID does not exist" Jun 09 13:34:21.526515 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.526476 2544 scope.go:117] "RemoveContainer" containerID="ad29fa1b06a3ef2c427c625ad3c0f700b704f22466794a3d7a2b5054717702ef" Jun 09 13:34:21.526713 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.526699 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad29fa1b06a3ef2c427c625ad3c0f700b704f22466794a3d7a2b5054717702ef"} err="failed to get container status \"ad29fa1b06a3ef2c427c625ad3c0f700b704f22466794a3d7a2b5054717702ef\": rpc error: code = NotFound desc = could not find container \"ad29fa1b06a3ef2c427c625ad3c0f700b704f22466794a3d7a2b5054717702ef\": container with ID starting with ad29fa1b06a3ef2c427c625ad3c0f700b704f22466794a3d7a2b5054717702ef not found: ID does not exist" Jun 09 13:34:21.526762 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.526715 2544 scope.go:117] "RemoveContainer" containerID="28539d027d6635950d5bb039f45a7c848c57b53355987f1761ecae015ca65deb" Jun 09 13:34:21.526928 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.526912 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28539d027d6635950d5bb039f45a7c848c57b53355987f1761ecae015ca65deb"} err="failed to get container status \"28539d027d6635950d5bb039f45a7c848c57b53355987f1761ecae015ca65deb\": rpc error: code = NotFound desc = could not find container \"28539d027d6635950d5bb039f45a7c848c57b53355987f1761ecae015ca65deb\": container with ID starting with 28539d027d6635950d5bb039f45a7c848c57b53355987f1761ecae015ca65deb not found: ID does not exist" Jun 09 13:34:21.526928 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.526928 2544 scope.go:117] "RemoveContainer" containerID="60698c3b007118750ba4c7f9243c772f83256f6d112bf7f1a4e0c83663466687" Jun 09 13:34:21.527101 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.527087 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60698c3b007118750ba4c7f9243c772f83256f6d112bf7f1a4e0c83663466687"} err="failed to get container status \"60698c3b007118750ba4c7f9243c772f83256f6d112bf7f1a4e0c83663466687\": rpc error: code = NotFound desc = could not find container \"60698c3b007118750ba4c7f9243c772f83256f6d112bf7f1a4e0c83663466687\": container with ID starting with 60698c3b007118750ba4c7f9243c772f83256f6d112bf7f1a4e0c83663466687 not found: ID does not exist" Jun 09 13:34:21.527141 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.527101 2544 scope.go:117] "RemoveContainer" containerID="9b43d6a84f89c6ebc41fffc9f1cdff4a276ca4271565d575d7a4028f6ea51f6d" Jun 09 13:34:21.527280 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.527264 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b43d6a84f89c6ebc41fffc9f1cdff4a276ca4271565d575d7a4028f6ea51f6d"} err="failed to get container status \"9b43d6a84f89c6ebc41fffc9f1cdff4a276ca4271565d575d7a4028f6ea51f6d\": rpc error: code = NotFound desc = could not find container \"9b43d6a84f89c6ebc41fffc9f1cdff4a276ca4271565d575d7a4028f6ea51f6d\": container with ID starting with 9b43d6a84f89c6ebc41fffc9f1cdff4a276ca4271565d575d7a4028f6ea51f6d not found: ID does not exist" Jun 09 13:34:21.527325 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.527279 2544 scope.go:117] "RemoveContainer" containerID="4f4216f1292d764a4c52d252c0808215aac951ec97ea683fcdfd389d587550d0" Jun 09 13:34:21.527500 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.527482 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f4216f1292d764a4c52d252c0808215aac951ec97ea683fcdfd389d587550d0"} err="failed to get container status \"4f4216f1292d764a4c52d252c0808215aac951ec97ea683fcdfd389d587550d0\": rpc error: code = NotFound desc = could not find container \"4f4216f1292d764a4c52d252c0808215aac951ec97ea683fcdfd389d587550d0\": container with ID starting with 4f4216f1292d764a4c52d252c0808215aac951ec97ea683fcdfd389d587550d0 not found: ID does not exist" Jun 09 13:34:21.530626 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.530609 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 13:34:21.530888 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.530877 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerName="kube-rbac-proxy" Jun 09 13:34:21.530928 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.530890 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerName="kube-rbac-proxy" Jun 09 13:34:21.530928 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.530900 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerName="config-reloader" Jun 09 13:34:21.530928 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.530905 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerName="config-reloader" Jun 09 13:34:21.530928 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.530912 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerName="kube-rbac-proxy-metric" Jun 09 13:34:21.530928 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.530917 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerName="kube-rbac-proxy-metric" Jun 09 13:34:21.530928 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.530929 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerName="alertmanager" Jun 09 13:34:21.531101 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.530934 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerName="alertmanager" Jun 09 13:34:21.531101 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.530942 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerName="prom-label-proxy" Jun 09 13:34:21.531101 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.530947 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerName="prom-label-proxy" Jun 09 13:34:21.531101 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.530957 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerName="kube-rbac-proxy-web" Jun 09 13:34:21.531101 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.530963 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerName="kube-rbac-proxy-web" Jun 09 13:34:21.531101 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.530970 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerName="init-config-reloader" Jun 09 13:34:21.531101 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.530974 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerName="init-config-reloader" Jun 09 13:34:21.531101 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.531019 2544 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerName="prom-label-proxy" Jun 09 13:34:21.531101 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.531026 2544 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerName="config-reloader" Jun 09 13:34:21.531101 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.531035 2544 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerName="kube-rbac-proxy" Jun 09 13:34:21.531101 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.531041 2544 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerName="kube-rbac-proxy-web" Jun 09 13:34:21.531101 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.531047 2544 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerName="kube-rbac-proxy-metric" Jun 09 13:34:21.531101 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.531053 2544 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e2420ba-627c-4c4d-9018-16db9b8d2938" containerName="alertmanager" Jun 09 13:34:21.534002 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.533987 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.536457 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.536435 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vknpl\"" Jun 09 13:34:21.536540 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.536485 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 13:34:21.536629 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.536542 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 13:34:21.536805 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.536787 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 13:34:21.536805 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.536801 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 13:34:21.536929 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.536793 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 13:34:21.536929 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.536813 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 13:34:21.536929 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.536852 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 13:34:21.536929 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.536803 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 13:34:21.542581 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.542540 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 13:34:21.547937 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.547920 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 13:34:21.662633 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.662604 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.662810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.662644 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldm4s\" (UniqueName: \"kubernetes.io/projected/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-kube-api-access-ldm4s\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.662810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.662667 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.662810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.662717 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.662810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.662764 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.662945 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.662814 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-config-volume\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.662945 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.662838 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-config-out\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.662945 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.662871 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.662945 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.662886 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.662945 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.662905 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-web-config\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.663091 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.662960 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.663091 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.663010 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.663091 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.663028 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.764088 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.764040 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.764235 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.764120 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.764235 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.764148 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.764235 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.764203 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.764235 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.764229 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldm4s\" (UniqueName: \"kubernetes.io/projected/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-kube-api-access-ldm4s\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.764402 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.764259 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.764402 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.764281 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.764402 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.764302 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.764402 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.764337 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-config-volume\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.764402 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.764368 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-config-out\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.764402 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.764400 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.764757 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.764421 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.764757 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.764445 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-web-config\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.765126 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.765094 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.767414 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.767189 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.767414 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.767319 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.767414 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.767335 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.767414 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.767372 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-config-volume\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.767414 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.767406 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-web-config\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.767761 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.767457 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.767761 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.767471 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-config-out\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.768111 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.768086 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.768193 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.768173 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.768240 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.768229 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.769048 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.769032 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.772125 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.772108 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldm4s\" (UniqueName: \"kubernetes.io/projected/9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d-kube-api-access-ldm4s\") pod \"alertmanager-main-0\" (UID: \"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.843212 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.843175 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 13:34:21.972934 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:21.972902 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 13:34:21.975931 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:34:21.975905 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c7a74a9_c7e2_4852_bdd9_0f5539f7f40d.slice/crio-d924d75de04eaeb30b8f2ade947b7d6b8a6257da73276c2db0664343b4b69875 WatchSource:0}: Error finding container d924d75de04eaeb30b8f2ade947b7d6b8a6257da73276c2db0664343b4b69875: Status 404 returned error can't find the container with id d924d75de04eaeb30b8f2ade947b7d6b8a6257da73276c2db0664343b4b69875 Jun 09 13:34:22.475637 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:22.475598 2544 generic.go:356] "Generic (PLEG): container finished" podID="9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d" containerID="bc26c48db7fbd371814371635d13309a6fcfd91fec422eae2cf006017569e590" exitCode=0 Jun 09 13:34:22.475775 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:22.475652 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d","Type":"ContainerDied","Data":"bc26c48db7fbd371814371635d13309a6fcfd91fec422eae2cf006017569e590"} Jun 09 13:34:22.475775 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:22.475707 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d","Type":"ContainerStarted","Data":"d924d75de04eaeb30b8f2ade947b7d6b8a6257da73276c2db0664343b4b69875"} Jun 09 13:34:23.275779 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:23.275739 2544 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e2420ba-627c-4c4d-9018-16db9b8d2938" path="/var/lib/kubelet/pods/8e2420ba-627c-4c4d-9018-16db9b8d2938/volumes" Jun 09 13:34:23.482842 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:23.482810 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d","Type":"ContainerStarted","Data":"0cbee52cd48cd11f300cac9dd6b836403d1f71a570a3781a2198acf1d06055e1"} Jun 09 13:34:23.482994 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:23.482878 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d","Type":"ContainerStarted","Data":"46c970b29fcf471fb86061a0955208c837e704d58e63431a6dd3934824a075e6"} Jun 09 13:34:23.482994 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:23.482903 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d","Type":"ContainerStarted","Data":"8c53f535073e5f6e130165b0ee51279193eb1b6517a56426f4165bfb9b5aea83"} Jun 09 13:34:23.482994 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:23.482929 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d","Type":"ContainerStarted","Data":"822089b50f1a909a19bafd2c301e320b0dc92c73977c868f236dfe22fb910658"} Jun 09 13:34:23.482994 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:23.482953 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d","Type":"ContainerStarted","Data":"778b9926d1b26ab17231d518b3d2d02e6f29dd0859d8d88259d2f7efcabf1629"} Jun 09 13:34:23.482994 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:23.482978 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d","Type":"ContainerStarted","Data":"2e4781b0240ae59970d2518e6652d27005ff59dc60290b17d040fea321461caa"} Jun 09 13:34:23.509732 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:23.509682 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.493641738 podStartE2EDuration="2.509667147s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.025409ms" isStatefulPod=false podCreationTimestamp="2026-06-09 13:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:34:23.507704866 +0000 UTC m=+370.662977078" watchObservedRunningTime="2026-06-09 13:34:23.509667147 +0000 UTC m=+370.664939358" Jun 09 13:34:23.902483 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:23.902446 2544 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 13:34:23.902785 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:23.902748 2544 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="308c72de-4700-42d8-967f-4a6da4d570dd" containerName="prometheus" containerID="cri-o://7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade" gracePeriod=600 Jun 09 13:34:23.902785 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:23.902776 2544 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="308c72de-4700-42d8-967f-4a6da4d570dd" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306" gracePeriod=600 Jun 09 13:34:23.902986 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:23.902784 2544 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="308c72de-4700-42d8-967f-4a6da4d570dd" containerName="thanos-sidecar" containerID="cri-o://fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105" gracePeriod=600 Jun 09 13:34:23.902986 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:23.902798 2544 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="308c72de-4700-42d8-967f-4a6da4d570dd" containerName="config-reloader" containerID="cri-o://dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b" gracePeriod=600 Jun 09 13:34:23.902986 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:23.902757 2544 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="308c72de-4700-42d8-967f-4a6da4d570dd" containerName="kube-rbac-proxy" containerID="cri-o://cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535" gracePeriod=600 Jun 09 13:34:23.902986 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:23.902798 2544 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="308c72de-4700-42d8-967f-4a6da4d570dd" containerName="kube-rbac-proxy-web" containerID="cri-o://1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92" gracePeriod=600 Jun 09 13:34:24.134741 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.134712 2544 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.285804 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.285780 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-prometheus-k8s-tls\") pod \"308c72de-4700-42d8-967f-4a6da4d570dd\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " Jun 09 13:34:24.286232 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.285811 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-k8s-rulefiles-0\") pod \"308c72de-4700-42d8-967f-4a6da4d570dd\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " Jun 09 13:34:24.286232 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.285828 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-kube-rbac-proxy\") pod \"308c72de-4700-42d8-967f-4a6da4d570dd\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " Jun 09 13:34:24.286232 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.285854 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzr6k\" (UniqueName: \"kubernetes.io/projected/308c72de-4700-42d8-967f-4a6da4d570dd-kube-api-access-xzr6k\") pod \"308c72de-4700-42d8-967f-4a6da4d570dd\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " Jun 09 13:34:24.286232 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.285882 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-k8s-rulefiles-2\") pod \"308c72de-4700-42d8-967f-4a6da4d570dd\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " Jun 09 13:34:24.286232 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.285917 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-grpc-tls\") pod \"308c72de-4700-42d8-967f-4a6da4d570dd\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " Jun 09 13:34:24.286232 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.285969 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/308c72de-4700-42d8-967f-4a6da4d570dd-config-out\") pod \"308c72de-4700-42d8-967f-4a6da4d570dd\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " Jun 09 13:34:24.286232 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.285996 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"308c72de-4700-42d8-967f-4a6da4d570dd\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " Jun 09 13:34:24.286232 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.286031 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-k8s-rulefiles-1\") pod \"308c72de-4700-42d8-967f-4a6da4d570dd\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " Jun 09 13:34:24.286232 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.286080 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-config\") pod \"308c72de-4700-42d8-967f-4a6da4d570dd\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " Jun 09 13:34:24.286232 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.286110 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-thanos-prometheus-http-client-file\") pod \"308c72de-4700-42d8-967f-4a6da4d570dd\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " Jun 09 13:34:24.286232 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.286140 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/308c72de-4700-42d8-967f-4a6da4d570dd-tls-assets\") pod \"308c72de-4700-42d8-967f-4a6da4d570dd\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " Jun 09 13:34:24.286232 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.286165 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-configmap-metrics-client-ca\") pod \"308c72de-4700-42d8-967f-4a6da4d570dd\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " Jun 09 13:34:24.286232 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.286192 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-metrics-client-certs\") pod \"308c72de-4700-42d8-967f-4a6da4d570dd\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " Jun 09 13:34:24.286232 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.286216 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-web-config\") pod \"308c72de-4700-42d8-967f-4a6da4d570dd\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " Jun 09 13:34:24.287080 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.286301 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "308c72de-4700-42d8-967f-4a6da4d570dd" (UID: "308c72de-4700-42d8-967f-4a6da4d570dd"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:34:24.287080 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.286327 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"308c72de-4700-42d8-967f-4a6da4d570dd\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " Jun 09 13:34:24.287080 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.286681 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "308c72de-4700-42d8-967f-4a6da4d570dd" (UID: "308c72de-4700-42d8-967f-4a6da4d570dd"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:34:24.287269 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.287242 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "308c72de-4700-42d8-967f-4a6da4d570dd" (UID: "308c72de-4700-42d8-967f-4a6da4d570dd"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:34:24.287878 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.287850 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "308c72de-4700-42d8-967f-4a6da4d570dd" (UID: "308c72de-4700-42d8-967f-4a6da4d570dd"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:34:24.288578 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.288402 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "308c72de-4700-42d8-967f-4a6da4d570dd" (UID: "308c72de-4700-42d8-967f-4a6da4d570dd"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:34:24.288578 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.288493 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "308c72de-4700-42d8-967f-4a6da4d570dd" (UID: "308c72de-4700-42d8-967f-4a6da4d570dd"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:34:24.288578 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.288514 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "308c72de-4700-42d8-967f-4a6da4d570dd" (UID: "308c72de-4700-42d8-967f-4a6da4d570dd"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:34:24.288578 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.288517 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/308c72de-4700-42d8-967f-4a6da4d570dd-kube-api-access-xzr6k" (OuterVolumeSpecName: "kube-api-access-xzr6k") pod "308c72de-4700-42d8-967f-4a6da4d570dd" (UID: "308c72de-4700-42d8-967f-4a6da4d570dd"). InnerVolumeSpecName "kube-api-access-xzr6k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:34:24.288578 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.288572 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-trusted-ca-bundle\") pod \"308c72de-4700-42d8-967f-4a6da4d570dd\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " Jun 09 13:34:24.288908 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.288615 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-k8s-db\") pod \"308c72de-4700-42d8-967f-4a6da4d570dd\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " Jun 09 13:34:24.288908 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.288648 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-configmap-kubelet-serving-ca-bundle\") pod \"308c72de-4700-42d8-967f-4a6da4d570dd\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " Jun 09 13:34:24.288908 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.288712 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-configmap-serving-certs-ca-bundle\") pod \"308c72de-4700-42d8-967f-4a6da4d570dd\" (UID: \"308c72de-4700-42d8-967f-4a6da4d570dd\") " Jun 09 13:34:24.288908 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.288764 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "308c72de-4700-42d8-967f-4a6da4d570dd" (UID: "308c72de-4700-42d8-967f-4a6da4d570dd"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:34:24.289110 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.289030 2544 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:24.289110 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.289050 2544 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:24.289110 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.289066 2544 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-configmap-metrics-client-ca\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:24.289110 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.289080 2544 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:24.289110 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.289095 2544 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:24.289110 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.289108 2544 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:24.289402 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.289123 2544 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-kube-rbac-proxy\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:24.289402 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.289137 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzr6k\" (UniqueName: \"kubernetes.io/projected/308c72de-4700-42d8-967f-4a6da4d570dd-kube-api-access-xzr6k\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:24.289402 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.289151 2544 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:24.289575 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.289476 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "308c72de-4700-42d8-967f-4a6da4d570dd" (UID: "308c72de-4700-42d8-967f-4a6da4d570dd"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:34:24.290148 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.289870 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "308c72de-4700-42d8-967f-4a6da4d570dd" (UID: "308c72de-4700-42d8-967f-4a6da4d570dd"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:34:24.290148 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.290019 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/308c72de-4700-42d8-967f-4a6da4d570dd-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "308c72de-4700-42d8-967f-4a6da4d570dd" (UID: "308c72de-4700-42d8-967f-4a6da4d570dd"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:34:24.290148 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.290134 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/308c72de-4700-42d8-967f-4a6da4d570dd-config-out" (OuterVolumeSpecName: "config-out") pod "308c72de-4700-42d8-967f-4a6da4d570dd" (UID: "308c72de-4700-42d8-967f-4a6da4d570dd"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:34:24.290495 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.290162 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "308c72de-4700-42d8-967f-4a6da4d570dd" (UID: "308c72de-4700-42d8-967f-4a6da4d570dd"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:34:24.290495 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.290393 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "308c72de-4700-42d8-967f-4a6da4d570dd" (UID: "308c72de-4700-42d8-967f-4a6da4d570dd"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:34:24.290495 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.290395 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "308c72de-4700-42d8-967f-4a6da4d570dd" (UID: "308c72de-4700-42d8-967f-4a6da4d570dd"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:34:24.290683 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.290635 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-config" (OuterVolumeSpecName: "config") pod "308c72de-4700-42d8-967f-4a6da4d570dd" (UID: "308c72de-4700-42d8-967f-4a6da4d570dd"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:34:24.290734 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.290709 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "308c72de-4700-42d8-967f-4a6da4d570dd" (UID: "308c72de-4700-42d8-967f-4a6da4d570dd"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:34:24.291845 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.291819 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "308c72de-4700-42d8-967f-4a6da4d570dd" (UID: "308c72de-4700-42d8-967f-4a6da4d570dd"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:34:24.300265 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.300245 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-web-config" (OuterVolumeSpecName: "web-config") pod "308c72de-4700-42d8-967f-4a6da4d570dd" (UID: "308c72de-4700-42d8-967f-4a6da4d570dd"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:34:24.390322 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.390285 2544 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-grpc-tls\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:24.390322 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.390318 2544 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/308c72de-4700-42d8-967f-4a6da4d570dd-config-out\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:24.390322 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.390330 2544 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:24.390583 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.390343 2544 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-config\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:24.390583 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.390355 2544 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/308c72de-4700-42d8-967f-4a6da4d570dd-tls-assets\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:24.390583 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.390366 2544 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-secret-metrics-client-certs\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:24.390583 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.390377 2544 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/308c72de-4700-42d8-967f-4a6da4d570dd-web-config\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:24.390583 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.390388 2544 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:24.390583 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.390399 2544 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/308c72de-4700-42d8-967f-4a6da4d570dd-prometheus-k8s-db\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:24.390583 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.390411 2544 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:24.390583 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.390424 2544 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/308c72de-4700-42d8-967f-4a6da4d570dd-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:34:24.489723 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.489689 2544 generic.go:356] "Generic (PLEG): container finished" podID="308c72de-4700-42d8-967f-4a6da4d570dd" containerID="c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306" exitCode=0 Jun 09 13:34:24.489723 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.489713 2544 generic.go:356] "Generic (PLEG): container finished" podID="308c72de-4700-42d8-967f-4a6da4d570dd" containerID="cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535" exitCode=0 Jun 09 13:34:24.489723 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.489719 2544 generic.go:356] "Generic (PLEG): container finished" podID="308c72de-4700-42d8-967f-4a6da4d570dd" containerID="1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92" exitCode=0 Jun 09 13:34:24.489723 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.489725 2544 generic.go:356] "Generic (PLEG): container finished" podID="308c72de-4700-42d8-967f-4a6da4d570dd" containerID="fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105" exitCode=0 Jun 09 13:34:24.489723 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.489730 2544 generic.go:356] "Generic (PLEG): container finished" podID="308c72de-4700-42d8-967f-4a6da4d570dd" containerID="dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b" exitCode=0 Jun 09 13:34:24.490012 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.489734 2544 generic.go:356] "Generic (PLEG): container finished" podID="308c72de-4700-42d8-967f-4a6da4d570dd" containerID="7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade" exitCode=0 Jun 09 13:34:24.490012 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.489769 2544 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.490012 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.489777 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"308c72de-4700-42d8-967f-4a6da4d570dd","Type":"ContainerDied","Data":"c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306"} Jun 09 13:34:24.490012 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.489847 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"308c72de-4700-42d8-967f-4a6da4d570dd","Type":"ContainerDied","Data":"cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535"} Jun 09 13:34:24.490012 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.489875 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"308c72de-4700-42d8-967f-4a6da4d570dd","Type":"ContainerDied","Data":"1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92"} Jun 09 13:34:24.490012 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.489905 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"308c72de-4700-42d8-967f-4a6da4d570dd","Type":"ContainerDied","Data":"fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105"} Jun 09 13:34:24.490012 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.489919 2544 scope.go:117] "RemoveContainer" containerID="c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306" Jun 09 13:34:24.490012 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.489952 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"308c72de-4700-42d8-967f-4a6da4d570dd","Type":"ContainerDied","Data":"dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b"} Jun 09 13:34:24.490012 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.489992 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"308c72de-4700-42d8-967f-4a6da4d570dd","Type":"ContainerDied","Data":"7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade"} Jun 09 13:34:24.490376 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.490031 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"308c72de-4700-42d8-967f-4a6da4d570dd","Type":"ContainerDied","Data":"54247c1dc18d7d1eda2458ef99d8855c06b281cb61650fb22095345616d7108d"} Jun 09 13:34:24.500396 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.500365 2544 scope.go:117] "RemoveContainer" containerID="cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535" Jun 09 13:34:24.508408 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.508390 2544 scope.go:117] "RemoveContainer" containerID="1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92" Jun 09 13:34:24.515424 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.515399 2544 scope.go:117] "RemoveContainer" containerID="fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105" Jun 09 13:34:24.516371 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.516318 2544 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 13:34:24.520570 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.520520 2544 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 13:34:24.522436 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.522420 2544 scope.go:117] "RemoveContainer" containerID="dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b" Jun 09 13:34:24.528829 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.528810 2544 scope.go:117] "RemoveContainer" containerID="7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade" Jun 09 13:34:24.535799 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.535785 2544 scope.go:117] "RemoveContainer" containerID="6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7" Jun 09 13:34:24.542501 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.542483 2544 scope.go:117] "RemoveContainer" containerID="c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306" Jun 09 13:34:24.542792 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:34:24.542775 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306\": container with ID starting with c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306 not found: ID does not exist" containerID="c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306" Jun 09 13:34:24.542875 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.542804 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306"} err="failed to get container status \"c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306\": rpc error: code = NotFound desc = could not find container \"c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306\": container with ID starting with c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306 not found: ID does not exist" Jun 09 13:34:24.542875 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.542830 2544 scope.go:117] "RemoveContainer" containerID="cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535" Jun 09 13:34:24.543078 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:34:24.543062 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535\": container with ID starting with cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535 not found: ID does not exist" containerID="cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535" Jun 09 13:34:24.543119 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.543084 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535"} err="failed to get container status \"cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535\": rpc error: code = NotFound desc = could not find container \"cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535\": container with ID starting with cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535 not found: ID does not exist" Jun 09 13:34:24.543119 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.543100 2544 scope.go:117] "RemoveContainer" containerID="1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92" Jun 09 13:34:24.543297 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:34:24.543283 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92\": container with ID starting with 1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92 not found: ID does not exist" containerID="1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92" Jun 09 13:34:24.543333 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.543298 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92"} err="failed to get container status \"1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92\": rpc error: code = NotFound desc = could not find container \"1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92\": container with ID starting with 1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92 not found: ID does not exist" Jun 09 13:34:24.543333 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.543308 2544 scope.go:117] "RemoveContainer" containerID="fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105" Jun 09 13:34:24.543537 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:34:24.543519 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105\": container with ID starting with fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105 not found: ID does not exist" containerID="fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105" Jun 09 13:34:24.543620 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.543558 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105"} err="failed to get container status \"fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105\": rpc error: code = NotFound desc = could not find container \"fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105\": container with ID starting with fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105 not found: ID does not exist" Jun 09 13:34:24.543620 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.543577 2544 scope.go:117] "RemoveContainer" containerID="dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b" Jun 09 13:34:24.543770 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:34:24.543756 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b\": container with ID starting with dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b not found: ID does not exist" containerID="dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b" Jun 09 13:34:24.543811 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.543773 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b"} err="failed to get container status \"dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b\": rpc error: code = NotFound desc = could not find container \"dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b\": container with ID starting with dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b not found: ID does not exist" Jun 09 13:34:24.543811 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.543785 2544 scope.go:117] "RemoveContainer" containerID="7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade" Jun 09 13:34:24.543981 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:34:24.543965 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade\": container with ID starting with 7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade not found: ID does not exist" containerID="7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade" Jun 09 13:34:24.544027 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.543985 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade"} err="failed to get container status \"7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade\": rpc error: code = NotFound desc = could not find container \"7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade\": container with ID starting with 7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade not found: ID does not exist" Jun 09 13:34:24.544027 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.543999 2544 scope.go:117] "RemoveContainer" containerID="6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7" Jun 09 13:34:24.544199 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:34:24.544183 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7\": container with ID starting with 6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7 not found: ID does not exist" containerID="6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7" Jun 09 13:34:24.544256 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.544208 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7"} err="failed to get container status \"6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7\": rpc error: code = NotFound desc = could not find container \"6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7\": container with ID starting with 6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7 not found: ID does not exist" Jun 09 13:34:24.544256 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.544227 2544 scope.go:117] "RemoveContainer" containerID="c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306" Jun 09 13:34:24.544451 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.544434 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306"} err="failed to get container status \"c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306\": rpc error: code = NotFound desc = could not find container \"c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306\": container with ID starting with c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306 not found: ID does not exist" Jun 09 13:34:24.544494 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.544452 2544 scope.go:117] "RemoveContainer" containerID="cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535" Jun 09 13:34:24.544673 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.544656 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535"} err="failed to get container status \"cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535\": rpc error: code = NotFound desc = could not find container \"cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535\": container with ID starting with cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535 not found: ID does not exist" Jun 09 13:34:24.544737 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.544674 2544 scope.go:117] "RemoveContainer" containerID="1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92" Jun 09 13:34:24.544896 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.544879 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92"} err="failed to get container status \"1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92\": rpc error: code = NotFound desc = could not find container \"1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92\": container with ID starting with 1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92 not found: ID does not exist" Jun 09 13:34:24.544944 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.544897 2544 scope.go:117] "RemoveContainer" containerID="fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105" Jun 09 13:34:24.545079 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.545062 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105"} err="failed to get container status \"fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105\": rpc error: code = NotFound desc = could not find container \"fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105\": container with ID starting with fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105 not found: ID does not exist" Jun 09 13:34:24.545120 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.545080 2544 scope.go:117] "RemoveContainer" containerID="dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b" Jun 09 13:34:24.545281 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.545264 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b"} err="failed to get container status \"dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b\": rpc error: code = NotFound desc = could not find container \"dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b\": container with ID starting with dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b not found: ID does not exist" Jun 09 13:34:24.545339 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.545282 2544 scope.go:117] "RemoveContainer" containerID="7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade" Jun 09 13:34:24.545486 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.545467 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade"} err="failed to get container status \"7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade\": rpc error: code = NotFound desc = could not find container \"7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade\": container with ID starting with 7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade not found: ID does not exist" Jun 09 13:34:24.545530 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.545488 2544 scope.go:117] "RemoveContainer" containerID="6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7" Jun 09 13:34:24.545715 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.545696 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7"} err="failed to get container status \"6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7\": rpc error: code = NotFound desc = could not find container \"6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7\": container with ID starting with 6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7 not found: ID does not exist" Jun 09 13:34:24.545787 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.545715 2544 scope.go:117] "RemoveContainer" containerID="c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306" Jun 09 13:34:24.545966 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.545947 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306"} err="failed to get container status \"c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306\": rpc error: code = NotFound desc = could not find container \"c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306\": container with ID starting with c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306 not found: ID does not exist" Jun 09 13:34:24.546009 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.545967 2544 scope.go:117] "RemoveContainer" containerID="cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535" Jun 09 13:34:24.546179 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.546161 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535"} err="failed to get container status \"cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535\": rpc error: code = NotFound desc = could not find container \"cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535\": container with ID starting with cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535 not found: ID does not exist" Jun 09 13:34:24.546223 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.546188 2544 scope.go:117] "RemoveContainer" containerID="1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92" Jun 09 13:34:24.546388 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.546367 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92"} err="failed to get container status \"1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92\": rpc error: code = NotFound desc = could not find container \"1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92\": container with ID starting with 1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92 not found: ID does not exist" Jun 09 13:34:24.546452 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.546389 2544 scope.go:117] "RemoveContainer" containerID="fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105" Jun 09 13:34:24.546609 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.546593 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105"} err="failed to get container status \"fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105\": rpc error: code = NotFound desc = could not find container \"fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105\": container with ID starting with fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105 not found: ID does not exist" Jun 09 13:34:24.546668 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.546609 2544 scope.go:117] "RemoveContainer" containerID="dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b" Jun 09 13:34:24.546814 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.546794 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b"} err="failed to get container status \"dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b\": rpc error: code = NotFound desc = could not find container \"dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b\": container with ID starting with dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b not found: ID does not exist" Jun 09 13:34:24.546872 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.546814 2544 scope.go:117] "RemoveContainer" containerID="7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade" Jun 09 13:34:24.547006 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.546986 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade"} err="failed to get container status \"7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade\": rpc error: code = NotFound desc = could not find container \"7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade\": container with ID starting with 7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade not found: ID does not exist" Jun 09 13:34:24.547006 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.547006 2544 scope.go:117] "RemoveContainer" containerID="6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7" Jun 09 13:34:24.547215 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.547201 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7"} err="failed to get container status \"6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7\": rpc error: code = NotFound desc = could not find container \"6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7\": container with ID starting with 6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7 not found: ID does not exist" Jun 09 13:34:24.547271 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.547216 2544 scope.go:117] "RemoveContainer" containerID="c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306" Jun 09 13:34:24.547394 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.547379 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306"} err="failed to get container status \"c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306\": rpc error: code = NotFound desc = could not find container \"c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306\": container with ID starting with c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306 not found: ID does not exist" Jun 09 13:34:24.547436 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.547394 2544 scope.go:117] "RemoveContainer" containerID="cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535" Jun 09 13:34:24.547578 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.547539 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535"} err="failed to get container status \"cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535\": rpc error: code = NotFound desc = could not find container \"cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535\": container with ID starting with cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535 not found: ID does not exist" Jun 09 13:34:24.547623 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.547580 2544 scope.go:117] "RemoveContainer" containerID="1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92" Jun 09 13:34:24.547806 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.547789 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92"} err="failed to get container status \"1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92\": rpc error: code = NotFound desc = could not find container \"1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92\": container with ID starting with 1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92 not found: ID does not exist" Jun 09 13:34:24.547849 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.547807 2544 scope.go:117] "RemoveContainer" containerID="fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105" Jun 09 13:34:24.548040 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.548023 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105"} err="failed to get container status \"fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105\": rpc error: code = NotFound desc = could not find container \"fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105\": container with ID starting with fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105 not found: ID does not exist" Jun 09 13:34:24.548040 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.548039 2544 scope.go:117] "RemoveContainer" containerID="dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b" Jun 09 13:34:24.548250 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.548229 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b"} err="failed to get container status \"dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b\": rpc error: code = NotFound desc = could not find container \"dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b\": container with ID starting with dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b not found: ID does not exist" Jun 09 13:34:24.548250 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.548248 2544 scope.go:117] "RemoveContainer" containerID="7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade" Jun 09 13:34:24.548523 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.548446 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade"} err="failed to get container status \"7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade\": rpc error: code = NotFound desc = could not find container \"7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade\": container with ID starting with 7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade not found: ID does not exist" Jun 09 13:34:24.548523 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.548459 2544 scope.go:117] "RemoveContainer" containerID="6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7" Jun 09 13:34:24.548783 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.548748 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7"} err="failed to get container status \"6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7\": rpc error: code = NotFound desc = could not find container \"6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7\": container with ID starting with 6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7 not found: ID does not exist" Jun 09 13:34:24.548783 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.548770 2544 scope.go:117] "RemoveContainer" containerID="c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306" Jun 09 13:34:24.549035 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.549010 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306"} err="failed to get container status \"c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306\": rpc error: code = NotFound desc = could not find container \"c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306\": container with ID starting with c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306 not found: ID does not exist" Jun 09 13:34:24.549035 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.549027 2544 scope.go:117] "RemoveContainer" containerID="cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535" Jun 09 13:34:24.549307 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.549280 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535"} err="failed to get container status \"cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535\": rpc error: code = NotFound desc = could not find container \"cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535\": container with ID starting with cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535 not found: ID does not exist" Jun 09 13:34:24.549403 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.549308 2544 scope.go:117] "RemoveContainer" containerID="1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92" Jun 09 13:34:24.549654 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.549594 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92"} err="failed to get container status \"1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92\": rpc error: code = NotFound desc = could not find container \"1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92\": container with ID starting with 1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92 not found: ID does not exist" Jun 09 13:34:24.549654 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.549613 2544 scope.go:117] "RemoveContainer" containerID="fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105" Jun 09 13:34:24.549878 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.549838 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105"} err="failed to get container status \"fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105\": rpc error: code = NotFound desc = could not find container \"fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105\": container with ID starting with fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105 not found: ID does not exist" Jun 09 13:34:24.549878 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.549857 2544 scope.go:117] "RemoveContainer" containerID="dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b" Jun 09 13:34:24.550091 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.550074 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b"} err="failed to get container status \"dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b\": rpc error: code = NotFound desc = could not find container \"dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b\": container with ID starting with dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b not found: ID does not exist" Jun 09 13:34:24.550144 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.550091 2544 scope.go:117] "RemoveContainer" containerID="7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade" Jun 09 13:34:24.550301 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.550284 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade"} err="failed to get container status \"7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade\": rpc error: code = NotFound desc = could not find container \"7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade\": container with ID starting with 7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade not found: ID does not exist" Jun 09 13:34:24.550342 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.550304 2544 scope.go:117] "RemoveContainer" containerID="6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7" Jun 09 13:34:24.550569 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.550524 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7"} err="failed to get container status \"6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7\": rpc error: code = NotFound desc = could not find container \"6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7\": container with ID starting with 6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7 not found: ID does not exist" Jun 09 13:34:24.550569 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.550561 2544 scope.go:117] "RemoveContainer" containerID="c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306" Jun 09 13:34:24.550716 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.550672 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 13:34:24.550797 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.550779 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306"} err="failed to get container status \"c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306\": rpc error: code = NotFound desc = could not find container \"c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306\": container with ID starting with c1ce1662b057dbdeeaa7d023fc3fb8c13822d4f4e6b03e71162f32d1d0d31306 not found: ID does not exist" Jun 09 13:34:24.550835 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.550799 2544 scope.go:117] "RemoveContainer" containerID="cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535" Jun 09 13:34:24.550987 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.550973 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="308c72de-4700-42d8-967f-4a6da4d570dd" containerName="thanos-sidecar" Jun 09 13:34:24.551048 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.550990 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="308c72de-4700-42d8-967f-4a6da4d570dd" containerName="thanos-sidecar" Jun 09 13:34:24.551048 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551001 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535"} err="failed to get container status \"cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535\": rpc error: code = NotFound desc = could not find container \"cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535\": container with ID starting with cdeadbd11013f3e800da6c87975bb7b898839a204074890c13c5dd9abc40b535 not found: ID does not exist" Jun 09 13:34:24.551048 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551015 2544 scope.go:117] "RemoveContainer" containerID="1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92" Jun 09 13:34:24.551147 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551005 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="308c72de-4700-42d8-967f-4a6da4d570dd" containerName="kube-rbac-proxy-web" Jun 09 13:34:24.551147 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551059 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="308c72de-4700-42d8-967f-4a6da4d570dd" containerName="kube-rbac-proxy-web" Jun 09 13:34:24.551147 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551075 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="308c72de-4700-42d8-967f-4a6da4d570dd" containerName="init-config-reloader" Jun 09 13:34:24.551147 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551081 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="308c72de-4700-42d8-967f-4a6da4d570dd" containerName="init-config-reloader" Jun 09 13:34:24.551147 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551089 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="308c72de-4700-42d8-967f-4a6da4d570dd" containerName="prometheus" Jun 09 13:34:24.551147 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551095 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="308c72de-4700-42d8-967f-4a6da4d570dd" containerName="prometheus" Jun 09 13:34:24.551147 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551104 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="308c72de-4700-42d8-967f-4a6da4d570dd" containerName="kube-rbac-proxy" Jun 09 13:34:24.551147 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551109 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="308c72de-4700-42d8-967f-4a6da4d570dd" containerName="kube-rbac-proxy" Jun 09 13:34:24.551147 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551129 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="308c72de-4700-42d8-967f-4a6da4d570dd" containerName="config-reloader" Jun 09 13:34:24.551147 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551135 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="308c72de-4700-42d8-967f-4a6da4d570dd" containerName="config-reloader" Jun 09 13:34:24.551147 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551144 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="308c72de-4700-42d8-967f-4a6da4d570dd" containerName="kube-rbac-proxy-thanos" Jun 09 13:34:24.551147 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551149 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="308c72de-4700-42d8-967f-4a6da4d570dd" containerName="kube-rbac-proxy-thanos" Jun 09 13:34:24.551533 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551221 2544 memory_manager.go:368] "RemoveStaleState removing state" podUID="308c72de-4700-42d8-967f-4a6da4d570dd" containerName="prometheus" Jun 09 13:34:24.551533 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551230 2544 memory_manager.go:368] "RemoveStaleState removing state" podUID="308c72de-4700-42d8-967f-4a6da4d570dd" containerName="thanos-sidecar" Jun 09 13:34:24.551533 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551237 2544 memory_manager.go:368] "RemoveStaleState removing state" podUID="308c72de-4700-42d8-967f-4a6da4d570dd" containerName="kube-rbac-proxy-thanos" Jun 09 13:34:24.551533 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551242 2544 memory_manager.go:368] "RemoveStaleState removing state" podUID="308c72de-4700-42d8-967f-4a6da4d570dd" containerName="kube-rbac-proxy-web" Jun 09 13:34:24.551533 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551248 2544 memory_manager.go:368] "RemoveStaleState removing state" podUID="308c72de-4700-42d8-967f-4a6da4d570dd" containerName="kube-rbac-proxy" Jun 09 13:34:24.551533 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551254 2544 memory_manager.go:368] "RemoveStaleState removing state" podUID="308c72de-4700-42d8-967f-4a6da4d570dd" containerName="config-reloader" Jun 09 13:34:24.551533 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551249 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92"} err="failed to get container status \"1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92\": rpc error: code = NotFound desc = could not find container \"1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92\": container with ID starting with 1a11566ed97e20808577be25be41ea263c1908b784e6e8a30dd0021110c7ee92 not found: ID does not exist" Jun 09 13:34:24.551533 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551268 2544 scope.go:117] "RemoveContainer" containerID="fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105" Jun 09 13:34:24.551533 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551477 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105"} err="failed to get container status \"fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105\": rpc error: code = NotFound desc = could not find container \"fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105\": container with ID starting with fdb2c70f528e67c931d9df5ba68ffa41aff445ef6c9d0acbbc0d29d980f16105 not found: ID does not exist" Jun 09 13:34:24.551533 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551491 2544 scope.go:117] "RemoveContainer" containerID="dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b" Jun 09 13:34:24.551896 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551727 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b"} err="failed to get container status \"dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b\": rpc error: code = NotFound desc = could not find container \"dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b\": container with ID starting with dd4274448638559b7b591f7d6f5d35e6da698bca66f1f0f0bb0d53c1c4ee467b not found: ID does not exist" Jun 09 13:34:24.551896 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551741 2544 scope.go:117] "RemoveContainer" containerID="7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade" Jun 09 13:34:24.551966 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551928 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade"} err="failed to get container status \"7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade\": rpc error: code = NotFound desc = could not find container \"7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade\": container with ID starting with 7a2fc9f01566e76f1bf63e56ee5ab5ef87774fe50a302b636eefc03323cfcade not found: ID does not exist" Jun 09 13:34:24.551966 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.551940 2544 scope.go:117] "RemoveContainer" containerID="6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7" Jun 09 13:34:24.552149 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.552133 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7"} err="failed to get container status \"6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7\": rpc error: code = NotFound desc = could not find container \"6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7\": container with ID starting with 6171860b6bd74c8bd6c7f29a8713b1ea2b2bb06f3ec3f1bba10e7fe22d753ed7 not found: ID does not exist" Jun 09 13:34:24.555125 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.555111 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.557558 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.557529 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 13:34:24.558061 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.558019 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 13:34:24.558061 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.558030 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 13:34:24.558208 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.558096 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 13:34:24.558208 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.558118 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 13:34:24.558208 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.558134 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 13:34:24.558355 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.558339 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 13:34:24.558451 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.558435 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-nwtmm\"" Jun 09 13:34:24.558583 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.558562 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 13:34:24.558636 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.558599 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 13:34:24.558636 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.558624 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-d9ieli5ffn8cd\"" Jun 09 13:34:24.558817 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.558800 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 13:34:24.558876 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.558862 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 13:34:24.558957 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.558937 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 13:34:24.559061 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.559049 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 13:34:24.561338 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.561308 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 13:34:24.563430 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.563413 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 13:34:24.568765 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.568749 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 13:34:24.692427 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.692392 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11923874-d106-4fd1-b09e-0028899dec9c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.692427 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.692430 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/11923874-d106-4fd1-b09e-0028899dec9c-config\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.692654 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.692506 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11923874-d106-4fd1-b09e-0028899dec9c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.692654 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.692536 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss67x\" (UniqueName: \"kubernetes.io/projected/11923874-d106-4fd1-b09e-0028899dec9c-kube-api-access-ss67x\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.692654 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.692570 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11923874-d106-4fd1-b09e-0028899dec9c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.692654 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.692585 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/11923874-d106-4fd1-b09e-0028899dec9c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.692654 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.692652 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/11923874-d106-4fd1-b09e-0028899dec9c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.692807 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.692673 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11923874-d106-4fd1-b09e-0028899dec9c-web-config\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.692807 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.692691 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11923874-d106-4fd1-b09e-0028899dec9c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.692807 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.692714 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11923874-d106-4fd1-b09e-0028899dec9c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.692807 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.692754 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/11923874-d106-4fd1-b09e-0028899dec9c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.692807 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.692800 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11923874-d106-4fd1-b09e-0028899dec9c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.692945 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.692819 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/11923874-d106-4fd1-b09e-0028899dec9c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.692945 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.692835 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/11923874-d106-4fd1-b09e-0028899dec9c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.692945 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.692850 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11923874-d106-4fd1-b09e-0028899dec9c-config-out\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.692945 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.692867 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/11923874-d106-4fd1-b09e-0028899dec9c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.692945 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.692897 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11923874-d106-4fd1-b09e-0028899dec9c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.692945 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.692926 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/11923874-d106-4fd1-b09e-0028899dec9c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.693111 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.692954 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/11923874-d106-4fd1-b09e-0028899dec9c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.693111 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.692968 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11923874-d106-4fd1-b09e-0028899dec9c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.793959 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.793855 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/11923874-d106-4fd1-b09e-0028899dec9c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.793959 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.793902 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11923874-d106-4fd1-b09e-0028899dec9c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.793959 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.793933 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/11923874-d106-4fd1-b09e-0028899dec9c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.794215 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.793965 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/11923874-d106-4fd1-b09e-0028899dec9c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.794215 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.793987 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11923874-d106-4fd1-b09e-0028899dec9c-config-out\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.794215 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.794006 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/11923874-d106-4fd1-b09e-0028899dec9c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.794215 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.794028 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11923874-d106-4fd1-b09e-0028899dec9c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.794215 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.794054 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/11923874-d106-4fd1-b09e-0028899dec9c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.794215 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.794084 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/11923874-d106-4fd1-b09e-0028899dec9c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.794527 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.794506 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/11923874-d106-4fd1-b09e-0028899dec9c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.794619 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.794591 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11923874-d106-4fd1-b09e-0028899dec9c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.794672 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.794632 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11923874-d106-4fd1-b09e-0028899dec9c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.794719 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.794670 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/11923874-d106-4fd1-b09e-0028899dec9c-config\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.794719 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.794675 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/11923874-d106-4fd1-b09e-0028899dec9c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.794719 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.794693 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/11923874-d106-4fd1-b09e-0028899dec9c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.794876 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.794735 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11923874-d106-4fd1-b09e-0028899dec9c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.794876 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.794771 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss67x\" (UniqueName: \"kubernetes.io/projected/11923874-d106-4fd1-b09e-0028899dec9c-kube-api-access-ss67x\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.794876 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.794796 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11923874-d106-4fd1-b09e-0028899dec9c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.794876 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.794822 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/11923874-d106-4fd1-b09e-0028899dec9c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.794876 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.794862 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/11923874-d106-4fd1-b09e-0028899dec9c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.795174 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.794894 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11923874-d106-4fd1-b09e-0028899dec9c-web-config\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.795174 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.794922 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11923874-d106-4fd1-b09e-0028899dec9c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.795174 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.794959 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11923874-d106-4fd1-b09e-0028899dec9c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.795393 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.795367 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11923874-d106-4fd1-b09e-0028899dec9c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.797816 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.797212 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11923874-d106-4fd1-b09e-0028899dec9c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.797816 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.797274 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/11923874-d106-4fd1-b09e-0028899dec9c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.797816 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.797383 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11923874-d106-4fd1-b09e-0028899dec9c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.797816 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.797469 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11923874-d106-4fd1-b09e-0028899dec9c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.797816 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.797684 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11923874-d106-4fd1-b09e-0028899dec9c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.797816 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.797702 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11923874-d106-4fd1-b09e-0028899dec9c-config-out\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.798198 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.798060 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11923874-d106-4fd1-b09e-0028899dec9c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.798712 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.798683 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11923874-d106-4fd1-b09e-0028899dec9c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.798712 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.798695 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11923874-d106-4fd1-b09e-0028899dec9c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.798874 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.798753 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/11923874-d106-4fd1-b09e-0028899dec9c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.798975 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.798957 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/11923874-d106-4fd1-b09e-0028899dec9c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.799020 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.798996 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11923874-d106-4fd1-b09e-0028899dec9c-web-config\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.799414 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.799398 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/11923874-d106-4fd1-b09e-0028899dec9c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.800324 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.800307 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/11923874-d106-4fd1-b09e-0028899dec9c-config\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.800393 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.800379 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/11923874-d106-4fd1-b09e-0028899dec9c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.804572 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.804538 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss67x\" (UniqueName: \"kubernetes.io/projected/11923874-d106-4fd1-b09e-0028899dec9c-kube-api-access-ss67x\") pod \"prometheus-k8s-0\" (UID: \"11923874-d106-4fd1-b09e-0028899dec9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.865137 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.865091 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:34:24.998823 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:24.998791 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 13:34:25.002644 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:34:25.002613 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11923874_d106_4fd1_b09e_0028899dec9c.slice/crio-6690bb2966bcf5f352c6fb83f829641be2f3db0e9543c469a886b2637b963c23 WatchSource:0}: Error finding container 6690bb2966bcf5f352c6fb83f829641be2f3db0e9543c469a886b2637b963c23: Status 404 returned error can't find the container with id 6690bb2966bcf5f352c6fb83f829641be2f3db0e9543c469a886b2637b963c23 Jun 09 13:34:25.275900 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:25.275872 2544 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="308c72de-4700-42d8-967f-4a6da4d570dd" path="/var/lib/kubelet/pods/308c72de-4700-42d8-967f-4a6da4d570dd/volumes" Jun 09 13:34:25.495541 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:25.495507 2544 generic.go:356] "Generic (PLEG): container finished" podID="11923874-d106-4fd1-b09e-0028899dec9c" containerID="cff2e132edc9afecd3ed5ab6d358734cf3f89459c11f858c4e380de9ccc5fcf7" exitCode=0 Jun 09 13:34:25.495951 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:25.495597 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11923874-d106-4fd1-b09e-0028899dec9c","Type":"ContainerDied","Data":"cff2e132edc9afecd3ed5ab6d358734cf3f89459c11f858c4e380de9ccc5fcf7"} Jun 09 13:34:25.495951 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:25.495666 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11923874-d106-4fd1-b09e-0028899dec9c","Type":"ContainerStarted","Data":"6690bb2966bcf5f352c6fb83f829641be2f3db0e9543c469a886b2637b963c23"} Jun 09 13:34:26.502842 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:26.502810 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11923874-d106-4fd1-b09e-0028899dec9c","Type":"ContainerStarted","Data":"f1287c80668161ab467f9c201b1b957ec5e11de50846fb078fcda1e65324567c"} Jun 09 13:34:26.503212 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:26.502900 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11923874-d106-4fd1-b09e-0028899dec9c","Type":"ContainerStarted","Data":"52f6d7ce12e9616771a6a5bb1f7c0b0aaf1958deb692fc210b88f52665b8a2b3"} Jun 09 13:34:26.503212 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:26.502927 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11923874-d106-4fd1-b09e-0028899dec9c","Type":"ContainerStarted","Data":"f1d1ef1f24e459866991965765ba6aa1206d71abaa62f8c3a33ad0f2f53d6a23"} Jun 09 13:34:26.503212 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:26.502955 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11923874-d106-4fd1-b09e-0028899dec9c","Type":"ContainerStarted","Data":"488f7d5b35178462fad719fd75faf6447963209570359afdbede3f6581e1654e"} Jun 09 13:34:26.503212 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:26.502979 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11923874-d106-4fd1-b09e-0028899dec9c","Type":"ContainerStarted","Data":"a992d343d99df7987e901509bbbd9f7a24f84b2ca2f3b3f3fb81cf0669ff062e"} Jun 09 13:34:26.503212 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:26.503002 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11923874-d106-4fd1-b09e-0028899dec9c","Type":"ContainerStarted","Data":"b51dd35a68fa9bd37c43fa7d8a43d5ee44e2effa5d09d5eff343397bc13cc5fc"} Jun 09 13:34:26.532038 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:26.531984 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.513450606 podStartE2EDuration="2.531965695s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.515089ms" isStatefulPod=false podCreationTimestamp="2026-06-09 13:34:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:34:26.529630744 +0000 UTC m=+373.684902956" watchObservedRunningTime="2026-06-09 13:34:26.531965695 +0000 UTC m=+373.687237912" Jun 09 13:34:27.116929 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:27.116889 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs\") pod \"network-metrics-daemon-wkwcl\" (UID: \"a7641f4a-8124-4524-ab0a-34dfebafe183\") " pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:34:27.119183 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:27.119163 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7641f4a-8124-4524-ab0a-34dfebafe183-metrics-certs\") pod \"network-metrics-daemon-wkwcl\" (UID: \"a7641f4a-8124-4524-ab0a-34dfebafe183\") " pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:34:27.179810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:27.179778 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vwqsn\"" Jun 09 13:34:27.187824 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:27.187801 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wkwcl" Jun 09 13:34:27.313043 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:27.312870 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wkwcl"] Jun 09 13:34:27.315866 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:34:27.315839 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7641f4a_8124_4524_ab0a_34dfebafe183.slice/crio-600aa45fed258be9029148f3078ee08d243dd3bfabeb1fc50b831490694c9bae WatchSource:0}: Error finding container 600aa45fed258be9029148f3078ee08d243dd3bfabeb1fc50b831490694c9bae: Status 404 returned error can't find the container with id 600aa45fed258be9029148f3078ee08d243dd3bfabeb1fc50b831490694c9bae Jun 09 13:34:27.317918 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:27.317897 2544 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 13:34:27.508557 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:27.508521 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wkwcl" event={"ID":"a7641f4a-8124-4524-ab0a-34dfebafe183","Type":"ContainerStarted","Data":"600aa45fed258be9029148f3078ee08d243dd3bfabeb1fc50b831490694c9bae"} Jun 09 13:34:28.513822 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:28.513787 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wkwcl" event={"ID":"a7641f4a-8124-4524-ab0a-34dfebafe183","Type":"ContainerStarted","Data":"1b0a00604f7ae830e7c65c8eb05f8de5692819909e38531303002863a67187c8"} Jun 09 13:34:28.514202 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:28.513847 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wkwcl" event={"ID":"a7641f4a-8124-4524-ab0a-34dfebafe183","Type":"ContainerStarted","Data":"f0ba1292603b7f5f388b95db5a8991ac0ab62404c12f5030a97400db3d29a77a"} Jun 09 13:34:28.530424 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:28.530376 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wkwcl" podStartSLOduration=374.764085851 podStartE2EDuration="6m15.530362172s" totalImagesPullingTime="766.276321ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:34:28.529171185 +0000 UTC m=+375.684443397" watchObservedRunningTime="2026-06-09 13:34:28.530362172 +0000 UTC m=+375.685634408" Jun 09 13:34:29.866269 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:34:29.866224 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:35:24.866213 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:35:24.866171 2544 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:35:24.881373 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:35:24.881349 2544 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:35:25.754330 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:35:25.754304 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 13:36:14.688882 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:14.688841 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-2pqw5"] Jun 09 13:36:14.692246 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:14.692224 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-2pqw5" Jun 09 13:36:14.694731 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:14.694707 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 13:36:14.694868 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:14.694806 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 13:36:14.694868 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:14.694810 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 13:36:14.695102 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:14.695084 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9m7tj\"" Jun 09 13:36:14.695743 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:14.695729 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 13:36:14.716030 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:14.716004 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-2pqw5"] Jun 09 13:36:14.727251 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:14.727220 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffe78902-e6f4-49a0-8d9e-c7fcf20046a9-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-2pqw5\" (UID: \"ffe78902-e6f4-49a0-8d9e-c7fcf20046a9\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-2pqw5" Jun 09 13:36:14.727352 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:14.727298 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ffe78902-e6f4-49a0-8d9e-c7fcf20046a9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-2pqw5\" (UID: \"ffe78902-e6f4-49a0-8d9e-c7fcf20046a9\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-2pqw5" Jun 09 13:36:14.727352 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:14.727330 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffe78902-e6f4-49a0-8d9e-c7fcf20046a9-tmp\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-2pqw5\" (UID: \"ffe78902-e6f4-49a0-8d9e-c7fcf20046a9\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-2pqw5" Jun 09 13:36:14.727470 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:14.727440 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s97k2\" (UniqueName: \"kubernetes.io/projected/ffe78902-e6f4-49a0-8d9e-c7fcf20046a9-kube-api-access-s97k2\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-2pqw5\" (UID: \"ffe78902-e6f4-49a0-8d9e-c7fcf20046a9\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-2pqw5" Jun 09 13:36:14.727518 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:14.727480 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ffe78902-e6f4-49a0-8d9e-c7fcf20046a9-manifests\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-2pqw5\" (UID: \"ffe78902-e6f4-49a0-8d9e-c7fcf20046a9\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-2pqw5" Jun 09 13:36:14.828291 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:14.828256 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s97k2\" (UniqueName: \"kubernetes.io/projected/ffe78902-e6f4-49a0-8d9e-c7fcf20046a9-kube-api-access-s97k2\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-2pqw5\" (UID: \"ffe78902-e6f4-49a0-8d9e-c7fcf20046a9\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-2pqw5" Jun 09 13:36:14.828453 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:14.828301 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ffe78902-e6f4-49a0-8d9e-c7fcf20046a9-manifests\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-2pqw5\" (UID: \"ffe78902-e6f4-49a0-8d9e-c7fcf20046a9\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-2pqw5" Jun 09 13:36:14.828453 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:14.828324 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffe78902-e6f4-49a0-8d9e-c7fcf20046a9-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-2pqw5\" (UID: \"ffe78902-e6f4-49a0-8d9e-c7fcf20046a9\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-2pqw5" Jun 09 13:36:14.828453 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:14.828365 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ffe78902-e6f4-49a0-8d9e-c7fcf20046a9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-2pqw5\" (UID: \"ffe78902-e6f4-49a0-8d9e-c7fcf20046a9\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-2pqw5" Jun 09 13:36:14.828453 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:14.828385 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffe78902-e6f4-49a0-8d9e-c7fcf20046a9-tmp\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-2pqw5\" (UID: \"ffe78902-e6f4-49a0-8d9e-c7fcf20046a9\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-2pqw5" Jun 09 13:36:14.828774 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:14.828754 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ffe78902-e6f4-49a0-8d9e-c7fcf20046a9-manifests\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-2pqw5\" (UID: \"ffe78902-e6f4-49a0-8d9e-c7fcf20046a9\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-2pqw5" Jun 09 13:36:14.830692 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:14.830667 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffe78902-e6f4-49a0-8d9e-c7fcf20046a9-tmp\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-2pqw5\" (UID: \"ffe78902-e6f4-49a0-8d9e-c7fcf20046a9\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-2pqw5" Jun 09 13:36:14.830891 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:14.830873 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffe78902-e6f4-49a0-8d9e-c7fcf20046a9-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-2pqw5\" (UID: \"ffe78902-e6f4-49a0-8d9e-c7fcf20046a9\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-2pqw5" Jun 09 13:36:14.830953 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:14.830913 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ffe78902-e6f4-49a0-8d9e-c7fcf20046a9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-2pqw5\" (UID: \"ffe78902-e6f4-49a0-8d9e-c7fcf20046a9\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-2pqw5" Jun 09 13:36:14.836899 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:14.836879 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s97k2\" (UniqueName: \"kubernetes.io/projected/ffe78902-e6f4-49a0-8d9e-c7fcf20046a9-kube-api-access-s97k2\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-2pqw5\" (UID: \"ffe78902-e6f4-49a0-8d9e-c7fcf20046a9\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-2pqw5" Jun 09 13:36:15.002878 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:15.002848 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-2pqw5" Jun 09 13:36:15.135594 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:15.135571 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-2pqw5"] Jun 09 13:36:15.138491 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:36:15.138465 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffe78902_e6f4_49a0_8d9e_c7fcf20046a9.slice/crio-efe986d55e8b60812c12bf5efdd97b6906088fb28004e61c691b1ea748a753de WatchSource:0}: Error finding container efe986d55e8b60812c12bf5efdd97b6906088fb28004e61c691b1ea748a753de: Status 404 returned error can't find the container with id efe986d55e8b60812c12bf5efdd97b6906088fb28004e61c691b1ea748a753de Jun 09 13:36:15.946827 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:15.946787 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-2pqw5" event={"ID":"ffe78902-e6f4-49a0-8d9e-c7fcf20046a9","Type":"ContainerStarted","Data":"efe986d55e8b60812c12bf5efdd97b6906088fb28004e61c691b1ea748a753de"} Jun 09 13:36:18.967648 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:18.967608 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-2pqw5" event={"ID":"ffe78902-e6f4-49a0-8d9e-c7fcf20046a9","Type":"ContainerStarted","Data":"a0bb8426cc38fa79b5329f21cc0dae9c69a4424d229217c4912bafb42260b520"} Jun 09 13:36:19.974003 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:19.973965 2544 generic.go:356] "Generic (PLEG): container finished" podID="ffe78902-e6f4-49a0-8d9e-c7fcf20046a9" containerID="a0bb8426cc38fa79b5329f21cc0dae9c69a4424d229217c4912bafb42260b520" exitCode=0 Jun 09 13:36:19.974587 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:19.974020 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-2pqw5" event={"ID":"ffe78902-e6f4-49a0-8d9e-c7fcf20046a9","Type":"ContainerDied","Data":"a0bb8426cc38fa79b5329f21cc0dae9c69a4424d229217c4912bafb42260b520"} Jun 09 13:36:20.979893 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:20.979857 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-2pqw5" event={"ID":"ffe78902-e6f4-49a0-8d9e-c7fcf20046a9","Type":"ContainerStarted","Data":"113c209ec8a4cdb6bca8629bdbbe4c1dc3054ecef8b8355e5d317763576b9130"} Jun 09 13:36:20.980325 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:20.980001 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-2pqw5" Jun 09 13:36:21.005713 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:21.005667 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-2pqw5" podStartSLOduration=2.5693799779999997 podStartE2EDuration="7.005651552s" totalImagesPullingTime="3.497379014s" totalInitContainerRuntime="938.89256ms" isStatefulPod=false podCreationTimestamp="2026-06-09 13:36:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:36:21.003517936 +0000 UTC m=+488.158790147" watchObservedRunningTime="2026-06-09 13:36:21.005651552 +0000 UTC m=+488.160923801" Jun 09 13:36:31.985766 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:31.985740 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-2pqw5" Jun 09 13:36:41.682907 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:41.682876 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-855cb6f887-shc6g"] Jun 09 13:36:41.688745 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:41.688725 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-855cb6f887-shc6g" Jun 09 13:36:41.691472 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:41.691448 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 13:36:41.691623 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:41.691510 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 13:36:41.691623 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:41.691541 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 13:36:41.691623 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:41.691510 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 13:36:41.692615 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:41.692595 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xhfqg\"" Jun 09 13:36:41.692740 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:41.692722 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 13:36:41.697847 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:41.697828 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-855cb6f887-shc6g"] Jun 09 13:36:41.760123 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:41.760095 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/529f7c7c-f16f-4e10-83a2-1160aa73d09f-metrics-cert\") pod \"lws-controller-manager-855cb6f887-shc6g\" (UID: \"529f7c7c-f16f-4e10-83a2-1160aa73d09f\") " pod="openshift-lws-operator/lws-controller-manager-855cb6f887-shc6g" Jun 09 13:36:41.760294 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:41.760129 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f57sf\" (UniqueName: \"kubernetes.io/projected/529f7c7c-f16f-4e10-83a2-1160aa73d09f-kube-api-access-f57sf\") pod \"lws-controller-manager-855cb6f887-shc6g\" (UID: \"529f7c7c-f16f-4e10-83a2-1160aa73d09f\") " pod="openshift-lws-operator/lws-controller-manager-855cb6f887-shc6g" Jun 09 13:36:41.760294 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:41.760152 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/529f7c7c-f16f-4e10-83a2-1160aa73d09f-cert\") pod \"lws-controller-manager-855cb6f887-shc6g\" (UID: \"529f7c7c-f16f-4e10-83a2-1160aa73d09f\") " pod="openshift-lws-operator/lws-controller-manager-855cb6f887-shc6g" Jun 09 13:36:41.760294 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:41.760192 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/529f7c7c-f16f-4e10-83a2-1160aa73d09f-manager-config\") pod \"lws-controller-manager-855cb6f887-shc6g\" (UID: \"529f7c7c-f16f-4e10-83a2-1160aa73d09f\") " pod="openshift-lws-operator/lws-controller-manager-855cb6f887-shc6g" Jun 09 13:36:41.861052 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:41.861017 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/529f7c7c-f16f-4e10-83a2-1160aa73d09f-metrics-cert\") pod \"lws-controller-manager-855cb6f887-shc6g\" (UID: \"529f7c7c-f16f-4e10-83a2-1160aa73d09f\") " pod="openshift-lws-operator/lws-controller-manager-855cb6f887-shc6g" Jun 09 13:36:41.861233 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:41.861058 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f57sf\" (UniqueName: \"kubernetes.io/projected/529f7c7c-f16f-4e10-83a2-1160aa73d09f-kube-api-access-f57sf\") pod \"lws-controller-manager-855cb6f887-shc6g\" (UID: \"529f7c7c-f16f-4e10-83a2-1160aa73d09f\") " pod="openshift-lws-operator/lws-controller-manager-855cb6f887-shc6g" Jun 09 13:36:41.861233 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:41.861087 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/529f7c7c-f16f-4e10-83a2-1160aa73d09f-cert\") pod \"lws-controller-manager-855cb6f887-shc6g\" (UID: \"529f7c7c-f16f-4e10-83a2-1160aa73d09f\") " pod="openshift-lws-operator/lws-controller-manager-855cb6f887-shc6g" Jun 09 13:36:41.861233 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:41.861125 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/529f7c7c-f16f-4e10-83a2-1160aa73d09f-manager-config\") pod \"lws-controller-manager-855cb6f887-shc6g\" (UID: \"529f7c7c-f16f-4e10-83a2-1160aa73d09f\") " pod="openshift-lws-operator/lws-controller-manager-855cb6f887-shc6g" Jun 09 13:36:41.861850 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:41.861830 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/529f7c7c-f16f-4e10-83a2-1160aa73d09f-manager-config\") pod \"lws-controller-manager-855cb6f887-shc6g\" (UID: \"529f7c7c-f16f-4e10-83a2-1160aa73d09f\") " pod="openshift-lws-operator/lws-controller-manager-855cb6f887-shc6g" Jun 09 13:36:41.863595 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:41.863578 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/529f7c7c-f16f-4e10-83a2-1160aa73d09f-metrics-cert\") pod \"lws-controller-manager-855cb6f887-shc6g\" (UID: \"529f7c7c-f16f-4e10-83a2-1160aa73d09f\") " pod="openshift-lws-operator/lws-controller-manager-855cb6f887-shc6g" Jun 09 13:36:41.863657 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:41.863624 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/529f7c7c-f16f-4e10-83a2-1160aa73d09f-cert\") pod \"lws-controller-manager-855cb6f887-shc6g\" (UID: \"529f7c7c-f16f-4e10-83a2-1160aa73d09f\") " pod="openshift-lws-operator/lws-controller-manager-855cb6f887-shc6g" Jun 09 13:36:41.869066 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:41.869042 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f57sf\" (UniqueName: \"kubernetes.io/projected/529f7c7c-f16f-4e10-83a2-1160aa73d09f-kube-api-access-f57sf\") pod \"lws-controller-manager-855cb6f887-shc6g\" (UID: \"529f7c7c-f16f-4e10-83a2-1160aa73d09f\") " pod="openshift-lws-operator/lws-controller-manager-855cb6f887-shc6g" Jun 09 13:36:41.998834 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:41.998807 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-855cb6f887-shc6g" Jun 09 13:36:42.125482 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:42.125439 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-855cb6f887-shc6g"] Jun 09 13:36:42.128052 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:36:42.128029 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod529f7c7c_f16f_4e10_83a2_1160aa73d09f.slice/crio-b6d7f2bce3ca1fa3025c350029ac22f5d2ca6e5aaed44ba7ff83c7c3f91fc9d7 WatchSource:0}: Error finding container b6d7f2bce3ca1fa3025c350029ac22f5d2ca6e5aaed44ba7ff83c7c3f91fc9d7: Status 404 returned error can't find the container with id b6d7f2bce3ca1fa3025c350029ac22f5d2ca6e5aaed44ba7ff83c7c3f91fc9d7 Jun 09 13:36:43.078720 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:43.078603 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-855cb6f887-shc6g" event={"ID":"529f7c7c-f16f-4e10-83a2-1160aa73d09f","Type":"ContainerStarted","Data":"b6d7f2bce3ca1fa3025c350029ac22f5d2ca6e5aaed44ba7ff83c7c3f91fc9d7"} Jun 09 13:36:45.089421 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:45.089383 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-855cb6f887-shc6g" event={"ID":"529f7c7c-f16f-4e10-83a2-1160aa73d09f","Type":"ContainerStarted","Data":"3fc2fd1ce67d4b718fe6d1878b5f02ad07fdf2bb864ed5837f89534a814d5e4d"} Jun 09 13:36:45.089858 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:45.089448 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-855cb6f887-shc6g" Jun 09 13:36:45.116085 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:45.116039 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-855cb6f887-shc6g" podStartSLOduration=1.861595274 podStartE2EDuration="4.116024327s" totalImagesPullingTime="2.254429053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:36:45.114787662 +0000 UTC m=+512.270059875" watchObservedRunningTime="2026-06-09 13:36:45.116024327 +0000 UTC m=+512.271296538" Jun 09 13:36:56.097128 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:36:56.097091 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-855cb6f887-shc6g" Jun 09 13:37:04.170271 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:04.170194 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7c5f8fd4f7-c8hbq"] Jun 09 13:37:04.173483 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:04.173455 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7c5f8fd4f7-c8hbq" Jun 09 13:37:04.176327 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:04.176305 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-znpw2\"" Jun 09 13:37:04.176448 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:04.176381 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 13:37:04.181644 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:04.181620 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7c5f8fd4f7-c8hbq"] Jun 09 13:37:04.253938 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:04.253904 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/885ec77c-335d-4f25-8166-c374fc185dd9-redirect-config\") pod \"dashboard-redirect-7c5f8fd4f7-c8hbq\" (UID: \"885ec77c-335d-4f25-8166-c374fc185dd9\") " pod="opendatahub/dashboard-redirect-7c5f8fd4f7-c8hbq" Jun 09 13:37:04.254128 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:04.253994 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-278d8\" (UniqueName: \"kubernetes.io/projected/885ec77c-335d-4f25-8166-c374fc185dd9-kube-api-access-278d8\") pod \"dashboard-redirect-7c5f8fd4f7-c8hbq\" (UID: \"885ec77c-335d-4f25-8166-c374fc185dd9\") " pod="opendatahub/dashboard-redirect-7c5f8fd4f7-c8hbq" Jun 09 13:37:04.355223 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:04.355180 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/885ec77c-335d-4f25-8166-c374fc185dd9-redirect-config\") pod \"dashboard-redirect-7c5f8fd4f7-c8hbq\" (UID: \"885ec77c-335d-4f25-8166-c374fc185dd9\") " pod="opendatahub/dashboard-redirect-7c5f8fd4f7-c8hbq" Jun 09 13:37:04.355430 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:04.355236 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-278d8\" (UniqueName: \"kubernetes.io/projected/885ec77c-335d-4f25-8166-c374fc185dd9-kube-api-access-278d8\") pod \"dashboard-redirect-7c5f8fd4f7-c8hbq\" (UID: \"885ec77c-335d-4f25-8166-c374fc185dd9\") " pod="opendatahub/dashboard-redirect-7c5f8fd4f7-c8hbq" Jun 09 13:37:04.355952 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:04.355932 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/885ec77c-335d-4f25-8166-c374fc185dd9-redirect-config\") pod \"dashboard-redirect-7c5f8fd4f7-c8hbq\" (UID: \"885ec77c-335d-4f25-8166-c374fc185dd9\") " pod="opendatahub/dashboard-redirect-7c5f8fd4f7-c8hbq" Jun 09 13:37:04.363703 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:04.363686 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-278d8\" (UniqueName: \"kubernetes.io/projected/885ec77c-335d-4f25-8166-c374fc185dd9-kube-api-access-278d8\") pod \"dashboard-redirect-7c5f8fd4f7-c8hbq\" (UID: \"885ec77c-335d-4f25-8166-c374fc185dd9\") " pod="opendatahub/dashboard-redirect-7c5f8fd4f7-c8hbq" Jun 09 13:37:04.485694 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:04.485612 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7c5f8fd4f7-c8hbq" Jun 09 13:37:04.613630 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:04.613604 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7c5f8fd4f7-c8hbq"] Jun 09 13:37:04.615970 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:37:04.615944 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod885ec77c_335d_4f25_8166_c374fc185dd9.slice/crio-e1729abae398e742c5efd9e5b6767228c757ca98614584818f4a877fefde80bb WatchSource:0}: Error finding container e1729abae398e742c5efd9e5b6767228c757ca98614584818f4a877fefde80bb: Status 404 returned error can't find the container with id e1729abae398e742c5efd9e5b6767228c757ca98614584818f4a877fefde80bb Jun 09 13:37:05.183455 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:05.183420 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7c5f8fd4f7-c8hbq" event={"ID":"885ec77c-335d-4f25-8166-c374fc185dd9","Type":"ContainerStarted","Data":"e1729abae398e742c5efd9e5b6767228c757ca98614584818f4a877fefde80bb"} Jun 09 13:37:07.194252 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:07.194214 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7c5f8fd4f7-c8hbq" event={"ID":"885ec77c-335d-4f25-8166-c374fc185dd9","Type":"ContainerStarted","Data":"64577960a9c88c2d07ebe1dd8019a4b2a51313fcc6bc2e8e1e5848c13b008a2f"} Jun 09 13:37:07.211747 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:07.211693 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7c5f8fd4f7-c8hbq" podStartSLOduration=1.428967102 podStartE2EDuration="3.21167365s" totalImagesPullingTime="1.782706548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:37:07.211078674 +0000 UTC m=+534.366350897" watchObservedRunningTime="2026-06-09 13:37:07.21167365 +0000 UTC m=+534.366945868" Jun 09 13:37:28.889197 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:28.889160 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf"] Jun 09 13:37:28.897640 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:28.897619 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:28.900365 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:28.900339 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-v884l\"" Jun 09 13:37:28.900365 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:28.900354 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 13:37:28.900564 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:28.900343 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 13:37:28.900564 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:28.900380 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 13:37:28.908883 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:28.908860 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf"] Jun 09 13:37:28.980510 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:28.980472 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:28.980510 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:28.980511 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47129e3d-376a-400c-b4b1-2ac988aadde8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:28.980728 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:28.980630 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47129e3d-376a-400c-b4b1-2ac988aadde8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:28.980728 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:28.980673 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47129e3d-376a-400c-b4b1-2ac988aadde8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:28.980728 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:28.980698 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:28.980830 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:28.980769 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vft4p\" (UniqueName: \"kubernetes.io/projected/47129e3d-376a-400c-b4b1-2ac988aadde8-kube-api-access-vft4p\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:28.980830 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:28.980806 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:28.980892 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:28.980856 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:28.980892 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:28.980875 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:29.081831 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.081795 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47129e3d-376a-400c-b4b1-2ac988aadde8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:29.082008 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.081845 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:29.082008 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.081895 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vft4p\" (UniqueName: \"kubernetes.io/projected/47129e3d-376a-400c-b4b1-2ac988aadde8-kube-api-access-vft4p\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:29.082008 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.081941 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:29.082008 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.081989 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:29.082208 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.082019 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:29.082208 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.082044 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:29.082208 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.082067 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47129e3d-376a-400c-b4b1-2ac988aadde8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:29.082208 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.082117 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47129e3d-376a-400c-b4b1-2ac988aadde8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:29.082490 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.082459 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:29.082654 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.082541 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:29.082654 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.082615 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:29.082772 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.082660 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:29.082889 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.082870 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47129e3d-376a-400c-b4b1-2ac988aadde8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:29.084364 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.084343 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:29.084475 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.084457 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47129e3d-376a-400c-b4b1-2ac988aadde8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:29.093204 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.093177 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47129e3d-376a-400c-b4b1-2ac988aadde8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:29.093489 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.093473 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vft4p\" (UniqueName: \"kubernetes.io/projected/47129e3d-376a-400c-b4b1-2ac988aadde8-kube-api-access-vft4p\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:29.139853 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.139766 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb"] Jun 09 13:37:29.144500 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.144485 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.154099 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.154066 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb"] Jun 09 13:37:29.208332 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.208300 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:29.283799 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.283771 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ac11b82-cbd5-48a4-a308-5969a21cd7b5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vttrb\" (UID: \"2ac11b82-cbd5-48a4-a308-5969a21cd7b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.283930 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.283812 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74254\" (UniqueName: \"kubernetes.io/projected/2ac11b82-cbd5-48a4-a308-5969a21cd7b5-kube-api-access-74254\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vttrb\" (UID: \"2ac11b82-cbd5-48a4-a308-5969a21cd7b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.283930 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.283875 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ac11b82-cbd5-48a4-a308-5969a21cd7b5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vttrb\" (UID: \"2ac11b82-cbd5-48a4-a308-5969a21cd7b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.284036 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.283947 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ac11b82-cbd5-48a4-a308-5969a21cd7b5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vttrb\" (UID: \"2ac11b82-cbd5-48a4-a308-5969a21cd7b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.284036 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.283987 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ac11b82-cbd5-48a4-a308-5969a21cd7b5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vttrb\" (UID: \"2ac11b82-cbd5-48a4-a308-5969a21cd7b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.284036 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.284004 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ac11b82-cbd5-48a4-a308-5969a21cd7b5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vttrb\" (UID: \"2ac11b82-cbd5-48a4-a308-5969a21cd7b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.284036 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.284022 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ac11b82-cbd5-48a4-a308-5969a21cd7b5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vttrb\" (UID: \"2ac11b82-cbd5-48a4-a308-5969a21cd7b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.284164 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.284097 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ac11b82-cbd5-48a4-a308-5969a21cd7b5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vttrb\" (UID: \"2ac11b82-cbd5-48a4-a308-5969a21cd7b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.284164 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.284158 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ac11b82-cbd5-48a4-a308-5969a21cd7b5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vttrb\" (UID: \"2ac11b82-cbd5-48a4-a308-5969a21cd7b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.346000 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.345952 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf"] Jun 09 13:37:29.348179 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:37:29.348151 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47129e3d_376a_400c_b4b1_2ac988aadde8.slice/crio-a44084e915ff8cd3fb305b5d5db46af743367b2ce57d2b1cef67ac4a34c0481a WatchSource:0}: Error finding container a44084e915ff8cd3fb305b5d5db46af743367b2ce57d2b1cef67ac4a34c0481a: Status 404 returned error can't find the container with id a44084e915ff8cd3fb305b5d5db46af743367b2ce57d2b1cef67ac4a34c0481a Jun 09 13:37:29.384642 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.384607 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ac11b82-cbd5-48a4-a308-5969a21cd7b5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vttrb\" (UID: \"2ac11b82-cbd5-48a4-a308-5969a21cd7b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.384797 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.384678 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ac11b82-cbd5-48a4-a308-5969a21cd7b5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vttrb\" (UID: \"2ac11b82-cbd5-48a4-a308-5969a21cd7b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.384797 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.384706 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ac11b82-cbd5-48a4-a308-5969a21cd7b5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vttrb\" (UID: \"2ac11b82-cbd5-48a4-a308-5969a21cd7b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.384797 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.384727 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ac11b82-cbd5-48a4-a308-5969a21cd7b5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vttrb\" (UID: \"2ac11b82-cbd5-48a4-a308-5969a21cd7b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.384797 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.384762 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ac11b82-cbd5-48a4-a308-5969a21cd7b5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vttrb\" (UID: \"2ac11b82-cbd5-48a4-a308-5969a21cd7b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.385006 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.384820 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ac11b82-cbd5-48a4-a308-5969a21cd7b5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vttrb\" (UID: \"2ac11b82-cbd5-48a4-a308-5969a21cd7b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.385006 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.384962 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ac11b82-cbd5-48a4-a308-5969a21cd7b5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vttrb\" (UID: \"2ac11b82-cbd5-48a4-a308-5969a21cd7b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.385110 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.385009 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74254\" (UniqueName: \"kubernetes.io/projected/2ac11b82-cbd5-48a4-a308-5969a21cd7b5-kube-api-access-74254\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vttrb\" (UID: \"2ac11b82-cbd5-48a4-a308-5969a21cd7b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.385110 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.385073 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ac11b82-cbd5-48a4-a308-5969a21cd7b5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vttrb\" (UID: \"2ac11b82-cbd5-48a4-a308-5969a21cd7b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.385110 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.385065 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ac11b82-cbd5-48a4-a308-5969a21cd7b5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vttrb\" (UID: \"2ac11b82-cbd5-48a4-a308-5969a21cd7b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.385262 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.385123 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ac11b82-cbd5-48a4-a308-5969a21cd7b5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vttrb\" (UID: \"2ac11b82-cbd5-48a4-a308-5969a21cd7b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.385262 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.385097 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ac11b82-cbd5-48a4-a308-5969a21cd7b5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vttrb\" (UID: \"2ac11b82-cbd5-48a4-a308-5969a21cd7b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.385350 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.385311 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ac11b82-cbd5-48a4-a308-5969a21cd7b5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vttrb\" (UID: \"2ac11b82-cbd5-48a4-a308-5969a21cd7b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.385527 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.385496 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ac11b82-cbd5-48a4-a308-5969a21cd7b5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vttrb\" (UID: \"2ac11b82-cbd5-48a4-a308-5969a21cd7b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.387216 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.387195 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ac11b82-cbd5-48a4-a308-5969a21cd7b5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vttrb\" (UID: \"2ac11b82-cbd5-48a4-a308-5969a21cd7b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.387321 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.387305 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ac11b82-cbd5-48a4-a308-5969a21cd7b5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vttrb\" (UID: \"2ac11b82-cbd5-48a4-a308-5969a21cd7b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.393717 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.393664 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ac11b82-cbd5-48a4-a308-5969a21cd7b5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vttrb\" (UID: \"2ac11b82-cbd5-48a4-a308-5969a21cd7b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.393808 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.393794 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74254\" (UniqueName: \"kubernetes.io/projected/2ac11b82-cbd5-48a4-a308-5969a21cd7b5-kube-api-access-74254\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vttrb\" (UID: \"2ac11b82-cbd5-48a4-a308-5969a21cd7b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.455261 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.455231 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:29.584057 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:29.584034 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb"] Jun 09 13:37:29.586016 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:37:29.585990 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ac11b82_cbd5_48a4_a308_5969a21cd7b5.slice/crio-d903afd4914e4e533ecf544c428da93d8291599548a01a0ad22dd5eed4c0d20c WatchSource:0}: Error finding container d903afd4914e4e533ecf544c428da93d8291599548a01a0ad22dd5eed4c0d20c: Status 404 returned error can't find the container with id d903afd4914e4e533ecf544c428da93d8291599548a01a0ad22dd5eed4c0d20c Jun 09 13:37:30.300169 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:30.300120 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" event={"ID":"47129e3d-376a-400c-b4b1-2ac988aadde8","Type":"ContainerStarted","Data":"a44084e915ff8cd3fb305b5d5db46af743367b2ce57d2b1cef67ac4a34c0481a"} Jun 09 13:37:30.301699 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:30.301667 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" event={"ID":"2ac11b82-cbd5-48a4-a308-5969a21cd7b5","Type":"ContainerStarted","Data":"d903afd4914e4e533ecf544c428da93d8291599548a01a0ad22dd5eed4c0d20c"} Jun 09 13:37:32.455299 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:32.455263 2544 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 13:37:32.455688 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:32.455331 2544 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 13:37:32.455688 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:32.455360 2544 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 13:37:32.463630 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:32.463596 2544 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 13:37:32.463713 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:32.463660 2544 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 13:37:32.463713 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:32.463688 2544 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 13:37:33.317514 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:33.317477 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" event={"ID":"47129e3d-376a-400c-b4b1-2ac988aadde8","Type":"ContainerStarted","Data":"183341a8dd0c46f0c4be41a6a781e4c402d14e1fc65a392518cf6c9983fbf140"} Jun 09 13:37:33.318972 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:33.318945 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" event={"ID":"2ac11b82-cbd5-48a4-a308-5969a21cd7b5","Type":"ContainerStarted","Data":"53214b727ddcbadcb4d8d3c96ae3abe25f8be1fd534d69396cda6835b82d42d5"} Jun 09 13:37:33.341918 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:33.341875 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" podStartSLOduration=2.236938401 podStartE2EDuration="5.341860545s" totalImagesPullingTime="3.104922144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:37:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:37:33.340263634 +0000 UTC m=+560.495535846" watchObservedRunningTime="2026-06-09 13:37:33.341860545 +0000 UTC m=+560.497132756" Jun 09 13:37:33.362887 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:33.362843 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" podStartSLOduration=1.48750484 podStartE2EDuration="4.362828661s" totalImagesPullingTime="2.875323821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:37:33.361842922 +0000 UTC m=+560.517115138" watchObservedRunningTime="2026-06-09 13:37:33.362828661 +0000 UTC m=+560.518100896" Jun 09 13:37:33.455641 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:33.455609 2544 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:33.462360 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:33.462337 2544 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:34.208827 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:34.208790 2544 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:34.210184 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:34.210157 2544 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jun 09 13:37:34.210286 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:34.210216 2544 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" podUID="47129e3d-376a-400c-b4b1-2ac988aadde8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jun 09 13:37:34.323698 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:34.323666 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:34.324451 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:34.324433 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vttrb" Jun 09 13:37:34.391783 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:34.391755 2544 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf"] Jun 09 13:37:35.208917 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:35.208880 2544 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jun 09 13:37:35.209374 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:35.208937 2544 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" podUID="47129e3d-376a-400c-b4b1-2ac988aadde8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jun 09 13:37:35.211973 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:35.211946 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8zq9r"] Jun 09 13:37:35.215367 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:35.215352 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8zq9r" Jun 09 13:37:35.218154 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:35.218130 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 13:37:35.218411 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:35.218394 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6njcq\"" Jun 09 13:37:35.218513 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:35.218423 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 13:37:35.223336 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:35.223310 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8zq9r"] Jun 09 13:37:35.341748 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:35.341717 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdwz5\" (UniqueName: \"kubernetes.io/projected/2702f943-5a98-4dc0-9b31-f903e5118571-kube-api-access-cdwz5\") pod \"kuadrant-operator-catalog-8zq9r\" (UID: \"2702f943-5a98-4dc0-9b31-f903e5118571\") " pod="kuadrant-system/kuadrant-operator-catalog-8zq9r" Jun 09 13:37:35.442885 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:35.442843 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdwz5\" (UniqueName: \"kubernetes.io/projected/2702f943-5a98-4dc0-9b31-f903e5118571-kube-api-access-cdwz5\") pod \"kuadrant-operator-catalog-8zq9r\" (UID: \"2702f943-5a98-4dc0-9b31-f903e5118571\") " pod="kuadrant-system/kuadrant-operator-catalog-8zq9r" Jun 09 13:37:35.451680 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:35.451654 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdwz5\" (UniqueName: \"kubernetes.io/projected/2702f943-5a98-4dc0-9b31-f903e5118571-kube-api-access-cdwz5\") pod \"kuadrant-operator-catalog-8zq9r\" (UID: \"2702f943-5a98-4dc0-9b31-f903e5118571\") " pod="kuadrant-system/kuadrant-operator-catalog-8zq9r" Jun 09 13:37:35.525909 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:35.525879 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8zq9r" Jun 09 13:37:35.582329 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:35.582247 2544 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8zq9r"] Jun 09 13:37:35.660601 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:35.660576 2544 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8zq9r"] Jun 09 13:37:35.663056 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:37:35.663029 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2702f943_5a98_4dc0_9b31_f903e5118571.slice/crio-a97dd8fb08e676e52e96bdf863f28768b37803d15eb1e276e59322b0343d225c WatchSource:0}: Error finding container a97dd8fb08e676e52e96bdf863f28768b37803d15eb1e276e59322b0343d225c: Status 404 returned error can't find the container with id a97dd8fb08e676e52e96bdf863f28768b37803d15eb1e276e59322b0343d225c Jun 09 13:37:35.788339 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:35.788251 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t7z8j"] Jun 09 13:37:35.792712 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:35.792693 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t7z8j" Jun 09 13:37:35.798620 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:35.798599 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t7z8j"] Jun 09 13:37:35.947839 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:35.947798 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz6s4\" (UniqueName: \"kubernetes.io/projected/523eb8b1-ee77-4ac1-9b49-98dfd53ed5f6-kube-api-access-mz6s4\") pod \"kuadrant-operator-catalog-t7z8j\" (UID: \"523eb8b1-ee77-4ac1-9b49-98dfd53ed5f6\") " pod="kuadrant-system/kuadrant-operator-catalog-t7z8j" Jun 09 13:37:36.049170 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:36.049089 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz6s4\" (UniqueName: \"kubernetes.io/projected/523eb8b1-ee77-4ac1-9b49-98dfd53ed5f6-kube-api-access-mz6s4\") pod \"kuadrant-operator-catalog-t7z8j\" (UID: \"523eb8b1-ee77-4ac1-9b49-98dfd53ed5f6\") " pod="kuadrant-system/kuadrant-operator-catalog-t7z8j" Jun 09 13:37:36.058635 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:36.058605 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz6s4\" (UniqueName: \"kubernetes.io/projected/523eb8b1-ee77-4ac1-9b49-98dfd53ed5f6-kube-api-access-mz6s4\") pod \"kuadrant-operator-catalog-t7z8j\" (UID: \"523eb8b1-ee77-4ac1-9b49-98dfd53ed5f6\") " pod="kuadrant-system/kuadrant-operator-catalog-t7z8j" Jun 09 13:37:36.102468 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:36.102427 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t7z8j" Jun 09 13:37:36.209207 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:36.209174 2544 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jun 09 13:37:36.209536 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:36.209239 2544 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" podUID="47129e3d-376a-400c-b4b1-2ac988aadde8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jun 09 13:37:36.255392 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:36.255368 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t7z8j"] Jun 09 13:37:36.267618 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:37:36.267589 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod523eb8b1_ee77_4ac1_9b49_98dfd53ed5f6.slice/crio-c5cebbed79a49e397921440b0645bba5d70a0d0641825e9a90022a1877090788 WatchSource:0}: Error finding container c5cebbed79a49e397921440b0645bba5d70a0d0641825e9a90022a1877090788: Status 404 returned error can't find the container with id c5cebbed79a49e397921440b0645bba5d70a0d0641825e9a90022a1877090788 Jun 09 13:37:36.333726 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:36.333639 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8zq9r" event={"ID":"2702f943-5a98-4dc0-9b31-f903e5118571","Type":"ContainerStarted","Data":"a97dd8fb08e676e52e96bdf863f28768b37803d15eb1e276e59322b0343d225c"} Jun 09 13:37:36.334899 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:36.334873 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t7z8j" event={"ID":"523eb8b1-ee77-4ac1-9b49-98dfd53ed5f6","Type":"ContainerStarted","Data":"c5cebbed79a49e397921440b0645bba5d70a0d0641825e9a90022a1877090788"} Jun 09 13:37:36.335157 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:36.335133 2544 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" podUID="47129e3d-376a-400c-b4b1-2ac988aadde8" containerName="istio-proxy" containerID="cri-o://183341a8dd0c46f0c4be41a6a781e4c402d14e1fc65a392518cf6c9983fbf140" gracePeriod=30 Jun 09 13:37:38.346197 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:38.346156 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t7z8j" event={"ID":"523eb8b1-ee77-4ac1-9b49-98dfd53ed5f6","Type":"ContainerStarted","Data":"7ed9585480e07c965fc3e5bbcc63b55d62dc8e9bcef9b6cbae1515d31a3c5047"} Jun 09 13:37:38.347526 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:38.347504 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8zq9r" event={"ID":"2702f943-5a98-4dc0-9b31-f903e5118571","Type":"ContainerStarted","Data":"430e06898abb9b65c4f259d249efab37a64b4c5eb7e1362ac5ab913fbfe6273a"} Jun 09 13:37:38.347651 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:38.347540 2544 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-8zq9r" podUID="2702f943-5a98-4dc0-9b31-f903e5118571" containerName="registry-server" containerID="cri-o://430e06898abb9b65c4f259d249efab37a64b4c5eb7e1362ac5ab913fbfe6273a" gracePeriod=2 Jun 09 13:37:38.362566 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:38.362509 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-t7z8j" podStartSLOduration=1.875690675 podStartE2EDuration="3.362492691s" totalImagesPullingTime="1.486802016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:37:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:37:38.361289637 +0000 UTC m=+565.516561859" watchObservedRunningTime="2026-06-09 13:37:38.362492691 +0000 UTC m=+565.517764906" Jun 09 13:37:38.376885 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:38.376843 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8zq9r" podStartSLOduration=1.289122318 podStartE2EDuration="3.376829136s" totalImagesPullingTime="2.087706818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:37:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:37:38.37599483 +0000 UTC m=+565.531267042" watchObservedRunningTime="2026-06-09 13:37:38.376829136 +0000 UTC m=+565.532101347" Jun 09 13:37:38.590013 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:38.589985 2544 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8zq9r" Jun 09 13:37:38.672901 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:38.672801 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdwz5\" (UniqueName: \"kubernetes.io/projected/2702f943-5a98-4dc0-9b31-f903e5118571-kube-api-access-cdwz5\") pod \"2702f943-5a98-4dc0-9b31-f903e5118571\" (UID: \"2702f943-5a98-4dc0-9b31-f903e5118571\") " Jun 09 13:37:38.675020 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:38.674990 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2702f943-5a98-4dc0-9b31-f903e5118571-kube-api-access-cdwz5" (OuterVolumeSpecName: "kube-api-access-cdwz5") pod "2702f943-5a98-4dc0-9b31-f903e5118571" (UID: "2702f943-5a98-4dc0-9b31-f903e5118571"). InnerVolumeSpecName "kube-api-access-cdwz5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:37:38.773471 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:38.773436 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdwz5\" (UniqueName: \"kubernetes.io/projected/2702f943-5a98-4dc0-9b31-f903e5118571-kube-api-access-cdwz5\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:37:39.353188 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:39.353154 2544 generic.go:356] "Generic (PLEG): container finished" podID="2702f943-5a98-4dc0-9b31-f903e5118571" containerID="430e06898abb9b65c4f259d249efab37a64b4c5eb7e1362ac5ab913fbfe6273a" exitCode=0 Jun 09 13:37:39.353645 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:39.353197 2544 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8zq9r" Jun 09 13:37:39.353645 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:39.353246 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8zq9r" event={"ID":"2702f943-5a98-4dc0-9b31-f903e5118571","Type":"ContainerDied","Data":"430e06898abb9b65c4f259d249efab37a64b4c5eb7e1362ac5ab913fbfe6273a"} Jun 09 13:37:39.353645 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:39.353297 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8zq9r" event={"ID":"2702f943-5a98-4dc0-9b31-f903e5118571","Type":"ContainerDied","Data":"a97dd8fb08e676e52e96bdf863f28768b37803d15eb1e276e59322b0343d225c"} Jun 09 13:37:39.353645 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:39.353317 2544 scope.go:117] "RemoveContainer" containerID="430e06898abb9b65c4f259d249efab37a64b4c5eb7e1362ac5ab913fbfe6273a" Jun 09 13:37:39.361897 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:39.361877 2544 scope.go:117] "RemoveContainer" containerID="430e06898abb9b65c4f259d249efab37a64b4c5eb7e1362ac5ab913fbfe6273a" Jun 09 13:37:39.362156 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:37:39.362138 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"430e06898abb9b65c4f259d249efab37a64b4c5eb7e1362ac5ab913fbfe6273a\": container with ID starting with 430e06898abb9b65c4f259d249efab37a64b4c5eb7e1362ac5ab913fbfe6273a not found: ID does not exist" containerID="430e06898abb9b65c4f259d249efab37a64b4c5eb7e1362ac5ab913fbfe6273a" Jun 09 13:37:39.362218 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:39.362171 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"430e06898abb9b65c4f259d249efab37a64b4c5eb7e1362ac5ab913fbfe6273a"} err="failed to get container status \"430e06898abb9b65c4f259d249efab37a64b4c5eb7e1362ac5ab913fbfe6273a\": rpc error: code = NotFound desc = could not find container \"430e06898abb9b65c4f259d249efab37a64b4c5eb7e1362ac5ab913fbfe6273a\": container with ID starting with 430e06898abb9b65c4f259d249efab37a64b4c5eb7e1362ac5ab913fbfe6273a not found: ID does not exist" Jun 09 13:37:39.371126 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:39.371102 2544 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8zq9r"] Jun 09 13:37:39.375491 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:39.375470 2544 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8zq9r"] Jun 09 13:37:41.276473 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.276439 2544 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2702f943-5a98-4dc0-9b31-f903e5118571" path="/var/lib/kubelet/pods/2702f943-5a98-4dc0-9b31-f903e5118571/volumes" Jun 09 13:37:41.588823 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.588800 2544 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:41.702591 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.702515 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-workload-certs\") pod \"47129e3d-376a-400c-b4b1-2ac988aadde8\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " Jun 09 13:37:41.702591 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.702588 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47129e3d-376a-400c-b4b1-2ac988aadde8-istio-podinfo\") pod \"47129e3d-376a-400c-b4b1-2ac988aadde8\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " Jun 09 13:37:41.702834 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.702614 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-workload-socket\") pod \"47129e3d-376a-400c-b4b1-2ac988aadde8\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " Jun 09 13:37:41.702834 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.702681 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vft4p\" (UniqueName: \"kubernetes.io/projected/47129e3d-376a-400c-b4b1-2ac988aadde8-kube-api-access-vft4p\") pod \"47129e3d-376a-400c-b4b1-2ac988aadde8\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " Jun 09 13:37:41.702834 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.702712 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-istio-envoy\") pod \"47129e3d-376a-400c-b4b1-2ac988aadde8\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " Jun 09 13:37:41.702834 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.702736 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47129e3d-376a-400c-b4b1-2ac988aadde8-istio-token\") pod \"47129e3d-376a-400c-b4b1-2ac988aadde8\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " Jun 09 13:37:41.702834 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.702759 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-istio-data\") pod \"47129e3d-376a-400c-b4b1-2ac988aadde8\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " Jun 09 13:37:41.702834 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.702797 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-credential-socket\") pod \"47129e3d-376a-400c-b4b1-2ac988aadde8\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " Jun 09 13:37:41.703138 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.702835 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47129e3d-376a-400c-b4b1-2ac988aadde8-istiod-ca-cert\") pod \"47129e3d-376a-400c-b4b1-2ac988aadde8\" (UID: \"47129e3d-376a-400c-b4b1-2ac988aadde8\") " Jun 09 13:37:41.703138 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.702833 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "47129e3d-376a-400c-b4b1-2ac988aadde8" (UID: "47129e3d-376a-400c-b4b1-2ac988aadde8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:37:41.703138 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.702914 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "47129e3d-376a-400c-b4b1-2ac988aadde8" (UID: "47129e3d-376a-400c-b4b1-2ac988aadde8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:37:41.703138 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.703127 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-istio-data" (OuterVolumeSpecName: "istio-data") pod "47129e3d-376a-400c-b4b1-2ac988aadde8" (UID: "47129e3d-376a-400c-b4b1-2ac988aadde8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:37:41.703326 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.703248 2544 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-workload-certs\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:37:41.703326 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.703268 2544 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-workload-socket\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:37:41.703326 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.703281 2544 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-istio-data\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:37:41.703326 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.703283 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "47129e3d-376a-400c-b4b1-2ac988aadde8" (UID: "47129e3d-376a-400c-b4b1-2ac988aadde8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:37:41.703326 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.703290 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47129e3d-376a-400c-b4b1-2ac988aadde8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "47129e3d-376a-400c-b4b1-2ac988aadde8" (UID: "47129e3d-376a-400c-b4b1-2ac988aadde8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:37:41.705082 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.705055 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47129e3d-376a-400c-b4b1-2ac988aadde8-istio-token" (OuterVolumeSpecName: "istio-token") pod "47129e3d-376a-400c-b4b1-2ac988aadde8" (UID: "47129e3d-376a-400c-b4b1-2ac988aadde8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:37:41.705203 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.705081 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "47129e3d-376a-400c-b4b1-2ac988aadde8" (UID: "47129e3d-376a-400c-b4b1-2ac988aadde8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:37:41.705203 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.705188 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47129e3d-376a-400c-b4b1-2ac988aadde8-kube-api-access-vft4p" (OuterVolumeSpecName: "kube-api-access-vft4p") pod "47129e3d-376a-400c-b4b1-2ac988aadde8" (UID: "47129e3d-376a-400c-b4b1-2ac988aadde8"). InnerVolumeSpecName "kube-api-access-vft4p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:37:41.705307 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.705189 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/47129e3d-376a-400c-b4b1-2ac988aadde8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "47129e3d-376a-400c-b4b1-2ac988aadde8" (UID: "47129e3d-376a-400c-b4b1-2ac988aadde8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 09 13:37:41.803852 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.803814 2544 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47129e3d-376a-400c-b4b1-2ac988aadde8-istio-podinfo\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:37:41.803852 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.803845 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vft4p\" (UniqueName: \"kubernetes.io/projected/47129e3d-376a-400c-b4b1-2ac988aadde8-kube-api-access-vft4p\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:37:41.803852 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.803856 2544 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-istio-envoy\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:37:41.803852 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.803865 2544 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47129e3d-376a-400c-b4b1-2ac988aadde8-istio-token\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:37:41.804114 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.803873 2544 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47129e3d-376a-400c-b4b1-2ac988aadde8-credential-socket\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:37:41.804114 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:41.803881 2544 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47129e3d-376a-400c-b4b1-2ac988aadde8-istiod-ca-cert\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:37:42.369715 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:42.369678 2544 generic.go:356] "Generic (PLEG): container finished" podID="47129e3d-376a-400c-b4b1-2ac988aadde8" containerID="183341a8dd0c46f0c4be41a6a781e4c402d14e1fc65a392518cf6c9983fbf140" exitCode=0 Jun 09 13:37:42.370119 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:42.369736 2544 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" Jun 09 13:37:42.370119 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:42.369754 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" event={"ID":"47129e3d-376a-400c-b4b1-2ac988aadde8","Type":"ContainerDied","Data":"183341a8dd0c46f0c4be41a6a781e4c402d14e1fc65a392518cf6c9983fbf140"} Jun 09 13:37:42.370119 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:42.369800 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf" event={"ID":"47129e3d-376a-400c-b4b1-2ac988aadde8","Type":"ContainerDied","Data":"a44084e915ff8cd3fb305b5d5db46af743367b2ce57d2b1cef67ac4a34c0481a"} Jun 09 13:37:42.370119 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:42.369823 2544 scope.go:117] "RemoveContainer" containerID="183341a8dd0c46f0c4be41a6a781e4c402d14e1fc65a392518cf6c9983fbf140" Jun 09 13:37:42.378998 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:42.378981 2544 scope.go:117] "RemoveContainer" containerID="183341a8dd0c46f0c4be41a6a781e4c402d14e1fc65a392518cf6c9983fbf140" Jun 09 13:37:42.379229 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:37:42.379209 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"183341a8dd0c46f0c4be41a6a781e4c402d14e1fc65a392518cf6c9983fbf140\": container with ID starting with 183341a8dd0c46f0c4be41a6a781e4c402d14e1fc65a392518cf6c9983fbf140 not found: ID does not exist" containerID="183341a8dd0c46f0c4be41a6a781e4c402d14e1fc65a392518cf6c9983fbf140" Jun 09 13:37:42.379291 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:42.379241 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"183341a8dd0c46f0c4be41a6a781e4c402d14e1fc65a392518cf6c9983fbf140"} err="failed to get container status \"183341a8dd0c46f0c4be41a6a781e4c402d14e1fc65a392518cf6c9983fbf140\": rpc error: code = NotFound desc = could not find container \"183341a8dd0c46f0c4be41a6a781e4c402d14e1fc65a392518cf6c9983fbf140\": container with ID starting with 183341a8dd0c46f0c4be41a6a781e4c402d14e1fc65a392518cf6c9983fbf140 not found: ID does not exist" Jun 09 13:37:42.392928 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:42.392905 2544 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf"] Jun 09 13:37:42.396979 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:42.396957 2544 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ff76wf"] Jun 09 13:37:43.276769 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:43.276740 2544 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47129e3d-376a-400c-b4b1-2ac988aadde8" path="/var/lib/kubelet/pods/47129e3d-376a-400c-b4b1-2ac988aadde8/volumes" Jun 09 13:37:46.103091 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:46.103058 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-t7z8j" Jun 09 13:37:46.103579 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:46.103115 2544 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-t7z8j" Jun 09 13:37:46.125138 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:46.125118 2544 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-t7z8j" Jun 09 13:37:46.410411 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:37:46.410335 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-t7z8j" Jun 09 13:38:00.691305 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:00.691267 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ntw7m"] Jun 09 13:38:00.691816 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:00.691795 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2702f943-5a98-4dc0-9b31-f903e5118571" containerName="registry-server" Jun 09 13:38:00.691884 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:00.691820 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="2702f943-5a98-4dc0-9b31-f903e5118571" containerName="registry-server" Jun 09 13:38:00.691884 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:00.691851 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47129e3d-376a-400c-b4b1-2ac988aadde8" containerName="istio-proxy" Jun 09 13:38:00.691884 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:00.691861 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="47129e3d-376a-400c-b4b1-2ac988aadde8" containerName="istio-proxy" Jun 09 13:38:00.692035 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:00.691946 2544 memory_manager.go:368] "RemoveStaleState removing state" podUID="2702f943-5a98-4dc0-9b31-f903e5118571" containerName="registry-server" Jun 09 13:38:00.692035 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:00.691964 2544 memory_manager.go:368] "RemoveStaleState removing state" podUID="47129e3d-376a-400c-b4b1-2ac988aadde8" containerName="istio-proxy" Jun 09 13:38:00.696277 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:00.696256 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ntw7m" Jun 09 13:38:00.698808 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:00.698784 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-vrgxv\"" Jun 09 13:38:00.705293 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:00.705268 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ntw7m"] Jun 09 13:38:00.776808 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:00.776780 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpk89\" (UniqueName: \"kubernetes.io/projected/9c348e4f-04c1-440b-bb86-b5ce00a8f58d-kube-api-access-cpk89\") pod \"limitador-operator-controller-manager-859d7b78bd-ntw7m\" (UID: \"9c348e4f-04c1-440b-bb86-b5ce00a8f58d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ntw7m" Jun 09 13:38:00.877988 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:00.877955 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpk89\" (UniqueName: \"kubernetes.io/projected/9c348e4f-04c1-440b-bb86-b5ce00a8f58d-kube-api-access-cpk89\") pod \"limitador-operator-controller-manager-859d7b78bd-ntw7m\" (UID: \"9c348e4f-04c1-440b-bb86-b5ce00a8f58d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ntw7m" Jun 09 13:38:00.886627 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:00.886598 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpk89\" (UniqueName: \"kubernetes.io/projected/9c348e4f-04c1-440b-bb86-b5ce00a8f58d-kube-api-access-cpk89\") pod \"limitador-operator-controller-manager-859d7b78bd-ntw7m\" (UID: \"9c348e4f-04c1-440b-bb86-b5ce00a8f58d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ntw7m" Jun 09 13:38:01.007194 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:01.007171 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ntw7m" Jun 09 13:38:01.138021 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:01.137994 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ntw7m"] Jun 09 13:38:01.139637 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:38:01.139611 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c348e4f_04c1_440b_bb86_b5ce00a8f58d.slice/crio-355fb9430ab3339d6e7dedf367c48d8f498e571279f8d7362c8c120dc30a5276 WatchSource:0}: Error finding container 355fb9430ab3339d6e7dedf367c48d8f498e571279f8d7362c8c120dc30a5276: Status 404 returned error can't find the container with id 355fb9430ab3339d6e7dedf367c48d8f498e571279f8d7362c8c120dc30a5276 Jun 09 13:38:01.455654 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:01.455571 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ntw7m" event={"ID":"9c348e4f-04c1-440b-bb86-b5ce00a8f58d","Type":"ContainerStarted","Data":"355fb9430ab3339d6e7dedf367c48d8f498e571279f8d7362c8c120dc30a5276"} Jun 09 13:38:03.465214 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:03.465182 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ntw7m" event={"ID":"9c348e4f-04c1-440b-bb86-b5ce00a8f58d","Type":"ContainerStarted","Data":"8b72e4810187dec163235707363b488fd9426dac40c7691ae1ff386d170c20b6"} Jun 09 13:38:03.465587 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:03.465309 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ntw7m" Jun 09 13:38:03.498127 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:03.498083 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ntw7m" podStartSLOduration=1.309625262 podStartE2EDuration="3.498069958s" totalImagesPullingTime="2.188444696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:38:03.496853985 +0000 UTC m=+590.652126198" watchObservedRunningTime="2026-06-09 13:38:03.498069958 +0000 UTC m=+590.653342221" Jun 09 13:38:04.300273 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:04.300242 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tnfvm"] Jun 09 13:38:04.303734 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:04.303720 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tnfvm" Jun 09 13:38:04.306311 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:04.306280 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-tb262\"" Jun 09 13:38:04.306454 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:04.306328 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 09 13:38:04.312957 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:04.312935 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tnfvm"] Jun 09 13:38:04.408733 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:04.408703 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7vlj\" (UniqueName: \"kubernetes.io/projected/595d9e2b-b43e-4ea5-a2c6-b4db03b59d98-kube-api-access-h7vlj\") pod \"dns-operator-controller-manager-864dd78c4c-tnfvm\" (UID: \"595d9e2b-b43e-4ea5-a2c6-b4db03b59d98\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tnfvm" Jun 09 13:38:04.509885 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:04.509861 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7vlj\" (UniqueName: \"kubernetes.io/projected/595d9e2b-b43e-4ea5-a2c6-b4db03b59d98-kube-api-access-h7vlj\") pod \"dns-operator-controller-manager-864dd78c4c-tnfvm\" (UID: \"595d9e2b-b43e-4ea5-a2c6-b4db03b59d98\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tnfvm" Jun 09 13:38:04.539197 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:04.539166 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7vlj\" (UniqueName: \"kubernetes.io/projected/595d9e2b-b43e-4ea5-a2c6-b4db03b59d98-kube-api-access-h7vlj\") pod \"dns-operator-controller-manager-864dd78c4c-tnfvm\" (UID: \"595d9e2b-b43e-4ea5-a2c6-b4db03b59d98\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tnfvm" Jun 09 13:38:04.615578 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:04.615488 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tnfvm" Jun 09 13:38:04.740674 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:04.740651 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tnfvm"] Jun 09 13:38:04.742191 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:38:04.742164 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod595d9e2b_b43e_4ea5_a2c6_b4db03b59d98.slice/crio-3066146c5649c960f3bf4d9ee160a489de9b7cd9bdac888bbf788751d3ea5c1d WatchSource:0}: Error finding container 3066146c5649c960f3bf4d9ee160a489de9b7cd9bdac888bbf788751d3ea5c1d: Status 404 returned error can't find the container with id 3066146c5649c960f3bf4d9ee160a489de9b7cd9bdac888bbf788751d3ea5c1d Jun 09 13:38:05.476400 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:05.476366 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tnfvm" event={"ID":"595d9e2b-b43e-4ea5-a2c6-b4db03b59d98","Type":"ContainerStarted","Data":"3066146c5649c960f3bf4d9ee160a489de9b7cd9bdac888bbf788751d3ea5c1d"} Jun 09 13:38:08.491946 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:08.491904 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tnfvm" event={"ID":"595d9e2b-b43e-4ea5-a2c6-b4db03b59d98","Type":"ContainerStarted","Data":"579345a466aa441828e40576654435fa58ad856a901dcb3ae3066db6b106840d"} Jun 09 13:38:08.492360 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:08.492039 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tnfvm" Jun 09 13:38:08.509839 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:08.509796 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tnfvm" podStartSLOduration=1.7704533169999999 podStartE2EDuration="4.509783045s" totalImagesPullingTime="2.739329728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:38:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:38:08.507720623 +0000 UTC m=+595.662992834" watchObservedRunningTime="2026-06-09 13:38:08.509783045 +0000 UTC m=+595.665055337" Jun 09 13:38:12.886688 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:12.886653 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-b957d"] Jun 09 13:38:12.894769 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:12.894742 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b957d" Jun 09 13:38:12.897245 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:12.897225 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-25gvp\"" Jun 09 13:38:12.902693 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:12.902670 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-b957d"] Jun 09 13:38:12.990094 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:12.990063 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg6ph\" (UniqueName: \"kubernetes.io/projected/d2d3601c-bd49-4cd4-9c0f-0bb562375cf0-kube-api-access-fg6ph\") pod \"authorino-operator-75cc8d5cb7-b957d\" (UID: \"d2d3601c-bd49-4cd4-9c0f-0bb562375cf0\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-b957d" Jun 09 13:38:13.090706 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:13.090675 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg6ph\" (UniqueName: \"kubernetes.io/projected/d2d3601c-bd49-4cd4-9c0f-0bb562375cf0-kube-api-access-fg6ph\") pod \"authorino-operator-75cc8d5cb7-b957d\" (UID: \"d2d3601c-bd49-4cd4-9c0f-0bb562375cf0\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-b957d" Jun 09 13:38:13.106647 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:13.106625 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg6ph\" (UniqueName: \"kubernetes.io/projected/d2d3601c-bd49-4cd4-9c0f-0bb562375cf0-kube-api-access-fg6ph\") pod \"authorino-operator-75cc8d5cb7-b957d\" (UID: \"d2d3601c-bd49-4cd4-9c0f-0bb562375cf0\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-b957d" Jun 09 13:38:13.207580 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:13.207509 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-25gvp\"" Jun 09 13:38:13.215124 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:13.215103 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b957d" Jun 09 13:38:13.353812 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:13.353790 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-b957d"] Jun 09 13:38:13.356496 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:38:13.356474 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2d3601c_bd49_4cd4_9c0f_0bb562375cf0.slice/crio-f3d320ba526410126af30ae05a3c8d88d3b5ccf2c627b71a83f9871a7a7e96c4 WatchSource:0}: Error finding container f3d320ba526410126af30ae05a3c8d88d3b5ccf2c627b71a83f9871a7a7e96c4: Status 404 returned error can't find the container with id f3d320ba526410126af30ae05a3c8d88d3b5ccf2c627b71a83f9871a7a7e96c4 Jun 09 13:38:13.516748 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:13.516715 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b957d" event={"ID":"d2d3601c-bd49-4cd4-9c0f-0bb562375cf0","Type":"ContainerStarted","Data":"f3d320ba526410126af30ae05a3c8d88d3b5ccf2c627b71a83f9871a7a7e96c4"} Jun 09 13:38:14.472784 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:14.472755 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ntw7m" Jun 09 13:38:16.533162 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:16.533120 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b957d" event={"ID":"d2d3601c-bd49-4cd4-9c0f-0bb562375cf0","Type":"ContainerStarted","Data":"2e498a4ff9194b4a3fa4a3c4167f9be1d38b65c43c774d7d170f4cd53fa3ea3c"} Jun 09 13:38:16.535372 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:16.533271 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b957d" Jun 09 13:38:16.559263 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:16.559215 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b957d" podStartSLOduration=2.357789073 podStartE2EDuration="4.559201463s" totalImagesPullingTime="2.20141239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:38:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:38:16.556866646 +0000 UTC m=+603.712138860" watchObservedRunningTime="2026-06-09 13:38:16.559201463 +0000 UTC m=+603.714473675" Jun 09 13:38:19.498890 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:19.498856 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tnfvm" Jun 09 13:38:27.540779 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:27.540743 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b957d" Jun 09 13:38:31.730585 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:31.730538 2544 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ntw7m"] Jun 09 13:38:31.731087 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:31.730740 2544 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ntw7m" podUID="9c348e4f-04c1-440b-bb86-b5ce00a8f58d" containerName="manager" containerID="cri-o://8b72e4810187dec163235707363b488fd9426dac40c7691ae1ff386d170c20b6" gracePeriod=2 Jun 09 13:38:31.739085 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:31.739059 2544 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ntw7m"] Jun 09 13:38:31.743813 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:38:31.743779 2544 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9c348e4f-04c1-440b-bb86-b5ce00a8f58d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-ntw7m\": pods \"limitador-operator-controller-manager-859d7b78bd-ntw7m\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ntw7m" Jun 09 13:38:31.755055 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:31.755031 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2m98"] Jun 09 13:38:31.756062 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:31.755542 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c348e4f-04c1-440b-bb86-b5ce00a8f58d" containerName="manager" Jun 09 13:38:31.756120 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:31.756068 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c348e4f-04c1-440b-bb86-b5ce00a8f58d" containerName="manager" Jun 09 13:38:31.756236 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:31.756219 2544 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c348e4f-04c1-440b-bb86-b5ce00a8f58d" containerName="manager" Jun 09 13:38:31.759527 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:31.759508 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2m98" Jun 09 13:38:31.767131 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:31.767107 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2m98"] Jun 09 13:38:31.794649 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:38:31.794621 2544 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ntw7m\" is forbidden: User \"system:node:ip-10-0-131-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-58.ec2.internal' and this object" podUID="9c348e4f-04c1-440b-bb86-b5ce00a8f58d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ntw7m" Jun 09 13:38:31.853751 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:31.853708 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhj8j\" (UniqueName: \"kubernetes.io/projected/f57cf277-cb49-4dbd-a877-774962782af7-kube-api-access-hhj8j\") pod \"limitador-operator-controller-manager-859d7b78bd-f2m98\" (UID: \"f57cf277-cb49-4dbd-a877-774962782af7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2m98" Jun 09 13:38:31.954353 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:31.954323 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhj8j\" (UniqueName: \"kubernetes.io/projected/f57cf277-cb49-4dbd-a877-774962782af7-kube-api-access-hhj8j\") pod \"limitador-operator-controller-manager-859d7b78bd-f2m98\" (UID: \"f57cf277-cb49-4dbd-a877-774962782af7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2m98" Jun 09 13:38:31.963400 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:31.963380 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhj8j\" (UniqueName: \"kubernetes.io/projected/f57cf277-cb49-4dbd-a877-774962782af7-kube-api-access-hhj8j\") pod \"limitador-operator-controller-manager-859d7b78bd-f2m98\" (UID: \"f57cf277-cb49-4dbd-a877-774962782af7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2m98" Jun 09 13:38:31.976250 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:31.976231 2544 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ntw7m" Jun 09 13:38:31.978687 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:38:31.978662 2544 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ntw7m\" is forbidden: User \"system:node:ip-10-0-131-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-58.ec2.internal' and this object" podUID="9c348e4f-04c1-440b-bb86-b5ce00a8f58d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ntw7m" Jun 09 13:38:32.055035 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:32.055008 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpk89\" (UniqueName: \"kubernetes.io/projected/9c348e4f-04c1-440b-bb86-b5ce00a8f58d-kube-api-access-cpk89\") pod \"9c348e4f-04c1-440b-bb86-b5ce00a8f58d\" (UID: \"9c348e4f-04c1-440b-bb86-b5ce00a8f58d\") " Jun 09 13:38:32.056969 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:32.056946 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c348e4f-04c1-440b-bb86-b5ce00a8f58d-kube-api-access-cpk89" (OuterVolumeSpecName: "kube-api-access-cpk89") pod "9c348e4f-04c1-440b-bb86-b5ce00a8f58d" (UID: "9c348e4f-04c1-440b-bb86-b5ce00a8f58d"). InnerVolumeSpecName "kube-api-access-cpk89". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:38:32.102138 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:32.102111 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2m98" Jun 09 13:38:32.156690 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:32.156649 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpk89\" (UniqueName: \"kubernetes.io/projected/9c348e4f-04c1-440b-bb86-b5ce00a8f58d-kube-api-access-cpk89\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:38:32.231096 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:32.231070 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2m98"] Jun 09 13:38:32.233102 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:38:32.233069 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf57cf277_cb49_4dbd_a877_774962782af7.slice/crio-055e9a56ec0fcaabcfbf8d8fa959e7adf46187330664383566e833207de63455 WatchSource:0}: Error finding container 055e9a56ec0fcaabcfbf8d8fa959e7adf46187330664383566e833207de63455: Status 404 returned error can't find the container with id 055e9a56ec0fcaabcfbf8d8fa959e7adf46187330664383566e833207de63455 Jun 09 13:38:32.606915 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:32.606882 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2m98" event={"ID":"f57cf277-cb49-4dbd-a877-774962782af7","Type":"ContainerStarted","Data":"eef1e91b7b1cbdda654546f0b5fb42de99c320894147e59f0e1ae8be5df82832"} Jun 09 13:38:32.607101 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:32.606966 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2m98" event={"ID":"f57cf277-cb49-4dbd-a877-774962782af7","Type":"ContainerStarted","Data":"055e9a56ec0fcaabcfbf8d8fa959e7adf46187330664383566e833207de63455"} Jun 09 13:38:32.607101 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:32.607000 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2m98" Jun 09 13:38:32.608186 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:32.608161 2544 generic.go:356] "Generic (PLEG): container finished" podID="9c348e4f-04c1-440b-bb86-b5ce00a8f58d" containerID="8b72e4810187dec163235707363b488fd9426dac40c7691ae1ff386d170c20b6" exitCode=0 Jun 09 13:38:32.608301 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:32.608208 2544 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ntw7m" Jun 09 13:38:32.608301 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:32.608268 2544 scope.go:117] "RemoveContainer" containerID="8b72e4810187dec163235707363b488fd9426dac40c7691ae1ff386d170c20b6" Jun 09 13:38:32.617107 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:32.617091 2544 scope.go:117] "RemoveContainer" containerID="8b72e4810187dec163235707363b488fd9426dac40c7691ae1ff386d170c20b6" Jun 09 13:38:32.617330 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:38:32.617311 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b72e4810187dec163235707363b488fd9426dac40c7691ae1ff386d170c20b6\": container with ID starting with 8b72e4810187dec163235707363b488fd9426dac40c7691ae1ff386d170c20b6 not found: ID does not exist" containerID="8b72e4810187dec163235707363b488fd9426dac40c7691ae1ff386d170c20b6" Jun 09 13:38:32.617369 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:32.617339 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b72e4810187dec163235707363b488fd9426dac40c7691ae1ff386d170c20b6"} err="failed to get container status \"8b72e4810187dec163235707363b488fd9426dac40c7691ae1ff386d170c20b6\": rpc error: code = NotFound desc = could not find container \"8b72e4810187dec163235707363b488fd9426dac40c7691ae1ff386d170c20b6\": container with ID starting with 8b72e4810187dec163235707363b488fd9426dac40c7691ae1ff386d170c20b6 not found: ID does not exist" Jun 09 13:38:32.632794 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:32.632756 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2m98" podStartSLOduration=1.632745261 podStartE2EDuration="1.632745261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:38:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:38:32.631458978 +0000 UTC m=+619.786731190" watchObservedRunningTime="2026-06-09 13:38:32.632745261 +0000 UTC m=+619.788017473" Jun 09 13:38:32.633706 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:38:32.633684 2544 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ntw7m\" is forbidden: User \"system:node:ip-10-0-131-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-58.ec2.internal' and this object" podUID="9c348e4f-04c1-440b-bb86-b5ce00a8f58d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ntw7m" Jun 09 13:38:32.635765 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:38:32.635743 2544 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ntw7m\" is forbidden: User \"system:node:ip-10-0-131-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-58.ec2.internal' and this object" podUID="9c348e4f-04c1-440b-bb86-b5ce00a8f58d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ntw7m" Jun 09 13:38:33.274600 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:38:33.274562 2544 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ntw7m\" is forbidden: User \"system:node:ip-10-0-131-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-58.ec2.internal' and this object" podUID="9c348e4f-04c1-440b-bb86-b5ce00a8f58d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ntw7m" Jun 09 13:38:33.276230 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:33.276208 2544 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c348e4f-04c1-440b-bb86-b5ce00a8f58d" path="/var/lib/kubelet/pods/9c348e4f-04c1-440b-bb86-b5ce00a8f58d/volumes" Jun 09 13:38:43.616810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:38:43.616773 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2m98" Jun 09 13:39:00.421778 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.421747 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h"] Jun 09 13:39:00.431968 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.431875 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.434629 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.434607 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-npnwr\"" Jun 09 13:39:00.436127 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.436105 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h"] Jun 09 13:39:00.604624 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.604595 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6fc1c94-245d-448e-993a-03cc120df477-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-hwg2h\" (UID: \"b6fc1c94-245d-448e-993a-03cc120df477\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.604800 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.604629 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2vrv\" (UniqueName: \"kubernetes.io/projected/b6fc1c94-245d-448e-993a-03cc120df477-kube-api-access-p2vrv\") pod \"maas-default-gateway-openshift-default-687ff6996-hwg2h\" (UID: \"b6fc1c94-245d-448e-993a-03cc120df477\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.604800 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.604652 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6fc1c94-245d-448e-993a-03cc120df477-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-hwg2h\" (UID: \"b6fc1c94-245d-448e-993a-03cc120df477\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.604800 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.604701 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6fc1c94-245d-448e-993a-03cc120df477-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-hwg2h\" (UID: \"b6fc1c94-245d-448e-993a-03cc120df477\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.604800 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.604790 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6fc1c94-245d-448e-993a-03cc120df477-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-hwg2h\" (UID: \"b6fc1c94-245d-448e-993a-03cc120df477\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.604974 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.604843 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6fc1c94-245d-448e-993a-03cc120df477-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-hwg2h\" (UID: \"b6fc1c94-245d-448e-993a-03cc120df477\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.604974 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.604885 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6fc1c94-245d-448e-993a-03cc120df477-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-hwg2h\" (UID: \"b6fc1c94-245d-448e-993a-03cc120df477\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.604974 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.604905 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6fc1c94-245d-448e-993a-03cc120df477-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-hwg2h\" (UID: \"b6fc1c94-245d-448e-993a-03cc120df477\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.604974 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.604929 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6fc1c94-245d-448e-993a-03cc120df477-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-hwg2h\" (UID: \"b6fc1c94-245d-448e-993a-03cc120df477\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.705364 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.705296 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6fc1c94-245d-448e-993a-03cc120df477-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-hwg2h\" (UID: \"b6fc1c94-245d-448e-993a-03cc120df477\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.705364 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.705331 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6fc1c94-245d-448e-993a-03cc120df477-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-hwg2h\" (UID: \"b6fc1c94-245d-448e-993a-03cc120df477\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.705364 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.705357 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6fc1c94-245d-448e-993a-03cc120df477-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-hwg2h\" (UID: \"b6fc1c94-245d-448e-993a-03cc120df477\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.705644 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.705491 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2vrv\" (UniqueName: \"kubernetes.io/projected/b6fc1c94-245d-448e-993a-03cc120df477-kube-api-access-p2vrv\") pod \"maas-default-gateway-openshift-default-687ff6996-hwg2h\" (UID: \"b6fc1c94-245d-448e-993a-03cc120df477\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.705644 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.705568 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6fc1c94-245d-448e-993a-03cc120df477-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-hwg2h\" (UID: \"b6fc1c94-245d-448e-993a-03cc120df477\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.705644 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.705596 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6fc1c94-245d-448e-993a-03cc120df477-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-hwg2h\" (UID: \"b6fc1c94-245d-448e-993a-03cc120df477\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.705874 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.705683 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6fc1c94-245d-448e-993a-03cc120df477-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-hwg2h\" (UID: \"b6fc1c94-245d-448e-993a-03cc120df477\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.705874 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.705741 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6fc1c94-245d-448e-993a-03cc120df477-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-hwg2h\" (UID: \"b6fc1c94-245d-448e-993a-03cc120df477\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.705874 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.705775 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6fc1c94-245d-448e-993a-03cc120df477-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-hwg2h\" (UID: \"b6fc1c94-245d-448e-993a-03cc120df477\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.706026 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.705913 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6fc1c94-245d-448e-993a-03cc120df477-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-hwg2h\" (UID: \"b6fc1c94-245d-448e-993a-03cc120df477\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.706100 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.706082 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6fc1c94-245d-448e-993a-03cc120df477-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-hwg2h\" (UID: \"b6fc1c94-245d-448e-993a-03cc120df477\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.706159 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.706096 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6fc1c94-245d-448e-993a-03cc120df477-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-hwg2h\" (UID: \"b6fc1c94-245d-448e-993a-03cc120df477\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.706159 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.706123 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6fc1c94-245d-448e-993a-03cc120df477-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-hwg2h\" (UID: \"b6fc1c94-245d-448e-993a-03cc120df477\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.706243 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.706170 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6fc1c94-245d-448e-993a-03cc120df477-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-hwg2h\" (UID: \"b6fc1c94-245d-448e-993a-03cc120df477\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.707650 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.707634 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6fc1c94-245d-448e-993a-03cc120df477-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-hwg2h\" (UID: \"b6fc1c94-245d-448e-993a-03cc120df477\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.708066 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.708049 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6fc1c94-245d-448e-993a-03cc120df477-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-hwg2h\" (UID: \"b6fc1c94-245d-448e-993a-03cc120df477\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.715153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.715129 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6fc1c94-245d-448e-993a-03cc120df477-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-hwg2h\" (UID: \"b6fc1c94-245d-448e-993a-03cc120df477\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.715397 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.715376 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2vrv\" (UniqueName: \"kubernetes.io/projected/b6fc1c94-245d-448e-993a-03cc120df477-kube-api-access-p2vrv\") pod \"maas-default-gateway-openshift-default-687ff6996-hwg2h\" (UID: \"b6fc1c94-245d-448e-993a-03cc120df477\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.743835 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.743809 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:00.881036 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.881013 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h"] Jun 09 13:39:00.883797 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:39:00.883772 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6fc1c94_245d_448e_993a_03cc120df477.slice/crio-facd69f195d12c2433f20d7806231cc52aae5f75b3694a8b593e6cebc910142e WatchSource:0}: Error finding container facd69f195d12c2433f20d7806231cc52aae5f75b3694a8b593e6cebc910142e: Status 404 returned error can't find the container with id facd69f195d12c2433f20d7806231cc52aae5f75b3694a8b593e6cebc910142e Jun 09 13:39:00.886010 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.885959 2544 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 13:39:00.886079 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.886061 2544 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 13:39:00.886117 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:00.886107 2544 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 13:39:01.747230 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:01.747197 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" event={"ID":"b6fc1c94-245d-448e-993a-03cc120df477","Type":"ContainerStarted","Data":"a5f11d581769305c589f2bacbda39e26f5e5bf98b0814b62b00944e25a099b50"} Jun 09 13:39:01.747656 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:01.747248 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" event={"ID":"b6fc1c94-245d-448e-993a-03cc120df477","Type":"ContainerStarted","Data":"facd69f195d12c2433f20d7806231cc52aae5f75b3694a8b593e6cebc910142e"} Jun 09 13:39:01.775759 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:01.775709 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" podStartSLOduration=1.775693955 podStartE2EDuration="1.775693955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:39:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:39:01.774985371 +0000 UTC m=+648.930257583" watchObservedRunningTime="2026-06-09 13:39:01.775693955 +0000 UTC m=+648.930966218" Jun 09 13:39:02.745001 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:02.744969 2544 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:02.749405 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:02.749376 2544 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:02.752591 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:02.752572 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:02.753436 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:02.753420 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:39:14.549772 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:14.549737 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:39:14.554370 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:14.554345 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-xc4px" Jun 09 13:39:14.556989 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:14.556961 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hjv4d\"" Jun 09 13:39:14.557120 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:14.557025 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 13:39:14.561771 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:14.561430 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:39:14.584875 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:14.584850 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:39:14.624747 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:14.624725 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5724f9d0-c67e-4776-898f-8f9851bd6550-config-file\") pod \"limitador-limitador-54d6d988d5-xc4px\" (UID: \"5724f9d0-c67e-4776-898f-8f9851bd6550\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xc4px" Jun 09 13:39:14.624842 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:14.624756 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkglk\" (UniqueName: \"kubernetes.io/projected/5724f9d0-c67e-4776-898f-8f9851bd6550-kube-api-access-mkglk\") pod \"limitador-limitador-54d6d988d5-xc4px\" (UID: \"5724f9d0-c67e-4776-898f-8f9851bd6550\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xc4px" Jun 09 13:39:14.725971 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:14.725940 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5724f9d0-c67e-4776-898f-8f9851bd6550-config-file\") pod \"limitador-limitador-54d6d988d5-xc4px\" (UID: \"5724f9d0-c67e-4776-898f-8f9851bd6550\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xc4px" Jun 09 13:39:14.726070 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:14.725981 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkglk\" (UniqueName: \"kubernetes.io/projected/5724f9d0-c67e-4776-898f-8f9851bd6550-kube-api-access-mkglk\") pod \"limitador-limitador-54d6d988d5-xc4px\" (UID: \"5724f9d0-c67e-4776-898f-8f9851bd6550\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xc4px" Jun 09 13:39:14.727022 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:14.726995 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5724f9d0-c67e-4776-898f-8f9851bd6550-config-file\") pod \"limitador-limitador-54d6d988d5-xc4px\" (UID: \"5724f9d0-c67e-4776-898f-8f9851bd6550\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xc4px" Jun 09 13:39:14.734966 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:14.734946 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkglk\" (UniqueName: \"kubernetes.io/projected/5724f9d0-c67e-4776-898f-8f9851bd6550-kube-api-access-mkglk\") pod \"limitador-limitador-54d6d988d5-xc4px\" (UID: \"5724f9d0-c67e-4776-898f-8f9851bd6550\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xc4px" Jun 09 13:39:14.865073 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:14.865005 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-xc4px" Jun 09 13:39:14.988175 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:14.988149 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:39:14.990248 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:39:14.990218 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5724f9d0_c67e_4776_898f_8f9851bd6550.slice/crio-be1f584c5285a4b4fda92ea00d7bab87cd3c2358ffda6d42ef8960ba4d10584f WatchSource:0}: Error finding container be1f584c5285a4b4fda92ea00d7bab87cd3c2358ffda6d42ef8960ba4d10584f: Status 404 returned error can't find the container with id be1f584c5285a4b4fda92ea00d7bab87cd3c2358ffda6d42ef8960ba4d10584f Jun 09 13:39:15.818356 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:15.818309 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-xc4px" event={"ID":"5724f9d0-c67e-4776-898f-8f9851bd6550","Type":"ContainerStarted","Data":"be1f584c5285a4b4fda92ea00d7bab87cd3c2358ffda6d42ef8960ba4d10584f"} Jun 09 13:39:17.830917 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:17.830826 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-xc4px" event={"ID":"5724f9d0-c67e-4776-898f-8f9851bd6550","Type":"ContainerStarted","Data":"c3e566d31c0d85432a8f30e7e5487213bd38f4970386e25fc0f656fae33c4f99"} Jun 09 13:39:17.831360 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:17.830954 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-xc4px" Jun 09 13:39:17.848046 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:17.847999 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-xc4px" podStartSLOduration=1.308235919 podStartE2EDuration="3.847984643s" totalImagesPullingTime="2.539748724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:39:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:39:17.847512424 +0000 UTC m=+665.002784652" watchObservedRunningTime="2026-06-09 13:39:17.847984643 +0000 UTC m=+665.003256854" Jun 09 13:39:28.836101 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:39:28.836074 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-xc4px" Jun 09 13:41:21.970124 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:21.970087 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-kt785"] Jun 09 13:41:21.973640 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:21.973623 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-kt785" Jun 09 13:41:21.976252 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:21.976231 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-bg7lf\"" Jun 09 13:41:21.976359 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:21.976304 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 09 13:41:21.981451 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:21.981430 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-kt785"] Jun 09 13:41:22.054995 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:22.054969 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:41:22.136745 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:22.136713 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsgcv\" (UniqueName: \"kubernetes.io/projected/b391cf3c-c22a-45e6-b268-c8ec68f4c58c-kube-api-access-qsgcv\") pod \"payload-processing-7c6c859784-kt785\" (UID: \"b391cf3c-c22a-45e6-b268-c8ec68f4c58c\") " pod="openshift-ingress/payload-processing-7c6c859784-kt785" Jun 09 13:41:22.237910 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:22.237830 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsgcv\" (UniqueName: \"kubernetes.io/projected/b391cf3c-c22a-45e6-b268-c8ec68f4c58c-kube-api-access-qsgcv\") pod \"payload-processing-7c6c859784-kt785\" (UID: \"b391cf3c-c22a-45e6-b268-c8ec68f4c58c\") " pod="openshift-ingress/payload-processing-7c6c859784-kt785" Jun 09 13:41:22.247823 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:22.247802 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsgcv\" (UniqueName: \"kubernetes.io/projected/b391cf3c-c22a-45e6-b268-c8ec68f4c58c-kube-api-access-qsgcv\") pod \"payload-processing-7c6c859784-kt785\" (UID: \"b391cf3c-c22a-45e6-b268-c8ec68f4c58c\") " pod="openshift-ingress/payload-processing-7c6c859784-kt785" Jun 09 13:41:22.284404 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:22.284378 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-kt785" Jun 09 13:41:22.415944 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:22.415916 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-kt785"] Jun 09 13:41:22.419488 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:41:22.419462 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb391cf3c_c22a_45e6_b268_c8ec68f4c58c.slice/crio-bc23c35e5fc9e56e4a59b1e754476f1b6c0ea8190f451ccd4f0f7b8c80d9e51b WatchSource:0}: Error finding container bc23c35e5fc9e56e4a59b1e754476f1b6c0ea8190f451ccd4f0f7b8c80d9e51b: Status 404 returned error can't find the container with id bc23c35e5fc9e56e4a59b1e754476f1b6c0ea8190f451ccd4f0f7b8c80d9e51b Jun 09 13:41:22.421377 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:22.421360 2544 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 13:41:23.414810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:23.414743 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-kt785" event={"ID":"b391cf3c-c22a-45e6-b268-c8ec68f4c58c","Type":"ContainerStarted","Data":"bc23c35e5fc9e56e4a59b1e754476f1b6c0ea8190f451ccd4f0f7b8c80d9e51b"} Jun 09 13:41:25.427727 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:25.427619 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-kt785" event={"ID":"b391cf3c-c22a-45e6-b268-c8ec68f4c58c","Type":"ContainerStarted","Data":"b1eec4c3d0b1df693a3041379b65009ca552d3627a28d9e7ee94dd83c7d8c296"} Jun 09 13:41:25.428497 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:25.428470 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-kt785" Jun 09 13:41:25.449310 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:25.446536 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-kt785" podStartSLOduration=1.721511134 podStartE2EDuration="4.446516421s" totalImagesPullingTime="2.725005287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:41:25.445899769 +0000 UTC m=+792.601171982" watchObservedRunningTime="2026-06-09 13:41:25.446516421 +0000 UTC m=+792.601788634" Jun 09 13:41:30.459762 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:30.459727 2544 generic.go:356] "Generic (PLEG): container finished" podID="b6fc1c94-245d-448e-993a-03cc120df477" containerID="a5f11d581769305c589f2bacbda39e26f5e5bf98b0814b62b00944e25a099b50" exitCode=0 Jun 09 13:41:30.460285 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:30.459802 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" event={"ID":"b6fc1c94-245d-448e-993a-03cc120df477","Type":"ContainerDied","Data":"a5f11d581769305c589f2bacbda39e26f5e5bf98b0814b62b00944e25a099b50"} Jun 09 13:41:30.460285 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:30.460239 2544 scope.go:117] "RemoveContainer" containerID="a5f11d581769305c589f2bacbda39e26f5e5bf98b0814b62b00944e25a099b50" Jun 09 13:41:30.463196 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:30.461685 2544 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 13:41:30.463196 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:30.461851 2544 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 13:41:30.463196 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:30.461951 2544 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 13:41:31.465727 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:31.465694 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" event={"ID":"b6fc1c94-245d-448e-993a-03cc120df477","Type":"ContainerStarted","Data":"1adc8dfcccbef2718afdf1c94bc30469978376e2f74d0679293387ab75759d75"} Jun 09 13:41:31.746021 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:31.745921 2544 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:41:31.746344 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:31.746320 2544 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-hwg2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jun 09 13:41:31.746580 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:31.746531 2544 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" podUID="b6fc1c94-245d-448e-993a-03cc120df477" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jun 09 13:41:32.745322 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:32.745282 2544 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-hwg2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jun 09 13:41:32.745818 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:32.745344 2544 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" podUID="b6fc1c94-245d-448e-993a-03cc120df477" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jun 09 13:41:32.753007 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:32.752982 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:41:33.744662 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:33.744628 2544 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-hwg2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jun 09 13:41:33.744934 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:33.744906 2544 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" podUID="b6fc1c94-245d-448e-993a-03cc120df477" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jun 09 13:41:34.754415 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:34.749077 2544 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-hwg2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jun 09 13:41:34.754415 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:34.749168 2544 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" podUID="b6fc1c94-245d-448e-993a-03cc120df477" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jun 09 13:41:35.745014 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:35.744980 2544 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-hwg2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jun 09 13:41:35.745190 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:35.745047 2544 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" podUID="b6fc1c94-245d-448e-993a-03cc120df477" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jun 09 13:41:36.748732 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:36.748701 2544 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:41:36.749794 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:36.749772 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hwg2h" Jun 09 13:41:37.445205 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:41:37.445173 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-kt785" Jun 09 13:42:15.809247 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:42:15.809216 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:42:20.274973 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:42:20.274939 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:42:29.778601 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:42:29.778569 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:42:36.973006 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:42:36.972973 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:42:47.090831 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:42:47.090788 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:42:56.981606 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:42:56.981572 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:43:26.006722 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:43:26.006688 2544 generic.go:356] "Generic (PLEG): container finished" podID="b391cf3c-c22a-45e6-b268-c8ec68f4c58c" containerID="b1eec4c3d0b1df693a3041379b65009ca552d3627a28d9e7ee94dd83c7d8c296" exitCode=1 Jun 09 13:43:26.007121 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:43:26.006742 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-kt785" event={"ID":"b391cf3c-c22a-45e6-b268-c8ec68f4c58c","Type":"ContainerDied","Data":"b1eec4c3d0b1df693a3041379b65009ca552d3627a28d9e7ee94dd83c7d8c296"} Jun 09 13:43:26.007121 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:43:26.007001 2544 scope.go:117] "RemoveContainer" containerID="b1eec4c3d0b1df693a3041379b65009ca552d3627a28d9e7ee94dd83c7d8c296" Jun 09 13:43:27.013499 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:43:27.013467 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-kt785" event={"ID":"b391cf3c-c22a-45e6-b268-c8ec68f4c58c","Type":"ContainerStarted","Data":"71d630de62e789462980a10b232753147dbd6e4f686a67be3067eb8295a5ec7c"} Jun 09 13:43:27.013923 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:43:27.013697 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-kt785" Jun 09 13:43:38.020530 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:43:38.020499 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-kt785" Jun 09 13:44:42.080690 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:44:42.080654 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:44:45.687252 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:44:45.687218 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:44:51.288114 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:44:51.288079 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:45:00.148575 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:00.148523 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29683545-8znd9"] Jun 09 13:45:00.152155 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:00.152140 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683545-8znd9" Jun 09 13:45:00.154440 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:00.154406 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-xq296\"" Jun 09 13:45:00.158890 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:00.158859 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29683545-8znd9"] Jun 09 13:45:00.237316 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:00.237277 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnct5\" (UniqueName: \"kubernetes.io/projected/53e024fb-c47b-4730-9d13-237c0c8c7706-kube-api-access-qnct5\") pod \"maas-api-key-cleanup-29683545-8znd9\" (UID: \"53e024fb-c47b-4730-9d13-237c0c8c7706\") " pod="opendatahub/maas-api-key-cleanup-29683545-8znd9" Jun 09 13:45:00.337729 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:00.337693 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnct5\" (UniqueName: \"kubernetes.io/projected/53e024fb-c47b-4730-9d13-237c0c8c7706-kube-api-access-qnct5\") pod \"maas-api-key-cleanup-29683545-8znd9\" (UID: \"53e024fb-c47b-4730-9d13-237c0c8c7706\") " pod="opendatahub/maas-api-key-cleanup-29683545-8znd9" Jun 09 13:45:00.346351 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:00.346320 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnct5\" (UniqueName: \"kubernetes.io/projected/53e024fb-c47b-4730-9d13-237c0c8c7706-kube-api-access-qnct5\") pod \"maas-api-key-cleanup-29683545-8znd9\" (UID: \"53e024fb-c47b-4730-9d13-237c0c8c7706\") " pod="opendatahub/maas-api-key-cleanup-29683545-8znd9" Jun 09 13:45:00.464083 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:00.464003 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683545-8znd9" Jun 09 13:45:00.601256 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:00.601232 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29683545-8znd9"] Jun 09 13:45:00.604223 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:45:00.604198 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53e024fb_c47b_4730_9d13_237c0c8c7706.slice/crio-3852ec280e9700aebf26257c37f2282bcb466afc1b931398a27d13c6ff83da50 WatchSource:0}: Error finding container 3852ec280e9700aebf26257c37f2282bcb466afc1b931398a27d13c6ff83da50: Status 404 returned error can't find the container with id 3852ec280e9700aebf26257c37f2282bcb466afc1b931398a27d13c6ff83da50 Jun 09 13:45:01.449599 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:01.449567 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683545-8znd9" event={"ID":"53e024fb-c47b-4730-9d13-237c0c8c7706","Type":"ContainerStarted","Data":"3852ec280e9700aebf26257c37f2282bcb466afc1b931398a27d13c6ff83da50"} Jun 09 13:45:01.982262 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:01.982225 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:45:03.461143 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:03.461109 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683545-8znd9" event={"ID":"53e024fb-c47b-4730-9d13-237c0c8c7706","Type":"ContainerStarted","Data":"04e1230806fb9bc9ae8b10589bc8ea24d31129295595bda1700bc9777f78331d"} Jun 09 13:45:03.479747 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:03.479700 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29683545-8znd9" podStartSLOduration=1.063377203 podStartE2EDuration="3.479684197s" totalImagesPullingTime="2.416306994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:45:03.478637185 +0000 UTC m=+1010.633909389" watchObservedRunningTime="2026-06-09 13:45:03.479684197 +0000 UTC m=+1010.634956408" Jun 09 13:45:04.467869 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:04.467832 2544 generic.go:356] "Generic (PLEG): container finished" podID="53e024fb-c47b-4730-9d13-237c0c8c7706" containerID="04e1230806fb9bc9ae8b10589bc8ea24d31129295595bda1700bc9777f78331d" exitCode=0 Jun 09 13:45:04.468256 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:04.467885 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683545-8znd9" event={"ID":"53e024fb-c47b-4730-9d13-237c0c8c7706","Type":"ContainerDied","Data":"04e1230806fb9bc9ae8b10589bc8ea24d31129295595bda1700bc9777f78331d"} Jun 09 13:45:05.596950 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:05.596924 2544 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683545-8znd9" Jun 09 13:45:05.688643 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:05.688615 2544 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnct5\" (UniqueName: \"kubernetes.io/projected/53e024fb-c47b-4730-9d13-237c0c8c7706-kube-api-access-qnct5\") pod \"53e024fb-c47b-4730-9d13-237c0c8c7706\" (UID: \"53e024fb-c47b-4730-9d13-237c0c8c7706\") " Jun 09 13:45:05.690708 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:05.690686 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53e024fb-c47b-4730-9d13-237c0c8c7706-kube-api-access-qnct5" (OuterVolumeSpecName: "kube-api-access-qnct5") pod "53e024fb-c47b-4730-9d13-237c0c8c7706" (UID: "53e024fb-c47b-4730-9d13-237c0c8c7706"). InnerVolumeSpecName "kube-api-access-qnct5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:45:05.789279 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:05.789248 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnct5\" (UniqueName: \"kubernetes.io/projected/53e024fb-c47b-4730-9d13-237c0c8c7706-kube-api-access-qnct5\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jun 09 13:45:06.478785 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:06.478752 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683545-8znd9" event={"ID":"53e024fb-c47b-4730-9d13-237c0c8c7706","Type":"ContainerDied","Data":"3852ec280e9700aebf26257c37f2282bcb466afc1b931398a27d13c6ff83da50"} Jun 09 13:45:06.478785 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:06.478779 2544 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683545-8znd9" Jun 09 13:45:06.478990 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:06.478806 2544 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3852ec280e9700aebf26257c37f2282bcb466afc1b931398a27d13c6ff83da50" Jun 09 13:45:10.687587 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:10.684984 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:45:21.177852 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:21.177817 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:45:26.572756 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:26.572725 2544 generic.go:356] "Generic (PLEG): container finished" podID="b391cf3c-c22a-45e6-b268-c8ec68f4c58c" containerID="71d630de62e789462980a10b232753147dbd6e4f686a67be3067eb8295a5ec7c" exitCode=1 Jun 09 13:45:26.573223 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:26.572773 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-kt785" event={"ID":"b391cf3c-c22a-45e6-b268-c8ec68f4c58c","Type":"ContainerDied","Data":"71d630de62e789462980a10b232753147dbd6e4f686a67be3067eb8295a5ec7c"} Jun 09 13:45:26.573223 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:26.572822 2544 scope.go:117] "RemoveContainer" containerID="b1eec4c3d0b1df693a3041379b65009ca552d3627a28d9e7ee94dd83c7d8c296" Jun 09 13:45:26.573223 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:26.573167 2544 scope.go:117] "RemoveContainer" containerID="71d630de62e789462980a10b232753147dbd6e4f686a67be3067eb8295a5ec7c" Jun 09 13:45:26.573443 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:45:26.573422 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-kt785_openshift-ingress(b391cf3c-c22a-45e6-b268-c8ec68f4c58c)\"" pod="openshift-ingress/payload-processing-7c6c859784-kt785" podUID="b391cf3c-c22a-45e6-b268-c8ec68f4c58c" Jun 09 13:45:28.018909 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:28.018877 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-kt785" Jun 09 13:45:28.019300 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:28.019193 2544 scope.go:117] "RemoveContainer" containerID="71d630de62e789462980a10b232753147dbd6e4f686a67be3067eb8295a5ec7c" Jun 09 13:45:28.019372 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:45:28.019355 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-kt785_openshift-ingress(b391cf3c-c22a-45e6-b268-c8ec68f4c58c)\"" pod="openshift-ingress/payload-processing-7c6c859784-kt785" podUID="b391cf3c-c22a-45e6-b268-c8ec68f4c58c" Jun 09 13:45:29.779132 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:29.779095 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:45:40.514774 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:40.514734 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:45:42.270769 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:42.270736 2544 scope.go:117] "RemoveContainer" containerID="71d630de62e789462980a10b232753147dbd6e4f686a67be3067eb8295a5ec7c" Jun 09 13:45:42.284948 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:42.284928 2544 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-kt785" Jun 09 13:45:42.655713 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:42.655623 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-kt785" event={"ID":"b391cf3c-c22a-45e6-b268-c8ec68f4c58c","Type":"ContainerStarted","Data":"4b8b49e33afa1b2d67c93444375b5f3ac18487f6502d6b5c7eeec28001d57699"} Jun 09 13:45:42.655858 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:42.655763 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-kt785" Jun 09 13:45:49.990158 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:49.990122 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7569bf7bf4-fk6c8"] Jun 09 13:45:49.990596 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:49.990581 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53e024fb-c47b-4730-9d13-237c0c8c7706" containerName="cleanup" Jun 09 13:45:49.990596 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:49.990597 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="53e024fb-c47b-4730-9d13-237c0c8c7706" containerName="cleanup" Jun 09 13:45:49.990678 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:49.990667 2544 memory_manager.go:368] "RemoveStaleState removing state" podUID="53e024fb-c47b-4730-9d13-237c0c8c7706" containerName="cleanup" Jun 09 13:45:49.992813 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:49.992798 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7569bf7bf4-fk6c8" Jun 09 13:45:49.996229 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:49.996207 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 09 13:45:49.996383 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:49.996241 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qblt8\"" Jun 09 13:45:49.996383 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:49.996279 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 09 13:45:50.000830 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:50.000805 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7569bf7bf4-fk6c8"] Jun 09 13:45:50.086315 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:50.086284 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsb8v\" (UniqueName: \"kubernetes.io/projected/3736222e-9404-431b-929b-03d01bbe5b6f-kube-api-access-xsb8v\") pod \"maas-controller-7569bf7bf4-fk6c8\" (UID: \"3736222e-9404-431b-929b-03d01bbe5b6f\") " pod="opendatahub/maas-controller-7569bf7bf4-fk6c8" Jun 09 13:45:50.086520 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:50.086326 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3736222e-9404-431b-929b-03d01bbe5b6f-webhook-cert\") pod \"maas-controller-7569bf7bf4-fk6c8\" (UID: \"3736222e-9404-431b-929b-03d01bbe5b6f\") " pod="opendatahub/maas-controller-7569bf7bf4-fk6c8" Jun 09 13:45:50.187364 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:50.187321 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsb8v\" (UniqueName: \"kubernetes.io/projected/3736222e-9404-431b-929b-03d01bbe5b6f-kube-api-access-xsb8v\") pod \"maas-controller-7569bf7bf4-fk6c8\" (UID: \"3736222e-9404-431b-929b-03d01bbe5b6f\") " pod="opendatahub/maas-controller-7569bf7bf4-fk6c8" Jun 09 13:45:50.187364 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:50.187370 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3736222e-9404-431b-929b-03d01bbe5b6f-webhook-cert\") pod \"maas-controller-7569bf7bf4-fk6c8\" (UID: \"3736222e-9404-431b-929b-03d01bbe5b6f\") " pod="opendatahub/maas-controller-7569bf7bf4-fk6c8" Jun 09 13:45:50.189878 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:50.189848 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3736222e-9404-431b-929b-03d01bbe5b6f-webhook-cert\") pod \"maas-controller-7569bf7bf4-fk6c8\" (UID: \"3736222e-9404-431b-929b-03d01bbe5b6f\") " pod="opendatahub/maas-controller-7569bf7bf4-fk6c8" Jun 09 13:45:50.196735 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:50.196711 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsb8v\" (UniqueName: \"kubernetes.io/projected/3736222e-9404-431b-929b-03d01bbe5b6f-kube-api-access-xsb8v\") pod \"maas-controller-7569bf7bf4-fk6c8\" (UID: \"3736222e-9404-431b-929b-03d01bbe5b6f\") " pod="opendatahub/maas-controller-7569bf7bf4-fk6c8" Jun 09 13:45:50.304009 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:50.303974 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7569bf7bf4-fk6c8" Jun 09 13:45:50.435873 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:50.435848 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7569bf7bf4-fk6c8"] Jun 09 13:45:50.437981 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:45:50.437940 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3736222e_9404_431b_929b_03d01bbe5b6f.slice/crio-8bded240bb7728468e2c37428a75b157d4ac528e12dcbcb2e0ea082b53bd0728 WatchSource:0}: Error finding container 8bded240bb7728468e2c37428a75b157d4ac528e12dcbcb2e0ea082b53bd0728: Status 404 returned error can't find the container with id 8bded240bb7728468e2c37428a75b157d4ac528e12dcbcb2e0ea082b53bd0728 Jun 09 13:45:50.697822 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:50.697733 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7569bf7bf4-fk6c8" event={"ID":"3736222e-9404-431b-929b-03d01bbe5b6f","Type":"ContainerStarted","Data":"8bded240bb7728468e2c37428a75b157d4ac528e12dcbcb2e0ea082b53bd0728"} Jun 09 13:45:52.710362 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:52.710266 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7569bf7bf4-fk6c8" event={"ID":"3736222e-9404-431b-929b-03d01bbe5b6f","Type":"ContainerStarted","Data":"c811a3563e818d95bce7263bc6464113e98dd3e1df0ee6f1a4f8a9259b4d34bc"} Jun 09 13:45:52.710834 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:52.710395 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7569bf7bf4-fk6c8" Jun 09 13:45:52.735012 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:52.734948 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7569bf7bf4-fk6c8" podStartSLOduration=1.763983331 podStartE2EDuration="3.734927264s" totalImagesPullingTime="1.970943933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:45:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:45:52.731766856 +0000 UTC m=+1059.887039069" watchObservedRunningTime="2026-06-09 13:45:52.734927264 +0000 UTC m=+1059.890199476" Jun 09 13:45:53.663441 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:45:53.663411 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-kt785" Jun 09 13:46:03.722054 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:46:03.721982 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7569bf7bf4-fk6c8" Jun 09 13:46:13.976871 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:46:13.976835 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:46:17.784995 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:46:17.784960 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:46:54.676638 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:46:54.676604 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:47:10.480977 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:47:10.480946 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:47:43.257908 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:47:43.257874 2544 generic.go:356] "Generic (PLEG): container finished" podID="b391cf3c-c22a-45e6-b268-c8ec68f4c58c" containerID="4b8b49e33afa1b2d67c93444375b5f3ac18487f6502d6b5c7eeec28001d57699" exitCode=1 Jun 09 13:47:43.258360 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:47:43.257945 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-kt785" event={"ID":"b391cf3c-c22a-45e6-b268-c8ec68f4c58c","Type":"ContainerDied","Data":"4b8b49e33afa1b2d67c93444375b5f3ac18487f6502d6b5c7eeec28001d57699"} Jun 09 13:47:43.258360 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:47:43.258011 2544 scope.go:117] "RemoveContainer" containerID="71d630de62e789462980a10b232753147dbd6e4f686a67be3067eb8295a5ec7c" Jun 09 13:47:43.258445 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:47:43.258361 2544 scope.go:117] "RemoveContainer" containerID="4b8b49e33afa1b2d67c93444375b5f3ac18487f6502d6b5c7eeec28001d57699" Jun 09 13:47:43.258607 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:47:43.258585 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-kt785_openshift-ingress(b391cf3c-c22a-45e6-b268-c8ec68f4c58c)\"" pod="openshift-ingress/payload-processing-7c6c859784-kt785" podUID="b391cf3c-c22a-45e6-b268-c8ec68f4c58c" Jun 09 13:47:43.661783 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:47:43.661695 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-kt785" Jun 09 13:47:44.264541 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:47:44.264513 2544 scope.go:117] "RemoveContainer" containerID="4b8b49e33afa1b2d67c93444375b5f3ac18487f6502d6b5c7eeec28001d57699" Jun 09 13:47:44.264917 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:47:44.264708 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-kt785_openshift-ingress(b391cf3c-c22a-45e6-b268-c8ec68f4c58c)\"" pod="openshift-ingress/payload-processing-7c6c859784-kt785" podUID="b391cf3c-c22a-45e6-b268-c8ec68f4c58c" Jun 09 13:47:49.084675 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:47:49.084636 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:47:59.271218 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:47:59.271185 2544 scope.go:117] "RemoveContainer" containerID="4b8b49e33afa1b2d67c93444375b5f3ac18487f6502d6b5c7eeec28001d57699" Jun 09 13:47:59.271632 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:47:59.271348 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-kt785_openshift-ingress(b391cf3c-c22a-45e6-b268-c8ec68f4c58c)\"" pod="openshift-ingress/payload-processing-7c6c859784-kt785" podUID="b391cf3c-c22a-45e6-b268-c8ec68f4c58c" Jun 09 13:48:02.284489 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:48:02.284454 2544 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-kt785" Jun 09 13:48:02.284909 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:48:02.284826 2544 scope.go:117] "RemoveContainer" containerID="4b8b49e33afa1b2d67c93444375b5f3ac18487f6502d6b5c7eeec28001d57699" Jun 09 13:48:02.285012 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:48:02.284993 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-kt785_openshift-ingress(b391cf3c-c22a-45e6-b268-c8ec68f4c58c)\"" pod="openshift-ingress/payload-processing-7c6c859784-kt785" podUID="b391cf3c-c22a-45e6-b268-c8ec68f4c58c" Jun 09 13:48:06.278916 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:48:06.278883 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:48:09.376005 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:48:09.375972 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:48:13.272803 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:48:13.272776 2544 scope.go:117] "RemoveContainer" containerID="4b8b49e33afa1b2d67c93444375b5f3ac18487f6502d6b5c7eeec28001d57699" Jun 09 13:48:13.408752 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:48:13.408717 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-kt785" event={"ID":"b391cf3c-c22a-45e6-b268-c8ec68f4c58c","Type":"ContainerStarted","Data":"cfd3383b9b2975ddf54e855d295744a325e6575d4495cd53b14f4970b3d05ec5"} Jun 09 13:48:13.409056 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:48:13.409036 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-kt785" Jun 09 13:48:20.819975 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:48:20.819941 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:48:24.416229 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:48:24.416202 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-kt785" Jun 09 13:48:37.076257 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:48:37.076224 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:49:15.890465 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:49:15.890381 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:49:18.986118 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:49:18.986077 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:49:41.082940 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:49:41.082903 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:49:50.285873 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:49:50.285841 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:50:06.776784 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:50:06.776753 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:50:13.997395 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:50:13.997361 2544 generic.go:356] "Generic (PLEG): container finished" podID="b391cf3c-c22a-45e6-b268-c8ec68f4c58c" containerID="cfd3383b9b2975ddf54e855d295744a325e6575d4495cd53b14f4970b3d05ec5" exitCode=1 Jun 09 13:50:13.997921 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:50:13.997438 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-kt785" event={"ID":"b391cf3c-c22a-45e6-b268-c8ec68f4c58c","Type":"ContainerDied","Data":"cfd3383b9b2975ddf54e855d295744a325e6575d4495cd53b14f4970b3d05ec5"} Jun 09 13:50:13.997921 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:50:13.997512 2544 scope.go:117] "RemoveContainer" containerID="4b8b49e33afa1b2d67c93444375b5f3ac18487f6502d6b5c7eeec28001d57699" Jun 09 13:50:13.997921 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:50:13.997886 2544 scope.go:117] "RemoveContainer" containerID="cfd3383b9b2975ddf54e855d295744a325e6575d4495cd53b14f4970b3d05ec5" Jun 09 13:50:13.998119 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:50:13.998098 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-kt785_openshift-ingress(b391cf3c-c22a-45e6-b268-c8ec68f4c58c)\"" pod="openshift-ingress/payload-processing-7c6c859784-kt785" podUID="b391cf3c-c22a-45e6-b268-c8ec68f4c58c" Jun 09 13:50:14.414529 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:50:14.414440 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-kt785" Jun 09 13:50:15.004332 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:50:15.004299 2544 scope.go:117] "RemoveContainer" containerID="cfd3383b9b2975ddf54e855d295744a325e6575d4495cd53b14f4970b3d05ec5" Jun 09 13:50:15.004721 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:50:15.004477 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-kt785_openshift-ingress(b391cf3c-c22a-45e6-b268-c8ec68f4c58c)\"" pod="openshift-ingress/payload-processing-7c6c859784-kt785" podUID="b391cf3c-c22a-45e6-b268-c8ec68f4c58c" Jun 09 13:50:15.580772 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:50:15.580736 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:50:22.284915 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:50:22.284864 2544 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-kt785" Jun 09 13:50:22.285511 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:50:22.285336 2544 scope.go:117] "RemoveContainer" containerID="cfd3383b9b2975ddf54e855d295744a325e6575d4495cd53b14f4970b3d05ec5" Jun 09 13:50:22.285657 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:50:22.285636 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-kt785_openshift-ingress(b391cf3c-c22a-45e6-b268-c8ec68f4c58c)\"" pod="openshift-ingress/payload-processing-7c6c859784-kt785" podUID="b391cf3c-c22a-45e6-b268-c8ec68f4c58c" Jun 09 13:50:23.689277 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:50:23.689244 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:50:37.270867 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:50:37.270834 2544 scope.go:117] "RemoveContainer" containerID="cfd3383b9b2975ddf54e855d295744a325e6575d4495cd53b14f4970b3d05ec5" Jun 09 13:50:37.271249 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:50:37.271081 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-kt785_openshift-ingress(b391cf3c-c22a-45e6-b268-c8ec68f4c58c)\"" pod="openshift-ingress/payload-processing-7c6c859784-kt785" podUID="b391cf3c-c22a-45e6-b268-c8ec68f4c58c" Jun 09 13:50:51.270958 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:50:51.270928 2544 scope.go:117] "RemoveContainer" containerID="cfd3383b9b2975ddf54e855d295744a325e6575d4495cd53b14f4970b3d05ec5" Jun 09 13:50:51.271369 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:50:51.271121 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-kt785_openshift-ingress(b391cf3c-c22a-45e6-b268-c8ec68f4c58c)\"" pod="openshift-ingress/payload-processing-7c6c859784-kt785" podUID="b391cf3c-c22a-45e6-b268-c8ec68f4c58c" Jun 09 13:51:02.270325 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:51:02.270296 2544 scope.go:117] "RemoveContainer" containerID="cfd3383b9b2975ddf54e855d295744a325e6575d4495cd53b14f4970b3d05ec5" Jun 09 13:51:03.243015 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:51:03.242979 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-kt785" event={"ID":"b391cf3c-c22a-45e6-b268-c8ec68f4c58c","Type":"ContainerStarted","Data":"07e77634cb2fd247a9f8aabf6b81db9c8923d359ea27bd91bddea21e675dd582"} Jun 09 13:51:03.243191 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:51:03.243176 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-kt785" Jun 09 13:51:14.250566 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:51:14.250521 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-kt785" Jun 09 13:51:16.684763 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:51:16.684731 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:51:25.993377 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:51:25.993342 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:51:33.994684 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:51:33.994650 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:52:06.384766 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:52:06.384674 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:52:15.395006 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:52:15.394973 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:52:23.783798 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:52:23.783769 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:52:31.593266 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:52:31.593226 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:52:40.377395 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:52:40.377361 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:52:48.779969 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:52:48.779940 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:52:51.788045 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:52:51.788009 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:52:57.281279 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:52:57.281245 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:53:02.830522 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:53:02.830491 2544 generic.go:356] "Generic (PLEG): container finished" podID="b391cf3c-c22a-45e6-b268-c8ec68f4c58c" containerID="07e77634cb2fd247a9f8aabf6b81db9c8923d359ea27bd91bddea21e675dd582" exitCode=1 Jun 09 13:53:02.830920 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:53:02.830577 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-kt785" event={"ID":"b391cf3c-c22a-45e6-b268-c8ec68f4c58c","Type":"ContainerDied","Data":"07e77634cb2fd247a9f8aabf6b81db9c8923d359ea27bd91bddea21e675dd582"} Jun 09 13:53:02.830920 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:53:02.830637 2544 scope.go:117] "RemoveContainer" containerID="cfd3383b9b2975ddf54e855d295744a325e6575d4495cd53b14f4970b3d05ec5" Jun 09 13:53:02.830920 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:53:02.830872 2544 scope.go:117] "RemoveContainer" containerID="07e77634cb2fd247a9f8aabf6b81db9c8923d359ea27bd91bddea21e675dd582" Jun 09 13:53:02.831083 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:53:02.831065 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-kt785_openshift-ingress(b391cf3c-c22a-45e6-b268-c8ec68f4c58c)\"" pod="openshift-ingress/payload-processing-7c6c859784-kt785" podUID="b391cf3c-c22a-45e6-b268-c8ec68f4c58c" Jun 09 13:53:04.249804 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:53:04.249771 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-kt785" Jun 09 13:53:04.250178 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:53:04.250105 2544 scope.go:117] "RemoveContainer" containerID="07e77634cb2fd247a9f8aabf6b81db9c8923d359ea27bd91bddea21e675dd582" Jun 09 13:53:04.250315 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:53:04.250295 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-kt785_openshift-ingress(b391cf3c-c22a-45e6-b268-c8ec68f4c58c)\"" pod="openshift-ingress/payload-processing-7c6c859784-kt785" podUID="b391cf3c-c22a-45e6-b268-c8ec68f4c58c" Jun 09 13:53:06.281116 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:53:06.281083 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:53:16.270589 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:53:16.270535 2544 scope.go:117] "RemoveContainer" containerID="07e77634cb2fd247a9f8aabf6b81db9c8923d359ea27bd91bddea21e675dd582" Jun 09 13:53:16.271043 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:53:16.270757 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-kt785_openshift-ingress(b391cf3c-c22a-45e6-b268-c8ec68f4c58c)\"" pod="openshift-ingress/payload-processing-7c6c859784-kt785" podUID="b391cf3c-c22a-45e6-b268-c8ec68f4c58c" Jun 09 13:53:22.284635 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:53:22.284602 2544 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-kt785" Jun 09 13:53:22.285079 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:53:22.284889 2544 scope.go:117] "RemoveContainer" containerID="07e77634cb2fd247a9f8aabf6b81db9c8923d359ea27bd91bddea21e675dd582" Jun 09 13:53:22.285079 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:53:22.285023 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-kt785_openshift-ingress(b391cf3c-c22a-45e6-b268-c8ec68f4c58c)\"" pod="openshift-ingress/payload-processing-7c6c859784-kt785" podUID="b391cf3c-c22a-45e6-b268-c8ec68f4c58c" Jun 09 13:53:35.271315 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:53:35.271276 2544 scope.go:117] "RemoveContainer" containerID="07e77634cb2fd247a9f8aabf6b81db9c8923d359ea27bd91bddea21e675dd582" Jun 09 13:53:35.271777 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:53:35.271502 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-kt785_openshift-ingress(b391cf3c-c22a-45e6-b268-c8ec68f4c58c)\"" pod="openshift-ingress/payload-processing-7c6c859784-kt785" podUID="b391cf3c-c22a-45e6-b268-c8ec68f4c58c" Jun 09 13:53:43.977937 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:53:43.977903 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:53:46.085595 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:53:46.085558 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xc4px"] Jun 09 13:53:48.271039 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:53:48.271009 2544 scope.go:117] "RemoveContainer" containerID="07e77634cb2fd247a9f8aabf6b81db9c8923d359ea27bd91bddea21e675dd582" Jun 09 13:53:48.271444 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:53:48.271213 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-kt785_openshift-ingress(b391cf3c-c22a-45e6-b268-c8ec68f4c58c)\"" pod="openshift-ingress/payload-processing-7c6c859784-kt785" podUID="b391cf3c-c22a-45e6-b268-c8ec68f4c58c" Jun 09 13:53:59.270852 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:53:59.270819 2544 scope.go:117] "RemoveContainer" containerID="07e77634cb2fd247a9f8aabf6b81db9c8923d359ea27bd91bddea21e675dd582" Jun 09 13:53:59.271399 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:53:59.271048 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-kt785_openshift-ingress(b391cf3c-c22a-45e6-b268-c8ec68f4c58c)\"" pod="openshift-ingress/payload-processing-7c6c859784-kt785" podUID="b391cf3c-c22a-45e6-b268-c8ec68f4c58c" Jun 09 13:54:06.757858 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:06.757834 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7c5f8fd4f7-c8hbq_885ec77c-335d-4f25-8166-c374fc185dd9/nginx/0.log" Jun 09 13:54:07.358217 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:07.358194 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29683545-8znd9_53e024fb-c47b-4730-9d13-237c0c8c7706/cleanup/0.log" Jun 09 13:54:07.484528 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:07.484497 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7569bf7bf4-fk6c8_3736222e-9404-431b-929b-03d01bbe5b6f/manager/0.log" Jun 09 13:54:07.853723 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:07.853698 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cc7576fb9-2pqw5_ffe78902-e6f4-49a0-8d9e-c7fcf20046a9/copy-manifests/0.log" Jun 09 13:54:07.861338 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:07.861315 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cc7576fb9-2pqw5_ffe78902-e6f4-49a0-8d9e-c7fcf20046a9/manager/0.log" Jun 09 13:54:09.645356 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:09.645321 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-b957d_d2d3601c-bd49-4cd4-9c0f-0bb562375cf0/manager/0.log" Jun 09 13:54:09.762611 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:09.762538 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tnfvm_595d9e2b-b43e-4ea5-a2c6-b4db03b59d98/manager/0.log" Jun 09 13:54:09.981560 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:09.981475 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-t7z8j_523eb8b1-ee77-4ac1-9b49-98dfd53ed5f6/registry-server/0.log" Jun 09 13:54:10.223504 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:10.223480 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-xc4px_5724f9d0-c67e-4776-898f-8f9851bd6550/limitador/0.log" Jun 09 13:54:10.342490 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:10.342460 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-f2m98_f57cf277-cb49-4dbd-a877-774962782af7/manager/0.log" Jun 09 13:54:10.686948 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:10.686870 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795vttrb_2ac11b82-cbd5-48a4-a308-5969a21cd7b5/istio-proxy/0.log" Jun 09 13:54:11.148513 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:11.148482 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-hwg2h_b6fc1c94-245d-448e-993a-03cc120df477/istio-proxy/1.log" Jun 09 13:54:11.393118 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:11.393087 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-kt785_b391cf3c-c22a-45e6-b268-c8ec68f4c58c/payload-processing/4.log" Jun 09 13:54:14.270393 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:14.270361 2544 scope.go:117] "RemoveContainer" containerID="07e77634cb2fd247a9f8aabf6b81db9c8923d359ea27bd91bddea21e675dd582" Jun 09 13:54:14.270799 ip-10-0-131-58 kubenswrapper[2544]: E0609 13:54:14.270603 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-kt785_openshift-ingress(b391cf3c-c22a-45e6-b268-c8ec68f4c58c)\"" pod="openshift-ingress/payload-processing-7c6c859784-kt785" podUID="b391cf3c-c22a-45e6-b268-c8ec68f4c58c" Jun 09 13:54:16.321813 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:16.321784 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fjgn8/must-gather-hg7dt"] Jun 09 13:54:16.325530 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:16.325514 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fjgn8/must-gather-hg7dt" Jun 09 13:54:16.328058 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:16.328036 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fjgn8\"/\"openshift-service-ca.crt\"" Jun 09 13:54:16.328164 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:16.328110 2544 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fjgn8\"/\"default-dockercfg-4f482\"" Jun 09 13:54:16.328164 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:16.328152 2544 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fjgn8\"/\"kube-root-ca.crt\"" Jun 09 13:54:16.332880 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:16.332729 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fjgn8/must-gather-hg7dt"] Jun 09 13:54:16.409787 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:16.409730 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cdfebf0b-2ea9-4e54-9bb2-66c5da2d46cb-must-gather-output\") pod \"must-gather-hg7dt\" (UID: \"cdfebf0b-2ea9-4e54-9bb2-66c5da2d46cb\") " pod="openshift-must-gather-fjgn8/must-gather-hg7dt" Jun 09 13:54:16.409973 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:16.409807 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfwsm\" (UniqueName: \"kubernetes.io/projected/cdfebf0b-2ea9-4e54-9bb2-66c5da2d46cb-kube-api-access-rfwsm\") pod \"must-gather-hg7dt\" (UID: \"cdfebf0b-2ea9-4e54-9bb2-66c5da2d46cb\") " pod="openshift-must-gather-fjgn8/must-gather-hg7dt" Jun 09 13:54:16.511221 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:16.511167 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cdfebf0b-2ea9-4e54-9bb2-66c5da2d46cb-must-gather-output\") pod \"must-gather-hg7dt\" (UID: \"cdfebf0b-2ea9-4e54-9bb2-66c5da2d46cb\") " pod="openshift-must-gather-fjgn8/must-gather-hg7dt" Jun 09 13:54:16.511221 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:16.511240 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfwsm\" (UniqueName: \"kubernetes.io/projected/cdfebf0b-2ea9-4e54-9bb2-66c5da2d46cb-kube-api-access-rfwsm\") pod \"must-gather-hg7dt\" (UID: \"cdfebf0b-2ea9-4e54-9bb2-66c5da2d46cb\") " pod="openshift-must-gather-fjgn8/must-gather-hg7dt" Jun 09 13:54:16.511632 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:16.511612 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cdfebf0b-2ea9-4e54-9bb2-66c5da2d46cb-must-gather-output\") pod \"must-gather-hg7dt\" (UID: \"cdfebf0b-2ea9-4e54-9bb2-66c5da2d46cb\") " pod="openshift-must-gather-fjgn8/must-gather-hg7dt" Jun 09 13:54:16.520959 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:16.520935 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfwsm\" (UniqueName: \"kubernetes.io/projected/cdfebf0b-2ea9-4e54-9bb2-66c5da2d46cb-kube-api-access-rfwsm\") pod \"must-gather-hg7dt\" (UID: \"cdfebf0b-2ea9-4e54-9bb2-66c5da2d46cb\") " pod="openshift-must-gather-fjgn8/must-gather-hg7dt" Jun 09 13:54:16.635712 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:16.635626 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fjgn8/must-gather-hg7dt" Jun 09 13:54:16.768311 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:16.768280 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fjgn8/must-gather-hg7dt"] Jun 09 13:54:16.770284 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:54:16.770256 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcdfebf0b_2ea9_4e54_9bb2_66c5da2d46cb.slice/crio-ba17ac3d1a98a27e4b95688829daca6df355e9408ea5af6b1b140e644a249dd1 WatchSource:0}: Error finding container ba17ac3d1a98a27e4b95688829daca6df355e9408ea5af6b1b140e644a249dd1: Status 404 returned error can't find the container with id ba17ac3d1a98a27e4b95688829daca6df355e9408ea5af6b1b140e644a249dd1 Jun 09 13:54:16.772227 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:16.772211 2544 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 13:54:17.188685 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:17.188652 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fjgn8/must-gather-hg7dt" event={"ID":"cdfebf0b-2ea9-4e54-9bb2-66c5da2d46cb","Type":"ContainerStarted","Data":"ba17ac3d1a98a27e4b95688829daca6df355e9408ea5af6b1b140e644a249dd1"} Jun 09 13:54:18.197456 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:18.197417 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fjgn8/must-gather-hg7dt" event={"ID":"cdfebf0b-2ea9-4e54-9bb2-66c5da2d46cb","Type":"ContainerStarted","Data":"f6a3a0883cae5c3e7ced33ea2a8f5ea696621f5d9a0e6b6510e4029166345e26"} Jun 09 13:54:18.197456 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:18.197465 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fjgn8/must-gather-hg7dt" event={"ID":"cdfebf0b-2ea9-4e54-9bb2-66c5da2d46cb","Type":"ContainerStarted","Data":"4051a9d2eff5d49cf98c338850f51d0ddda759870ded5c2b7186e4fe43244c82"} Jun 09 13:54:18.213478 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:18.213427 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fjgn8/must-gather-hg7dt" podStartSLOduration=1.316850735 podStartE2EDuration="2.213408618s" totalImagesPullingTime="896.557883ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:54:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:54:18.213181627 +0000 UTC m=+1565.368453839" watchObservedRunningTime="2026-06-09 13:54:18.213408618 +0000 UTC m=+1565.368680830" Jun 09 13:54:19.348073 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:19.348041 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lm86k_20644c8b-cdf0-49f4-920a-5975ca9a0175/global-pull-secret-syncer/0.log" Jun 09 13:54:19.524277 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:19.524247 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-v9p5z_4b282799-7abc-42f2-bc74-9da3ee15b65a/konnectivity-agent/0.log" Jun 09 13:54:19.569542 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:19.569512 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-58.ec2.internal_404401a3bc64135c3d2334b8265bc10b/haproxy/0.log" Jun 09 13:54:25.220747 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:25.220718 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-b957d_d2d3601c-bd49-4cd4-9c0f-0bb562375cf0/manager/0.log" Jun 09 13:54:25.257524 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:25.257450 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tnfvm_595d9e2b-b43e-4ea5-a2c6-b4db03b59d98/manager/0.log" Jun 09 13:54:25.317159 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:25.317122 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-t7z8j_523eb8b1-ee77-4ac1-9b49-98dfd53ed5f6/registry-server/0.log" Jun 09 13:54:25.395697 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:25.395669 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-xc4px_5724f9d0-c67e-4776-898f-8f9851bd6550/limitador/0.log" Jun 09 13:54:25.448938 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:25.448906 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-f2m98_f57cf277-cb49-4dbd-a877-774962782af7/manager/0.log" Jun 09 13:54:27.129211 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:27.129185 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d/alertmanager/0.log" Jun 09 13:54:27.167154 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:27.167103 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d/config-reloader/0.log" Jun 09 13:54:27.186181 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:27.186155 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d/kube-rbac-proxy-web/0.log" Jun 09 13:54:27.208103 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:27.208030 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d/kube-rbac-proxy/0.log" Jun 09 13:54:27.231867 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:27.231831 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d/kube-rbac-proxy-metric/0.log" Jun 09 13:54:27.252213 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:27.252135 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d/prom-label-proxy/0.log" Jun 09 13:54:27.277225 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:27.277196 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c7a74a9-c7e2-4852-bdd9-0f5539f7f40d/init-config-reloader/0.log" Jun 09 13:54:27.322792 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:27.322762 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-xkvf7_85779f48-91b4-4298-8e90-f9574514984c/cluster-monitoring-operator/0.log" Jun 09 13:54:27.503084 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:27.503054 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gdpkn_6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2/node-exporter/0.log" Jun 09 13:54:27.528810 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:27.528755 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gdpkn_6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2/kube-rbac-proxy/0.log" Jun 09 13:54:27.551827 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:27.551796 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gdpkn_6ebe1f14-02c1-4aad-8a0c-66ba1c4e6bb2/init-textfile/0.log" Jun 09 13:54:27.752458 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:27.752408 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-tbk9v_1f34cca9-2073-4001-8c2c-8fbd09435265/kube-rbac-proxy-main/0.log" Jun 09 13:54:27.781570 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:27.781425 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-tbk9v_1f34cca9-2073-4001-8c2c-8fbd09435265/kube-rbac-proxy-self/0.log" Jun 09 13:54:27.803987 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:27.803934 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-tbk9v_1f34cca9-2073-4001-8c2c-8fbd09435265/openshift-state-metrics/0.log" Jun 09 13:54:27.840876 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:27.840849 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11923874-d106-4fd1-b09e-0028899dec9c/prometheus/0.log" Jun 09 13:54:27.868901 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:27.868875 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11923874-d106-4fd1-b09e-0028899dec9c/config-reloader/0.log" Jun 09 13:54:27.894982 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:27.894956 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11923874-d106-4fd1-b09e-0028899dec9c/thanos-sidecar/0.log" Jun 09 13:54:27.917477 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:27.916408 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11923874-d106-4fd1-b09e-0028899dec9c/kube-rbac-proxy-web/0.log" Jun 09 13:54:27.941288 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:27.941260 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11923874-d106-4fd1-b09e-0028899dec9c/kube-rbac-proxy/0.log" Jun 09 13:54:27.964047 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:27.964016 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11923874-d106-4fd1-b09e-0028899dec9c/kube-rbac-proxy-thanos/0.log" Jun 09 13:54:27.984994 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:27.984965 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11923874-d106-4fd1-b09e-0028899dec9c/init-config-reloader/0.log" Jun 09 13:54:28.061365 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:28.061277 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-bwlq6_f66f3033-7f07-4722-b45f-fff03ce605fa/prometheus-operator-admission-webhook/0.log" Jun 09 13:54:28.090854 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:28.090829 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6595769959-dfbfg_47c59023-c371-4b24-bead-1aa73b6c2365/telemeter-client/0.log" Jun 09 13:54:28.115955 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:28.115924 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6595769959-dfbfg_47c59023-c371-4b24-bead-1aa73b6c2365/reload/0.log" Jun 09 13:54:28.138108 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:28.138077 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6595769959-dfbfg_47c59023-c371-4b24-bead-1aa73b6c2365/kube-rbac-proxy/0.log" Jun 09 13:54:29.270898 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:29.270780 2544 scope.go:117] "RemoveContainer" containerID="07e77634cb2fd247a9f8aabf6b81db9c8923d359ea27bd91bddea21e675dd582" Jun 09 13:54:30.302079 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:30.302038 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-kt785" event={"ID":"b391cf3c-c22a-45e6-b268-c8ec68f4c58c","Type":"ContainerStarted","Data":"bd58c0f552cbbf2fb8910ed5146a6e17a1e757d3182e829afd8ff7db2f258887"} Jun 09 13:54:30.302904 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:30.302880 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-kt785" Jun 09 13:54:30.544593 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:30.544543 2544 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fjgn8/perf-node-gather-daemonset-ndczc"] Jun 09 13:54:30.550884 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:30.550859 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-ndczc" Jun 09 13:54:30.555739 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:30.555671 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fjgn8/perf-node-gather-daemonset-ndczc"] Jun 09 13:54:30.694291 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:30.694262 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1444dd15-a11b-4c4c-9d85-05ba67038495-podres\") pod \"perf-node-gather-daemonset-ndczc\" (UID: \"1444dd15-a11b-4c4c-9d85-05ba67038495\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-ndczc" Jun 09 13:54:30.694457 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:30.694298 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf95z\" (UniqueName: \"kubernetes.io/projected/1444dd15-a11b-4c4c-9d85-05ba67038495-kube-api-access-sf95z\") pod \"perf-node-gather-daemonset-ndczc\" (UID: \"1444dd15-a11b-4c4c-9d85-05ba67038495\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-ndczc" Jun 09 13:54:30.694457 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:30.694320 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1444dd15-a11b-4c4c-9d85-05ba67038495-sys\") pod \"perf-node-gather-daemonset-ndczc\" (UID: \"1444dd15-a11b-4c4c-9d85-05ba67038495\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-ndczc" Jun 09 13:54:30.694457 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:30.694335 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1444dd15-a11b-4c4c-9d85-05ba67038495-lib-modules\") pod \"perf-node-gather-daemonset-ndczc\" (UID: \"1444dd15-a11b-4c4c-9d85-05ba67038495\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-ndczc" Jun 09 13:54:30.694457 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:30.694358 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1444dd15-a11b-4c4c-9d85-05ba67038495-proc\") pod \"perf-node-gather-daemonset-ndczc\" (UID: \"1444dd15-a11b-4c4c-9d85-05ba67038495\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-ndczc" Jun 09 13:54:30.795887 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:30.795852 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1444dd15-a11b-4c4c-9d85-05ba67038495-podres\") pod \"perf-node-gather-daemonset-ndczc\" (UID: \"1444dd15-a11b-4c4c-9d85-05ba67038495\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-ndczc" Jun 09 13:54:30.796061 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:30.795897 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf95z\" (UniqueName: \"kubernetes.io/projected/1444dd15-a11b-4c4c-9d85-05ba67038495-kube-api-access-sf95z\") pod \"perf-node-gather-daemonset-ndczc\" (UID: \"1444dd15-a11b-4c4c-9d85-05ba67038495\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-ndczc" Jun 09 13:54:30.796061 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:30.795931 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1444dd15-a11b-4c4c-9d85-05ba67038495-sys\") pod \"perf-node-gather-daemonset-ndczc\" (UID: \"1444dd15-a11b-4c4c-9d85-05ba67038495\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-ndczc" Jun 09 13:54:30.796061 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:30.795965 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1444dd15-a11b-4c4c-9d85-05ba67038495-lib-modules\") pod \"perf-node-gather-daemonset-ndczc\" (UID: \"1444dd15-a11b-4c4c-9d85-05ba67038495\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-ndczc" Jun 09 13:54:30.796061 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:30.796010 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1444dd15-a11b-4c4c-9d85-05ba67038495-proc\") pod \"perf-node-gather-daemonset-ndczc\" (UID: \"1444dd15-a11b-4c4c-9d85-05ba67038495\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-ndczc" Jun 09 13:54:30.796061 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:30.796018 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1444dd15-a11b-4c4c-9d85-05ba67038495-podres\") pod \"perf-node-gather-daemonset-ndczc\" (UID: \"1444dd15-a11b-4c4c-9d85-05ba67038495\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-ndczc" Jun 09 13:54:30.796339 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:30.796074 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1444dd15-a11b-4c4c-9d85-05ba67038495-sys\") pod \"perf-node-gather-daemonset-ndczc\" (UID: \"1444dd15-a11b-4c4c-9d85-05ba67038495\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-ndczc" Jun 09 13:54:30.796339 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:30.796119 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1444dd15-a11b-4c4c-9d85-05ba67038495-lib-modules\") pod \"perf-node-gather-daemonset-ndczc\" (UID: \"1444dd15-a11b-4c4c-9d85-05ba67038495\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-ndczc" Jun 09 13:54:30.796339 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:30.796131 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1444dd15-a11b-4c4c-9d85-05ba67038495-proc\") pod \"perf-node-gather-daemonset-ndczc\" (UID: \"1444dd15-a11b-4c4c-9d85-05ba67038495\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-ndczc" Jun 09 13:54:30.804749 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:30.804725 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf95z\" (UniqueName: \"kubernetes.io/projected/1444dd15-a11b-4c4c-9d85-05ba67038495-kube-api-access-sf95z\") pod \"perf-node-gather-daemonset-ndczc\" (UID: \"1444dd15-a11b-4c4c-9d85-05ba67038495\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-ndczc" Jun 09 13:54:30.864977 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:30.864867 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-ndczc" Jun 09 13:54:31.056153 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:31.056122 2544 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fjgn8/perf-node-gather-daemonset-ndczc"] Jun 09 13:54:31.057707 ip-10-0-131-58 kubenswrapper[2544]: W0609 13:54:31.057667 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1444dd15_a11b_4c4c_9d85_05ba67038495.slice/crio-40ab87ae23c673c7acfe38a2be8143ebf008a84fc5baf2a4d0b09e54b395be53 WatchSource:0}: Error finding container 40ab87ae23c673c7acfe38a2be8143ebf008a84fc5baf2a4d0b09e54b395be53: Status 404 returned error can't find the container with id 40ab87ae23c673c7acfe38a2be8143ebf008a84fc5baf2a4d0b09e54b395be53 Jun 09 13:54:31.311031 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:31.310992 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-ndczc" event={"ID":"1444dd15-a11b-4c4c-9d85-05ba67038495","Type":"ContainerStarted","Data":"d5792e2e0f4c9a22eba7c8f648a120c988bc1209f148e2fc3733a13eb3823428"} Jun 09 13:54:31.311512 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:31.311059 2544 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-ndczc" event={"ID":"1444dd15-a11b-4c4c-9d85-05ba67038495","Type":"ContainerStarted","Data":"40ab87ae23c673c7acfe38a2be8143ebf008a84fc5baf2a4d0b09e54b395be53"} Jun 09 13:54:31.311512 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:31.311297 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-ndczc" Jun 09 13:54:31.327042 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:31.326982 2544 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-ndczc" podStartSLOduration=1.32696168 podStartE2EDuration="1.32696168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:54:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:54:31.326420168 +0000 UTC m=+1578.481692383" watchObservedRunningTime="2026-06-09 13:54:31.32696168 +0000 UTC m=+1578.482233893" Jun 09 13:54:31.523334 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:31.523307 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-qpf72_58cd5e68-2c3c-4353-a5b9-3ee4845283e0/volume-data-source-validator/0.log" Jun 09 13:54:32.544019 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:32.543990 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bf4sh_d3f532cd-176b-4271-b61c-8169febf3a46/dns/0.log" Jun 09 13:54:32.566670 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:32.566641 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bf4sh_d3f532cd-176b-4271-b61c-8169febf3a46/kube-rbac-proxy/0.log" Jun 09 13:54:32.734039 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:32.734014 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9vxbd_7eadc018-78fa-404b-9a37-6f86d44ce1af/dns-node-resolver/0.log" Jun 09 13:54:33.289137 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:33.289110 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-78d5b497d5-w7n4x_b474320b-22ac-4a52-896c-b89367de8abb/registry/0.log" Jun 09 13:54:33.336173 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:33.336148 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dppgq_abe91674-8930-4d3e-b6d0-4fe9234121a5/node-ca/0.log" Jun 09 13:54:34.317303 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:34.317271 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795vttrb_2ac11b82-cbd5-48a4-a308-5969a21cd7b5/istio-proxy/0.log" Jun 09 13:54:34.454759 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:34.454731 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-hwg2h_b6fc1c94-245d-448e-993a-03cc120df477/istio-proxy/0.log" Jun 09 13:54:34.481251 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:34.481215 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-hwg2h_b6fc1c94-245d-448e-993a-03cc120df477/istio-proxy/1.log" Jun 09 13:54:34.531721 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:34.531687 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-kt785_b391cf3c-c22a-45e6-b268-c8ec68f4c58c/payload-processing/5.log" Jun 09 13:54:34.534602 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:34.534579 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-kt785_b391cf3c-c22a-45e6-b268-c8ec68f4c58c/payload-processing/4.log" Jun 09 13:54:35.227386 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:35.227353 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8xvj9_7a7966ab-4a03-4d00-a421-5d347ad36262/serve-healthcheck-canary/0.log" Jun 09 13:54:36.074499 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:36.074473 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vwwnb_657d935b-62ff-43d0-b647-e9212e4c0bef/kube-rbac-proxy/0.log" Jun 09 13:54:36.099759 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:36.099726 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vwwnb_657d935b-62ff-43d0-b647-e9212e4c0bef/exporter/0.log" Jun 09 13:54:36.130307 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:36.130272 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vwwnb_657d935b-62ff-43d0-b647-e9212e4c0bef/extractor/0.log" Jun 09 13:54:37.331743 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:37.331709 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-ndczc" Jun 09 13:54:38.368356 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:38.368325 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7c5f8fd4f7-c8hbq_885ec77c-335d-4f25-8166-c374fc185dd9/nginx/0.log" Jun 09 13:54:38.520027 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:38.519995 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29683545-8znd9_53e024fb-c47b-4730-9d13-237c0c8c7706/cleanup/0.log" Jun 09 13:54:38.568062 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:38.568022 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7569bf7bf4-fk6c8_3736222e-9404-431b-929b-03d01bbe5b6f/manager/0.log" Jun 09 13:54:38.673192 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:38.673110 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cc7576fb9-2pqw5_ffe78902-e6f4-49a0-8d9e-c7fcf20046a9/manager/0.log" Jun 09 13:54:38.697325 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:38.697297 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cc7576fb9-2pqw5_ffe78902-e6f4-49a0-8d9e-c7fcf20046a9/copy-manifests/0.log" Jun 09 13:54:40.741037 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:40.740955 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-855cb6f887-shc6g_529f7c7c-f16f-4e10-83a2-1160aa73d09f/manager/0.log" Jun 09 13:54:41.313134 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:41.313105 2544 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-kt785" Jun 09 13:54:44.371443 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:44.371410 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795vttrb_2ac11b82-cbd5-48a4-a308-5969a21cd7b5/istio-proxy/0.log" Jun 09 13:54:44.481892 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:44.481861 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-hwg2h_b6fc1c94-245d-448e-993a-03cc120df477/istio-proxy/0.log" Jun 09 13:54:44.505502 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:44.505463 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-hwg2h_b6fc1c94-245d-448e-993a-03cc120df477/istio-proxy/1.log" Jun 09 13:54:44.539627 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:44.539588 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-kt785_b391cf3c-c22a-45e6-b268-c8ec68f4c58c/payload-processing/5.log" Jun 09 13:54:44.541832 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:44.541810 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-kt785_b391cf3c-c22a-45e6-b268-c8ec68f4c58c/payload-processing/4.log" Jun 09 13:54:45.647689 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:45.647634 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795vttrb_2ac11b82-cbd5-48a4-a308-5969a21cd7b5/istio-proxy/0.log" Jun 09 13:54:45.827218 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:45.827186 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-hwg2h_b6fc1c94-245d-448e-993a-03cc120df477/istio-proxy/0.log" Jun 09 13:54:45.852857 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:45.852819 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-hwg2h_b6fc1c94-245d-448e-993a-03cc120df477/istio-proxy/1.log" Jun 09 13:54:45.885274 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:45.885244 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-kt785_b391cf3c-c22a-45e6-b268-c8ec68f4c58c/payload-processing/5.log" Jun 09 13:54:45.887567 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:45.887525 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-kt785_b391cf3c-c22a-45e6-b268-c8ec68f4c58c/payload-processing/4.log" Jun 09 13:54:46.224610 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:46.224582 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-xpfdf_759a0c70-17ef-45d5-9c85-6720795bd969/migrator/0.log" Jun 09 13:54:46.246853 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:46.246828 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-xpfdf_759a0c70-17ef-45d5-9c85-6720795bd969/graceful-termination/0.log" Jun 09 13:54:47.771054 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:47.771023 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795vttrb_2ac11b82-cbd5-48a4-a308-5969a21cd7b5/istio-proxy/0.log" Jun 09 13:54:47.868651 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:47.868604 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-hwg2h_b6fc1c94-245d-448e-993a-03cc120df477/istio-proxy/0.log" Jun 09 13:54:47.896740 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:47.896656 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-hwg2h_b6fc1c94-245d-448e-993a-03cc120df477/istio-proxy/1.log" Jun 09 13:54:47.926957 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:47.926930 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-kt785_b391cf3c-c22a-45e6-b268-c8ec68f4c58c/payload-processing/5.log" Jun 09 13:54:47.931680 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:47.931653 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-kt785_b391cf3c-c22a-45e6-b268-c8ec68f4c58c/payload-processing/4.log" Jun 09 13:54:48.049792 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:48.049760 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bdhxc_9841f4d8-0a3f-4c94-8b0f-eede32071a6b/kube-multus-additional-cni-plugins/0.log" Jun 09 13:54:48.072088 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:48.071965 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bdhxc_9841f4d8-0a3f-4c94-8b0f-eede32071a6b/egress-router-binary-copy/0.log" Jun 09 13:54:48.093177 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:48.093148 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bdhxc_9841f4d8-0a3f-4c94-8b0f-eede32071a6b/cni-plugins/0.log" Jun 09 13:54:48.113904 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:48.113879 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bdhxc_9841f4d8-0a3f-4c94-8b0f-eede32071a6b/bond-cni-plugin/0.log" Jun 09 13:54:48.135518 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:48.135485 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bdhxc_9841f4d8-0a3f-4c94-8b0f-eede32071a6b/routeoverride-cni/0.log" Jun 09 13:54:48.156957 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:48.156862 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bdhxc_9841f4d8-0a3f-4c94-8b0f-eede32071a6b/whereabouts-cni-bincopy/0.log" Jun 09 13:54:48.178447 ip-10-0-131-58 kubenswrapper[2544]: I0609 13:54:48.178419 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bdhxc_9841f4d8-0a3f-4c94-8b0f-eede32071a6b/whereabouts-cni/0.log"