Jun 08 19:26:23.747009 ip-10-0-141-14 systemd[1]: Starting Kubernetes Kubelet... Jun 08 19:26:24.149134 ip-10-0-141-14 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 19:26:24.149134 ip-10-0-141-14 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 19:26:24.149134 ip-10-0-141-14 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 19:26:24.149134 ip-10-0-141-14 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 19:26:24.149134 ip-10-0-141-14 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 19:26:24.149843 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.149236 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 19:26:24.153496 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153479 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:26:24.153496 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153495 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:26:24.153557 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153498 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:26:24.153557 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153502 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:26:24.153557 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153507 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:26:24.153557 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153510 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:26:24.153557 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153513 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:26:24.153557 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153516 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:26:24.153557 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153519 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:26:24.153557 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153522 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:26:24.153557 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153524 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:26:24.153557 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153527 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:26:24.153557 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153530 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:26:24.153557 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153532 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:26:24.153557 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153535 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:26:24.153557 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153538 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:26:24.153557 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153541 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:26:24.153557 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153549 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:26:24.153557 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153552 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:26:24.153557 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153555 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:26:24.153557 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153558 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:26:24.153557 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153561 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:26:24.154062 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153564 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:26:24.154062 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153568 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:26:24.154062 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153572 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:26:24.154062 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153575 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:26:24.154062 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153578 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:26:24.154062 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153581 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:26:24.154062 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153584 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:26:24.154062 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153586 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:26:24.154062 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153589 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:26:24.154062 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153591 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:26:24.154062 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153594 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:26:24.154062 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153596 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:26:24.154062 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153599 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:26:24.154062 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153602 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:26:24.154062 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153604 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:26:24.154062 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153606 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:26:24.154062 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153610 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:26:24.154062 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153612 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:26:24.154062 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153615 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:26:24.154517 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153618 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:26:24.154517 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153620 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:26:24.154517 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153623 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:26:24.154517 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153625 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:26:24.154517 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153628 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:26:24.154517 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153630 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:26:24.154517 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153633 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:26:24.154517 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153635 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:26:24.154517 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153638 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:26:24.154517 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153640 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:26:24.154517 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153643 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:26:24.154517 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153645 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:26:24.154517 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153648 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:26:24.154517 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153650 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:26:24.154517 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153653 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:26:24.154517 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153656 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:26:24.154517 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153660 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:26:24.154517 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153662 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:26:24.154517 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153665 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:26:24.154517 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153667 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:26:24.155023 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153670 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:26:24.155023 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153673 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:26:24.155023 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153675 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:26:24.155023 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153678 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:26:24.155023 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153680 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:26:24.155023 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153683 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:26:24.155023 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153685 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:26:24.155023 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153688 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:26:24.155023 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153690 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:26:24.155023 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153693 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:26:24.155023 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153695 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:26:24.155023 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153700 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:26:24.155023 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153703 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:26:24.155023 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153706 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:26:24.155023 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153709 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:26:24.155023 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153712 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:26:24.155023 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153714 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:26:24.155023 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153731 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:26:24.155023 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153734 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:26:24.155489 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153739 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:26:24.155489 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153742 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:26:24.155489 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153745 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:26:24.155489 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153748 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:26:24.155489 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153751 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:26:24.155489 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153754 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:26:24.155489 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153756 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:26:24.155489 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153760 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:26:24.155489 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153762 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:26:24.155489 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153765 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:26:24.155489 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153768 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:26:24.155489 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153770 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:26:24.155489 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153773 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:26:24.155489 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153776 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:26:24.155489 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153778 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:26:24.155489 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153781 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:26:24.155489 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153784 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:26:24.155489 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153786 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:26:24.155489 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.153789 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:26:24.155489 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154514 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:26:24.156013 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154521 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:26:24.156013 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154524 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:26:24.156013 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154527 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:26:24.156013 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154530 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:26:24.156013 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154533 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:26:24.156013 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154536 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:26:24.156013 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154538 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:26:24.156013 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154541 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:26:24.156013 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154544 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:26:24.156013 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154546 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:26:24.156013 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154549 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:26:24.156013 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154551 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:26:24.156013 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154555 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:26:24.156013 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154557 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:26:24.156013 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154560 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:26:24.156013 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154564 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:26:24.156013 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154568 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:26:24.156013 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154571 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:26:24.156013 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154574 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:26:24.156478 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154576 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:26:24.156478 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154579 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:26:24.156478 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154582 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:26:24.156478 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154584 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:26:24.156478 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154655 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:26:24.156478 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154660 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:26:24.156478 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154664 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:26:24.156478 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154668 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:26:24.156478 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154672 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:26:24.156478 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154675 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:26:24.156478 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154677 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:26:24.156478 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154680 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:26:24.156478 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154683 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:26:24.156478 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154685 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:26:24.156478 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154688 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:26:24.156478 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154690 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:26:24.156478 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154693 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:26:24.156478 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154695 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:26:24.156478 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154698 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:26:24.156478 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154700 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:26:24.156977 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154703 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:26:24.156977 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154706 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:26:24.156977 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154708 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:26:24.156977 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154711 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:26:24.156977 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154713 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:26:24.156977 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154732 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:26:24.156977 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154739 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:26:24.156977 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154743 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:26:24.156977 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154747 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:26:24.156977 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154750 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:26:24.156977 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154756 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:26:24.156977 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154759 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:26:24.156977 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154761 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:26:24.156977 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154764 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:26:24.156977 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154767 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:26:24.156977 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154769 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:26:24.156977 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154772 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:26:24.156977 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154774 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:26:24.156977 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154777 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:26:24.157439 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154779 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:26:24.157439 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154782 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:26:24.157439 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154785 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:26:24.157439 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154787 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:26:24.157439 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154789 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:26:24.157439 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154792 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:26:24.157439 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154795 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:26:24.157439 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154798 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:26:24.157439 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154801 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:26:24.157439 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154803 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:26:24.157439 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154806 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:26:24.157439 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154808 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:26:24.157439 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154811 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:26:24.157439 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154813 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:26:24.157439 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154816 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:26:24.157439 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154821 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:26:24.157439 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154825 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:26:24.157439 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154828 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:26:24.157439 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154831 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:26:24.157439 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154833 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:26:24.157957 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154836 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:26:24.157957 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154839 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:26:24.157957 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154841 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:26:24.157957 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154844 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:26:24.157957 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154847 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:26:24.157957 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154850 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:26:24.157957 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154852 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:26:24.157957 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154855 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:26:24.157957 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154858 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:26:24.157957 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154860 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:26:24.157957 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154863 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:26:24.157957 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154865 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:26:24.157957 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154868 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:26:24.157957 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154870 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:26:24.157957 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154873 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:26:24.157957 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154875 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:26:24.157957 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154878 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:26:24.157957 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154880 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:26:24.157957 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154883 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:26:24.157957 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.154886 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:26:24.158435 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155272 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:26:24.158435 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155276 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:26:24.158435 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155279 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:26:24.158435 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155282 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:26:24.158435 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155284 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:26:24.158435 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155287 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:26:24.158435 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155290 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:26:24.158435 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155292 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:26:24.158435 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155295 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:26:24.158435 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155297 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:26:24.158435 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155300 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:26:24.158435 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155303 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:26:24.158435 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155306 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:26:24.158435 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155308 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:26:24.158435 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155311 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:26:24.158435 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155316 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:26:24.158435 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155320 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:26:24.158435 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155323 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:26:24.158435 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155326 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:26:24.158435 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155329 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:26:24.158940 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155332 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:26:24.158940 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155335 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:26:24.158940 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155337 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:26:24.158940 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155340 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:26:24.158940 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155342 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:26:24.158940 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155345 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:26:24.158940 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155347 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:26:24.158940 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155350 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:26:24.158940 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155354 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:26:24.158940 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155357 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:26:24.158940 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155360 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:26:24.158940 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155363 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:26:24.158940 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155365 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:26:24.158940 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155368 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:26:24.158940 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155370 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:26:24.158940 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155373 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:26:24.158940 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155376 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:26:24.158940 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155378 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:26:24.158940 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155380 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:26:24.159402 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155383 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:26:24.159402 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155386 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:26:24.159402 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155389 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:26:24.159402 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155392 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:26:24.159402 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155394 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:26:24.159402 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155397 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:26:24.159402 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155400 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:26:24.159402 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155402 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:26:24.159402 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155405 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:26:24.159402 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155408 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:26:24.159402 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155410 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:26:24.159402 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155413 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:26:24.159402 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155416 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:26:24.159402 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155418 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:26:24.159402 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155421 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:26:24.159402 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155423 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:26:24.159402 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155426 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:26:24.159402 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155429 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:26:24.159402 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155431 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:26:24.159402 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155434 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:26:24.159895 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155436 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:26:24.159895 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155439 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:26:24.159895 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155441 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:26:24.159895 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155446 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:26:24.159895 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155449 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:26:24.159895 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155451 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:26:24.159895 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155454 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:26:24.159895 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155456 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:26:24.159895 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155459 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:26:24.159895 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155461 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:26:24.159895 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155464 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:26:24.159895 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155466 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:26:24.159895 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155470 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:26:24.159895 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155474 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:26:24.159895 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155477 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:26:24.159895 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155481 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:26:24.159895 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155486 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:26:24.159895 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155488 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:26:24.159895 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155493 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:26:24.159895 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155496 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:26:24.160374 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155500 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:26:24.160374 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155505 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:26:24.160374 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155509 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:26:24.160374 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155512 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:26:24.160374 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155514 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:26:24.160374 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155517 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:26:24.160374 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155520 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:26:24.160374 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155522 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:26:24.160374 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155525 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:26:24.160374 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155527 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:26:24.160374 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155530 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:26:24.160374 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155532 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:26:24.160374 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155535 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:26:24.160374 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155537 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:26:24.160374 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155540 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:26:24.160374 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155544 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:26:24.160374 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155548 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:26:24.160374 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155552 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:26:24.160374 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155554 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:26:24.160842 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.155557 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:26:24.160842 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155643 2573 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 19:26:24.160842 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155653 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 19:26:24.160842 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155660 2573 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 19:26:24.160842 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155664 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 19:26:24.160842 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155668 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 19:26:24.160842 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155672 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 19:26:24.160842 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155675 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 19:26:24.160842 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155681 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 19:26:24.160842 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155684 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 19:26:24.160842 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155687 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 19:26:24.160842 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155690 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 19:26:24.160842 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155694 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 19:26:24.160842 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155698 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 19:26:24.160842 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155701 2573 flags.go:64] FLAG: --cgroup-root="" Jun 08 19:26:24.160842 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155704 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 19:26:24.160842 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155707 2573 flags.go:64] FLAG: --client-ca-file="" Jun 08 19:26:24.160842 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155709 2573 flags.go:64] FLAG: --cloud-provider="external" Jun 08 19:26:24.160842 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155712 2573 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 19:26:24.160842 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155729 2573 flags.go:64] FLAG: --cluster-domain="" Jun 08 19:26:24.160842 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155732 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 19:26:24.160842 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155736 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 19:26:24.160842 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155739 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 19:26:24.160842 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155742 2573 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 19:26:24.161424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155746 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 19:26:24.161424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155749 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 19:26:24.161424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155755 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 19:26:24.161424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155759 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 19:26:24.161424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155766 2573 flags.go:64] FLAG: --contention-profiling="false" Jun 08 19:26:24.161424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155769 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 19:26:24.161424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155772 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 19:26:24.161424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155775 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 19:26:24.161424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155778 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 19:26:24.161424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155782 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 19:26:24.161424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155785 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 19:26:24.161424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155788 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 19:26:24.161424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155790 2573 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 19:26:24.161424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155793 2573 flags.go:64] FLAG: --enable-server="true" Jun 08 19:26:24.161424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155796 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 19:26:24.161424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155801 2573 flags.go:64] FLAG: --event-burst="100" Jun 08 19:26:24.161424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155805 2573 flags.go:64] FLAG: --event-qps="50" Jun 08 19:26:24.161424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155808 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 19:26:24.161424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155811 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 19:26:24.161424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155814 2573 flags.go:64] FLAG: --eviction-hard="" Jun 08 19:26:24.161424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155817 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 19:26:24.161424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155820 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 19:26:24.161424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155824 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 19:26:24.161424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155827 2573 flags.go:64] FLAG: --eviction-soft="" Jun 08 19:26:24.161424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155830 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 19:26:24.162045 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155833 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 19:26:24.162045 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155835 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 19:26:24.162045 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155838 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 19:26:24.162045 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155841 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 19:26:24.162045 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155844 2573 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 19:26:24.162045 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155847 2573 flags.go:64] FLAG: --feature-gates="" Jun 08 19:26:24.162045 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155850 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 19:26:24.162045 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155853 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 19:26:24.162045 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155856 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 19:26:24.162045 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155859 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 19:26:24.162045 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155862 2573 flags.go:64] FLAG: --healthz-port="10248" Jun 08 19:26:24.162045 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155866 2573 flags.go:64] FLAG: --help="false" Jun 08 19:26:24.162045 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155869 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-141-14.ec2.internal" Jun 08 19:26:24.162045 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155872 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 19:26:24.162045 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155875 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 19:26:24.162045 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155878 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 19:26:24.162045 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155881 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 19:26:24.162045 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155884 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 19:26:24.162045 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155887 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 19:26:24.162045 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155890 2573 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 19:26:24.162045 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155893 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 19:26:24.162045 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155896 2573 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 19:26:24.162045 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155899 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 19:26:24.162655 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155903 2573 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 19:26:24.162655 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155906 2573 flags.go:64] FLAG: --kube-reserved="" Jun 08 19:26:24.162655 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155909 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 19:26:24.162655 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155912 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 19:26:24.162655 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155915 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 19:26:24.162655 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155918 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 19:26:24.162655 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155922 2573 flags.go:64] FLAG: --lock-file="" Jun 08 19:26:24.162655 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155925 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 19:26:24.162655 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155928 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 19:26:24.162655 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155931 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 19:26:24.162655 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155936 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 19:26:24.162655 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155939 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 19:26:24.162655 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155941 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 19:26:24.162655 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155944 2573 flags.go:64] FLAG: --logging-format="text" Jun 08 19:26:24.162655 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155947 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 19:26:24.162655 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155950 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 19:26:24.162655 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155953 2573 flags.go:64] FLAG: --manifest-url="" Jun 08 19:26:24.162655 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155956 2573 flags.go:64] FLAG: --manifest-url-header="" Jun 08 19:26:24.162655 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155960 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 19:26:24.162655 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155963 2573 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 19:26:24.162655 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155969 2573 flags.go:64] FLAG: --max-pods="110" Jun 08 19:26:24.162655 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155972 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 19:26:24.162655 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155975 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 19:26:24.162655 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155978 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 19:26:24.162655 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155981 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 19:26:24.163359 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155984 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 19:26:24.163359 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155986 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 19:26:24.163359 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155989 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 19:26:24.163359 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.155997 2573 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 19:26:24.163359 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156000 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 19:26:24.163359 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156003 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 19:26:24.163359 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156006 2573 flags.go:64] FLAG: --pod-cidr="" Jun 08 19:26:24.163359 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156010 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 19:26:24.163359 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156015 2573 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 19:26:24.163359 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156019 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 19:26:24.163359 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156022 2573 flags.go:64] FLAG: --pods-per-core="0" Jun 08 19:26:24.163359 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156025 2573 flags.go:64] FLAG: --port="10250" Jun 08 19:26:24.163359 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156028 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 19:26:24.163359 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156031 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fefb880747e2c6fd" Jun 08 19:26:24.163359 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156034 2573 flags.go:64] FLAG: --qos-reserved="" Jun 08 19:26:24.163359 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156037 2573 flags.go:64] FLAG: --read-only-port="10255" Jun 08 19:26:24.163359 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156040 2573 flags.go:64] FLAG: --register-node="true" Jun 08 19:26:24.163359 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156044 2573 flags.go:64] FLAG: --register-with-taints="" Jun 08 19:26:24.163359 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156047 2573 flags.go:64] FLAG: --registry-burst="10" Jun 08 19:26:24.163359 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156050 2573 flags.go:64] FLAG: --registry-qps="5" Jun 08 19:26:24.163359 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156053 2573 flags.go:64] FLAG: --reserved-cpus="" Jun 08 19:26:24.163359 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156055 2573 flags.go:64] FLAG: --reserved-memory="" Jun 08 19:26:24.163359 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156059 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 19:26:24.163359 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156062 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 19:26:24.163359 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156065 2573 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 19:26:24.163993 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156068 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 19:26:24.163993 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156070 2573 flags.go:64] FLAG: --runonce="false" Jun 08 19:26:24.163993 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156074 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 19:26:24.163993 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156077 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 19:26:24.163993 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156080 2573 flags.go:64] FLAG: --seccomp-default="false" Jun 08 19:26:24.163993 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156083 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 19:26:24.163993 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156086 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 19:26:24.163993 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156089 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 19:26:24.163993 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156092 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 19:26:24.163993 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156095 2573 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 19:26:24.163993 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156098 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 19:26:24.163993 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156101 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 19:26:24.163993 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156103 2573 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 19:26:24.163993 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156106 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 19:26:24.163993 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156109 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 19:26:24.163993 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156113 2573 flags.go:64] FLAG: --system-cgroups="" Jun 08 19:26:24.163993 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156116 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 19:26:24.163993 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156121 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 19:26:24.163993 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156124 2573 flags.go:64] FLAG: --tls-cert-file="" Jun 08 19:26:24.163993 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156127 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 19:26:24.163993 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156130 2573 flags.go:64] FLAG: --tls-min-version="" Jun 08 19:26:24.163993 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156133 2573 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 19:26:24.163993 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156136 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 19:26:24.163993 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156140 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 19:26:24.163993 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156143 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 19:26:24.164612 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156145 2573 flags.go:64] FLAG: --v="2" Jun 08 19:26:24.164612 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156149 2573 flags.go:64] FLAG: --version="false" Jun 08 19:26:24.164612 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156153 2573 flags.go:64] FLAG: --vmodule="" Jun 08 19:26:24.164612 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156157 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 19:26:24.164612 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.156160 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 19:26:24.164612 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156276 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:26:24.164612 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156280 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:26:24.164612 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156283 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:26:24.164612 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156286 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:26:24.164612 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156290 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:26:24.164612 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156293 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:26:24.164612 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156296 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:26:24.164612 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156300 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:26:24.164612 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156302 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:26:24.164612 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156305 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:26:24.164612 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156308 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:26:24.164612 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156310 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:26:24.164612 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156313 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:26:24.164612 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156315 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:26:24.164612 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156318 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:26:24.164612 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156320 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:26:24.165260 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156323 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:26:24.165260 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156327 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:26:24.165260 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156329 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:26:24.165260 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156332 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:26:24.165260 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156334 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:26:24.165260 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156337 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:26:24.165260 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156340 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:26:24.165260 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156343 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:26:24.165260 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156345 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:26:24.165260 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156348 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:26:24.165260 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156351 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:26:24.165260 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156355 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:26:24.165260 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156359 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:26:24.165260 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156363 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:26:24.165260 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156366 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:26:24.165260 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156369 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:26:24.165260 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156371 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:26:24.165260 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156374 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:26:24.165708 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156377 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:26:24.165708 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156380 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:26:24.165708 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156385 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:26:24.165708 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156387 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:26:24.165708 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156390 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:26:24.165708 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156392 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:26:24.165708 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156395 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:26:24.165708 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156397 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:26:24.165708 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156400 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:26:24.165708 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156402 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:26:24.165708 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156405 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:26:24.165708 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156407 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:26:24.165708 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156410 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:26:24.165708 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156413 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:26:24.165708 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156415 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:26:24.165708 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156419 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:26:24.165708 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156422 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:26:24.165708 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156424 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:26:24.165708 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156427 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:26:24.166188 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156430 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:26:24.166188 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156432 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:26:24.166188 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156435 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:26:24.166188 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156437 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:26:24.166188 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156440 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:26:24.166188 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156442 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:26:24.166188 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156445 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:26:24.166188 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156448 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:26:24.166188 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156451 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:26:24.166188 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156453 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:26:24.166188 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156456 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:26:24.166188 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156459 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:26:24.166188 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156461 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:26:24.166188 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156464 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:26:24.166188 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156467 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:26:24.166188 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156470 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:26:24.166188 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156473 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:26:24.166188 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156475 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:26:24.166188 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156478 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:26:24.166188 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156481 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:26:24.166188 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156484 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:26:24.166713 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156487 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:26:24.166713 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156490 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:26:24.166713 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156492 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:26:24.166713 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156495 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:26:24.166713 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156497 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:26:24.166713 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156500 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:26:24.166713 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156503 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:26:24.166713 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156506 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:26:24.166713 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156509 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:26:24.166713 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156511 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:26:24.166713 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156514 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:26:24.166713 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156517 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:26:24.166713 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156519 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:26:24.166713 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156523 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:26:24.166713 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156527 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:26:24.166713 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156531 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:26:24.166713 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156533 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:26:24.166713 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156536 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:26:24.166713 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156539 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:26:24.166713 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156542 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:26:24.167305 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156545 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:26:24.167305 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156547 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:26:24.167305 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156550 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:26:24.167305 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156552 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:26:24.167305 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.156555 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:26:24.167305 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.157035 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 19:26:24.167305 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.163516 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 19:26:24.167305 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.163531 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 19:26:24.167305 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.163547 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 19:26:24.167305 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.163556 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 19:26:24.167305 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163619 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:26:24.167305 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163625 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:26:24.167305 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163629 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:26:24.167305 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163632 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:26:24.167658 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163635 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:26:24.167658 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163639 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:26:24.167658 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163642 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:26:24.167658 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163645 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:26:24.167658 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163649 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:26:24.167658 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163653 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:26:24.167658 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163656 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:26:24.167658 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163660 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:26:24.167658 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163664 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:26:24.167658 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163667 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:26:24.167658 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163670 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:26:24.167658 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163673 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:26:24.167658 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163675 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:26:24.167658 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163678 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:26:24.167658 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163681 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:26:24.167658 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163683 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:26:24.167658 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163686 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:26:24.167658 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163689 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:26:24.167658 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163692 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:26:24.168118 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163694 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:26:24.168118 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163697 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:26:24.168118 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163699 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:26:24.168118 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163702 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:26:24.168118 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163704 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:26:24.168118 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163707 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:26:24.168118 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163712 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:26:24.168118 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163714 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:26:24.168118 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163730 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:26:24.168118 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163733 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:26:24.168118 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163736 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:26:24.168118 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163739 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:26:24.168118 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163741 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:26:24.168118 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163744 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:26:24.168118 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163747 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:26:24.168118 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163749 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:26:24.168118 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163752 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:26:24.168118 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163755 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:26:24.168118 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163757 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:26:24.168118 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163760 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:26:24.168606 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163763 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:26:24.168606 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163765 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:26:24.168606 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163768 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:26:24.168606 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163770 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:26:24.168606 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163773 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:26:24.168606 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163775 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:26:24.168606 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163778 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:26:24.168606 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163781 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:26:24.168606 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163783 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:26:24.168606 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163786 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:26:24.168606 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163788 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:26:24.168606 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163791 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:26:24.168606 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163793 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:26:24.168606 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163796 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:26:24.168606 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163798 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:26:24.168606 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163801 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:26:24.168606 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163803 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:26:24.168606 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163806 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:26:24.168606 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163809 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:26:24.168606 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163812 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:26:24.169102 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163815 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:26:24.169102 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163818 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:26:24.169102 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163820 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:26:24.169102 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163823 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:26:24.169102 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163826 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:26:24.169102 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163829 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:26:24.169102 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163831 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:26:24.169102 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163834 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:26:24.169102 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163836 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:26:24.169102 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163839 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:26:24.169102 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163842 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:26:24.169102 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163844 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:26:24.169102 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163847 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:26:24.169102 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163849 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:26:24.169102 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163852 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:26:24.169102 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163854 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:26:24.169102 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163857 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:26:24.169102 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163860 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:26:24.169102 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163862 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:26:24.169102 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163865 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:26:24.169589 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163867 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:26:24.169589 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163870 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:26:24.169589 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163872 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:26:24.169589 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163875 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:26:24.169589 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163877 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:26:24.169589 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163880 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:26:24.169589 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163882 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:26:24.169589 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163885 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:26:24.169589 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163887 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:26:24.169589 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163890 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:26:24.169589 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163894 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:26:24.169589 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163897 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:26:24.169589 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163900 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:26:24.169589 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163902 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:26:24.169589 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163905 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:26:24.169589 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.163907 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:26:24.170008 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.163912 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 19:26:24.170008 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164023 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:26:24.170008 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164029 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:26:24.170008 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164032 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:26:24.170008 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164035 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:26:24.170008 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164038 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:26:24.170008 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164041 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:26:24.170008 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164044 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:26:24.170008 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164047 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:26:24.170008 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164050 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:26:24.170008 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164053 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:26:24.170008 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164056 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:26:24.170008 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164059 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:26:24.170008 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164061 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:26:24.170349 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164064 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:26:24.170349 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164067 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:26:24.170349 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164069 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:26:24.170349 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164072 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:26:24.170349 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164074 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:26:24.170349 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164077 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:26:24.170349 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164081 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:26:24.170349 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164085 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:26:24.170349 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164088 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:26:24.170349 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164092 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:26:24.170349 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164096 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:26:24.170349 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164099 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:26:24.170349 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164102 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:26:24.170349 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164105 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:26:24.170349 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164108 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:26:24.170349 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164111 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:26:24.170349 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164114 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:26:24.170349 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164116 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:26:24.170349 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164119 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:26:24.170898 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164121 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:26:24.170898 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164124 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:26:24.170898 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164126 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:26:24.170898 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164129 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:26:24.170898 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164132 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:26:24.170898 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164134 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:26:24.170898 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164137 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:26:24.170898 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164139 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:26:24.170898 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164142 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:26:24.170898 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164144 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:26:24.170898 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164147 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:26:24.170898 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164149 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:26:24.170898 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164152 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:26:24.170898 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164154 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:26:24.170898 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164157 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:26:24.170898 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164159 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:26:24.170898 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164162 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:26:24.170898 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164164 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:26:24.170898 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164166 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:26:24.170898 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164169 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:26:24.171378 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164171 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:26:24.171378 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164174 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:26:24.171378 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164176 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:26:24.171378 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164179 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:26:24.171378 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164182 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:26:24.171378 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164185 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:26:24.171378 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164187 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:26:24.171378 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164190 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:26:24.171378 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164193 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:26:24.171378 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164196 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:26:24.171378 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164198 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:26:24.171378 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164201 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:26:24.171378 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164203 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:26:24.171378 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164206 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:26:24.171378 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164208 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:26:24.171378 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164211 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:26:24.171378 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164213 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:26:24.171378 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164216 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:26:24.171378 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164218 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:26:24.171378 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164221 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:26:24.171880 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164223 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:26:24.171880 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164227 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:26:24.171880 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164230 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:26:24.171880 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164233 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:26:24.171880 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164235 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:26:24.171880 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164238 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:26:24.171880 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164240 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:26:24.171880 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164243 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:26:24.171880 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164245 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:26:24.171880 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164248 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:26:24.171880 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164250 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:26:24.171880 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164253 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:26:24.171880 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164255 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:26:24.171880 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164258 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:26:24.171880 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164260 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:26:24.171880 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164264 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:26:24.171880 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164266 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:26:24.171880 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164269 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:26:24.171880 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164271 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:26:24.171880 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164274 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:26:24.172366 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164276 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:26:24.172366 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164279 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:26:24.172366 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164282 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:26:24.172366 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164284 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:26:24.172366 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164286 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:26:24.172366 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164289 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:26:24.172366 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:24.164292 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:26:24.172366 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.164296 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 19:26:24.172366 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.164394 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 19:26:24.172366 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.166340 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 19:26:24.172366 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.167645 2573 server.go:1019] "Starting client certificate rotation" Jun 08 19:26:24.172366 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.167748 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 19:26:24.172366 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.168377 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 19:26:24.172705 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.170333 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 19:26:24.177119 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.177081 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 19:26:24.188877 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.188862 2573 log.go:25] "Validated CRI v1 runtime API" Jun 08 19:26:24.191457 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.191443 2573 log.go:25] "Validated CRI v1 image API" Jun 08 19:26:24.192336 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.192317 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 19:26:24.197368 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.197347 2573 fs.go:135] Filesystem UUIDs: map[6cdb9119-9fbf-41a7-86e3-4bd7ce63a49f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b7951dba-6ab1-4bff-853c-ebf42a96c2e4:/dev/nvme0n1p4] Jun 08 19:26:24.197435 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.197367 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 19:26:24.201400 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.201382 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 19:26:24.202710 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.202604 2573 manager.go:216] Machine: {Timestamp:2026-06-08 19:26:24.201233461 +0000 UTC m=+0.336689894 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3125861 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2efd47e23f2e917420b64cd7b242fe SystemUUID:ec2efd47-e23f-2e91-7420-b64cd7b242fe BootID:5d07a050-8a98-4074-a1c2-bf59e8a33945 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:02:82:90:e8:a7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:02:82:90:e8:a7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:4b:5f:f3:a7:5b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 19:26:24.202710 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.202705 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 19:26:24.202819 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.202787 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 19:26:24.205906 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.205881 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 19:26:24.206032 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.205907 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-14.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 19:26:24.207135 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.207125 2573 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 19:26:24.207176 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.207137 2573 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 19:26:24.207176 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.207145 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 19:26:24.207818 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.207808 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 19:26:24.208657 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.208648 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 19:26:24.211288 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.211277 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 08 19:26:24.211551 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.211541 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 19:26:24.211591 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.211571 2573 kubelet.go:486] "Attempting to sync node with API server" Jun 08 19:26:24.211591 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.211581 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 19:26:24.211660 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.211595 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 19:26:24.211660 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.211604 2573 kubelet.go:398] "Adding apiserver pod source" Jun 08 19:26:24.211660 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.211615 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 19:26:24.211934 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.211921 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 19:26:24.211966 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.211942 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 19:26:24.214094 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.214078 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 19:26:24.215377 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.215362 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 19:26:24.215464 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.215399 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 19:26:24.216011 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.215997 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 19:26:24.216083 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.216023 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 19:26:24.216083 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.216033 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 19:26:24.216083 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.216041 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 19:26:24.216083 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.216054 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 19:26:24.216083 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.216063 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 19:26:24.216274 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.216110 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 19:26:24.216274 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.216120 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 19:26:24.216274 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.216131 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 19:26:24.216274 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.216139 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 19:26:24.216274 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.216152 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 19:26:24.216274 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.216166 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 19:26:24.217231 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.217219 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 19:26:24.217282 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.217233 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 19:26:24.220173 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.220157 2573 server.go:1268] "Started kubelet" Jun 08 19:26:24.220255 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.220235 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 19:26:24.220341 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.220240 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 19:26:24.220380 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.220348 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 19:26:24.220977 ip-10-0-141-14 systemd[1]: Started Kubernetes Kubelet. Jun 08 19:26:24.225103 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.225014 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 19:26:24.227712 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.227377 2573 server.go:310] "Adding debug handlers to kubelet server" Jun 08 19:26:24.229128 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:24.229109 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 19:26:24.229596 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.229522 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-14.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 19:26:24.229948 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:24.229928 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 19:26:24.231216 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.231201 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 19:26:24.231288 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.231215 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 19:26:24.232166 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:24.232114 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-14.ec2.internal\" not found" Jun 08 19:26:24.232640 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.232321 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 19:26:24.232640 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.232403 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 19:26:24.232640 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.232418 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 19:26:24.232640 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.232572 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 19:26:24.232640 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.232581 2573 reconstruct.go:97] "Volume reconstruction finished" Jun 08 19:26:24.232640 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.232586 2573 factory.go:55] Registering systemd factory Jun 08 19:26:24.232640 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.232589 2573 reconciler.go:29] "Reconciler: start to sync state" Jun 08 19:26:24.232640 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.232594 2573 factory.go:223] Registration of the systemd container factory successfully Jun 08 19:26:24.233036 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.232813 2573 factory.go:153] Registering CRI-O factory Jun 08 19:26:24.233036 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.232826 2573 factory.go:223] Registration of the crio container factory successfully Jun 08 19:26:24.233036 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.232847 2573 factory.go:103] Registering Raw factory Jun 08 19:26:24.233036 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.232860 2573 manager.go:1196] Started watching for new ooms in manager Jun 08 19:26:24.233285 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.233272 2573 manager.go:349] Starting recovery of all containers Jun 08 19:26:24.236882 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:24.236840 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 19:26:24.237241 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:24.237217 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-14.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 19:26:24.238436 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:24.237296 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-14.ec2.internal.18b731aa1550a68d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-14.ec2.internal,UID:ip-10-0-141-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-14.ec2.internal,},FirstTimestamp:2026-06-08 19:26:24.220128909 +0000 UTC m=+0.355585342,LastTimestamp:2026-06-08 19:26:24.220128909 +0000 UTC m=+0.355585342,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-14.ec2.internal,}" Jun 08 19:26:24.240401 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:24.240365 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-14.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 08 19:26:24.244230 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.244217 2573 manager.go:354] Recovery completed Jun 08 19:26:24.248388 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.248376 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:26:24.250086 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.250069 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-14.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:26:24.250156 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.250104 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-14.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:26:24.250156 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.250114 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-14.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:26:24.250564 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.250551 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 19:26:24.250564 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.250562 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 19:26:24.250671 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.250576 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 08 19:26:24.250671 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.250576 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:26:24.250898 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.250884 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dg49z" Jun 08 19:26:24.251190 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.251177 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-14.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:26:24.251235 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.251204 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-14.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:26:24.251235 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.251214 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-14.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:26:24.251751 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.251738 2573 policy_none.go:49] "None policy: Start" Jun 08 19:26:24.251804 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.251756 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 19:26:24.251804 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.251772 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 19:26:24.252324 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:24.252243 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-14.ec2.internal.18b731aa1719c35b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-14.ec2.internal,UID:ip-10-0-141-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-14.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-14.ec2.internal,},FirstTimestamp:2026-06-08 19:26:24.250086235 +0000 UTC m=+0.385542667,LastTimestamp:2026-06-08 19:26:24.250086235 +0000 UTC m=+0.385542667,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-14.ec2.internal,}" Jun 08 19:26:24.253092 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.253080 2573 policy_none.go:47] "Start" Jun 08 19:26:24.260302 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.260284 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dg49z" Jun 08 19:26:24.261256 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:24.261190 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-14.ec2.internal.18b731aa171a1daa default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-14.ec2.internal,UID:ip-10-0-141-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-14.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-14.ec2.internal,},FirstTimestamp:2026-06-08 19:26:24.250109354 +0000 UTC m=+0.385565788,LastTimestamp:2026-06-08 19:26:24.250109354 +0000 UTC m=+0.385565788,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-14.ec2.internal,}" Jun 08 19:26:24.264686 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:24.264631 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-14.ec2.internal.18b731aa171a4269 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-14.ec2.internal,UID:ip-10-0-141-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-14.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-14.ec2.internal,},FirstTimestamp:2026-06-08 19:26:24.250118761 +0000 UTC m=+0.385575196,LastTimestamp:2026-06-08 19:26:24.250118761 +0000 UTC m=+0.385575196,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-14.ec2.internal,}" Jun 08 19:26:24.291302 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.291288 2573 manager.go:337] "Starting Device Plugin manager" Jun 08 19:26:24.300099 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:24.291318 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 19:26:24.300099 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.291331 2573 server.go:87] "Starting device plugin registration server" Jun 08 19:26:24.300099 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.291556 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 19:26:24.300099 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.291568 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 19:26:24.300099 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.291654 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 19:26:24.300099 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.291762 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 19:26:24.300099 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.291771 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 19:26:24.300099 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:24.292184 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 19:26:24.300099 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:24.292223 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-14.ec2.internal\" not found" Jun 08 19:26:24.300099 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.297567 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 19:26:24.300099 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.298841 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 19:26:24.300099 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.298871 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 19:26:24.300099 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.298891 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 19:26:24.300099 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:24.298919 2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 19:26:24.301455 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.301437 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 19:26:24.392403 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.392389 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:26:24.393461 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.393444 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-14.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:26:24.393549 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.393473 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-14.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:26:24.393549 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.393482 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-14.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:26:24.393549 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.393505 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-14.ec2.internal" Jun 08 19:26:24.399895 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.399846 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-14.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-14.ec2.internal"] Jun 08 19:26:24.399942 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.399912 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:26:24.401202 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.401191 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-14.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:26:24.401259 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.401215 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-14.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:26:24.401259 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.401225 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-14.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:26:24.402478 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.402467 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:26:24.402628 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.402615 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-14.ec2.internal" Jun 08 19:26:24.402664 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.402642 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:26:24.402880 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.402866 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-14.ec2.internal" Jun 08 19:26:24.402920 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:24.402890 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-14.ec2.internal\": node \"ip-10-0-141-14.ec2.internal\" not found" Jun 08 19:26:24.403230 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.403213 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-14.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:26:24.403317 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.403245 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-14.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:26:24.403317 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.403259 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-14.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:26:24.403317 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.403262 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-14.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:26:24.403317 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.403285 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-14.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:26:24.403317 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.403294 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-14.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:26:24.404483 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.404469 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-14.ec2.internal" Jun 08 19:26:24.404557 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.404493 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:26:24.405202 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.405188 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-14.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:26:24.405268 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.405216 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-14.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:26:24.405268 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.405228 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-14.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:26:24.419556 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:24.419535 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-14.ec2.internal\" not found" Jun 08 19:26:24.428217 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:24.428202 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-14.ec2.internal\" not found" node="ip-10-0-141-14.ec2.internal" Jun 08 19:26:24.432382 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:24.432363 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-14.ec2.internal\" not found" node="ip-10-0-141-14.ec2.internal" Jun 08 19:26:24.520345 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:24.520325 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-14.ec2.internal\" not found" Jun 08 19:26:24.533859 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.533844 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3c8a4b2043ee79cf2ae0fbd916dd875-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-14.ec2.internal\" (UID: \"f3c8a4b2043ee79cf2ae0fbd916dd875\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-14.ec2.internal" Jun 08 19:26:24.533939 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.533866 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d234ad56bfcf5710e49217980ee8b515-config\") pod \"kube-apiserver-proxy-ip-10-0-141-14.ec2.internal\" (UID: \"d234ad56bfcf5710e49217980ee8b515\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-14.ec2.internal" Jun 08 19:26:24.533939 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.533899 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f3c8a4b2043ee79cf2ae0fbd916dd875-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-14.ec2.internal\" (UID: \"f3c8a4b2043ee79cf2ae0fbd916dd875\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-14.ec2.internal" Jun 08 19:26:24.620694 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:24.620671 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-14.ec2.internal\" not found" Jun 08 19:26:24.634999 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.634982 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d234ad56bfcf5710e49217980ee8b515-config\") pod \"kube-apiserver-proxy-ip-10-0-141-14.ec2.internal\" (UID: \"d234ad56bfcf5710e49217980ee8b515\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-14.ec2.internal" Jun 08 19:26:24.635054 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.635015 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f3c8a4b2043ee79cf2ae0fbd916dd875-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-14.ec2.internal\" (UID: \"f3c8a4b2043ee79cf2ae0fbd916dd875\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-14.ec2.internal" Jun 08 19:26:24.635054 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.635006 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d234ad56bfcf5710e49217980ee8b515-config\") pod \"kube-apiserver-proxy-ip-10-0-141-14.ec2.internal\" (UID: \"d234ad56bfcf5710e49217980ee8b515\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-14.ec2.internal" Jun 08 19:26:24.635054 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.635035 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3c8a4b2043ee79cf2ae0fbd916dd875-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-14.ec2.internal\" (UID: \"f3c8a4b2043ee79cf2ae0fbd916dd875\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-14.ec2.internal" Jun 08 19:26:24.635144 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.635064 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3c8a4b2043ee79cf2ae0fbd916dd875-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-14.ec2.internal\" (UID: \"f3c8a4b2043ee79cf2ae0fbd916dd875\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-14.ec2.internal" Jun 08 19:26:24.635144 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.635098 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f3c8a4b2043ee79cf2ae0fbd916dd875-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-14.ec2.internal\" (UID: \"f3c8a4b2043ee79cf2ae0fbd916dd875\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-14.ec2.internal" Jun 08 19:26:24.721365 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:24.721303 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-14.ec2.internal\" not found" Jun 08 19:26:24.732482 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.732464 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-14.ec2.internal" Jun 08 19:26:24.736445 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:24.736423 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-14.ec2.internal" Jun 08 19:26:24.822261 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:24.822232 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-14.ec2.internal\" not found" Jun 08 19:26:24.922729 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:24.922691 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-14.ec2.internal\" not found" Jun 08 19:26:25.023235 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:25.023169 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-14.ec2.internal\" not found" Jun 08 19:26:25.123746 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:25.123707 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-14.ec2.internal\" not found" Jun 08 19:26:25.167170 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:25.167143 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 19:26:25.167625 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:25.167317 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 19:26:25.224616 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:25.224584 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-14.ec2.internal\" not found" Jun 08 19:26:25.243903 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:25.243875 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3c8a4b2043ee79cf2ae0fbd916dd875.slice/crio-22cea699c82bf932b2053604d75b556a34dc49f792b57fb80fbf75ea70512207 WatchSource:0}: Error finding container 22cea699c82bf932b2053604d75b556a34dc49f792b57fb80fbf75ea70512207: Status 404 returned error can't find the container with id 22cea699c82bf932b2053604d75b556a34dc49f792b57fb80fbf75ea70512207 Jun 08 19:26:25.244250 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:25.244224 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd234ad56bfcf5710e49217980ee8b515.slice/crio-df62735b6646d7f8ec06132aedef2e17f1a742e891a30173a063548de69afbc0 WatchSource:0}: Error finding container df62735b6646d7f8ec06132aedef2e17f1a742e891a30173a063548de69afbc0: Status 404 returned error can't find the container with id df62735b6646d7f8ec06132aedef2e17f1a742e891a30173a063548de69afbc0 Jun 08 19:26:25.250484 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:25.250470 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 19:26:25.263924 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:25.263885 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 19:21:24 +0000 UTC" deadline="2027-11-27 21:19:00.014749495 +0000 UTC" Jun 08 19:26:25.263999 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:25.263925 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12889h52m34.750827861s" Jun 08 19:26:25.302150 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:25.302103 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-14.ec2.internal" event={"ID":"f3c8a4b2043ee79cf2ae0fbd916dd875","Type":"ContainerStarted","Data":"22cea699c82bf932b2053604d75b556a34dc49f792b57fb80fbf75ea70512207"} Jun 08 19:26:25.303035 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:25.303007 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-14.ec2.internal" event={"ID":"d234ad56bfcf5710e49217980ee8b515","Type":"ContainerStarted","Data":"df62735b6646d7f8ec06132aedef2e17f1a742e891a30173a063548de69afbc0"} Jun 08 19:26:25.303200 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:25.303186 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 19:26:25.325591 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:25.325572 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-14.ec2.internal\" not found" Jun 08 19:26:25.426132 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:25.426108 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-14.ec2.internal\" not found" Jun 08 19:26:25.448598 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:25.448584 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:26:25.449820 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:25.449800 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-14.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:26:25.449919 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:25.449831 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-14.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:26:25.449919 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:25.449841 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-14.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:26:25.526260 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:25.526234 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-14.ec2.internal\" not found" Jun 08 19:26:25.527967 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:25.527951 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 19:26:25.626932 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:25.626858 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-14.ec2.internal\" not found" Jun 08 19:26:25.727782 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:25.727749 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-14.ec2.internal\" not found" Jun 08 19:26:25.811097 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:25.811064 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 19:26:25.833020 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:25.832991 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-14.ec2.internal" Jun 08 19:26:25.852636 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:25.852507 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 19:26:25.853620 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:25.853560 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-14.ec2.internal" Jun 08 19:26:25.865783 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:25.865741 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 19:26:26.213532 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.213485 2573 apiserver.go:52] "Watching apiserver" Jun 08 19:26:26.222346 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.222323 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 19:26:26.223285 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.223260 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-lvnmk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-14.ec2.internal","openshift-multus/multus-mr75f","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p","openshift-multus/multus-additional-cni-plugins-xcr5w","openshift-multus/network-metrics-daemon-7ngtn","openshift-network-diagnostics/network-check-target-tvpck","openshift-network-operator/iptables-alerter-x45p2","openshift-ovn-kubernetes/ovnkube-node-ghdr2","kube-system/global-pull-secret-syncer-tdj7t","kube-system/konnectivity-agent-mckqj","kube-system/kube-apiserver-proxy-ip-10-0-141-14.ec2.internal","openshift-cluster-node-tuning-operator/tuned-hksvz","openshift-dns/node-resolver-mv9h2"] Jun 08 19:26:26.224693 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.224676 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:26:26.224789 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:26.224763 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvpck" podUID="4e78d959-fe7c-48b9-90b3-7ed41b7a8156" Jun 08 19:26:26.225789 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.225761 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.227031 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.227001 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.228479 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.228355 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" Jun 08 19:26:26.228479 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.228383 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 19:26:26.228479 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.228450 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6jgwg\"" Jun 08 19:26:26.228890 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.228871 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 19:26:26.229384 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.229361 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 19:26:26.229589 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.229563 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 19:26:26.229755 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.229738 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-blddq\"" Jun 08 19:26:26.229818 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.229787 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 19:26:26.230030 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.230014 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xcr5w" Jun 08 19:26:26.230631 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.230610 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 19:26:26.231058 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.231042 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 19:26:26.231305 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.231289 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 19:26:26.231379 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.231338 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qffnq\"" Jun 08 19:26:26.231379 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.231368 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:26.231482 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:26.231423 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ngtn" podUID="9c8290ed-a8c2-4904-a862-a9e41138d285" Jun 08 19:26:26.232260 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.232243 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 19:26:26.232613 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.232450 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 19:26:26.232613 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.232461 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bhmqm\"" Jun 08 19:26:26.232613 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.232520 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 19:26:26.232985 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.232964 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.233546 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.233527 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 19:26:26.234521 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.234504 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lvnmk" Jun 08 19:26:26.236021 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.236003 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 19:26:26.236896 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.236262 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b4dcj\"" Jun 08 19:26:26.236896 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.236444 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 19:26:26.236896 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.236568 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mv9h2" Jun 08 19:26:26.236896 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.236603 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 19:26:26.236896 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.236609 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 19:26:26.236896 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.236822 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 19:26:26.237796 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.237771 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 19:26:26.237796 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.237714 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 19:26:26.238029 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.238010 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:26.238113 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:26.238086 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdj7t" podUID="117928d5-6f02-4a5e-b96b-4a2cc6e507eb" Jun 08 19:26:26.238593 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.238571 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 19:26:26.238739 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.238703 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 19:26:26.238821 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.238772 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4xjqw\"" Jun 08 19:26:26.240228 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.239925 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5wfsv\"" Jun 08 19:26:26.240228 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.239952 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 19:26:26.240228 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.240014 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 19:26:26.240417 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.240406 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mckqj" Jun 08 19:26:26.242607 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.242587 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-etc-sysctl-d\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.242751 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.242713 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-cnibin\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.242815 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.242799 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-host-run-multus-certs\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.242870 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.242834 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/adfef4fa-95ab-4a43-8b80-2dc9326968de-etc-selinux\") pod \"aws-ebs-csi-driver-node-k8g6p\" (UID: \"adfef4fa-95ab-4a43-8b80-2dc9326968de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" Jun 08 19:26:26.242909 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.242892 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-host-cni-bin\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.242957 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.242930 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfmgj\" (UniqueName: \"kubernetes.io/projected/4e78d959-fe7c-48b9-90b3-7ed41b7a8156-kube-api-access-pfmgj\") pod \"network-check-target-tvpck\" (UID: \"4e78d959-fe7c-48b9-90b3-7ed41b7a8156\") " pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:26:26.243011 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.242981 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-multus-cni-dir\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.243062 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.243028 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-host-run-k8s-cni-cncf-io\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.243125 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.243073 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/adfef4fa-95ab-4a43-8b80-2dc9326968de-device-dir\") pod \"aws-ebs-csi-driver-node-k8g6p\" (UID: \"adfef4fa-95ab-4a43-8b80-2dc9326968de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" Jun 08 19:26:26.243125 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.243104 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 19:26:26.243221 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.243109 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-host-slash\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.243274 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.243239 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-log-socket\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.243319 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.243293 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/96ef3189-8e53-416d-8fbb-684d16eedfb8-cnibin\") pod \"multus-additional-cni-plugins-xcr5w\" (UID: \"96ef3189-8e53-416d-8fbb-684d16eedfb8\") " pod="openshift-multus/multus-additional-cni-plugins-xcr5w" Jun 08 19:26:26.243319 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.243305 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lrphw\"" Jun 08 19:26:26.243412 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.243329 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-host-run-netns\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.243460 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.243414 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-host-var-lib-kubelet\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.243514 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.243460 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/adfef4fa-95ab-4a43-8b80-2dc9326968de-socket-dir\") pod \"aws-ebs-csi-driver-node-k8g6p\" (UID: \"adfef4fa-95ab-4a43-8b80-2dc9326968de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" Jun 08 19:26:26.243514 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.243489 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-systemd-units\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.243605 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.243535 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-run-systemd\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.243655 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.243615 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/96ef3189-8e53-416d-8fbb-684d16eedfb8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xcr5w\" (UID: \"96ef3189-8e53-416d-8fbb-684d16eedfb8\") " pod="openshift-multus/multus-additional-cni-plugins-xcr5w" Jun 08 19:26:26.243776 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.243650 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-sys\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.243776 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.243689 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbtpc\" (UniqueName: \"kubernetes.io/projected/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-kube-api-access-zbtpc\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.243776 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.243709 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-lib-modules\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.243776 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.243742 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-host\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.243946 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.243805 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-etc-kubernetes\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.243946 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.243823 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-os-release\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.243946 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.243863 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-cni-binary-copy\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.243946 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.243882 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-etc-kubernetes\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.243946 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.243905 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-node-log\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.243946 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.243926 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp729\" (UniqueName: \"kubernetes.io/projected/9c8290ed-a8c2-4904-a862-a9e41138d285-kube-api-access-cp729\") pod \"network-metrics-daemon-7ngtn\" (UID: \"9c8290ed-a8c2-4904-a862-a9e41138d285\") " pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:26.243946 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.243943 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x45p2" Jun 08 19:26:26.244266 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.243965 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-tmp\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.244266 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.243993 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/adfef4fa-95ab-4a43-8b80-2dc9326968de-registration-dir\") pod \"aws-ebs-csi-driver-node-k8g6p\" (UID: \"adfef4fa-95ab-4a43-8b80-2dc9326968de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" Jun 08 19:26:26.244266 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.244011 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-ovnkube-config\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.244266 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.244026 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96ef3189-8e53-416d-8fbb-684d16eedfb8-system-cni-dir\") pod \"multus-additional-cni-plugins-xcr5w\" (UID: \"96ef3189-8e53-416d-8fbb-684d16eedfb8\") " pod="openshift-multus/multus-additional-cni-plugins-xcr5w" Jun 08 19:26:26.244266 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.244043 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-host-cni-netd\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.244266 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.244062 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbx5c\" (UniqueName: \"kubernetes.io/projected/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-kube-api-access-gbx5c\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.244266 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.244079 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-host-kubelet\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.244266 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.244088 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 19:26:26.244266 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.244170 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-etc-openvswitch\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.244266 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.244254 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-ovnkube-script-lib\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.244699 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.244357 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/96ef3189-8e53-416d-8fbb-684d16eedfb8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xcr5w\" (UID: \"96ef3189-8e53-416d-8fbb-684d16eedfb8\") " pod="openshift-multus/multus-additional-cni-plugins-xcr5w" Jun 08 19:26:26.244699 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.244434 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-etc-tuned\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.244699 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.244513 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-multus-conf-dir\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.244699 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.244563 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-multus-daemon-config\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.244699 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.244619 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/adfef4fa-95ab-4a43-8b80-2dc9326968de-sys-fs\") pod \"aws-ebs-csi-driver-node-k8g6p\" (UID: \"adfef4fa-95ab-4a43-8b80-2dc9326968de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" Jun 08 19:26:26.244699 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.244652 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-var-lib-openvswitch\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.244943 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.244737 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-env-overrides\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.244943 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.244786 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-host-run-ovn-kubernetes\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.244943 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.244914 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/adfef4fa-95ab-4a43-8b80-2dc9326968de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k8g6p\" (UID: \"adfef4fa-95ab-4a43-8b80-2dc9326968de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" Jun 08 19:26:26.245061 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.244945 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-run-openvswitch\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.245061 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.244962 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-system-cni-dir\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.245061 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.244999 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-host-var-lib-cni-bin\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.245384 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.245360 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-run\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.245466 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.245401 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-ovn-node-metrics-cert\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.245466 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.245444 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/96ef3189-8e53-416d-8fbb-684d16eedfb8-cni-binary-copy\") pod \"multus-additional-cni-plugins-xcr5w\" (UID: \"96ef3189-8e53-416d-8fbb-684d16eedfb8\") " pod="openshift-multus/multus-additional-cni-plugins-xcr5w" Jun 08 19:26:26.245564 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.245467 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-etc-systemd\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.245564 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.245489 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-var-lib-kubelet\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.245736 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.245565 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-hostroot\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.245736 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.245584 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn7jc\" (UniqueName: \"kubernetes.io/projected/96ef3189-8e53-416d-8fbb-684d16eedfb8-kube-api-access-rn7jc\") pod \"multus-additional-cni-plugins-xcr5w\" (UID: \"96ef3189-8e53-416d-8fbb-684d16eedfb8\") " pod="openshift-multus/multus-additional-cni-plugins-xcr5w" Jun 08 19:26:26.245736 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.245643 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-host-var-lib-cni-multus\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.245736 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.245668 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-host-run-netns\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.245736 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.245703 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-run-ovn\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.246166 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.245754 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs\") pod \"network-metrics-daemon-7ngtn\" (UID: \"9c8290ed-a8c2-4904-a862-a9e41138d285\") " pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:26.246166 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.245776 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-etc-modprobe-d\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.246166 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.245800 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/96ef3189-8e53-416d-8fbb-684d16eedfb8-os-release\") pod \"multus-additional-cni-plugins-xcr5w\" (UID: \"96ef3189-8e53-416d-8fbb-684d16eedfb8\") " pod="openshift-multus/multus-additional-cni-plugins-xcr5w" Jun 08 19:26:26.246166 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.245822 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/96ef3189-8e53-416d-8fbb-684d16eedfb8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xcr5w\" (UID: \"96ef3189-8e53-416d-8fbb-684d16eedfb8\") " pod="openshift-multus/multus-additional-cni-plugins-xcr5w" Jun 08 19:26:26.246166 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.245909 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-multus-socket-dir-parent\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.246166 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.245976 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-etc-sysconfig\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.246166 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.246000 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-etc-sysctl-conf\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.246166 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.246024 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 19:26:26.246166 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.246025 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d46x\" (UniqueName: \"kubernetes.io/projected/adfef4fa-95ab-4a43-8b80-2dc9326968de-kube-api-access-6d46x\") pod \"aws-ebs-csi-driver-node-k8g6p\" (UID: \"adfef4fa-95ab-4a43-8b80-2dc9326968de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" Jun 08 19:26:26.246166 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.246073 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.246166 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.246093 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6xlq\" (UniqueName: \"kubernetes.io/projected/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-kube-api-access-m6xlq\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.246596 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.246545 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jmjqr\"" Jun 08 19:26:26.247008 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.246990 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 19:26:26.247270 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.247250 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 19:26:26.247356 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.247250 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 19:26:26.272837 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.272815 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9mhx2" Jun 08 19:26:26.285047 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.285026 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9mhx2" Jun 08 19:26:26.333073 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.333042 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 19:26:26.346743 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.346700 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-original-pull-secret\") pod \"global-pull-secret-syncer-tdj7t\" (UID: \"117928d5-6f02-4a5e-b96b-4a2cc6e507eb\") " pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:26.346890 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.346767 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-host-run-ovn-kubernetes\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.346890 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.346797 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/adfef4fa-95ab-4a43-8b80-2dc9326968de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k8g6p\" (UID: \"adfef4fa-95ab-4a43-8b80-2dc9326968de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" Jun 08 19:26:26.346890 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.346800 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-host-run-ovn-kubernetes\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.346890 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.346820 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-run-openvswitch\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.346890 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.346844 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-system-cni-dir\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.346890 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.346867 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-host-var-lib-cni-bin\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.346890 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.346869 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/adfef4fa-95ab-4a43-8b80-2dc9326968de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k8g6p\" (UID: \"adfef4fa-95ab-4a43-8b80-2dc9326968de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" Jun 08 19:26:26.346890 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.346890 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-run\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.347246 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.346914 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-ovn-node-metrics-cert\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.347246 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.346922 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-system-cni-dir\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.347246 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.346928 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-host-var-lib-cni-bin\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.347246 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.346946 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/96ef3189-8e53-416d-8fbb-684d16eedfb8-cni-binary-copy\") pod \"multus-additional-cni-plugins-xcr5w\" (UID: \"96ef3189-8e53-416d-8fbb-684d16eedfb8\") " pod="openshift-multus/multus-additional-cni-plugins-xcr5w" Jun 08 19:26:26.347246 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.346963 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-run-openvswitch\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.347246 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.346971 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b654dba0-02ff-4e38-bf5f-643f7a958123-host-slash\") pod \"iptables-alerter-x45p2\" (UID: \"b654dba0-02ff-4e38-bf5f-643f7a958123\") " pod="openshift-network-operator/iptables-alerter-x45p2" Jun 08 19:26:26.347246 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.346979 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-run\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.347246 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.346998 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-etc-systemd\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.347246 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347088 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-var-lib-kubelet\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.347246 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347102 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-etc-systemd\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.347246 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347135 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-var-lib-kubelet\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.347246 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347176 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-hostroot\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.347246 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347208 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn7jc\" (UniqueName: \"kubernetes.io/projected/96ef3189-8e53-416d-8fbb-684d16eedfb8-kube-api-access-rn7jc\") pod \"multus-additional-cni-plugins-xcr5w\" (UID: \"96ef3189-8e53-416d-8fbb-684d16eedfb8\") " pod="openshift-multus/multus-additional-cni-plugins-xcr5w" Jun 08 19:26:26.347246 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347237 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/529224c9-b129-4c0b-baf2-096ad4106daa-host\") pod \"node-ca-lvnmk\" (UID: \"529224c9-b129-4c0b-baf2-096ad4106daa\") " pod="openshift-image-registry/node-ca-lvnmk" Jun 08 19:26:26.347246 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347242 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-hostroot\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.347925 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347264 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8rlw\" (UniqueName: \"kubernetes.io/projected/4d52db18-8dbf-4de9-9d50-1020690ab64a-kube-api-access-z8rlw\") pod \"node-resolver-mv9h2\" (UID: \"4d52db18-8dbf-4de9-9d50-1020690ab64a\") " pod="openshift-dns/node-resolver-mv9h2" Jun 08 19:26:26.347925 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347291 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-dbus\") pod \"global-pull-secret-syncer-tdj7t\" (UID: \"117928d5-6f02-4a5e-b96b-4a2cc6e507eb\") " pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:26.347925 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347317 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-host-var-lib-cni-multus\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.347925 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347340 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-host-run-netns\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.347925 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347328 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 19:26:26.347925 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347383 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-run-ovn\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.347925 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347407 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs\") pod \"network-metrics-daemon-7ngtn\" (UID: \"9c8290ed-a8c2-4904-a862-a9e41138d285\") " pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:26.347925 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347430 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-host-run-netns\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.347925 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347444 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/529224c9-b129-4c0b-baf2-096ad4106daa-serviceca\") pod \"node-ca-lvnmk\" (UID: \"529224c9-b129-4c0b-baf2-096ad4106daa\") " pod="openshift-image-registry/node-ca-lvnmk" Jun 08 19:26:26.347925 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347457 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-run-ovn\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.347925 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347469 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-etc-modprobe-d\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.347925 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347515 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/96ef3189-8e53-416d-8fbb-684d16eedfb8-os-release\") pod \"multus-additional-cni-plugins-xcr5w\" (UID: \"96ef3189-8e53-416d-8fbb-684d16eedfb8\") " pod="openshift-multus/multus-additional-cni-plugins-xcr5w" Jun 08 19:26:26.347925 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347511 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-host-var-lib-cni-multus\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.347925 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347548 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/96ef3189-8e53-416d-8fbb-684d16eedfb8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xcr5w\" (UID: \"96ef3189-8e53-416d-8fbb-684d16eedfb8\") " pod="openshift-multus/multus-additional-cni-plugins-xcr5w" Jun 08 19:26:26.347925 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:26.347521 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:26:26.347925 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347573 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/96ef3189-8e53-416d-8fbb-684d16eedfb8-cni-binary-copy\") pod \"multus-additional-cni-plugins-xcr5w\" (UID: \"96ef3189-8e53-416d-8fbb-684d16eedfb8\") " pod="openshift-multus/multus-additional-cni-plugins-xcr5w" Jun 08 19:26:26.347925 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347579 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/96ef3189-8e53-416d-8fbb-684d16eedfb8-os-release\") pod \"multus-additional-cni-plugins-xcr5w\" (UID: \"96ef3189-8e53-416d-8fbb-684d16eedfb8\") " pod="openshift-multus/multus-additional-cni-plugins-xcr5w" Jun 08 19:26:26.347925 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347624 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-etc-modprobe-d\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.348769 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347574 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d52db18-8dbf-4de9-9d50-1020690ab64a-tmp-dir\") pod \"node-resolver-mv9h2\" (UID: \"4d52db18-8dbf-4de9-9d50-1020690ab64a\") " pod="openshift-dns/node-resolver-mv9h2" Jun 08 19:26:26.348769 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:26.347656 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs podName:9c8290ed-a8c2-4904-a862-a9e41138d285 nodeName:}" failed. No retries permitted until 2026-06-08 19:26:26.847629367 +0000 UTC m=+2.983085803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs") pod "network-metrics-daemon-7ngtn" (UID: "9c8290ed-a8c2-4904-a862-a9e41138d285") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:26:26.348769 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347751 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/96ef3189-8e53-416d-8fbb-684d16eedfb8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xcr5w\" (UID: \"96ef3189-8e53-416d-8fbb-684d16eedfb8\") " pod="openshift-multus/multus-additional-cni-plugins-xcr5w" Jun 08 19:26:26.348769 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347741 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-multus-socket-dir-parent\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.348769 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347798 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-etc-sysconfig\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.348769 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347807 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-multus-socket-dir-parent\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.348769 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347820 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-etc-sysctl-conf\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.348769 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347848 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d46x\" (UniqueName: \"kubernetes.io/projected/adfef4fa-95ab-4a43-8b80-2dc9326968de-kube-api-access-6d46x\") pod \"aws-ebs-csi-driver-node-k8g6p\" (UID: \"adfef4fa-95ab-4a43-8b80-2dc9326968de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" Jun 08 19:26:26.348769 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347868 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.348769 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347873 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-etc-sysconfig\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.348769 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347889 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6xlq\" (UniqueName: \"kubernetes.io/projected/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-kube-api-access-m6xlq\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.348769 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347923 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/26f426a9-91e2-47d1-adc2-fa6a36f8ced0-konnectivity-ca\") pod \"konnectivity-agent-mckqj\" (UID: \"26f426a9-91e2-47d1-adc2-fa6a36f8ced0\") " pod="kube-system/konnectivity-agent-mckqj" Jun 08 19:26:26.348769 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347932 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.348769 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347951 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-etc-sysctl-d\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.348769 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347961 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-etc-sysctl-conf\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.348769 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.347979 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-cnibin\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.349509 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348004 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-host-run-multus-certs\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.349509 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348027 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/adfef4fa-95ab-4a43-8b80-2dc9326968de-etc-selinux\") pod \"aws-ebs-csi-driver-node-k8g6p\" (UID: \"adfef4fa-95ab-4a43-8b80-2dc9326968de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" Jun 08 19:26:26.349509 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348051 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-host-cni-bin\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.349509 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348053 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-cnibin\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.349509 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348104 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfmgj\" (UniqueName: \"kubernetes.io/projected/4e78d959-fe7c-48b9-90b3-7ed41b7a8156-kube-api-access-pfmgj\") pod \"network-check-target-tvpck\" (UID: \"4e78d959-fe7c-48b9-90b3-7ed41b7a8156\") " pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:26:26.349509 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348105 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-host-cni-bin\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.349509 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348138 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/adfef4fa-95ab-4a43-8b80-2dc9326968de-etc-selinux\") pod \"aws-ebs-csi-driver-node-k8g6p\" (UID: \"adfef4fa-95ab-4a43-8b80-2dc9326968de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" Jun 08 19:26:26.349509 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348105 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-etc-sysctl-d\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.349509 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348054 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-host-run-multus-certs\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.349509 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348148 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-multus-cni-dir\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.349509 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348188 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-multus-cni-dir\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.349509 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348197 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-host-run-k8s-cni-cncf-io\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.349509 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348222 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/adfef4fa-95ab-4a43-8b80-2dc9326968de-device-dir\") pod \"aws-ebs-csi-driver-node-k8g6p\" (UID: \"adfef4fa-95ab-4a43-8b80-2dc9326968de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" Jun 08 19:26:26.349509 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348264 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-host-slash\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.349509 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348265 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-host-run-k8s-cni-cncf-io\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.349509 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348286 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-log-socket\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.349509 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348312 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/96ef3189-8e53-416d-8fbb-684d16eedfb8-cnibin\") pod \"multus-additional-cni-plugins-xcr5w\" (UID: \"96ef3189-8e53-416d-8fbb-684d16eedfb8\") " pod="openshift-multus/multus-additional-cni-plugins-xcr5w" Jun 08 19:26:26.349509 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348318 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-host-slash\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.350347 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348337 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-host-run-netns\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.350347 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348304 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/adfef4fa-95ab-4a43-8b80-2dc9326968de-device-dir\") pod \"aws-ebs-csi-driver-node-k8g6p\" (UID: \"adfef4fa-95ab-4a43-8b80-2dc9326968de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" Jun 08 19:26:26.350347 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348362 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-host-var-lib-kubelet\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.350347 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348367 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-log-socket\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.350347 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348382 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/96ef3189-8e53-416d-8fbb-684d16eedfb8-cnibin\") pod \"multus-additional-cni-plugins-xcr5w\" (UID: \"96ef3189-8e53-416d-8fbb-684d16eedfb8\") " pod="openshift-multus/multus-additional-cni-plugins-xcr5w" Jun 08 19:26:26.350347 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348391 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/adfef4fa-95ab-4a43-8b80-2dc9326968de-socket-dir\") pod \"aws-ebs-csi-driver-node-k8g6p\" (UID: \"adfef4fa-95ab-4a43-8b80-2dc9326968de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" Jun 08 19:26:26.350347 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348392 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-host-run-netns\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.350347 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348421 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-systemd-units\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.350347 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348470 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-run-systemd\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.350347 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348423 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-host-var-lib-kubelet\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.350347 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348506 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/adfef4fa-95ab-4a43-8b80-2dc9326968de-socket-dir\") pod \"aws-ebs-csi-driver-node-k8g6p\" (UID: \"adfef4fa-95ab-4a43-8b80-2dc9326968de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" Jun 08 19:26:26.350347 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348509 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/96ef3189-8e53-416d-8fbb-684d16eedfb8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xcr5w\" (UID: \"96ef3189-8e53-416d-8fbb-684d16eedfb8\") " pod="openshift-multus/multus-additional-cni-plugins-xcr5w" Jun 08 19:26:26.350347 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348506 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-systemd-units\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.350347 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348538 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-kubelet-config\") pod \"global-pull-secret-syncer-tdj7t\" (UID: \"117928d5-6f02-4a5e-b96b-4a2cc6e507eb\") " pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:26.350347 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348539 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-run-systemd\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.350347 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348678 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-sys\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.350347 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348778 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-sys\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.351143 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348818 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbtpc\" (UniqueName: \"kubernetes.io/projected/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-kube-api-access-zbtpc\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.351143 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.348858 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-lib-modules\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.351143 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349047 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/96ef3189-8e53-416d-8fbb-684d16eedfb8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xcr5w\" (UID: \"96ef3189-8e53-416d-8fbb-684d16eedfb8\") " pod="openshift-multus/multus-additional-cni-plugins-xcr5w" Jun 08 19:26:26.351143 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349106 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-host\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.351143 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349131 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-etc-kubernetes\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.351143 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349154 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b654dba0-02ff-4e38-bf5f-643f7a958123-iptables-alerter-script\") pod \"iptables-alerter-x45p2\" (UID: \"b654dba0-02ff-4e38-bf5f-643f7a958123\") " pod="openshift-network-operator/iptables-alerter-x45p2" Jun 08 19:26:26.351143 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349179 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-os-release\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.351143 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349206 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-cni-binary-copy\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.351143 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349234 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-etc-kubernetes\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.351143 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349267 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-node-log\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.351143 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349248 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-etc-kubernetes\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.351143 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349303 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp729\" (UniqueName: \"kubernetes.io/projected/9c8290ed-a8c2-4904-a862-a9e41138d285-kube-api-access-cp729\") pod \"network-metrics-daemon-7ngtn\" (UID: \"9c8290ed-a8c2-4904-a862-a9e41138d285\") " pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:26.351143 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349330 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-os-release\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.351143 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349266 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-lib-modules\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.351143 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349341 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-host\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.351143 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349332 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/26f426a9-91e2-47d1-adc2-fa6a36f8ced0-agent-certs\") pod \"konnectivity-agent-mckqj\" (UID: \"26f426a9-91e2-47d1-adc2-fa6a36f8ced0\") " pod="kube-system/konnectivity-agent-mckqj" Jun 08 19:26:26.351143 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349396 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcv6h\" (UniqueName: \"kubernetes.io/projected/b654dba0-02ff-4e38-bf5f-643f7a958123-kube-api-access-qcv6h\") pod \"iptables-alerter-x45p2\" (UID: \"b654dba0-02ff-4e38-bf5f-643f7a958123\") " pod="openshift-network-operator/iptables-alerter-x45p2" Jun 08 19:26:26.351912 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349443 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-tmp\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.351912 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349491 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/adfef4fa-95ab-4a43-8b80-2dc9326968de-registration-dir\") pod \"aws-ebs-csi-driver-node-k8g6p\" (UID: \"adfef4fa-95ab-4a43-8b80-2dc9326968de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" Jun 08 19:26:26.351912 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349517 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-ovnkube-config\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.351912 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349603 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96ef3189-8e53-416d-8fbb-684d16eedfb8-system-cni-dir\") pod \"multus-additional-cni-plugins-xcr5w\" (UID: \"96ef3189-8e53-416d-8fbb-684d16eedfb8\") " pod="openshift-multus/multus-additional-cni-plugins-xcr5w" Jun 08 19:26:26.351912 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349606 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-node-log\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.351912 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349414 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-etc-kubernetes\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.351912 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349625 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-host-cni-netd\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.351912 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349682 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-host-cni-netd\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.351912 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349704 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4d52db18-8dbf-4de9-9d50-1020690ab64a-hosts-file\") pod \"node-resolver-mv9h2\" (UID: \"4d52db18-8dbf-4de9-9d50-1020690ab64a\") " pod="openshift-dns/node-resolver-mv9h2" Jun 08 19:26:26.351912 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349745 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96ef3189-8e53-416d-8fbb-684d16eedfb8-system-cni-dir\") pod \"multus-additional-cni-plugins-xcr5w\" (UID: \"96ef3189-8e53-416d-8fbb-684d16eedfb8\") " pod="openshift-multus/multus-additional-cni-plugins-xcr5w" Jun 08 19:26:26.351912 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349857 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbx5c\" (UniqueName: \"kubernetes.io/projected/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-kube-api-access-gbx5c\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.351912 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349894 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-host-kubelet\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.351912 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349917 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-etc-openvswitch\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.351912 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349953 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-ovnkube-script-lib\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.351912 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.349992 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98rqf\" (UniqueName: \"kubernetes.io/projected/529224c9-b129-4c0b-baf2-096ad4106daa-kube-api-access-98rqf\") pod \"node-ca-lvnmk\" (UID: \"529224c9-b129-4c0b-baf2-096ad4106daa\") " pod="openshift-image-registry/node-ca-lvnmk" Jun 08 19:26:26.351912 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.350013 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-host-kubelet\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.351912 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.350031 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/96ef3189-8e53-416d-8fbb-684d16eedfb8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xcr5w\" (UID: \"96ef3189-8e53-416d-8fbb-684d16eedfb8\") " pod="openshift-multus/multus-additional-cni-plugins-xcr5w" Jun 08 19:26:26.352575 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.350059 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-etc-tuned\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.352575 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.350091 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-multus-conf-dir\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.352575 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.350117 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-multus-daemon-config\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.352575 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.350138 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/adfef4fa-95ab-4a43-8b80-2dc9326968de-sys-fs\") pod \"aws-ebs-csi-driver-node-k8g6p\" (UID: \"adfef4fa-95ab-4a43-8b80-2dc9326968de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" Jun 08 19:26:26.352575 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.350159 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-var-lib-openvswitch\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.352575 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.350181 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-env-overrides\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.352575 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.350249 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-etc-openvswitch\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.352575 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.350307 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-multus-conf-dir\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.352575 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.350365 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-ovnkube-config\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.352575 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.350600 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-cni-binary-copy\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.352575 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.350600 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-ovnkube-script-lib\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.352575 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.350651 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/adfef4fa-95ab-4a43-8b80-2dc9326968de-sys-fs\") pod \"aws-ebs-csi-driver-node-k8g6p\" (UID: \"adfef4fa-95ab-4a43-8b80-2dc9326968de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" Jun 08 19:26:26.352575 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.350693 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-env-overrides\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.352575 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.350694 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-var-lib-openvswitch\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.352575 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.350775 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/adfef4fa-95ab-4a43-8b80-2dc9326968de-registration-dir\") pod \"aws-ebs-csi-driver-node-k8g6p\" (UID: \"adfef4fa-95ab-4a43-8b80-2dc9326968de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" Jun 08 19:26:26.352575 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.350851 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/96ef3189-8e53-416d-8fbb-684d16eedfb8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xcr5w\" (UID: \"96ef3189-8e53-416d-8fbb-684d16eedfb8\") " pod="openshift-multus/multus-additional-cni-plugins-xcr5w" Jun 08 19:26:26.352575 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.351114 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-multus-daemon-config\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.353295 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.351161 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-ovn-node-metrics-cert\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.353295 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.352508 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-tmp\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.353295 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.352604 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-etc-tuned\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.355295 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:26.355276 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:26:26.355399 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:26.355323 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:26:26.355399 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:26.355337 2573 projected.go:196] Error preparing data for projected volume kube-api-access-pfmgj for pod openshift-network-diagnostics/network-check-target-tvpck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:26:26.355510 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:26.355426 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e78d959-fe7c-48b9-90b3-7ed41b7a8156-kube-api-access-pfmgj podName:4e78d959-fe7c-48b9-90b3-7ed41b7a8156 nodeName:}" failed. No retries permitted until 2026-06-08 19:26:26.855389463 +0000 UTC m=+2.990848108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pfmgj" (UniqueName: "kubernetes.io/projected/4e78d959-fe7c-48b9-90b3-7ed41b7a8156-kube-api-access-pfmgj") pod "network-check-target-tvpck" (UID: "4e78d959-fe7c-48b9-90b3-7ed41b7a8156") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:26:26.357244 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.357204 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn7jc\" (UniqueName: \"kubernetes.io/projected/96ef3189-8e53-416d-8fbb-684d16eedfb8-kube-api-access-rn7jc\") pod \"multus-additional-cni-plugins-xcr5w\" (UID: \"96ef3189-8e53-416d-8fbb-684d16eedfb8\") " pod="openshift-multus/multus-additional-cni-plugins-xcr5w" Jun 08 19:26:26.357857 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.357747 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6xlq\" (UniqueName: \"kubernetes.io/projected/95410e6e-a4fd-4f1e-9f31-588b8dc50a78-kube-api-access-m6xlq\") pod \"ovnkube-node-ghdr2\" (UID: \"95410e6e-a4fd-4f1e-9f31-588b8dc50a78\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.358051 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.358029 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d46x\" (UniqueName: \"kubernetes.io/projected/adfef4fa-95ab-4a43-8b80-2dc9326968de-kube-api-access-6d46x\") pod \"aws-ebs-csi-driver-node-k8g6p\" (UID: \"adfef4fa-95ab-4a43-8b80-2dc9326968de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" Jun 08 19:26:26.360064 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.360040 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp729\" (UniqueName: \"kubernetes.io/projected/9c8290ed-a8c2-4904-a862-a9e41138d285-kube-api-access-cp729\") pod \"network-metrics-daemon-7ngtn\" (UID: \"9c8290ed-a8c2-4904-a862-a9e41138d285\") " pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:26.360260 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.360242 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbx5c\" (UniqueName: \"kubernetes.io/projected/d3b4d7f8-d49b-492b-bedc-42bbae4ee126-kube-api-access-gbx5c\") pod \"tuned-hksvz\" (UID: \"d3b4d7f8-d49b-492b-bedc-42bbae4ee126\") " pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.360519 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.360500 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbtpc\" (UniqueName: \"kubernetes.io/projected/39058fb2-35ae-4f7e-bdb6-8c306fd3f81a-kube-api-access-zbtpc\") pod \"multus-mr75f\" (UID: \"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a\") " pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.451485 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.451453 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b654dba0-02ff-4e38-bf5f-643f7a958123-host-slash\") pod \"iptables-alerter-x45p2\" (UID: \"b654dba0-02ff-4e38-bf5f-643f7a958123\") " pod="openshift-network-operator/iptables-alerter-x45p2" Jun 08 19:26:26.451656 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.451491 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/529224c9-b129-4c0b-baf2-096ad4106daa-host\") pod \"node-ca-lvnmk\" (UID: \"529224c9-b129-4c0b-baf2-096ad4106daa\") " pod="openshift-image-registry/node-ca-lvnmk" Jun 08 19:26:26.451656 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.451514 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8rlw\" (UniqueName: \"kubernetes.io/projected/4d52db18-8dbf-4de9-9d50-1020690ab64a-kube-api-access-z8rlw\") pod \"node-resolver-mv9h2\" (UID: \"4d52db18-8dbf-4de9-9d50-1020690ab64a\") " pod="openshift-dns/node-resolver-mv9h2" Jun 08 19:26:26.451656 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.451537 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-dbus\") pod \"global-pull-secret-syncer-tdj7t\" (UID: \"117928d5-6f02-4a5e-b96b-4a2cc6e507eb\") " pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:26.451656 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.451571 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/529224c9-b129-4c0b-baf2-096ad4106daa-serviceca\") pod \"node-ca-lvnmk\" (UID: \"529224c9-b129-4c0b-baf2-096ad4106daa\") " pod="openshift-image-registry/node-ca-lvnmk" Jun 08 19:26:26.451656 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.451581 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b654dba0-02ff-4e38-bf5f-643f7a958123-host-slash\") pod \"iptables-alerter-x45p2\" (UID: \"b654dba0-02ff-4e38-bf5f-643f7a958123\") " pod="openshift-network-operator/iptables-alerter-x45p2" Jun 08 19:26:26.451656 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.451581 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/529224c9-b129-4c0b-baf2-096ad4106daa-host\") pod \"node-ca-lvnmk\" (UID: \"529224c9-b129-4c0b-baf2-096ad4106daa\") " pod="openshift-image-registry/node-ca-lvnmk" Jun 08 19:26:26.451656 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.451616 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d52db18-8dbf-4de9-9d50-1020690ab64a-tmp-dir\") pod \"node-resolver-mv9h2\" (UID: \"4d52db18-8dbf-4de9-9d50-1020690ab64a\") " pod="openshift-dns/node-resolver-mv9h2" Jun 08 19:26:26.452025 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.451661 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/26f426a9-91e2-47d1-adc2-fa6a36f8ced0-konnectivity-ca\") pod \"konnectivity-agent-mckqj\" (UID: \"26f426a9-91e2-47d1-adc2-fa6a36f8ced0\") " pod="kube-system/konnectivity-agent-mckqj" Jun 08 19:26:26.452025 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.451700 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-dbus\") pod \"global-pull-secret-syncer-tdj7t\" (UID: \"117928d5-6f02-4a5e-b96b-4a2cc6e507eb\") " pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:26.452025 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.451747 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-kubelet-config\") pod \"global-pull-secret-syncer-tdj7t\" (UID: \"117928d5-6f02-4a5e-b96b-4a2cc6e507eb\") " pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:26.452025 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.451782 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b654dba0-02ff-4e38-bf5f-643f7a958123-iptables-alerter-script\") pod \"iptables-alerter-x45p2\" (UID: \"b654dba0-02ff-4e38-bf5f-643f7a958123\") " pod="openshift-network-operator/iptables-alerter-x45p2" Jun 08 19:26:26.452025 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.451810 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/26f426a9-91e2-47d1-adc2-fa6a36f8ced0-agent-certs\") pod \"konnectivity-agent-mckqj\" (UID: \"26f426a9-91e2-47d1-adc2-fa6a36f8ced0\") " pod="kube-system/konnectivity-agent-mckqj" Jun 08 19:26:26.452025 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.451835 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcv6h\" (UniqueName: \"kubernetes.io/projected/b654dba0-02ff-4e38-bf5f-643f7a958123-kube-api-access-qcv6h\") pod \"iptables-alerter-x45p2\" (UID: \"b654dba0-02ff-4e38-bf5f-643f7a958123\") " pod="openshift-network-operator/iptables-alerter-x45p2" Jun 08 19:26:26.452025 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.451861 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4d52db18-8dbf-4de9-9d50-1020690ab64a-hosts-file\") pod \"node-resolver-mv9h2\" (UID: \"4d52db18-8dbf-4de9-9d50-1020690ab64a\") " pod="openshift-dns/node-resolver-mv9h2" Jun 08 19:26:26.452025 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.451888 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98rqf\" (UniqueName: \"kubernetes.io/projected/529224c9-b129-4c0b-baf2-096ad4106daa-kube-api-access-98rqf\") pod \"node-ca-lvnmk\" (UID: \"529224c9-b129-4c0b-baf2-096ad4106daa\") " pod="openshift-image-registry/node-ca-lvnmk" Jun 08 19:26:26.452025 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.451918 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-original-pull-secret\") pod \"global-pull-secret-syncer-tdj7t\" (UID: \"117928d5-6f02-4a5e-b96b-4a2cc6e507eb\") " pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:26.452025 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.451959 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d52db18-8dbf-4de9-9d50-1020690ab64a-tmp-dir\") pod \"node-resolver-mv9h2\" (UID: \"4d52db18-8dbf-4de9-9d50-1020690ab64a\") " pod="openshift-dns/node-resolver-mv9h2" Jun 08 19:26:26.452025 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:26.452028 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:26:26.452486 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:26.452096 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-original-pull-secret podName:117928d5-6f02-4a5e-b96b-4a2cc6e507eb nodeName:}" failed. No retries permitted until 2026-06-08 19:26:26.952078096 +0000 UTC m=+3.087534535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-original-pull-secret") pod "global-pull-secret-syncer-tdj7t" (UID: "117928d5-6f02-4a5e-b96b-4a2cc6e507eb") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:26:26.452486 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.452095 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/529224c9-b129-4c0b-baf2-096ad4106daa-serviceca\") pod \"node-ca-lvnmk\" (UID: \"529224c9-b129-4c0b-baf2-096ad4106daa\") " pod="openshift-image-registry/node-ca-lvnmk" Jun 08 19:26:26.452486 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.452242 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4d52db18-8dbf-4de9-9d50-1020690ab64a-hosts-file\") pod \"node-resolver-mv9h2\" (UID: \"4d52db18-8dbf-4de9-9d50-1020690ab64a\") " pod="openshift-dns/node-resolver-mv9h2" Jun 08 19:26:26.452486 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.452025 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-kubelet-config\") pod \"global-pull-secret-syncer-tdj7t\" (UID: \"117928d5-6f02-4a5e-b96b-4a2cc6e507eb\") " pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:26.452486 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.452377 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b654dba0-02ff-4e38-bf5f-643f7a958123-iptables-alerter-script\") pod \"iptables-alerter-x45p2\" (UID: \"b654dba0-02ff-4e38-bf5f-643f7a958123\") " pod="openshift-network-operator/iptables-alerter-x45p2" Jun 08 19:26:26.453021 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.453000 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/26f426a9-91e2-47d1-adc2-fa6a36f8ced0-konnectivity-ca\") pod \"konnectivity-agent-mckqj\" (UID: \"26f426a9-91e2-47d1-adc2-fa6a36f8ced0\") " pod="kube-system/konnectivity-agent-mckqj" Jun 08 19:26:26.454256 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.454240 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/26f426a9-91e2-47d1-adc2-fa6a36f8ced0-agent-certs\") pod \"konnectivity-agent-mckqj\" (UID: \"26f426a9-91e2-47d1-adc2-fa6a36f8ced0\") " pod="kube-system/konnectivity-agent-mckqj" Jun 08 19:26:26.463133 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.463101 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8rlw\" (UniqueName: \"kubernetes.io/projected/4d52db18-8dbf-4de9-9d50-1020690ab64a-kube-api-access-z8rlw\") pod \"node-resolver-mv9h2\" (UID: \"4d52db18-8dbf-4de9-9d50-1020690ab64a\") " pod="openshift-dns/node-resolver-mv9h2" Jun 08 19:26:26.467098 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.467033 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcv6h\" (UniqueName: \"kubernetes.io/projected/b654dba0-02ff-4e38-bf5f-643f7a958123-kube-api-access-qcv6h\") pod \"iptables-alerter-x45p2\" (UID: \"b654dba0-02ff-4e38-bf5f-643f7a958123\") " pod="openshift-network-operator/iptables-alerter-x45p2" Jun 08 19:26:26.468599 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.468583 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98rqf\" (UniqueName: \"kubernetes.io/projected/529224c9-b129-4c0b-baf2-096ad4106daa-kube-api-access-98rqf\") pod \"node-ca-lvnmk\" (UID: \"529224c9-b129-4c0b-baf2-096ad4106daa\") " pod="openshift-image-registry/node-ca-lvnmk" Jun 08 19:26:26.497629 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.497612 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 19:26:26.538283 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.538258 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hksvz" Jun 08 19:26:26.546634 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.546616 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mr75f" Jun 08 19:26:26.555553 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.555530 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" Jun 08 19:26:26.560317 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.560297 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xcr5w" Jun 08 19:26:26.567121 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.567102 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:26.572648 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.572633 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lvnmk" Jun 08 19:26:26.579213 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.579189 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mv9h2" Jun 08 19:26:26.584886 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.584866 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mckqj" Jun 08 19:26:26.590542 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.590524 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x45p2" Jun 08 19:26:26.854375 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.854349 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs\") pod \"network-metrics-daemon-7ngtn\" (UID: \"9c8290ed-a8c2-4904-a862-a9e41138d285\") " pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:26.854549 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:26.854505 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:26:26.854616 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:26.854578 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs podName:9c8290ed-a8c2-4904-a862-a9e41138d285 nodeName:}" failed. No retries permitted until 2026-06-08 19:26:27.854556583 +0000 UTC m=+3.990013028 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs") pod "network-metrics-daemon-7ngtn" (UID: "9c8290ed-a8c2-4904-a862-a9e41138d285") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:26:26.955396 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.955365 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfmgj\" (UniqueName: \"kubernetes.io/projected/4e78d959-fe7c-48b9-90b3-7ed41b7a8156-kube-api-access-pfmgj\") pod \"network-check-target-tvpck\" (UID: \"4e78d959-fe7c-48b9-90b3-7ed41b7a8156\") " pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:26:26.955537 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:26.955408 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-original-pull-secret\") pod \"global-pull-secret-syncer-tdj7t\" (UID: \"117928d5-6f02-4a5e-b96b-4a2cc6e507eb\") " pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:26.955537 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:26.955522 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:26:26.955602 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:26.955541 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:26:26.955602 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:26.955551 2573 projected.go:196] Error preparing data for projected volume kube-api-access-pfmgj for pod openshift-network-diagnostics/network-check-target-tvpck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:26:26.955602 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:26.955568 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:26:26.955602 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:26.955599 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e78d959-fe7c-48b9-90b3-7ed41b7a8156-kube-api-access-pfmgj podName:4e78d959-fe7c-48b9-90b3-7ed41b7a8156 nodeName:}" failed. No retries permitted until 2026-06-08 19:26:27.955585435 +0000 UTC m=+4.091041853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pfmgj" (UniqueName: "kubernetes.io/projected/4e78d959-fe7c-48b9-90b3-7ed41b7a8156-kube-api-access-pfmgj") pod "network-check-target-tvpck" (UID: "4e78d959-fe7c-48b9-90b3-7ed41b7a8156") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:26:26.955748 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:26.955613 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-original-pull-secret podName:117928d5-6f02-4a5e-b96b-4a2cc6e507eb nodeName:}" failed. No retries permitted until 2026-06-08 19:26:27.955607158 +0000 UTC m=+4.091063577 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-original-pull-secret") pod "global-pull-secret-syncer-tdj7t" (UID: "117928d5-6f02-4a5e-b96b-4a2cc6e507eb") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:26:27.090776 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:27.090747 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96ef3189_8e53_416d_8fbb_684d16eedfb8.slice/crio-8561b5cb9dd7161edb810e3438783f0490b7b79af5ce67caf7c7bb2fef6fe6e2 WatchSource:0}: Error finding container 8561b5cb9dd7161edb810e3438783f0490b7b79af5ce67caf7c7bb2fef6fe6e2: Status 404 returned error can't find the container with id 8561b5cb9dd7161edb810e3438783f0490b7b79af5ce67caf7c7bb2fef6fe6e2 Jun 08 19:26:27.092300 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:27.092273 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39058fb2_35ae_4f7e_bdb6_8c306fd3f81a.slice/crio-473a0dc24a3e2a37229bd7f7d6d8d39df4d8cf238bb91d92c970a2513b887b27 WatchSource:0}: Error finding container 473a0dc24a3e2a37229bd7f7d6d8d39df4d8cf238bb91d92c970a2513b887b27: Status 404 returned error can't find the container with id 473a0dc24a3e2a37229bd7f7d6d8d39df4d8cf238bb91d92c970a2513b887b27 Jun 08 19:26:27.097284 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:27.097261 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d52db18_8dbf_4de9_9d50_1020690ab64a.slice/crio-d321f667b64097c321f4fa8cba4d6f0739670fb90327ce5d4e8d4aa3b6801d6e WatchSource:0}: Error finding container d321f667b64097c321f4fa8cba4d6f0739670fb90327ce5d4e8d4aa3b6801d6e: Status 404 returned error can't find the container with id d321f667b64097c321f4fa8cba4d6f0739670fb90327ce5d4e8d4aa3b6801d6e Jun 08 19:26:27.098677 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:27.098646 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb654dba0_02ff_4e38_bf5f_643f7a958123.slice/crio-4e00323eba91a2333d88cbb9b2bddd77f75994370459c4a66c558f4073cf3aaf WatchSource:0}: Error finding container 4e00323eba91a2333d88cbb9b2bddd77f75994370459c4a66c558f4073cf3aaf: Status 404 returned error can't find the container with id 4e00323eba91a2333d88cbb9b2bddd77f75994370459c4a66c558f4073cf3aaf Jun 08 19:26:27.099422 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:27.099401 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadfef4fa_95ab_4a43_8b80_2dc9326968de.slice/crio-394fde4992cb7c9db15e93e2bd05aa87666bdf921501f9fc6aa9da57ae4e226e WatchSource:0}: Error finding container 394fde4992cb7c9db15e93e2bd05aa87666bdf921501f9fc6aa9da57ae4e226e: Status 404 returned error can't find the container with id 394fde4992cb7c9db15e93e2bd05aa87666bdf921501f9fc6aa9da57ae4e226e Jun 08 19:26:27.101305 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:27.101238 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26f426a9_91e2_47d1_adc2_fa6a36f8ced0.slice/crio-9443dc877aa4b971d931b3d835948a914c756da43a87f6177ae933291591e793 WatchSource:0}: Error finding container 9443dc877aa4b971d931b3d835948a914c756da43a87f6177ae933291591e793: Status 404 returned error can't find the container with id 9443dc877aa4b971d931b3d835948a914c756da43a87f6177ae933291591e793 Jun 08 19:26:27.102672 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:27.102651 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod529224c9_b129_4c0b_baf2_096ad4106daa.slice/crio-959017b7afa5515b911c374c8803176a4aff0114bf00ce487d4a9feb651a0e4e WatchSource:0}: Error finding container 959017b7afa5515b911c374c8803176a4aff0114bf00ce487d4a9feb651a0e4e: Status 404 returned error can't find the container with id 959017b7afa5515b911c374c8803176a4aff0114bf00ce487d4a9feb651a0e4e Jun 08 19:26:27.103523 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:27.103502 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b4d7f8_d49b_492b_bedc_42bbae4ee126.slice/crio-9f0c6e4125fc2194b60850ac48314c655a4c2cd3dc5d3b45259472dd06295a70 WatchSource:0}: Error finding container 9f0c6e4125fc2194b60850ac48314c655a4c2cd3dc5d3b45259472dd06295a70: Status 404 returned error can't find the container with id 9f0c6e4125fc2194b60850ac48314c655a4c2cd3dc5d3b45259472dd06295a70 Jun 08 19:26:27.105884 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:26:27.105853 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95410e6e_a4fd_4f1e_9f31_588b8dc50a78.slice/crio-e5e3223a65340d887abe95efd96fb341fd5f9986e00fdcca41679675e86268cc WatchSource:0}: Error finding container e5e3223a65340d887abe95efd96fb341fd5f9986e00fdcca41679675e86268cc: Status 404 returned error can't find the container with id e5e3223a65340d887abe95efd96fb341fd5f9986e00fdcca41679675e86268cc Jun 08 19:26:27.287210 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:27.287165 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 19:21:26 +0000 UTC" deadline="2027-12-31 22:31:32.332779833 +0000 UTC" Jun 08 19:26:27.287210 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:27.287197 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13707h5m5.045586341s" Jun 08 19:26:27.306701 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:27.306670 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" event={"ID":"adfef4fa-95ab-4a43-8b80-2dc9326968de","Type":"ContainerStarted","Data":"394fde4992cb7c9db15e93e2bd05aa87666bdf921501f9fc6aa9da57ae4e226e"} Jun 08 19:26:27.307690 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:27.307659 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mv9h2" event={"ID":"4d52db18-8dbf-4de9-9d50-1020690ab64a","Type":"ContainerStarted","Data":"d321f667b64097c321f4fa8cba4d6f0739670fb90327ce5d4e8d4aa3b6801d6e"} Jun 08 19:26:27.308618 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:27.308598 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mr75f" event={"ID":"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a","Type":"ContainerStarted","Data":"473a0dc24a3e2a37229bd7f7d6d8d39df4d8cf238bb91d92c970a2513b887b27"} Jun 08 19:26:27.309651 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:27.309634 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xcr5w" event={"ID":"96ef3189-8e53-416d-8fbb-684d16eedfb8","Type":"ContainerStarted","Data":"8561b5cb9dd7161edb810e3438783f0490b7b79af5ce67caf7c7bb2fef6fe6e2"} Jun 08 19:26:27.311197 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:27.311026 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" event={"ID":"95410e6e-a4fd-4f1e-9f31-588b8dc50a78","Type":"ContainerStarted","Data":"e5e3223a65340d887abe95efd96fb341fd5f9986e00fdcca41679675e86268cc"} Jun 08 19:26:27.312114 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:27.312094 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hksvz" event={"ID":"d3b4d7f8-d49b-492b-bedc-42bbae4ee126","Type":"ContainerStarted","Data":"9f0c6e4125fc2194b60850ac48314c655a4c2cd3dc5d3b45259472dd06295a70"} Jun 08 19:26:27.313164 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:27.313143 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x45p2" event={"ID":"b654dba0-02ff-4e38-bf5f-643f7a958123","Type":"ContainerStarted","Data":"4e00323eba91a2333d88cbb9b2bddd77f75994370459c4a66c558f4073cf3aaf"} Jun 08 19:26:27.314881 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:27.314861 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-14.ec2.internal" event={"ID":"d234ad56bfcf5710e49217980ee8b515","Type":"ContainerStarted","Data":"e913d25fbffa5248a710b1bed6c72e08614952843bfecaacf904bc04d27fa233"} Jun 08 19:26:27.315955 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:27.315847 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lvnmk" event={"ID":"529224c9-b129-4c0b-baf2-096ad4106daa","Type":"ContainerStarted","Data":"959017b7afa5515b911c374c8803176a4aff0114bf00ce487d4a9feb651a0e4e"} Jun 08 19:26:27.319208 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:27.319181 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mckqj" event={"ID":"26f426a9-91e2-47d1-adc2-fa6a36f8ced0","Type":"ContainerStarted","Data":"9443dc877aa4b971d931b3d835948a914c756da43a87f6177ae933291591e793"} Jun 08 19:26:27.333585 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:27.333533 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-14.ec2.internal" podStartSLOduration=2.333522035 podStartE2EDuration="2.333522035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:26:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:26:27.333216907 +0000 UTC m=+3.468673360" watchObservedRunningTime="2026-06-08 19:26:27.333522035 +0000 UTC m=+3.468978476" Jun 08 19:26:27.862585 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:27.862548 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs\") pod \"network-metrics-daemon-7ngtn\" (UID: \"9c8290ed-a8c2-4904-a862-a9e41138d285\") " pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:27.862784 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:27.862730 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:26:27.862867 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:27.862796 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs podName:9c8290ed-a8c2-4904-a862-a9e41138d285 nodeName:}" failed. No retries permitted until 2026-06-08 19:26:29.862776607 +0000 UTC m=+5.998233026 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs") pod "network-metrics-daemon-7ngtn" (UID: "9c8290ed-a8c2-4904-a862-a9e41138d285") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:26:27.963052 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:27.963016 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-original-pull-secret\") pod \"global-pull-secret-syncer-tdj7t\" (UID: \"117928d5-6f02-4a5e-b96b-4a2cc6e507eb\") " pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:27.963230 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:27.963090 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfmgj\" (UniqueName: \"kubernetes.io/projected/4e78d959-fe7c-48b9-90b3-7ed41b7a8156-kube-api-access-pfmgj\") pod \"network-check-target-tvpck\" (UID: \"4e78d959-fe7c-48b9-90b3-7ed41b7a8156\") " pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:26:27.963298 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:27.963240 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:26:27.963298 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:27.963259 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:26:27.963298 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:27.963272 2573 projected.go:196] Error preparing data for projected volume kube-api-access-pfmgj for pod openshift-network-diagnostics/network-check-target-tvpck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:26:27.963443 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:27.963328 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e78d959-fe7c-48b9-90b3-7ed41b7a8156-kube-api-access-pfmgj podName:4e78d959-fe7c-48b9-90b3-7ed41b7a8156 nodeName:}" failed. No retries permitted until 2026-06-08 19:26:29.963309557 +0000 UTC m=+6.098765991 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pfmgj" (UniqueName: "kubernetes.io/projected/4e78d959-fe7c-48b9-90b3-7ed41b7a8156-kube-api-access-pfmgj") pod "network-check-target-tvpck" (UID: "4e78d959-fe7c-48b9-90b3-7ed41b7a8156") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:26:27.963750 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:27.963732 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:26:27.963855 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:27.963788 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-original-pull-secret podName:117928d5-6f02-4a5e-b96b-4a2cc6e507eb nodeName:}" failed. No retries permitted until 2026-06-08 19:26:29.963772308 +0000 UTC m=+6.099228746 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-original-pull-secret") pod "global-pull-secret-syncer-tdj7t" (UID: "117928d5-6f02-4a5e-b96b-4a2cc6e507eb") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:26:28.287829 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:28.287696 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 19:21:26 +0000 UTC" deadline="2028-02-06 10:20:09.670171964 +0000 UTC" Jun 08 19:26:28.287829 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:28.287774 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14582h53m41.382402083s" Jun 08 19:26:28.299107 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:28.299081 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:28.299238 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:28.299211 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdj7t" podUID="117928d5-6f02-4a5e-b96b-4a2cc6e507eb" Jun 08 19:26:28.299692 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:28.299672 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:26:28.299842 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:28.299818 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvpck" podUID="4e78d959-fe7c-48b9-90b3-7ed41b7a8156" Jun 08 19:26:28.300134 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:28.300115 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:28.300236 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:28.300214 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ngtn" podUID="9c8290ed-a8c2-4904-a862-a9e41138d285" Jun 08 19:26:28.326454 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:28.326428 2573 generic.go:356] "Generic (PLEG): container finished" podID="f3c8a4b2043ee79cf2ae0fbd916dd875" containerID="97e63dea3b44f427407e2799601c393e3b10871e7d2ed71f851184368343e087" exitCode=0 Jun 08 19:26:28.327267 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:28.327246 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-14.ec2.internal" event={"ID":"f3c8a4b2043ee79cf2ae0fbd916dd875","Type":"ContainerDied","Data":"97e63dea3b44f427407e2799601c393e3b10871e7d2ed71f851184368343e087"} Jun 08 19:26:29.345783 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:29.345100 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-14.ec2.internal" event={"ID":"f3c8a4b2043ee79cf2ae0fbd916dd875","Type":"ContainerStarted","Data":"3f8b69988de8057c6c385ea452856dbaa3ea03b3d6a55db78845ccd4f2655256"} Jun 08 19:26:29.363292 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:29.363231 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-14.ec2.internal" podStartSLOduration=4.363213277 podStartE2EDuration="4.363213277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:26:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:26:29.362393434 +0000 UTC m=+5.497849874" watchObservedRunningTime="2026-06-08 19:26:29.363213277 +0000 UTC m=+5.498669719" Jun 08 19:26:29.880455 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:29.880416 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs\") pod \"network-metrics-daemon-7ngtn\" (UID: \"9c8290ed-a8c2-4904-a862-a9e41138d285\") " pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:29.880630 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:29.880596 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:26:29.880690 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:29.880660 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs podName:9c8290ed-a8c2-4904-a862-a9e41138d285 nodeName:}" failed. No retries permitted until 2026-06-08 19:26:33.880639956 +0000 UTC m=+10.016096377 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs") pod "network-metrics-daemon-7ngtn" (UID: "9c8290ed-a8c2-4904-a862-a9e41138d285") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:26:29.981592 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:29.981544 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfmgj\" (UniqueName: \"kubernetes.io/projected/4e78d959-fe7c-48b9-90b3-7ed41b7a8156-kube-api-access-pfmgj\") pod \"network-check-target-tvpck\" (UID: \"4e78d959-fe7c-48b9-90b3-7ed41b7a8156\") " pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:26:29.981770 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:29.981615 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-original-pull-secret\") pod \"global-pull-secret-syncer-tdj7t\" (UID: \"117928d5-6f02-4a5e-b96b-4a2cc6e507eb\") " pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:29.981866 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:29.981796 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:26:29.981866 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:29.981861 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-original-pull-secret podName:117928d5-6f02-4a5e-b96b-4a2cc6e507eb nodeName:}" failed. No retries permitted until 2026-06-08 19:26:33.981841481 +0000 UTC m=+10.117297904 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-original-pull-secret") pod "global-pull-secret-syncer-tdj7t" (UID: "117928d5-6f02-4a5e-b96b-4a2cc6e507eb") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:26:29.982511 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:29.982311 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:26:29.982511 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:29.982338 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:26:29.982511 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:29.982352 2573 projected.go:196] Error preparing data for projected volume kube-api-access-pfmgj for pod openshift-network-diagnostics/network-check-target-tvpck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:26:29.982511 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:29.982421 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e78d959-fe7c-48b9-90b3-7ed41b7a8156-kube-api-access-pfmgj podName:4e78d959-fe7c-48b9-90b3-7ed41b7a8156 nodeName:}" failed. No retries permitted until 2026-06-08 19:26:33.982385156 +0000 UTC m=+10.117841578 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pfmgj" (UniqueName: "kubernetes.io/projected/4e78d959-fe7c-48b9-90b3-7ed41b7a8156-kube-api-access-pfmgj") pod "network-check-target-tvpck" (UID: "4e78d959-fe7c-48b9-90b3-7ed41b7a8156") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:26:30.299475 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:30.299449 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:26:30.299657 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:30.299572 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvpck" podUID="4e78d959-fe7c-48b9-90b3-7ed41b7a8156" Jun 08 19:26:30.300019 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:30.300000 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:30.300137 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:30.300113 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ngtn" podUID="9c8290ed-a8c2-4904-a862-a9e41138d285" Jun 08 19:26:30.300216 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:30.300190 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:30.300302 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:30.300283 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdj7t" podUID="117928d5-6f02-4a5e-b96b-4a2cc6e507eb" Jun 08 19:26:32.299376 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:32.299339 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:26:32.299864 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:32.299355 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:32.299864 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:32.299475 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvpck" podUID="4e78d959-fe7c-48b9-90b3-7ed41b7a8156" Jun 08 19:26:32.299864 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:32.299575 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ngtn" podUID="9c8290ed-a8c2-4904-a862-a9e41138d285" Jun 08 19:26:32.299864 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:32.299644 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:32.299864 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:32.299769 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdj7t" podUID="117928d5-6f02-4a5e-b96b-4a2cc6e507eb" Jun 08 19:26:33.916777 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:33.916621 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs\") pod \"network-metrics-daemon-7ngtn\" (UID: \"9c8290ed-a8c2-4904-a862-a9e41138d285\") " pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:33.916777 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:33.916770 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:26:33.917468 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:33.916852 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs podName:9c8290ed-a8c2-4904-a862-a9e41138d285 nodeName:}" failed. No retries permitted until 2026-06-08 19:26:41.916829801 +0000 UTC m=+18.052286226 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs") pod "network-metrics-daemon-7ngtn" (UID: "9c8290ed-a8c2-4904-a862-a9e41138d285") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:26:34.018110 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:34.018069 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-original-pull-secret\") pod \"global-pull-secret-syncer-tdj7t\" (UID: \"117928d5-6f02-4a5e-b96b-4a2cc6e507eb\") " pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:34.018393 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:34.018184 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfmgj\" (UniqueName: \"kubernetes.io/projected/4e78d959-fe7c-48b9-90b3-7ed41b7a8156-kube-api-access-pfmgj\") pod \"network-check-target-tvpck\" (UID: \"4e78d959-fe7c-48b9-90b3-7ed41b7a8156\") " pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:26:34.018393 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:34.018378 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:26:34.018512 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:34.018404 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:26:34.018512 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:34.018419 2573 projected.go:196] Error preparing data for projected volume kube-api-access-pfmgj for pod openshift-network-diagnostics/network-check-target-tvpck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:26:34.018512 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:34.018486 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e78d959-fe7c-48b9-90b3-7ed41b7a8156-kube-api-access-pfmgj podName:4e78d959-fe7c-48b9-90b3-7ed41b7a8156 nodeName:}" failed. No retries permitted until 2026-06-08 19:26:42.018464351 +0000 UTC m=+18.153920786 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pfmgj" (UniqueName: "kubernetes.io/projected/4e78d959-fe7c-48b9-90b3-7ed41b7a8156-kube-api-access-pfmgj") pod "network-check-target-tvpck" (UID: "4e78d959-fe7c-48b9-90b3-7ed41b7a8156") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:26:34.018887 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:34.018794 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:26:34.018887 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:34.018858 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-original-pull-secret podName:117928d5-6f02-4a5e-b96b-4a2cc6e507eb nodeName:}" failed. No retries permitted until 2026-06-08 19:26:42.018841146 +0000 UTC m=+18.154297572 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-original-pull-secret") pod "global-pull-secret-syncer-tdj7t" (UID: "117928d5-6f02-4a5e-b96b-4a2cc6e507eb") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:26:34.300880 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:34.300150 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:26:34.300880 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:34.300260 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvpck" podUID="4e78d959-fe7c-48b9-90b3-7ed41b7a8156" Jun 08 19:26:34.300880 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:34.300607 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:34.300880 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:34.300713 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ngtn" podUID="9c8290ed-a8c2-4904-a862-a9e41138d285" Jun 08 19:26:34.300880 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:34.300776 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:34.300880 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:34.300846 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdj7t" podUID="117928d5-6f02-4a5e-b96b-4a2cc6e507eb" Jun 08 19:26:36.299376 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:36.299330 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:36.299376 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:36.299369 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:36.299970 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:36.299330 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:26:36.299970 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:36.299478 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ngtn" podUID="9c8290ed-a8c2-4904-a862-a9e41138d285" Jun 08 19:26:36.299970 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:36.299570 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvpck" podUID="4e78d959-fe7c-48b9-90b3-7ed41b7a8156" Jun 08 19:26:36.299970 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:36.299637 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdj7t" podUID="117928d5-6f02-4a5e-b96b-4a2cc6e507eb" Jun 08 19:26:38.299826 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:38.299791 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:38.300274 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:38.299791 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:26:38.300274 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:38.299943 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ngtn" podUID="9c8290ed-a8c2-4904-a862-a9e41138d285" Jun 08 19:26:38.300274 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:38.299805 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:38.300274 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:38.300019 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvpck" podUID="4e78d959-fe7c-48b9-90b3-7ed41b7a8156" Jun 08 19:26:38.300274 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:38.300081 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdj7t" podUID="117928d5-6f02-4a5e-b96b-4a2cc6e507eb" Jun 08 19:26:40.299694 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:40.299669 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:26:40.299694 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:40.299689 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:40.300225 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:40.299788 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:40.300225 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:40.299801 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvpck" podUID="4e78d959-fe7c-48b9-90b3-7ed41b7a8156" Jun 08 19:26:40.300225 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:40.299940 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ngtn" podUID="9c8290ed-a8c2-4904-a862-a9e41138d285" Jun 08 19:26:40.300225 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:40.300033 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdj7t" podUID="117928d5-6f02-4a5e-b96b-4a2cc6e507eb" Jun 08 19:26:41.978643 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:41.978604 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs\") pod \"network-metrics-daemon-7ngtn\" (UID: \"9c8290ed-a8c2-4904-a862-a9e41138d285\") " pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:41.979070 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:41.978758 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:26:41.979070 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:41.978833 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs podName:9c8290ed-a8c2-4904-a862-a9e41138d285 nodeName:}" failed. No retries permitted until 2026-06-08 19:26:57.97881125 +0000 UTC m=+34.114267684 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs") pod "network-metrics-daemon-7ngtn" (UID: "9c8290ed-a8c2-4904-a862-a9e41138d285") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:26:42.079818 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:42.079778 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfmgj\" (UniqueName: \"kubernetes.io/projected/4e78d959-fe7c-48b9-90b3-7ed41b7a8156-kube-api-access-pfmgj\") pod \"network-check-target-tvpck\" (UID: \"4e78d959-fe7c-48b9-90b3-7ed41b7a8156\") " pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:26:42.080008 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:42.079957 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-original-pull-secret\") pod \"global-pull-secret-syncer-tdj7t\" (UID: \"117928d5-6f02-4a5e-b96b-4a2cc6e507eb\") " pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:42.080075 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:42.079967 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:26:42.080075 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:42.080049 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:26:42.080075 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:42.080061 2573 projected.go:196] Error preparing data for projected volume kube-api-access-pfmgj for pod openshift-network-diagnostics/network-check-target-tvpck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:26:42.080182 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:42.080108 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e78d959-fe7c-48b9-90b3-7ed41b7a8156-kube-api-access-pfmgj podName:4e78d959-fe7c-48b9-90b3-7ed41b7a8156 nodeName:}" failed. No retries permitted until 2026-06-08 19:26:58.080094969 +0000 UTC m=+34.215551388 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pfmgj" (UniqueName: "kubernetes.io/projected/4e78d959-fe7c-48b9-90b3-7ed41b7a8156-kube-api-access-pfmgj") pod "network-check-target-tvpck" (UID: "4e78d959-fe7c-48b9-90b3-7ed41b7a8156") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:26:42.080182 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:42.080025 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:26:42.080270 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:42.080215 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-original-pull-secret podName:117928d5-6f02-4a5e-b96b-4a2cc6e507eb nodeName:}" failed. No retries permitted until 2026-06-08 19:26:58.080193686 +0000 UTC m=+34.215650119 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-original-pull-secret") pod "global-pull-secret-syncer-tdj7t" (UID: "117928d5-6f02-4a5e-b96b-4a2cc6e507eb") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:26:42.299687 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:42.299654 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:26:42.299870 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:42.299654 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:42.299870 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:42.299800 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvpck" podUID="4e78d959-fe7c-48b9-90b3-7ed41b7a8156" Jun 08 19:26:42.299870 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:42.299862 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdj7t" podUID="117928d5-6f02-4a5e-b96b-4a2cc6e507eb" Jun 08 19:26:42.300029 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:42.299654 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:42.300029 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:42.299967 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ngtn" podUID="9c8290ed-a8c2-4904-a862-a9e41138d285" Jun 08 19:26:44.300730 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:44.300681 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:26:44.301180 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:44.300803 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvpck" podUID="4e78d959-fe7c-48b9-90b3-7ed41b7a8156" Jun 08 19:26:44.301180 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:44.300847 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:44.301180 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:44.300941 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:44.301180 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:44.301068 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ngtn" podUID="9c8290ed-a8c2-4904-a862-a9e41138d285" Jun 08 19:26:44.301180 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:44.301159 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdj7t" podUID="117928d5-6f02-4a5e-b96b-4a2cc6e507eb" Jun 08 19:26:46.299767 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:46.299739 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:46.300398 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:46.299739 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:26:46.300398 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:46.299742 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:46.300398 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:46.299933 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvpck" podUID="4e78d959-fe7c-48b9-90b3-7ed41b7a8156" Jun 08 19:26:46.300398 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:46.300006 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ngtn" podUID="9c8290ed-a8c2-4904-a862-a9e41138d285" Jun 08 19:26:46.300398 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:46.299836 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdj7t" podUID="117928d5-6f02-4a5e-b96b-4a2cc6e507eb" Jun 08 19:26:46.379713 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:46.379641 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" event={"ID":"95410e6e-a4fd-4f1e-9f31-588b8dc50a78","Type":"ContainerStarted","Data":"0058a5efcefea1ca79a1020c99a62ee8e99d4e85013efb43eb11e92b861d2fc3"} Jun 08 19:26:46.379863 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:46.379751 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" event={"ID":"95410e6e-a4fd-4f1e-9f31-588b8dc50a78","Type":"ContainerStarted","Data":"c93afe9ae528bbc3f39454cb5ab41fc65e77a24eb9882a10a91abc31d1e57318"} Jun 08 19:26:46.379863 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:46.379804 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" event={"ID":"95410e6e-a4fd-4f1e-9f31-588b8dc50a78","Type":"ContainerStarted","Data":"c6cba1fb872d7b7efdbb54e7c3dd109b4d674fe659962c1467c578cf1ed2b300"} Jun 08 19:26:46.379863 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:46.379848 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" event={"ID":"95410e6e-a4fd-4f1e-9f31-588b8dc50a78","Type":"ContainerStarted","Data":"c6fc00f02575d0c0e15af8ca6fca6bc30a064af3e3390cf900068c61b62e1902"} Jun 08 19:26:46.380022 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:46.379891 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" event={"ID":"95410e6e-a4fd-4f1e-9f31-588b8dc50a78","Type":"ContainerStarted","Data":"78725121086e1351ad6166798dd68d36740a1ab991ca8f8c3b281ebacabd8056"} Jun 08 19:26:46.380022 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:46.379939 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" event={"ID":"95410e6e-a4fd-4f1e-9f31-588b8dc50a78","Type":"ContainerStarted","Data":"1b6ab9751dac4a1088a2cacf309f0f4cb2b2cebe3679321d02db2830b73771f1"} Jun 08 19:26:46.381528 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:46.381493 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hksvz" event={"ID":"d3b4d7f8-d49b-492b-bedc-42bbae4ee126","Type":"ContainerStarted","Data":"3f0aef3d8f8f607bdd5550bca54f7a0dc4910fbc2ccef6a72ef2166a335dc024"} Jun 08 19:26:46.383272 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:46.383248 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lvnmk" event={"ID":"529224c9-b129-4c0b-baf2-096ad4106daa","Type":"ContainerStarted","Data":"769184912b9422ad2712e5ef588622b084761a4ff5d06a156867127852b8610a"} Jun 08 19:26:46.384867 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:46.384840 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mckqj" event={"ID":"26f426a9-91e2-47d1-adc2-fa6a36f8ced0","Type":"ContainerStarted","Data":"a0c4403a98a485c92f931aa1d44e2f060c107c171b8c5571276c28a23cb588b1"} Jun 08 19:26:46.386446 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:46.386422 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" event={"ID":"adfef4fa-95ab-4a43-8b80-2dc9326968de","Type":"ContainerStarted","Data":"85f3d787642559d9275ddb41fe445ff78a15bb1a71155c5afd32c31df23df26a"} Jun 08 19:26:46.387980 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:46.387955 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mv9h2" event={"ID":"4d52db18-8dbf-4de9-9d50-1020690ab64a","Type":"ContainerStarted","Data":"221e1e8aaeb374ea4b4778ab98773169cdbafef5b4bd5a604d14d824727271f1"} Jun 08 19:26:46.389756 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:46.389713 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mr75f" event={"ID":"39058fb2-35ae-4f7e-bdb6-8c306fd3f81a","Type":"ContainerStarted","Data":"d3de349ebff9f540509ff9df3b507ad8adab764fbdf3d6241fe14d18795f73db"} Jun 08 19:26:46.391305 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:46.391281 2573 generic.go:356] "Generic (PLEG): container finished" podID="96ef3189-8e53-416d-8fbb-684d16eedfb8" containerID="9d3981edd44f26247a70122bfe834d474ffee7a1653389dda23a666498632afe" exitCode=0 Jun 08 19:26:46.391394 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:46.391315 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xcr5w" event={"ID":"96ef3189-8e53-416d-8fbb-684d16eedfb8","Type":"ContainerDied","Data":"9d3981edd44f26247a70122bfe834d474ffee7a1653389dda23a666498632afe"} Jun 08 19:26:46.409497 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:46.409450 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hksvz" podStartSLOduration=3.771078744 podStartE2EDuration="22.409439295s" totalImagesPullingTime="18.638360551s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:26:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:26:46.409312199 +0000 UTC m=+22.544768641" watchObservedRunningTime="2026-06-08 19:26:46.409439295 +0000 UTC m=+22.544895735" Jun 08 19:26:46.432042 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:46.431998 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mr75f" podStartSLOduration=3.747551226 podStartE2EDuration="22.4319805s" totalImagesPullingTime="18.684429274s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:26:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:26:46.43149382 +0000 UTC m=+22.566950258" watchObservedRunningTime="2026-06-08 19:26:46.4319805 +0000 UTC m=+22.567436943" Jun 08 19:26:46.479381 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:46.479334 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mv9h2" podStartSLOduration=3.836714304 podStartE2EDuration="22.479316802s" totalImagesPullingTime="18.642602498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:26:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:26:46.454994304 +0000 UTC m=+22.590450745" watchObservedRunningTime="2026-06-08 19:26:46.479316802 +0000 UTC m=+22.614773244" Jun 08 19:26:46.515687 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:46.515627 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mckqj" podStartSLOduration=12.382638989 podStartE2EDuration="22.515608196s" totalImagesPullingTime="10.132969207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:26:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:26:46.47927078 +0000 UTC m=+22.614727222" watchObservedRunningTime="2026-06-08 19:26:46.515608196 +0000 UTC m=+22.651064641" Jun 08 19:26:46.545384 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:46.545345 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lvnmk" podStartSLOduration=3.908290706 podStartE2EDuration="22.545332852s" totalImagesPullingTime="18.637042146s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:26:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:26:46.5453125 +0000 UTC m=+22.680768940" watchObservedRunningTime="2026-06-08 19:26:46.545332852 +0000 UTC m=+22.680789292" Jun 08 19:26:46.552353 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:46.552330 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:26:46.638062 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:46.637992 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:26:46.742802 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:46.742769 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:26:46.802021 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:46.801998 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 19:26:47.301600 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:47.301517 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T19:26:46.802016157Z","UUID":"ae954254-e37e-49b0-821d-98e6ffafeea5","Handler":null,"Name":"","Endpoint":""} Jun 08 19:26:47.303273 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:47.303254 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 19:26:47.303400 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:47.303296 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 19:26:47.396322 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:47.396287 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" event={"ID":"adfef4fa-95ab-4a43-8b80-2dc9326968de","Type":"ContainerStarted","Data":"a2aa3c95134118fed7a4cb0c547d4af027d086b93020d6b7b4ab2c4c0aa74091"} Jun 08 19:26:47.398165 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:47.398135 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x45p2" event={"ID":"b654dba0-02ff-4e38-bf5f-643f7a958123","Type":"ContainerStarted","Data":"942dc3b0af688d1614c462c4f4510fd1d5265fcfb26a29d748cfc829f71c5bd8"} Jun 08 19:26:47.430543 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:47.430496 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x45p2" podStartSLOduration=4.789102569 podStartE2EDuration="23.43048202s" totalImagesPullingTime="18.641379451s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:26:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:26:47.43000584 +0000 UTC m=+23.565462282" watchObservedRunningTime="2026-06-08 19:26:47.43048202 +0000 UTC m=+23.565938498" Jun 08 19:26:47.685230 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:47.685199 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:26:47.786145 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:47.786115 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:26:48.299929 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:48.299895 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:48.300090 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:48.299895 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:48.300090 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:48.300048 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ngtn" podUID="9c8290ed-a8c2-4904-a862-a9e41138d285" Jun 08 19:26:48.300222 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:48.299895 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:26:48.300222 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:48.300119 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdj7t" podUID="117928d5-6f02-4a5e-b96b-4a2cc6e507eb" Jun 08 19:26:48.300222 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:48.300193 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvpck" podUID="4e78d959-fe7c-48b9-90b3-7ed41b7a8156" Jun 08 19:26:48.405567 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:48.405514 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" event={"ID":"adfef4fa-95ab-4a43-8b80-2dc9326968de","Type":"ContainerStarted","Data":"5fd736454f9a69b2a5544bb019249463262e8edf454f37422c726144955a6b1f"} Jun 08 19:26:48.426269 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:48.426222 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8g6p" podStartSLOduration=4.224742106 podStartE2EDuration="24.426204454s" totalImagesPullingTime="20.201462348s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:26:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:26:48.42563145 +0000 UTC m=+24.561087890" watchObservedRunningTime="2026-06-08 19:26:48.426204454 +0000 UTC m=+24.561660894" Jun 08 19:26:48.632080 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:48.632002 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mckqj" Jun 08 19:26:48.632657 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:48.632638 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mckqj" Jun 08 19:26:49.411740 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:49.411694 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" event={"ID":"95410e6e-a4fd-4f1e-9f31-588b8dc50a78","Type":"ContainerStarted","Data":"4b6e2f988fdc67a21397db4dbd1eeb5424f0c201f04548c9183ac7a8c24d26c6"} Jun 08 19:26:49.412222 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:49.412113 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mckqj" Jun 08 19:26:49.412586 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:49.412567 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mckqj" Jun 08 19:26:49.548577 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:49.548342 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:26:50.299465 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:50.299432 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:50.299651 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:50.299433 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:26:50.299651 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:50.299572 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ngtn" podUID="9c8290ed-a8c2-4904-a862-a9e41138d285" Jun 08 19:26:50.299651 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:50.299621 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:50.299879 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:50.299763 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvpck" podUID="4e78d959-fe7c-48b9-90b3-7ed41b7a8156" Jun 08 19:26:50.299879 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:50.299853 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdj7t" podUID="117928d5-6f02-4a5e-b96b-4a2cc6e507eb" Jun 08 19:26:51.418794 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:51.418554 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" event={"ID":"95410e6e-a4fd-4f1e-9f31-588b8dc50a78","Type":"ContainerStarted","Data":"50539a40094e8a306ee336268d818a135b1bb00a82d103d0dbde6db066a61a4f"} Jun 08 19:26:51.419600 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:51.418879 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:51.419600 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:51.418915 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:51.420361 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:51.420336 2573 generic.go:356] "Generic (PLEG): container finished" podID="96ef3189-8e53-416d-8fbb-684d16eedfb8" containerID="a10345bd544e063758c7023dea228a3c0be1ff0efdf86cad2c8d973ecef9e4bd" exitCode=0 Jun 08 19:26:51.420420 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:51.420387 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xcr5w" event={"ID":"96ef3189-8e53-416d-8fbb-684d16eedfb8","Type":"ContainerDied","Data":"a10345bd544e063758c7023dea228a3c0be1ff0efdf86cad2c8d973ecef9e4bd"} Jun 08 19:26:51.434018 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:51.433997 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:51.450271 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:51.450229 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" podStartSLOduration=8.738422451 podStartE2EDuration="27.450217208s" totalImagesPullingTime="18.711794757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:26:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:26:51.449632857 +0000 UTC m=+27.585089301" watchObservedRunningTime="2026-06-08 19:26:51.450217208 +0000 UTC m=+27.585673649" Jun 08 19:26:52.299253 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:52.299226 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:52.299411 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:52.299227 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:52.299411 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:52.299368 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:26:52.299496 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:52.299423 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdj7t" podUID="117928d5-6f02-4a5e-b96b-4a2cc6e507eb" Jun 08 19:26:52.299496 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:52.299337 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ngtn" podUID="9c8290ed-a8c2-4904-a862-a9e41138d285" Jun 08 19:26:52.299496 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:52.299485 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvpck" podUID="4e78d959-fe7c-48b9-90b3-7ed41b7a8156" Jun 08 19:26:52.422584 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:52.422559 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:52.437232 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:52.437203 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:26:52.871373 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:52.871283 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tdj7t"] Jun 08 19:26:52.871526 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:52.871420 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:52.871587 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:52.871524 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdj7t" podUID="117928d5-6f02-4a5e-b96b-4a2cc6e507eb" Jun 08 19:26:52.871995 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:52.871973 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tvpck"] Jun 08 19:26:52.872084 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:52.872057 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:26:52.872136 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:52.872122 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvpck" podUID="4e78d959-fe7c-48b9-90b3-7ed41b7a8156" Jun 08 19:26:52.874110 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:52.874079 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7ngtn"] Jun 08 19:26:52.874210 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:52.874179 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:52.874298 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:52.874281 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ngtn" podUID="9c8290ed-a8c2-4904-a862-a9e41138d285" Jun 08 19:26:53.426572 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:53.426542 2573 generic.go:356] "Generic (PLEG): container finished" podID="96ef3189-8e53-416d-8fbb-684d16eedfb8" containerID="ad43f5744d4254aedacb8cc6c701366948f5f86b8f7f4b32ddf17f91db1547a5" exitCode=0 Jun 08 19:26:53.426964 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:53.426602 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xcr5w" event={"ID":"96ef3189-8e53-416d-8fbb-684d16eedfb8","Type":"ContainerDied","Data":"ad43f5744d4254aedacb8cc6c701366948f5f86b8f7f4b32ddf17f91db1547a5"} Jun 08 19:26:54.299905 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:54.299869 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:26:54.300079 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:54.299962 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvpck" podUID="4e78d959-fe7c-48b9-90b3-7ed41b7a8156" Jun 08 19:26:54.300079 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:54.300009 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:54.300188 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:54.300114 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ngtn" podUID="9c8290ed-a8c2-4904-a862-a9e41138d285" Jun 08 19:26:54.823555 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:54.823351 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:26:54.932959 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:54.932907 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:26:55.030862 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:55.030833 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:26:55.299213 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:55.299195 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:55.299345 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:55.299287 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdj7t" podUID="117928d5-6f02-4a5e-b96b-4a2cc6e507eb" Jun 08 19:26:55.432227 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:55.432197 2573 generic.go:356] "Generic (PLEG): container finished" podID="96ef3189-8e53-416d-8fbb-684d16eedfb8" containerID="17dd3327ead4be7c0467c36c8bcbd6e91d77692ec752dd94c68ffa2568e7e8ee" exitCode=0 Jun 08 19:26:55.432364 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:55.432234 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xcr5w" event={"ID":"96ef3189-8e53-416d-8fbb-684d16eedfb8","Type":"ContainerDied","Data":"17dd3327ead4be7c0467c36c8bcbd6e91d77692ec752dd94c68ffa2568e7e8ee"} Jun 08 19:26:55.720596 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:55.720523 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:26:55.831123 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:55.831092 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:26:56.299964 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:56.299932 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:26:56.299964 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:56.299950 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:56.300186 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:56.300064 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvpck" podUID="4e78d959-fe7c-48b9-90b3-7ed41b7a8156" Jun 08 19:26:56.300259 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:56.300189 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ngtn" podUID="9c8290ed-a8c2-4904-a862-a9e41138d285" Jun 08 19:26:56.699807 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:56.699768 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:26:57.299975 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:57.299942 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:57.300626 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:57.300068 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdj7t" podUID="117928d5-6f02-4a5e-b96b-4a2cc6e507eb" Jun 08 19:26:57.996232 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:57.996194 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs\") pod \"network-metrics-daemon-7ngtn\" (UID: \"9c8290ed-a8c2-4904-a862-a9e41138d285\") " pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:57.996414 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:57.996321 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:26:57.996414 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:57.996379 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs podName:9c8290ed-a8c2-4904-a862-a9e41138d285 nodeName:}" failed. No retries permitted until 2026-06-08 19:27:29.996364513 +0000 UTC m=+66.131820932 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs") pod "network-metrics-daemon-7ngtn" (UID: "9c8290ed-a8c2-4904-a862-a9e41138d285") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:26:58.097144 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:58.097112 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-original-pull-secret\") pod \"global-pull-secret-syncer-tdj7t\" (UID: \"117928d5-6f02-4a5e-b96b-4a2cc6e507eb\") " pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:58.097305 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:58.097181 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfmgj\" (UniqueName: \"kubernetes.io/projected/4e78d959-fe7c-48b9-90b3-7ed41b7a8156-kube-api-access-pfmgj\") pod \"network-check-target-tvpck\" (UID: \"4e78d959-fe7c-48b9-90b3-7ed41b7a8156\") " pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:26:58.097305 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:58.097252 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:26:58.097395 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:58.097313 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-original-pull-secret podName:117928d5-6f02-4a5e-b96b-4a2cc6e507eb nodeName:}" failed. No retries permitted until 2026-06-08 19:27:30.097297647 +0000 UTC m=+66.232754066 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-original-pull-secret") pod "global-pull-secret-syncer-tdj7t" (UID: "117928d5-6f02-4a5e-b96b-4a2cc6e507eb") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:26:58.097395 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:58.097319 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:26:58.097395 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:58.097339 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:26:58.097395 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:58.097352 2573 projected.go:196] Error preparing data for projected volume kube-api-access-pfmgj for pod openshift-network-diagnostics/network-check-target-tvpck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:26:58.097563 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:58.097407 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e78d959-fe7c-48b9-90b3-7ed41b7a8156-kube-api-access-pfmgj podName:4e78d959-fe7c-48b9-90b3-7ed41b7a8156 nodeName:}" failed. No retries permitted until 2026-06-08 19:27:30.09739106 +0000 UTC m=+66.232847483 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pfmgj" (UniqueName: "kubernetes.io/projected/4e78d959-fe7c-48b9-90b3-7ed41b7a8156-kube-api-access-pfmgj") pod "network-check-target-tvpck" (UID: "4e78d959-fe7c-48b9-90b3-7ed41b7a8156") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:26:58.299524 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:58.299496 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:26:58.299695 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:58.299634 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvpck" podUID="4e78d959-fe7c-48b9-90b3-7ed41b7a8156" Jun 08 19:26:58.299695 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:58.299664 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:26:58.299832 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:58.299796 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ngtn" podUID="9c8290ed-a8c2-4904-a862-a9e41138d285" Jun 08 19:26:58.671114 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:58.671085 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-14.ec2.internal" event="NodeReady" Jun 08 19:26:58.671607 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:58.671245 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 19:26:58.741653 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:58.741628 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b5k6w"] Jun 08 19:26:58.767898 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:58.767876 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vjzfq"] Jun 08 19:26:58.768054 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:58.768003 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b5k6w" Jun 08 19:26:58.776984 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:58.776956 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2qd47\"" Jun 08 19:26:58.778760 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:58.778736 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 19:26:58.778998 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:58.778978 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 19:26:58.789706 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:58.789683 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b5k6w"] Jun 08 19:26:58.789833 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:58.789741 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vjzfq"] Jun 08 19:26:58.789833 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:58.789827 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vjzfq" Jun 08 19:26:58.799125 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:58.799098 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 19:26:58.799218 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:58.799176 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fjjgf\"" Jun 08 19:26:58.799301 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:58.799282 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 19:26:58.799568 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:58.799544 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 19:26:58.903884 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:58.903855 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-config-volume\") pod \"dns-default-b5k6w\" (UID: \"d95c391c-ac01-42cf-ad49-7a5e0653ecd9\") " pod="openshift-dns/dns-default-b5k6w" Jun 08 19:26:58.904049 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:58.903895 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-tmp-dir\") pod \"dns-default-b5k6w\" (UID: \"d95c391c-ac01-42cf-ad49-7a5e0653ecd9\") " pod="openshift-dns/dns-default-b5k6w" Jun 08 19:26:58.904049 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:58.903928 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgq2m\" (UniqueName: \"kubernetes.io/projected/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-kube-api-access-pgq2m\") pod \"dns-default-b5k6w\" (UID: \"d95c391c-ac01-42cf-ad49-7a5e0653ecd9\") " pod="openshift-dns/dns-default-b5k6w" Jun 08 19:26:58.904049 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:58.904018 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xw76\" (UniqueName: \"kubernetes.io/projected/dbf38036-cdd0-4181-9967-bdbbf4d67a1e-kube-api-access-4xw76\") pod \"ingress-canary-vjzfq\" (UID: \"dbf38036-cdd0-4181-9967-bdbbf4d67a1e\") " pod="openshift-ingress-canary/ingress-canary-vjzfq" Jun 08 19:26:58.904226 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:58.904056 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbf38036-cdd0-4181-9967-bdbbf4d67a1e-cert\") pod \"ingress-canary-vjzfq\" (UID: \"dbf38036-cdd0-4181-9967-bdbbf4d67a1e\") " pod="openshift-ingress-canary/ingress-canary-vjzfq" Jun 08 19:26:58.904226 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:58.904121 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls\") pod \"dns-default-b5k6w\" (UID: \"d95c391c-ac01-42cf-ad49-7a5e0653ecd9\") " pod="openshift-dns/dns-default-b5k6w" Jun 08 19:26:59.004811 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:59.004734 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls\") pod \"dns-default-b5k6w\" (UID: \"d95c391c-ac01-42cf-ad49-7a5e0653ecd9\") " pod="openshift-dns/dns-default-b5k6w" Jun 08 19:26:59.004811 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:59.004786 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-config-volume\") pod \"dns-default-b5k6w\" (UID: \"d95c391c-ac01-42cf-ad49-7a5e0653ecd9\") " pod="openshift-dns/dns-default-b5k6w" Jun 08 19:26:59.004811 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:59.004807 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-tmp-dir\") pod \"dns-default-b5k6w\" (UID: \"d95c391c-ac01-42cf-ad49-7a5e0653ecd9\") " pod="openshift-dns/dns-default-b5k6w" Jun 08 19:26:59.005056 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:59.004839 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgq2m\" (UniqueName: \"kubernetes.io/projected/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-kube-api-access-pgq2m\") pod \"dns-default-b5k6w\" (UID: \"d95c391c-ac01-42cf-ad49-7a5e0653ecd9\") " pod="openshift-dns/dns-default-b5k6w" Jun 08 19:26:59.005056 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:59.004884 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xw76\" (UniqueName: \"kubernetes.io/projected/dbf38036-cdd0-4181-9967-bdbbf4d67a1e-kube-api-access-4xw76\") pod \"ingress-canary-vjzfq\" (UID: \"dbf38036-cdd0-4181-9967-bdbbf4d67a1e\") " pod="openshift-ingress-canary/ingress-canary-vjzfq" Jun 08 19:26:59.005056 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:59.004903 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:26:59.005056 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:59.004912 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbf38036-cdd0-4181-9967-bdbbf4d67a1e-cert\") pod \"ingress-canary-vjzfq\" (UID: \"dbf38036-cdd0-4181-9967-bdbbf4d67a1e\") " pod="openshift-ingress-canary/ingress-canary-vjzfq" Jun 08 19:26:59.005056 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:59.004984 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls podName:d95c391c-ac01-42cf-ad49-7a5e0653ecd9 nodeName:}" failed. No retries permitted until 2026-06-08 19:26:59.504963017 +0000 UTC m=+35.640419459 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls") pod "dns-default-b5k6w" (UID: "d95c391c-ac01-42cf-ad49-7a5e0653ecd9") : secret "dns-default-metrics-tls" not found Jun 08 19:26:59.005290 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:59.005192 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-tmp-dir\") pod \"dns-default-b5k6w\" (UID: \"d95c391c-ac01-42cf-ad49-7a5e0653ecd9\") " pod="openshift-dns/dns-default-b5k6w" Jun 08 19:26:59.005395 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:59.005379 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-config-volume\") pod \"dns-default-b5k6w\" (UID: \"d95c391c-ac01-42cf-ad49-7a5e0653ecd9\") " pod="openshift-dns/dns-default-b5k6w" Jun 08 19:26:59.009524 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:59.009498 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbf38036-cdd0-4181-9967-bdbbf4d67a1e-cert\") pod \"ingress-canary-vjzfq\" (UID: \"dbf38036-cdd0-4181-9967-bdbbf4d67a1e\") " pod="openshift-ingress-canary/ingress-canary-vjzfq" Jun 08 19:26:59.023973 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:59.023950 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xw76\" (UniqueName: \"kubernetes.io/projected/dbf38036-cdd0-4181-9967-bdbbf4d67a1e-kube-api-access-4xw76\") pod \"ingress-canary-vjzfq\" (UID: \"dbf38036-cdd0-4181-9967-bdbbf4d67a1e\") " pod="openshift-ingress-canary/ingress-canary-vjzfq" Jun 08 19:26:59.024831 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:59.024802 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:26:59.027511 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:59.027492 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgq2m\" (UniqueName: \"kubernetes.io/projected/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-kube-api-access-pgq2m\") pod \"dns-default-b5k6w\" (UID: \"d95c391c-ac01-42cf-ad49-7a5e0653ecd9\") " pod="openshift-dns/dns-default-b5k6w" Jun 08 19:26:59.098787 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:59.098758 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vjzfq" Jun 08 19:26:59.141422 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:59.141389 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:26:59.300102 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:59.300069 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:26:59.303207 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:59.303184 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 19:26:59.508601 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:26:59.508568 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls\") pod \"dns-default-b5k6w\" (UID: \"d95c391c-ac01-42cf-ad49-7a5e0653ecd9\") " pod="openshift-dns/dns-default-b5k6w" Jun 08 19:26:59.508793 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:59.508759 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:26:59.508869 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:26:59.508830 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls podName:d95c391c-ac01-42cf-ad49-7a5e0653ecd9 nodeName:}" failed. No retries permitted until 2026-06-08 19:27:00.508809426 +0000 UTC m=+36.644265847 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls") pod "dns-default-b5k6w" (UID: "d95c391c-ac01-42cf-ad49-7a5e0653ecd9") : secret "dns-default-metrics-tls" not found Jun 08 19:27:00.171220 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:00.170990 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vjzfq"] Jun 08 19:27:00.272442 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:27:00.272408 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbf38036_cdd0_4181_9967_bdbbf4d67a1e.slice/crio-bd63c8c1cc5d707bd4e656575424ea8f7aead505e0ad01f28bc9f4a1e99793c2 WatchSource:0}: Error finding container bd63c8c1cc5d707bd4e656575424ea8f7aead505e0ad01f28bc9f4a1e99793c2: Status 404 returned error can't find the container with id bd63c8c1cc5d707bd4e656575424ea8f7aead505e0ad01f28bc9f4a1e99793c2 Jun 08 19:27:00.299239 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:00.299218 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:27:00.299411 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:00.299389 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:27:00.302650 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:00.302631 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 19:27:00.302650 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:00.302647 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9vt4h\"" Jun 08 19:27:00.303771 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:00.303755 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 19:27:00.303884 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:00.303782 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 19:27:00.303984 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:00.303968 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b4x6n\"" Jun 08 19:27:00.444855 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:00.444832 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vjzfq" event={"ID":"dbf38036-cdd0-4181-9967-bdbbf4d67a1e","Type":"ContainerStarted","Data":"bd63c8c1cc5d707bd4e656575424ea8f7aead505e0ad01f28bc9f4a1e99793c2"} Jun 08 19:27:00.447783 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:00.447761 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xcr5w" event={"ID":"96ef3189-8e53-416d-8fbb-684d16eedfb8","Type":"ContainerStarted","Data":"57ea0f56d0e96bf125c2ade478334263d091c28eff13bb4ac9343bf383664a52"} Jun 08 19:27:00.515397 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:00.515372 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls\") pod \"dns-default-b5k6w\" (UID: \"d95c391c-ac01-42cf-ad49-7a5e0653ecd9\") " pod="openshift-dns/dns-default-b5k6w" Jun 08 19:27:00.515538 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:27:00.515520 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:27:00.515590 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:27:00.515581 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls podName:d95c391c-ac01-42cf-ad49-7a5e0653ecd9 nodeName:}" failed. No retries permitted until 2026-06-08 19:27:02.515566408 +0000 UTC m=+38.651022827 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls") pod "dns-default-b5k6w" (UID: "d95c391c-ac01-42cf-ad49-7a5e0653ecd9") : secret "dns-default-metrics-tls" not found Jun 08 19:27:01.453512 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:01.453479 2573 generic.go:356] "Generic (PLEG): container finished" podID="96ef3189-8e53-416d-8fbb-684d16eedfb8" containerID="57ea0f56d0e96bf125c2ade478334263d091c28eff13bb4ac9343bf383664a52" exitCode=0 Jun 08 19:27:01.453996 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:01.453546 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xcr5w" event={"ID":"96ef3189-8e53-416d-8fbb-684d16eedfb8","Type":"ContainerDied","Data":"57ea0f56d0e96bf125c2ade478334263d091c28eff13bb4ac9343bf383664a52"} Jun 08 19:27:02.458386 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:02.458355 2573 generic.go:356] "Generic (PLEG): container finished" podID="96ef3189-8e53-416d-8fbb-684d16eedfb8" containerID="b8f1cb0079a69dbbf2d63abc718cf560a54bc05c941f5705feed095de9995564" exitCode=0 Jun 08 19:27:02.458699 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:02.458396 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xcr5w" event={"ID":"96ef3189-8e53-416d-8fbb-684d16eedfb8","Type":"ContainerDied","Data":"b8f1cb0079a69dbbf2d63abc718cf560a54bc05c941f5705feed095de9995564"} Jun 08 19:27:02.531976 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:02.531947 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls\") pod \"dns-default-b5k6w\" (UID: \"d95c391c-ac01-42cf-ad49-7a5e0653ecd9\") " pod="openshift-dns/dns-default-b5k6w" Jun 08 19:27:02.532106 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:27:02.532088 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:27:02.532167 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:27:02.532157 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls podName:d95c391c-ac01-42cf-ad49-7a5e0653ecd9 nodeName:}" failed. No retries permitted until 2026-06-08 19:27:06.532141752 +0000 UTC m=+42.667598170 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls") pod "dns-default-b5k6w" (UID: "d95c391c-ac01-42cf-ad49-7a5e0653ecd9") : secret "dns-default-metrics-tls" not found Jun 08 19:27:03.464554 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:03.464373 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xcr5w" event={"ID":"96ef3189-8e53-416d-8fbb-684d16eedfb8","Type":"ContainerStarted","Data":"aab7084b6f41a116b48335897a793f618664199b6e1494c86fdeb4fd068f6087"} Jun 08 19:27:03.465895 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:03.465862 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vjzfq" event={"ID":"dbf38036-cdd0-4181-9967-bdbbf4d67a1e","Type":"ContainerStarted","Data":"092efbfba49a779e2d0929084851dc83c939788a5f219600bb8ac4295aa56825"} Jun 08 19:27:03.494827 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:03.494781 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xcr5w" podStartSLOduration=9.549398189 podStartE2EDuration="39.494769607s" totalImagesPullingTime="29.945371418s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:26:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:27:03.493150269 +0000 UTC m=+39.628606721" watchObservedRunningTime="2026-06-08 19:27:03.494769607 +0000 UTC m=+39.630226047" Jun 08 19:27:03.517156 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:03.517113 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vjzfq" podStartSLOduration=3.2260599660000002 podStartE2EDuration="5.517097634s" totalImagesPullingTime="2.291037668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:26:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:27:03.514835959 +0000 UTC m=+39.650292400" watchObservedRunningTime="2026-06-08 19:27:03.517097634 +0000 UTC m=+39.652554075" Jun 08 19:27:03.641061 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:03.641030 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:27:03.748186 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:03.748129 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:27:04.132325 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:04.132297 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:27:04.238167 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:04.238136 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:27:06.532884 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:06.532809 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:27:06.561735 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:06.561689 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls\") pod \"dns-default-b5k6w\" (UID: \"d95c391c-ac01-42cf-ad49-7a5e0653ecd9\") " pod="openshift-dns/dns-default-b5k6w" Jun 08 19:27:06.561863 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:27:06.561805 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:27:06.561863 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:27:06.561852 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls podName:d95c391c-ac01-42cf-ad49-7a5e0653ecd9 nodeName:}" failed. No retries permitted until 2026-06-08 19:27:14.561840398 +0000 UTC m=+50.697296817 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls") pod "dns-default-b5k6w" (UID: "d95c391c-ac01-42cf-ad49-7a5e0653ecd9") : secret "dns-default-metrics-tls" not found Jun 08 19:27:06.622511 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:06.622472 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:27:10.807373 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:10.807337 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:27:10.892016 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:10.891987 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:27:10.975824 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:10.975792 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:27:11.896973 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:11.896940 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:27:12.001251 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:12.001216 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:27:14.619955 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:14.619916 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls\") pod \"dns-default-b5k6w\" (UID: \"d95c391c-ac01-42cf-ad49-7a5e0653ecd9\") " pod="openshift-dns/dns-default-b5k6w" Jun 08 19:27:14.620414 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:27:14.620038 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:27:14.620414 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:27:14.620092 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls podName:d95c391c-ac01-42cf-ad49-7a5e0653ecd9 nodeName:}" failed. No retries permitted until 2026-06-08 19:27:30.620077176 +0000 UTC m=+66.755533596 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls") pod "dns-default-b5k6w" (UID: "d95c391c-ac01-42cf-ad49-7a5e0653ecd9") : secret "dns-default-metrics-tls" not found Jun 08 19:27:24.438050 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:24.438026 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ghdr2" Jun 08 19:27:24.691223 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:24.691128 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:27:24.798267 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:24.798236 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:27:30.025012 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:30.024959 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs\") pod \"network-metrics-daemon-7ngtn\" (UID: \"9c8290ed-a8c2-4904-a862-a9e41138d285\") " pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:27:30.027805 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:30.027787 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 19:27:30.036135 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:27:30.036117 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 19:27:30.036196 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:27:30.036187 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs podName:9c8290ed-a8c2-4904-a862-a9e41138d285 nodeName:}" failed. No retries permitted until 2026-06-08 19:28:34.036169982 +0000 UTC m=+130.171626401 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs") pod "network-metrics-daemon-7ngtn" (UID: "9c8290ed-a8c2-4904-a862-a9e41138d285") : secret "metrics-daemon-secret" not found Jun 08 19:27:30.125374 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:30.125344 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-original-pull-secret\") pod \"global-pull-secret-syncer-tdj7t\" (UID: \"117928d5-6f02-4a5e-b96b-4a2cc6e507eb\") " pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:27:30.125489 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:30.125403 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfmgj\" (UniqueName: \"kubernetes.io/projected/4e78d959-fe7c-48b9-90b3-7ed41b7a8156-kube-api-access-pfmgj\") pod \"network-check-target-tvpck\" (UID: \"4e78d959-fe7c-48b9-90b3-7ed41b7a8156\") " pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:27:30.128290 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:30.128274 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 19:27:30.128348 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:30.128329 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 19:27:30.139500 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:30.139475 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 19:27:30.140335 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:30.140318 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/117928d5-6f02-4a5e-b96b-4a2cc6e507eb-original-pull-secret\") pod \"global-pull-secret-syncer-tdj7t\" (UID: \"117928d5-6f02-4a5e-b96b-4a2cc6e507eb\") " pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:27:30.149190 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:30.149165 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfmgj\" (UniqueName: \"kubernetes.io/projected/4e78d959-fe7c-48b9-90b3-7ed41b7a8156-kube-api-access-pfmgj\") pod \"network-check-target-tvpck\" (UID: \"4e78d959-fe7c-48b9-90b3-7ed41b7a8156\") " pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:27:30.211284 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:30.211248 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdj7t" Jun 08 19:27:30.314430 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:30.314402 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9vt4h\"" Jun 08 19:27:30.319794 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:30.319772 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:27:30.332325 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:30.332299 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tdj7t"] Jun 08 19:27:30.335470 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:27:30.335441 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod117928d5_6f02_4a5e_b96b_4a2cc6e507eb.slice/crio-16c0a7250be06995207677c168f2f799ac9b04c25bc7c06212f9b8269a577836 WatchSource:0}: Error finding container 16c0a7250be06995207677c168f2f799ac9b04c25bc7c06212f9b8269a577836: Status 404 returned error can't find the container with id 16c0a7250be06995207677c168f2f799ac9b04c25bc7c06212f9b8269a577836 Jun 08 19:27:30.439066 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:30.439045 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tvpck"] Jun 08 19:27:30.441098 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:27:30.441073 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e78d959_fe7c_48b9_90b3_7ed41b7a8156.slice/crio-ff225f39c9a2ec941a908cd06631a6a2175e8d1c19d5964077f3fe728fcfa88c WatchSource:0}: Error finding container ff225f39c9a2ec941a908cd06631a6a2175e8d1c19d5964077f3fe728fcfa88c: Status 404 returned error can't find the container with id ff225f39c9a2ec941a908cd06631a6a2175e8d1c19d5964077f3fe728fcfa88c Jun 08 19:27:30.530432 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:30.530401 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tvpck" event={"ID":"4e78d959-fe7c-48b9-90b3-7ed41b7a8156","Type":"ContainerStarted","Data":"ff225f39c9a2ec941a908cd06631a6a2175e8d1c19d5964077f3fe728fcfa88c"} Jun 08 19:27:30.531486 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:30.531455 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tdj7t" event={"ID":"117928d5-6f02-4a5e-b96b-4a2cc6e507eb","Type":"ContainerStarted","Data":"16c0a7250be06995207677c168f2f799ac9b04c25bc7c06212f9b8269a577836"} Jun 08 19:27:30.628819 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:30.628787 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls\") pod \"dns-default-b5k6w\" (UID: \"d95c391c-ac01-42cf-ad49-7a5e0653ecd9\") " pod="openshift-dns/dns-default-b5k6w" Jun 08 19:27:30.629012 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:27:30.628970 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:27:30.629080 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:27:30.629050 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls podName:d95c391c-ac01-42cf-ad49-7a5e0653ecd9 nodeName:}" failed. No retries permitted until 2026-06-08 19:28:02.629026665 +0000 UTC m=+98.764483086 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls") pod "dns-default-b5k6w" (UID: "d95c391c-ac01-42cf-ad49-7a5e0653ecd9") : secret "dns-default-metrics-tls" not found Jun 08 19:27:31.867809 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:31.867771 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:27:32.010177 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:32.010086 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:27:33.541422 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:33.541386 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tvpck" event={"ID":"4e78d959-fe7c-48b9-90b3-7ed41b7a8156","Type":"ContainerStarted","Data":"26532ac380e76165312a5d98d815e239b26cd978903878f939d1b7e3dc6c4c71"} Jun 08 19:27:33.541885 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:33.541494 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:27:33.560186 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:33.560146 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tvpck" podStartSLOduration=66.687994701 podStartE2EDuration="1m9.560129662s" totalImagesPullingTime="2.872134961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:26:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:27:33.559330507 +0000 UTC m=+69.694786948" watchObservedRunningTime="2026-06-08 19:27:33.560129662 +0000 UTC m=+69.695586104" Jun 08 19:27:35.548094 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:35.548060 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tdj7t" event={"ID":"117928d5-6f02-4a5e-b96b-4a2cc6e507eb","Type":"ContainerStarted","Data":"3881bb9f3e3d3147ce8720905994a96c6759f37d1a88b5b1669f6d741d30cdc5"} Jun 08 19:27:35.564561 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:27:35.564505 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tdj7t" podStartSLOduration=66.704172231 podStartE2EDuration="1m11.564487242s" totalImagesPullingTime="4.860315011s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:26:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:27:35.564014085 +0000 UTC m=+71.699470572" watchObservedRunningTime="2026-06-08 19:27:35.564487242 +0000 UTC m=+71.699943684" Jun 08 19:28:02.637181 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:28:02.637098 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls\") pod \"dns-default-b5k6w\" (UID: \"d95c391c-ac01-42cf-ad49-7a5e0653ecd9\") " pod="openshift-dns/dns-default-b5k6w" Jun 08 19:28:02.637568 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:28:02.637223 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:28:02.637568 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:28:02.637284 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls podName:d95c391c-ac01-42cf-ad49-7a5e0653ecd9 nodeName:}" failed. No retries permitted until 2026-06-08 19:29:06.637271473 +0000 UTC m=+162.772727893 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls") pod "dns-default-b5k6w" (UID: "d95c391c-ac01-42cf-ad49-7a5e0653ecd9") : secret "dns-default-metrics-tls" not found Jun 08 19:28:04.546385 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:28:04.546357 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tvpck" Jun 08 19:28:34.036819 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:28:34.036774 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs\") pod \"network-metrics-daemon-7ngtn\" (UID: \"9c8290ed-a8c2-4904-a862-a9e41138d285\") " pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:28:34.037308 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:28:34.036904 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 19:28:34.037308 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:28:34.036970 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs podName:9c8290ed-a8c2-4904-a862-a9e41138d285 nodeName:}" failed. No retries permitted until 2026-06-08 19:30:36.03695448 +0000 UTC m=+252.172410898 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs") pod "network-metrics-daemon-7ngtn" (UID: "9c8290ed-a8c2-4904-a862-a9e41138d285") : secret "metrics-daemon-secret" not found Jun 08 19:28:53.794544 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:28:53.794505 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:28:55.910206 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:28:55.910172 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:01.779645 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:01.779603 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-b5k6w" podUID="d95c391c-ac01-42cf-ad49-7a5e0653ecd9" Jun 08 19:29:02.750573 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:02.750476 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b5k6w" Jun 08 19:29:03.313817 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:03.313779 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7ngtn" podUID="9c8290ed-a8c2-4904-a862-a9e41138d285" Jun 08 19:29:06.646733 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:06.646680 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls\") pod \"dns-default-b5k6w\" (UID: \"d95c391c-ac01-42cf-ad49-7a5e0653ecd9\") " pod="openshift-dns/dns-default-b5k6w" Jun 08 19:29:06.647136 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:06.646842 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:29:06.647136 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:06.646913 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls podName:d95c391c-ac01-42cf-ad49-7a5e0653ecd9 nodeName:}" failed. No retries permitted until 2026-06-08 19:31:08.646898639 +0000 UTC m=+284.782355057 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls") pod "dns-default-b5k6w" (UID: "d95c391c-ac01-42cf-ad49-7a5e0653ecd9") : secret "dns-default-metrics-tls" not found Jun 08 19:29:18.299155 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:18.299118 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:29:30.349734 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.349688 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6j4vn"] Jun 08 19:29:30.351604 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.351588 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6j4vn" Jun 08 19:29:30.354985 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.354968 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 08 19:29:30.355440 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.355424 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-txww2\"" Jun 08 19:29:30.356409 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.356389 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 08 19:29:30.356409 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.356397 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 08 19:29:30.356591 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.356419 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 08 19:29:30.361622 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.361598 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-59744cfc99-6bbqq"] Jun 08 19:29:30.363522 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.363508 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:30.366739 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.366709 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 19:29:30.366835 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.366756 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 08 19:29:30.366896 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.366866 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 08 19:29:30.367023 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.367007 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 08 19:29:30.367076 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.367062 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 19:29:30.367303 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.367287 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xlpqz\"" Jun 08 19:29:30.368057 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.368043 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 08 19:29:30.381000 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.380983 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6j4vn"] Jun 08 19:29:30.398031 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.398002 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-59744cfc99-6bbqq"] Jun 08 19:29:30.402511 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.402491 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bd6r\" (UniqueName: \"kubernetes.io/projected/4688083e-34f2-43f7-bbc0-44c7d3ff1aa4-kube-api-access-4bd6r\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-6j4vn\" (UID: \"4688083e-34f2-43f7-bbc0-44c7d3ff1aa4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6j4vn" Jun 08 19:29:30.402610 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.402524 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5lkj\" (UniqueName: \"kubernetes.io/projected/bbfe4877-4383-4442-8b5f-e9f68186901c-kube-api-access-j5lkj\") pod \"router-default-59744cfc99-6bbqq\" (UID: \"bbfe4877-4383-4442-8b5f-e9f68186901c\") " pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:30.402610 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.402549 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bbfe4877-4383-4442-8b5f-e9f68186901c-default-certificate\") pod \"router-default-59744cfc99-6bbqq\" (UID: \"bbfe4877-4383-4442-8b5f-e9f68186901c\") " pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:30.402610 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.402583 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bbfe4877-4383-4442-8b5f-e9f68186901c-stats-auth\") pod \"router-default-59744cfc99-6bbqq\" (UID: \"bbfe4877-4383-4442-8b5f-e9f68186901c\") " pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:30.402792 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.402635 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4688083e-34f2-43f7-bbc0-44c7d3ff1aa4-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-6j4vn\" (UID: \"4688083e-34f2-43f7-bbc0-44c7d3ff1aa4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6j4vn" Jun 08 19:29:30.402792 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.402671 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4688083e-34f2-43f7-bbc0-44c7d3ff1aa4-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-6j4vn\" (UID: \"4688083e-34f2-43f7-bbc0-44c7d3ff1aa4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6j4vn" Jun 08 19:29:30.402792 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.402691 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbfe4877-4383-4442-8b5f-e9f68186901c-service-ca-bundle\") pod \"router-default-59744cfc99-6bbqq\" (UID: \"bbfe4877-4383-4442-8b5f-e9f68186901c\") " pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:30.402792 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.402713 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbfe4877-4383-4442-8b5f-e9f68186901c-metrics-certs\") pod \"router-default-59744cfc99-6bbqq\" (UID: \"bbfe4877-4383-4442-8b5f-e9f68186901c\") " pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:30.502990 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.502966 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4688083e-34f2-43f7-bbc0-44c7d3ff1aa4-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-6j4vn\" (UID: \"4688083e-34f2-43f7-bbc0-44c7d3ff1aa4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6j4vn" Jun 08 19:29:30.503089 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.503009 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4688083e-34f2-43f7-bbc0-44c7d3ff1aa4-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-6j4vn\" (UID: \"4688083e-34f2-43f7-bbc0-44c7d3ff1aa4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6j4vn" Jun 08 19:29:30.503089 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.503032 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbfe4877-4383-4442-8b5f-e9f68186901c-service-ca-bundle\") pod \"router-default-59744cfc99-6bbqq\" (UID: \"bbfe4877-4383-4442-8b5f-e9f68186901c\") " pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:30.503089 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.503067 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbfe4877-4383-4442-8b5f-e9f68186901c-metrics-certs\") pod \"router-default-59744cfc99-6bbqq\" (UID: \"bbfe4877-4383-4442-8b5f-e9f68186901c\") " pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:30.503204 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.503098 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bd6r\" (UniqueName: \"kubernetes.io/projected/4688083e-34f2-43f7-bbc0-44c7d3ff1aa4-kube-api-access-4bd6r\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-6j4vn\" (UID: \"4688083e-34f2-43f7-bbc0-44c7d3ff1aa4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6j4vn" Jun 08 19:29:30.503254 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:30.503203 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 19:29:30.503254 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:30.503213 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bbfe4877-4383-4442-8b5f-e9f68186901c-service-ca-bundle podName:bbfe4877-4383-4442-8b5f-e9f68186901c nodeName:}" failed. No retries permitted until 2026-06-08 19:29:31.003193578 +0000 UTC m=+187.138649998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bbfe4877-4383-4442-8b5f-e9f68186901c-service-ca-bundle") pod "router-default-59744cfc99-6bbqq" (UID: "bbfe4877-4383-4442-8b5f-e9f68186901c") : configmap references non-existent config key: service-ca.crt Jun 08 19:29:30.503383 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.503271 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5lkj\" (UniqueName: \"kubernetes.io/projected/bbfe4877-4383-4442-8b5f-e9f68186901c-kube-api-access-j5lkj\") pod \"router-default-59744cfc99-6bbqq\" (UID: \"bbfe4877-4383-4442-8b5f-e9f68186901c\") " pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:30.503383 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.503308 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bbfe4877-4383-4442-8b5f-e9f68186901c-default-certificate\") pod \"router-default-59744cfc99-6bbqq\" (UID: \"bbfe4877-4383-4442-8b5f-e9f68186901c\") " pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:30.503383 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:30.503328 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbfe4877-4383-4442-8b5f-e9f68186901c-metrics-certs podName:bbfe4877-4383-4442-8b5f-e9f68186901c nodeName:}" failed. No retries permitted until 2026-06-08 19:29:31.003304506 +0000 UTC m=+187.138760931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbfe4877-4383-4442-8b5f-e9f68186901c-metrics-certs") pod "router-default-59744cfc99-6bbqq" (UID: "bbfe4877-4383-4442-8b5f-e9f68186901c") : secret "router-metrics-certs-default" not found Jun 08 19:29:30.503532 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.503385 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bbfe4877-4383-4442-8b5f-e9f68186901c-stats-auth\") pod \"router-default-59744cfc99-6bbqq\" (UID: \"bbfe4877-4383-4442-8b5f-e9f68186901c\") " pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:30.503621 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.503593 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4688083e-34f2-43f7-bbc0-44c7d3ff1aa4-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-6j4vn\" (UID: \"4688083e-34f2-43f7-bbc0-44c7d3ff1aa4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6j4vn" Jun 08 19:29:30.505030 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.505009 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-j548p"] Jun 08 19:29:30.505526 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.505505 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4688083e-34f2-43f7-bbc0-44c7d3ff1aa4-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-6j4vn\" (UID: \"4688083e-34f2-43f7-bbc0-44c7d3ff1aa4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6j4vn" Jun 08 19:29:30.505879 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.505860 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bbfe4877-4383-4442-8b5f-e9f68186901c-stats-auth\") pod \"router-default-59744cfc99-6bbqq\" (UID: \"bbfe4877-4383-4442-8b5f-e9f68186901c\") " pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:30.506003 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.505983 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bbfe4877-4383-4442-8b5f-e9f68186901c-default-certificate\") pod \"router-default-59744cfc99-6bbqq\" (UID: \"bbfe4877-4383-4442-8b5f-e9f68186901c\") " pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:30.507281 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.507265 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-j548p" Jun 08 19:29:30.510067 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.510045 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 08 19:29:30.510233 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.510211 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 08 19:29:30.510489 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.510466 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 08 19:29:30.510793 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.510545 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 08 19:29:30.511064 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.510563 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-z6wv2\"" Jun 08 19:29:30.521832 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.521812 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ld5nh"] Jun 08 19:29:30.523524 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.523511 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ld5nh" Jun 08 19:29:30.526551 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.526534 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-wbzs5\"" Jun 08 19:29:30.526787 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.526770 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 08 19:29:30.526879 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.526864 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 08 19:29:30.527562 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.527543 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-j548p"] Jun 08 19:29:30.531904 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.531884 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bd6r\" (UniqueName: \"kubernetes.io/projected/4688083e-34f2-43f7-bbc0-44c7d3ff1aa4-kube-api-access-4bd6r\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-6j4vn\" (UID: \"4688083e-34f2-43f7-bbc0-44c7d3ff1aa4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6j4vn" Jun 08 19:29:30.533606 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.533588 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5lkj\" (UniqueName: \"kubernetes.io/projected/bbfe4877-4383-4442-8b5f-e9f68186901c-kube-api-access-j5lkj\") pod \"router-default-59744cfc99-6bbqq\" (UID: \"bbfe4877-4383-4442-8b5f-e9f68186901c\") " pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:30.538472 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.538453 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ld5nh"] Jun 08 19:29:30.563603 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.563582 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcdzf"] Jun 08 19:29:30.565541 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.565528 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcdzf" Jun 08 19:29:30.570858 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.570813 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5frgs\"" Jun 08 19:29:30.570858 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.570852 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 19:29:30.570977 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.570937 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 08 19:29:30.571034 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.571011 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 08 19:29:30.571085 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.571053 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 19:29:30.581398 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.581379 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcdzf"] Jun 08 19:29:30.604214 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.604168 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6af04de5-f785-4b47-9ddf-9e4cee87aa45-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dcdzf\" (UID: \"6af04de5-f785-4b47-9ddf-9e4cee87aa45\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcdzf" Jun 08 19:29:30.604214 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.604194 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwvp8\" (UniqueName: \"kubernetes.io/projected/6af04de5-f785-4b47-9ddf-9e4cee87aa45-kube-api-access-wwvp8\") pod \"cluster-monitoring-operator-74bbf69bbb-dcdzf\" (UID: \"6af04de5-f785-4b47-9ddf-9e4cee87aa45\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcdzf" Jun 08 19:29:30.604321 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.604224 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7410016e-2c37-4c20-a9c8-4b5403668213-config\") pod \"service-ca-operator-6bc5ff68f5-j548p\" (UID: \"7410016e-2c37-4c20-a9c8-4b5403668213\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-j548p" Jun 08 19:29:30.604321 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.604246 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmzb4\" (UniqueName: \"kubernetes.io/projected/7d8d5585-6f29-4aed-be79-7292fea196a5-kube-api-access-cmzb4\") pod \"volume-data-source-validator-78dd696465-ld5nh\" (UID: \"7d8d5585-6f29-4aed-be79-7292fea196a5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ld5nh" Jun 08 19:29:30.604383 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.604323 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7410016e-2c37-4c20-a9c8-4b5403668213-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-j548p\" (UID: \"7410016e-2c37-4c20-a9c8-4b5403668213\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-j548p" Jun 08 19:29:30.604383 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.604349 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptkzp\" (UniqueName: \"kubernetes.io/projected/7410016e-2c37-4c20-a9c8-4b5403668213-kube-api-access-ptkzp\") pod \"service-ca-operator-6bc5ff68f5-j548p\" (UID: \"7410016e-2c37-4c20-a9c8-4b5403668213\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-j548p" Jun 08 19:29:30.604441 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.604383 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6af04de5-f785-4b47-9ddf-9e4cee87aa45-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-dcdzf\" (UID: \"6af04de5-f785-4b47-9ddf-9e4cee87aa45\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcdzf" Jun 08 19:29:30.660172 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.660150 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6j4vn" Jun 08 19:29:30.705445 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.705412 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6af04de5-f785-4b47-9ddf-9e4cee87aa45-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dcdzf\" (UID: \"6af04de5-f785-4b47-9ddf-9e4cee87aa45\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcdzf" Jun 08 19:29:30.705558 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.705461 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwvp8\" (UniqueName: \"kubernetes.io/projected/6af04de5-f785-4b47-9ddf-9e4cee87aa45-kube-api-access-wwvp8\") pod \"cluster-monitoring-operator-74bbf69bbb-dcdzf\" (UID: \"6af04de5-f785-4b47-9ddf-9e4cee87aa45\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcdzf" Jun 08 19:29:30.705558 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.705518 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7410016e-2c37-4c20-a9c8-4b5403668213-config\") pod \"service-ca-operator-6bc5ff68f5-j548p\" (UID: \"7410016e-2c37-4c20-a9c8-4b5403668213\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-j548p" Jun 08 19:29:30.705558 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:30.705538 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 19:29:30.705708 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.705558 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmzb4\" (UniqueName: \"kubernetes.io/projected/7d8d5585-6f29-4aed-be79-7292fea196a5-kube-api-access-cmzb4\") pod \"volume-data-source-validator-78dd696465-ld5nh\" (UID: \"7d8d5585-6f29-4aed-be79-7292fea196a5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ld5nh" Jun 08 19:29:30.705708 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:30.705620 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af04de5-f785-4b47-9ddf-9e4cee87aa45-cluster-monitoring-operator-tls podName:6af04de5-f785-4b47-9ddf-9e4cee87aa45 nodeName:}" failed. No retries permitted until 2026-06-08 19:29:31.205598234 +0000 UTC m=+187.341054676 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6af04de5-f785-4b47-9ddf-9e4cee87aa45-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-dcdzf" (UID: "6af04de5-f785-4b47-9ddf-9e4cee87aa45") : secret "cluster-monitoring-operator-tls" not found Jun 08 19:29:30.705708 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.705644 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7410016e-2c37-4c20-a9c8-4b5403668213-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-j548p\" (UID: \"7410016e-2c37-4c20-a9c8-4b5403668213\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-j548p" Jun 08 19:29:30.705708 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.705677 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptkzp\" (UniqueName: \"kubernetes.io/projected/7410016e-2c37-4c20-a9c8-4b5403668213-kube-api-access-ptkzp\") pod \"service-ca-operator-6bc5ff68f5-j548p\" (UID: \"7410016e-2c37-4c20-a9c8-4b5403668213\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-j548p" Jun 08 19:29:30.705934 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.705754 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6af04de5-f785-4b47-9ddf-9e4cee87aa45-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-dcdzf\" (UID: \"6af04de5-f785-4b47-9ddf-9e4cee87aa45\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcdzf" Jun 08 19:29:30.706215 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.706188 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7410016e-2c37-4c20-a9c8-4b5403668213-config\") pod \"service-ca-operator-6bc5ff68f5-j548p\" (UID: \"7410016e-2c37-4c20-a9c8-4b5403668213\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-j548p" Jun 08 19:29:30.707252 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.707225 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6af04de5-f785-4b47-9ddf-9e4cee87aa45-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-dcdzf\" (UID: \"6af04de5-f785-4b47-9ddf-9e4cee87aa45\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcdzf" Jun 08 19:29:30.707994 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.707966 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7410016e-2c37-4c20-a9c8-4b5403668213-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-j548p\" (UID: \"7410016e-2c37-4c20-a9c8-4b5403668213\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-j548p" Jun 08 19:29:30.717018 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.716993 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptkzp\" (UniqueName: \"kubernetes.io/projected/7410016e-2c37-4c20-a9c8-4b5403668213-kube-api-access-ptkzp\") pod \"service-ca-operator-6bc5ff68f5-j548p\" (UID: \"7410016e-2c37-4c20-a9c8-4b5403668213\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-j548p" Jun 08 19:29:30.717114 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.717085 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwvp8\" (UniqueName: \"kubernetes.io/projected/6af04de5-f785-4b47-9ddf-9e4cee87aa45-kube-api-access-wwvp8\") pod \"cluster-monitoring-operator-74bbf69bbb-dcdzf\" (UID: \"6af04de5-f785-4b47-9ddf-9e4cee87aa45\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcdzf" Jun 08 19:29:30.717173 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.717117 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmzb4\" (UniqueName: \"kubernetes.io/projected/7d8d5585-6f29-4aed-be79-7292fea196a5-kube-api-access-cmzb4\") pod \"volume-data-source-validator-78dd696465-ld5nh\" (UID: \"7d8d5585-6f29-4aed-be79-7292fea196a5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ld5nh" Jun 08 19:29:30.719819 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.719787 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:30.777061 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.777033 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6j4vn"] Jun 08 19:29:30.779768 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:29:30.779747 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4688083e_34f2_43f7_bbc0_44c7d3ff1aa4.slice/crio-93e096d428b3d7d0257f3794ab5fe927486a0ae93e0a1990b97a49cf195c347c WatchSource:0}: Error finding container 93e096d428b3d7d0257f3794ab5fe927486a0ae93e0a1990b97a49cf195c347c: Status 404 returned error can't find the container with id 93e096d428b3d7d0257f3794ab5fe927486a0ae93e0a1990b97a49cf195c347c Jun 08 19:29:30.789481 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.789458 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:30.811279 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.811259 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6j4vn" event={"ID":"4688083e-34f2-43f7-bbc0-44c7d3ff1aa4","Type":"ContainerStarted","Data":"93e096d428b3d7d0257f3794ab5fe927486a0ae93e0a1990b97a49cf195c347c"} Jun 08 19:29:30.823423 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.823407 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-j548p" Jun 08 19:29:30.831977 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.831954 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ld5nh" Jun 08 19:29:30.939163 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.939133 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-j548p"] Jun 08 19:29:30.942320 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:29:30.942293 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7410016e_2c37_4c20_a9c8_4b5403668213.slice/crio-39e4956e03338a1876b0a30e6a6480e758010d7bc27ad5dff5b03cae1c3bff89 WatchSource:0}: Error finding container 39e4956e03338a1876b0a30e6a6480e758010d7bc27ad5dff5b03cae1c3bff89: Status 404 returned error can't find the container with id 39e4956e03338a1876b0a30e6a6480e758010d7bc27ad5dff5b03cae1c3bff89 Jun 08 19:29:30.955901 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:30.955880 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ld5nh"] Jun 08 19:29:30.958560 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:29:30.958530 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d8d5585_6f29_4aed_be79_7292fea196a5.slice/crio-d2da935ca82d35e46355e1725a62b6d7d41e355aeecd53fff3b9bfdb94e76692 WatchSource:0}: Error finding container d2da935ca82d35e46355e1725a62b6d7d41e355aeecd53fff3b9bfdb94e76692: Status 404 returned error can't find the container with id d2da935ca82d35e46355e1725a62b6d7d41e355aeecd53fff3b9bfdb94e76692 Jun 08 19:29:31.008337 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:31.008316 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbfe4877-4383-4442-8b5f-e9f68186901c-service-ca-bundle\") pod \"router-default-59744cfc99-6bbqq\" (UID: \"bbfe4877-4383-4442-8b5f-e9f68186901c\") " pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:31.008470 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:31.008357 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbfe4877-4383-4442-8b5f-e9f68186901c-metrics-certs\") pod \"router-default-59744cfc99-6bbqq\" (UID: \"bbfe4877-4383-4442-8b5f-e9f68186901c\") " pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:31.008530 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:31.008477 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bbfe4877-4383-4442-8b5f-e9f68186901c-service-ca-bundle podName:bbfe4877-4383-4442-8b5f-e9f68186901c nodeName:}" failed. No retries permitted until 2026-06-08 19:29:32.008460485 +0000 UTC m=+188.143916904 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bbfe4877-4383-4442-8b5f-e9f68186901c-service-ca-bundle") pod "router-default-59744cfc99-6bbqq" (UID: "bbfe4877-4383-4442-8b5f-e9f68186901c") : configmap references non-existent config key: service-ca.crt Jun 08 19:29:31.008640 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:31.008527 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 19:29:31.008640 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:31.008583 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbfe4877-4383-4442-8b5f-e9f68186901c-metrics-certs podName:bbfe4877-4383-4442-8b5f-e9f68186901c nodeName:}" failed. No retries permitted until 2026-06-08 19:29:32.00856701 +0000 UTC m=+188.144023445 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbfe4877-4383-4442-8b5f-e9f68186901c-metrics-certs") pod "router-default-59744cfc99-6bbqq" (UID: "bbfe4877-4383-4442-8b5f-e9f68186901c") : secret "router-metrics-certs-default" not found Jun 08 19:29:31.209550 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:31.209476 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6af04de5-f785-4b47-9ddf-9e4cee87aa45-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dcdzf\" (UID: \"6af04de5-f785-4b47-9ddf-9e4cee87aa45\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcdzf" Jun 08 19:29:31.209683 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:31.209620 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 19:29:31.209740 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:31.209684 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af04de5-f785-4b47-9ddf-9e4cee87aa45-cluster-monitoring-operator-tls podName:6af04de5-f785-4b47-9ddf-9e4cee87aa45 nodeName:}" failed. No retries permitted until 2026-06-08 19:29:32.209669968 +0000 UTC m=+188.345126390 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6af04de5-f785-4b47-9ddf-9e4cee87aa45-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-dcdzf" (UID: "6af04de5-f785-4b47-9ddf-9e4cee87aa45") : secret "cluster-monitoring-operator-tls" not found Jun 08 19:29:31.816011 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:31.815969 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-j548p" event={"ID":"7410016e-2c37-4c20-a9c8-4b5403668213","Type":"ContainerStarted","Data":"39e4956e03338a1876b0a30e6a6480e758010d7bc27ad5dff5b03cae1c3bff89"} Jun 08 19:29:31.817276 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:31.817248 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ld5nh" event={"ID":"7d8d5585-6f29-4aed-be79-7292fea196a5","Type":"ContainerStarted","Data":"d2da935ca82d35e46355e1725a62b6d7d41e355aeecd53fff3b9bfdb94e76692"} Jun 08 19:29:32.015842 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:32.015811 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbfe4877-4383-4442-8b5f-e9f68186901c-metrics-certs\") pod \"router-default-59744cfc99-6bbqq\" (UID: \"bbfe4877-4383-4442-8b5f-e9f68186901c\") " pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:32.016009 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:32.015988 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 19:29:32.016078 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:32.016032 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbfe4877-4383-4442-8b5f-e9f68186901c-service-ca-bundle\") pod \"router-default-59744cfc99-6bbqq\" (UID: \"bbfe4877-4383-4442-8b5f-e9f68186901c\") " pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:32.016078 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:32.016057 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbfe4877-4383-4442-8b5f-e9f68186901c-metrics-certs podName:bbfe4877-4383-4442-8b5f-e9f68186901c nodeName:}" failed. No retries permitted until 2026-06-08 19:29:34.016035988 +0000 UTC m=+190.151492410 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbfe4877-4383-4442-8b5f-e9f68186901c-metrics-certs") pod "router-default-59744cfc99-6bbqq" (UID: "bbfe4877-4383-4442-8b5f-e9f68186901c") : secret "router-metrics-certs-default" not found Jun 08 19:29:32.016189 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:32.016130 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bbfe4877-4383-4442-8b5f-e9f68186901c-service-ca-bundle podName:bbfe4877-4383-4442-8b5f-e9f68186901c nodeName:}" failed. No retries permitted until 2026-06-08 19:29:34.01611671 +0000 UTC m=+190.151573129 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bbfe4877-4383-4442-8b5f-e9f68186901c-service-ca-bundle") pod "router-default-59744cfc99-6bbqq" (UID: "bbfe4877-4383-4442-8b5f-e9f68186901c") : configmap references non-existent config key: service-ca.crt Jun 08 19:29:32.217977 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:32.217879 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6af04de5-f785-4b47-9ddf-9e4cee87aa45-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dcdzf\" (UID: \"6af04de5-f785-4b47-9ddf-9e4cee87aa45\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcdzf" Jun 08 19:29:32.218145 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:32.218056 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 19:29:32.218145 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:32.218139 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af04de5-f785-4b47-9ddf-9e4cee87aa45-cluster-monitoring-operator-tls podName:6af04de5-f785-4b47-9ddf-9e4cee87aa45 nodeName:}" failed. No retries permitted until 2026-06-08 19:29:34.218117191 +0000 UTC m=+190.353573612 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6af04de5-f785-4b47-9ddf-9e4cee87aa45-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-dcdzf" (UID: "6af04de5-f785-4b47-9ddf-9e4cee87aa45") : secret "cluster-monitoring-operator-tls" not found Jun 08 19:29:32.821225 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:32.821184 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ld5nh" event={"ID":"7d8d5585-6f29-4aed-be79-7292fea196a5","Type":"ContainerStarted","Data":"81a5df4cdc7e121e1a3f7c1bab3e3ad59330d834ba2886b87c7d4b084ccbd2dc"} Jun 08 19:29:32.836047 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:32.835998 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ld5nh" podStartSLOduration=1.781937048 podStartE2EDuration="2.835983254s" totalImagesPullingTime="1.054046206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:29:32.835149854 +0000 UTC m=+188.970606308" watchObservedRunningTime="2026-06-08 19:29:32.835983254 +0000 UTC m=+188.971439693" Jun 08 19:29:32.941513 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:32.941480 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:33.008736 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:33.008691 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:33.827205 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:33.827171 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6j4vn" event={"ID":"4688083e-34f2-43f7-bbc0-44c7d3ff1aa4","Type":"ContainerStarted","Data":"219c08468b9e764fda2ea7937caeca36797a7c7a08f84b2e2aa6f4e6fe3dc1fc"} Jun 08 19:29:33.849780 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:33.849715 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6j4vn" podStartSLOduration=1.442305553 podStartE2EDuration="3.849695868s" totalImagesPullingTime="2.407390315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:29:33.848657182 +0000 UTC m=+189.984113622" watchObservedRunningTime="2026-06-08 19:29:33.849695868 +0000 UTC m=+189.985152310" Jun 08 19:29:34.032011 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:34.031969 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbfe4877-4383-4442-8b5f-e9f68186901c-service-ca-bundle\") pod \"router-default-59744cfc99-6bbqq\" (UID: \"bbfe4877-4383-4442-8b5f-e9f68186901c\") " pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:34.032011 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:34.032018 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbfe4877-4383-4442-8b5f-e9f68186901c-metrics-certs\") pod \"router-default-59744cfc99-6bbqq\" (UID: \"bbfe4877-4383-4442-8b5f-e9f68186901c\") " pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:34.032236 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:34.032148 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 19:29:34.032236 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:34.032172 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bbfe4877-4383-4442-8b5f-e9f68186901c-service-ca-bundle podName:bbfe4877-4383-4442-8b5f-e9f68186901c nodeName:}" failed. No retries permitted until 2026-06-08 19:29:38.032148503 +0000 UTC m=+194.167604926 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bbfe4877-4383-4442-8b5f-e9f68186901c-service-ca-bundle") pod "router-default-59744cfc99-6bbqq" (UID: "bbfe4877-4383-4442-8b5f-e9f68186901c") : configmap references non-existent config key: service-ca.crt Jun 08 19:29:34.032236 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:34.032211 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbfe4877-4383-4442-8b5f-e9f68186901c-metrics-certs podName:bbfe4877-4383-4442-8b5f-e9f68186901c nodeName:}" failed. No retries permitted until 2026-06-08 19:29:38.032196216 +0000 UTC m=+194.167652634 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbfe4877-4383-4442-8b5f-e9f68186901c-metrics-certs") pod "router-default-59744cfc99-6bbqq" (UID: "bbfe4877-4383-4442-8b5f-e9f68186901c") : secret "router-metrics-certs-default" not found Jun 08 19:29:34.233243 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:34.233212 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6af04de5-f785-4b47-9ddf-9e4cee87aa45-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dcdzf\" (UID: \"6af04de5-f785-4b47-9ddf-9e4cee87aa45\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcdzf" Jun 08 19:29:34.233387 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:34.233365 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 19:29:34.233451 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:34.233439 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af04de5-f785-4b47-9ddf-9e4cee87aa45-cluster-monitoring-operator-tls podName:6af04de5-f785-4b47-9ddf-9e4cee87aa45 nodeName:}" failed. No retries permitted until 2026-06-08 19:29:38.233419526 +0000 UTC m=+194.368875965 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6af04de5-f785-4b47-9ddf-9e4cee87aa45-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-dcdzf" (UID: "6af04de5-f785-4b47-9ddf-9e4cee87aa45") : secret "cluster-monitoring-operator-tls" not found Jun 08 19:29:34.539265 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:34.539181 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:34.637374 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:34.637329 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:34.831194 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:34.831157 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-j548p" event={"ID":"7410016e-2c37-4c20-a9c8-4b5403668213","Type":"ContainerStarted","Data":"3b06c3971e3f973bb4596f4e59fbf78d8fd7a46350fd070a901ac9b7b6a8a742"} Jun 08 19:29:34.847317 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:34.847272 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-j548p" podStartSLOduration=1.634040494 podStartE2EDuration="4.847259219s" totalImagesPullingTime="3.213218725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:29:34.846268935 +0000 UTC m=+190.981725385" watchObservedRunningTime="2026-06-08 19:29:34.847259219 +0000 UTC m=+190.982715658" Jun 08 19:29:35.272087 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:35.272008 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:35.343152 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:35.343120 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:35.410070 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:35.410040 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:35.529399 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:35.529329 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-576bp"] Jun 08 19:29:35.531558 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:35.531544 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-576bp" Jun 08 19:29:35.534152 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:35.534128 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-7jqf6\"" Jun 08 19:29:35.535312 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:35.535296 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 08 19:29:35.535407 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:35.535345 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 08 19:29:35.541407 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:35.541388 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-576bp"] Jun 08 19:29:35.542688 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:35.542671 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjcpv\" (UniqueName: \"kubernetes.io/projected/9bd75889-5c99-4447-9b8f-ea9398b2aacf-kube-api-access-kjcpv\") pod \"migrator-955ffdf5f-576bp\" (UID: \"9bd75889-5c99-4447-9b8f-ea9398b2aacf\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-576bp" Jun 08 19:29:35.568448 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:35.568415 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:35.644117 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:35.644085 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjcpv\" (UniqueName: \"kubernetes.io/projected/9bd75889-5c99-4447-9b8f-ea9398b2aacf-kube-api-access-kjcpv\") pod \"migrator-955ffdf5f-576bp\" (UID: \"9bd75889-5c99-4447-9b8f-ea9398b2aacf\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-576bp" Jun 08 19:29:35.652266 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:35.652244 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjcpv\" (UniqueName: \"kubernetes.io/projected/9bd75889-5c99-4447-9b8f-ea9398b2aacf-kube-api-access-kjcpv\") pod \"migrator-955ffdf5f-576bp\" (UID: \"9bd75889-5c99-4447-9b8f-ea9398b2aacf\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-576bp" Jun 08 19:29:35.670477 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:35.670449 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:35.840229 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:35.840204 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-576bp" Jun 08 19:29:35.957120 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:35.957095 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-576bp"] Jun 08 19:29:35.959832 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:29:35.959804 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bd75889_5c99_4447_9b8f_ea9398b2aacf.slice/crio-a1685aa202fc6214950c0a2c398ecc1cf9202b4c9d85f251fe552b7ecf620c18 WatchSource:0}: Error finding container a1685aa202fc6214950c0a2c398ecc1cf9202b4c9d85f251fe552b7ecf620c18: Status 404 returned error can't find the container with id a1685aa202fc6214950c0a2c398ecc1cf9202b4c9d85f251fe552b7ecf620c18 Jun 08 19:29:36.101938 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:36.101833 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:36.214553 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:36.214520 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:36.838169 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:36.838137 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-576bp" event={"ID":"9bd75889-5c99-4447-9b8f-ea9398b2aacf","Type":"ContainerStarted","Data":"a1685aa202fc6214950c0a2c398ecc1cf9202b4c9d85f251fe552b7ecf620c18"} Jun 08 19:29:37.375988 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:37.375966 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mv9h2_4d52db18-8dbf-4de9-9d50-1020690ab64a/dns-node-resolver/0.log" Jun 08 19:29:37.692524 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:37.692494 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-vjvd6"] Jun 08 19:29:37.695473 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:37.695455 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-vjvd6" Jun 08 19:29:37.698209 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:37.698184 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 08 19:29:37.699501 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:37.699474 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 08 19:29:37.699603 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:37.699515 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 08 19:29:37.699603 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:37.699531 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-7l6np\"" Jun 08 19:29:37.699603 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:37.699538 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 08 19:29:37.704848 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:37.704828 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-vjvd6"] Jun 08 19:29:37.760709 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:37.760678 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/81d1b67e-6a5a-4dae-b0e0-d633d6bf8bd6-signing-cabundle\") pod \"service-ca-7d74d578b8-vjvd6\" (UID: \"81d1b67e-6a5a-4dae-b0e0-d633d6bf8bd6\") " pod="openshift-service-ca/service-ca-7d74d578b8-vjvd6" Jun 08 19:29:37.760709 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:37.760712 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx6gp\" (UniqueName: \"kubernetes.io/projected/81d1b67e-6a5a-4dae-b0e0-d633d6bf8bd6-kube-api-access-gx6gp\") pod \"service-ca-7d74d578b8-vjvd6\" (UID: \"81d1b67e-6a5a-4dae-b0e0-d633d6bf8bd6\") " pod="openshift-service-ca/service-ca-7d74d578b8-vjvd6" Jun 08 19:29:37.760923 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:37.760752 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/81d1b67e-6a5a-4dae-b0e0-d633d6bf8bd6-signing-key\") pod \"service-ca-7d74d578b8-vjvd6\" (UID: \"81d1b67e-6a5a-4dae-b0e0-d633d6bf8bd6\") " pod="openshift-service-ca/service-ca-7d74d578b8-vjvd6" Jun 08 19:29:37.842448 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:37.842418 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-576bp" event={"ID":"9bd75889-5c99-4447-9b8f-ea9398b2aacf","Type":"ContainerStarted","Data":"d9d50cbda2892a371e8b75078839e8f80d8d0ea367f5d7570a99f60aceb54583"} Jun 08 19:29:37.842571 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:37.842465 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-576bp" event={"ID":"9bd75889-5c99-4447-9b8f-ea9398b2aacf","Type":"ContainerStarted","Data":"cac75994372965ab7ae993846886c61bee14ab74b5dfb97d541f7178c8964f07"} Jun 08 19:29:37.845820 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:37.845797 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:37.861814 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:37.861789 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/81d1b67e-6a5a-4dae-b0e0-d633d6bf8bd6-signing-cabundle\") pod \"service-ca-7d74d578b8-vjvd6\" (UID: \"81d1b67e-6a5a-4dae-b0e0-d633d6bf8bd6\") " pod="openshift-service-ca/service-ca-7d74d578b8-vjvd6" Jun 08 19:29:37.861928 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:37.861814 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx6gp\" (UniqueName: \"kubernetes.io/projected/81d1b67e-6a5a-4dae-b0e0-d633d6bf8bd6-kube-api-access-gx6gp\") pod \"service-ca-7d74d578b8-vjvd6\" (UID: \"81d1b67e-6a5a-4dae-b0e0-d633d6bf8bd6\") " pod="openshift-service-ca/service-ca-7d74d578b8-vjvd6" Jun 08 19:29:37.861928 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:37.861833 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/81d1b67e-6a5a-4dae-b0e0-d633d6bf8bd6-signing-key\") pod \"service-ca-7d74d578b8-vjvd6\" (UID: \"81d1b67e-6a5a-4dae-b0e0-d633d6bf8bd6\") " pod="openshift-service-ca/service-ca-7d74d578b8-vjvd6" Jun 08 19:29:37.862401 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:37.862381 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/81d1b67e-6a5a-4dae-b0e0-d633d6bf8bd6-signing-cabundle\") pod \"service-ca-7d74d578b8-vjvd6\" (UID: \"81d1b67e-6a5a-4dae-b0e0-d633d6bf8bd6\") " pod="openshift-service-ca/service-ca-7d74d578b8-vjvd6" Jun 08 19:29:37.864098 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:37.864083 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/81d1b67e-6a5a-4dae-b0e0-d633d6bf8bd6-signing-key\") pod \"service-ca-7d74d578b8-vjvd6\" (UID: \"81d1b67e-6a5a-4dae-b0e0-d633d6bf8bd6\") " pod="openshift-service-ca/service-ca-7d74d578b8-vjvd6" Jun 08 19:29:37.880846 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:37.880809 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-576bp" podStartSLOduration=1.614143103 podStartE2EDuration="2.880794744s" totalImagesPullingTime="1.266651641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:29:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:29:37.879815297 +0000 UTC m=+194.015271736" watchObservedRunningTime="2026-06-08 19:29:37.880794744 +0000 UTC m=+194.016251183" Jun 08 19:29:37.881873 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:37.881851 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx6gp\" (UniqueName: \"kubernetes.io/projected/81d1b67e-6a5a-4dae-b0e0-d633d6bf8bd6-kube-api-access-gx6gp\") pod \"service-ca-7d74d578b8-vjvd6\" (UID: \"81d1b67e-6a5a-4dae-b0e0-d633d6bf8bd6\") " pod="openshift-service-ca/service-ca-7d74d578b8-vjvd6" Jun 08 19:29:38.003485 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:38.003419 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-vjvd6" Jun 08 19:29:38.050055 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:38.050021 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:38.063509 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:38.063484 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbfe4877-4383-4442-8b5f-e9f68186901c-service-ca-bundle\") pod \"router-default-59744cfc99-6bbqq\" (UID: \"bbfe4877-4383-4442-8b5f-e9f68186901c\") " pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:38.063615 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:38.063523 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbfe4877-4383-4442-8b5f-e9f68186901c-metrics-certs\") pod \"router-default-59744cfc99-6bbqq\" (UID: \"bbfe4877-4383-4442-8b5f-e9f68186901c\") " pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:38.063665 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:38.063619 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 19:29:38.063992 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:38.063676 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bbfe4877-4383-4442-8b5f-e9f68186901c-service-ca-bundle podName:bbfe4877-4383-4442-8b5f-e9f68186901c nodeName:}" failed. No retries permitted until 2026-06-08 19:29:46.063654872 +0000 UTC m=+202.199111307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bbfe4877-4383-4442-8b5f-e9f68186901c-service-ca-bundle") pod "router-default-59744cfc99-6bbqq" (UID: "bbfe4877-4383-4442-8b5f-e9f68186901c") : configmap references non-existent config key: service-ca.crt Jun 08 19:29:38.063992 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:38.063739 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbfe4877-4383-4442-8b5f-e9f68186901c-metrics-certs podName:bbfe4877-4383-4442-8b5f-e9f68186901c nodeName:}" failed. No retries permitted until 2026-06-08 19:29:46.063713302 +0000 UTC m=+202.199169746 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbfe4877-4383-4442-8b5f-e9f68186901c-metrics-certs") pod "router-default-59744cfc99-6bbqq" (UID: "bbfe4877-4383-4442-8b5f-e9f68186901c") : secret "router-metrics-certs-default" not found Jun 08 19:29:38.123419 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:38.123387 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-vjvd6"] Jun 08 19:29:38.126206 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:29:38.126182 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81d1b67e_6a5a_4dae_b0e0_d633d6bf8bd6.slice/crio-43cd730fa8cfde4d11cb42521058fece4f824c21861b11a3d8bfe80b37dc81b1 WatchSource:0}: Error finding container 43cd730fa8cfde4d11cb42521058fece4f824c21861b11a3d8bfe80b37dc81b1: Status 404 returned error can't find the container with id 43cd730fa8cfde4d11cb42521058fece4f824c21861b11a3d8bfe80b37dc81b1 Jun 08 19:29:38.138969 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:38.138942 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:38.265095 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:38.265012 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6af04de5-f785-4b47-9ddf-9e4cee87aa45-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dcdzf\" (UID: \"6af04de5-f785-4b47-9ddf-9e4cee87aa45\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcdzf" Jun 08 19:29:38.265251 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:38.265143 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 19:29:38.265251 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:29:38.265210 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af04de5-f785-4b47-9ddf-9e4cee87aa45-cluster-monitoring-operator-tls podName:6af04de5-f785-4b47-9ddf-9e4cee87aa45 nodeName:}" failed. No retries permitted until 2026-06-08 19:29:46.265192201 +0000 UTC m=+202.400648622 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6af04de5-f785-4b47-9ddf-9e4cee87aa45-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-dcdzf" (UID: "6af04de5-f785-4b47-9ddf-9e4cee87aa45") : secret "cluster-monitoring-operator-tls" not found Jun 08 19:29:38.375733 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:38.375696 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lvnmk_529224c9-b129-4c0b-baf2-096ad4106daa/node-ca/0.log" Jun 08 19:29:38.847212 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:38.847171 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-vjvd6" event={"ID":"81d1b67e-6a5a-4dae-b0e0-d633d6bf8bd6","Type":"ContainerStarted","Data":"18a9e6a7a4fa7f3d0e5be6ad52298b334beeba37230a8ebb117a72d982742c90"} Jun 08 19:29:38.847670 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:38.847231 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-vjvd6" event={"ID":"81d1b67e-6a5a-4dae-b0e0-d633d6bf8bd6","Type":"ContainerStarted","Data":"43cd730fa8cfde4d11cb42521058fece4f824c21861b11a3d8bfe80b37dc81b1"} Jun 08 19:29:38.865071 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:38.865030 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-vjvd6" podStartSLOduration=1.8650129500000001 podStartE2EDuration="1.86501295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:29:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:29:38.864469957 +0000 UTC m=+194.999926399" watchObservedRunningTime="2026-06-08 19:29:38.86501295 +0000 UTC m=+195.000469389" Jun 08 19:29:38.887879 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:38.887853 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:39.177571 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:39.177490 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vjzfq_dbf38036-cdd0-4181-9967-bdbbf4d67a1e/serve-healthcheck-canary/0.log" Jun 08 19:29:39.600303 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:39.600270 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:39.955785 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:39.955687 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:40.051988 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:40.051958 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:40.328978 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:40.328944 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:41.125089 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:41.125060 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:41.674734 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:41.674686 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:41.773555 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:41.773523 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:41.924976 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:41.924892 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:42.332794 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:42.332757 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:42.525170 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:42.525137 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:42.930185 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:42.930152 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:43.320509 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:43.320480 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:43.486632 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:43.486595 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:43.757043 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:43.756962 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:44.126156 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:44.126120 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:44.525704 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:44.525619 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:44.724348 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:44.724318 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:44.922948 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:44.922919 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:45.133411 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:45.133380 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:45.230558 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:45.230489 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:46.122767 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:46.122735 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbfe4877-4383-4442-8b5f-e9f68186901c-service-ca-bundle\") pod \"router-default-59744cfc99-6bbqq\" (UID: \"bbfe4877-4383-4442-8b5f-e9f68186901c\") " pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:46.122767 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:46.122782 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbfe4877-4383-4442-8b5f-e9f68186901c-metrics-certs\") pod \"router-default-59744cfc99-6bbqq\" (UID: \"bbfe4877-4383-4442-8b5f-e9f68186901c\") " pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:46.123267 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:46.123233 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbfe4877-4383-4442-8b5f-e9f68186901c-service-ca-bundle\") pod \"router-default-59744cfc99-6bbqq\" (UID: \"bbfe4877-4383-4442-8b5f-e9f68186901c\") " pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:46.124976 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:46.124958 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbfe4877-4383-4442-8b5f-e9f68186901c-metrics-certs\") pod \"router-default-59744cfc99-6bbqq\" (UID: \"bbfe4877-4383-4442-8b5f-e9f68186901c\") " pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:46.271532 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:46.271500 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:46.323902 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:46.323836 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6af04de5-f785-4b47-9ddf-9e4cee87aa45-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dcdzf\" (UID: \"6af04de5-f785-4b47-9ddf-9e4cee87aa45\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcdzf" Jun 08 19:29:46.326535 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:46.326509 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6af04de5-f785-4b47-9ddf-9e4cee87aa45-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dcdzf\" (UID: \"6af04de5-f785-4b47-9ddf-9e4cee87aa45\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcdzf" Jun 08 19:29:46.328220 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:46.328184 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:46.395294 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:46.395232 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-59744cfc99-6bbqq"] Jun 08 19:29:46.398015 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:46.397983 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:46.399475 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:29:46.399448 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbfe4877_4383_4442_8b5f_e9f68186901c.slice/crio-32e45120a61943222ee8243f7ac12282c57f05ce2d87422681f1489357011e9c WatchSource:0}: Error finding container 32e45120a61943222ee8243f7ac12282c57f05ce2d87422681f1489357011e9c: Status 404 returned error can't find the container with id 32e45120a61943222ee8243f7ac12282c57f05ce2d87422681f1489357011e9c Jun 08 19:29:46.473043 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:46.473018 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcdzf" Jun 08 19:29:46.541773 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:46.541713 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:46.595925 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:46.595764 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcdzf"] Jun 08 19:29:46.598610 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:29:46.598585 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6af04de5_f785_4b47_9ddf_9e4cee87aa45.slice/crio-a6ae86a1bf9ef1879ef9b3a16de2e3e4b4f14da1c53834bbd25264c6bfabf919 WatchSource:0}: Error finding container a6ae86a1bf9ef1879ef9b3a16de2e3e4b4f14da1c53834bbd25264c6bfabf919: Status 404 returned error can't find the container with id a6ae86a1bf9ef1879ef9b3a16de2e3e4b4f14da1c53834bbd25264c6bfabf919 Jun 08 19:29:46.725527 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:46.725447 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:46.876415 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:46.876387 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcdzf" event={"ID":"6af04de5-f785-4b47-9ddf-9e4cee87aa45","Type":"ContainerStarted","Data":"a6ae86a1bf9ef1879ef9b3a16de2e3e4b4f14da1c53834bbd25264c6bfabf919"} Jun 08 19:29:46.877925 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:46.877903 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-59744cfc99-6bbqq" event={"ID":"bbfe4877-4383-4442-8b5f-e9f68186901c","Type":"ContainerStarted","Data":"135cdd597819d8a590695218e4c4fa06a4f0a4f118ea19a6ccddd93928705b61"} Jun 08 19:29:46.878061 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:46.877942 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-59744cfc99-6bbqq" event={"ID":"bbfe4877-4383-4442-8b5f-e9f68186901c","Type":"ContainerStarted","Data":"32e45120a61943222ee8243f7ac12282c57f05ce2d87422681f1489357011e9c"} Jun 08 19:29:46.897998 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:46.897942 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-59744cfc99-6bbqq" podStartSLOduration=16.897929448 podStartE2EDuration="16.897929448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:29:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:29:46.896948298 +0000 UTC m=+203.032404731" watchObservedRunningTime="2026-06-08 19:29:46.897929448 +0000 UTC m=+203.033385887" Jun 08 19:29:46.917217 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:46.917190 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:47.124354 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:47.124317 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:47.272551 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:47.272519 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:47.274891 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:47.274872 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:47.571009 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:47.570965 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:47.880903 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:47.880820 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:47.882063 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:47.882043 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-59744cfc99-6bbqq" Jun 08 19:29:48.088321 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:48.088288 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:48.154523 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:48.154439 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:48.533659 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:48.533623 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:48.733239 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:48.733150 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:48.833617 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:48.833567 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:48.885012 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:48.884977 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcdzf" event={"ID":"6af04de5-f785-4b47-9ddf-9e4cee87aa45","Type":"ContainerStarted","Data":"6e0be2f8eefcfa43c191e2102728720bffdb54edd45e94a3891e77da792d3895"} Jun 08 19:29:48.903812 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:48.903767 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dcdzf" podStartSLOduration=17.023947098 podStartE2EDuration="18.903751483s" totalImagesPullingTime="1.879804385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:29:48.901789746 +0000 UTC m=+205.037246186" watchObservedRunningTime="2026-06-08 19:29:48.903751483 +0000 UTC m=+205.039207922" Jun 08 19:29:48.935703 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:48.935668 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:49.035331 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:49.035245 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:49.322699 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:49.322671 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:49.921077 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:49.921050 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:51.049059 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:51.049027 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:54.238510 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:54.238480 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:54.327338 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:54.327293 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:54.672144 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:54.672112 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:54.730891 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:54.730861 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:54.865372 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:54.865339 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:54.930121 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:54.930046 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:55.878348 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:55.878314 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:56.123527 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:56.123497 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:56.217235 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:56.217148 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:56.317942 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:56.317909 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:56.418995 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:56.418962 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:57.079187 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.079157 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kb8br"] Jun 08 19:29:57.083381 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.083356 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kb8br" Jun 08 19:29:57.083540 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.083420 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qrjqw"] Jun 08 19:29:57.086087 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.086066 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 19:29:57.086233 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.086122 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 19:29:57.086233 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.086179 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 19:29:57.086339 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.086269 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qrjqw" Jun 08 19:29:57.086442 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.086428 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mfg6k\"" Jun 08 19:29:57.087427 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.087404 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 19:29:57.091946 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.091927 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-zx5ch\"" Jun 08 19:29:57.094702 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.094681 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 08 19:29:57.105590 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.105556 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qrjqw"] Jun 08 19:29:57.106486 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.106463 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kb8br"] Jun 08 19:29:57.207201 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.207163 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/744ddc5a-8124-4099-a1a1-88de388de52d-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-qrjqw\" (UID: \"744ddc5a-8124-4099-a1a1-88de388de52d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qrjqw" Jun 08 19:29:57.207201 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.207205 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9z22\" (UniqueName: \"kubernetes.io/projected/93f9918f-d2e6-4a90-9af3-372ff33abf82-kube-api-access-c9z22\") pod \"insights-runtime-extractor-kb8br\" (UID: \"93f9918f-d2e6-4a90-9af3-372ff33abf82\") " pod="openshift-insights/insights-runtime-extractor-kb8br" Jun 08 19:29:57.207467 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.207234 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93f9918f-d2e6-4a90-9af3-372ff33abf82-crio-socket\") pod \"insights-runtime-extractor-kb8br\" (UID: \"93f9918f-d2e6-4a90-9af3-372ff33abf82\") " pod="openshift-insights/insights-runtime-extractor-kb8br" Jun 08 19:29:57.207467 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.207312 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93f9918f-d2e6-4a90-9af3-372ff33abf82-data-volume\") pod \"insights-runtime-extractor-kb8br\" (UID: \"93f9918f-d2e6-4a90-9af3-372ff33abf82\") " pod="openshift-insights/insights-runtime-extractor-kb8br" Jun 08 19:29:57.207467 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.207381 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93f9918f-d2e6-4a90-9af3-372ff33abf82-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kb8br\" (UID: \"93f9918f-d2e6-4a90-9af3-372ff33abf82\") " pod="openshift-insights/insights-runtime-extractor-kb8br" Jun 08 19:29:57.207467 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.207402 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93f9918f-d2e6-4a90-9af3-372ff33abf82-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kb8br\" (UID: \"93f9918f-d2e6-4a90-9af3-372ff33abf82\") " pod="openshift-insights/insights-runtime-extractor-kb8br" Jun 08 19:29:57.217791 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.217761 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:57.307731 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.307694 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/744ddc5a-8124-4099-a1a1-88de388de52d-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-qrjqw\" (UID: \"744ddc5a-8124-4099-a1a1-88de388de52d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qrjqw" Jun 08 19:29:57.307939 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.307774 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9z22\" (UniqueName: \"kubernetes.io/projected/93f9918f-d2e6-4a90-9af3-372ff33abf82-kube-api-access-c9z22\") pod \"insights-runtime-extractor-kb8br\" (UID: \"93f9918f-d2e6-4a90-9af3-372ff33abf82\") " pod="openshift-insights/insights-runtime-extractor-kb8br" Jun 08 19:29:57.307939 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.307803 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93f9918f-d2e6-4a90-9af3-372ff33abf82-crio-socket\") pod \"insights-runtime-extractor-kb8br\" (UID: \"93f9918f-d2e6-4a90-9af3-372ff33abf82\") " pod="openshift-insights/insights-runtime-extractor-kb8br" Jun 08 19:29:57.307939 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.307827 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93f9918f-d2e6-4a90-9af3-372ff33abf82-data-volume\") pod \"insights-runtime-extractor-kb8br\" (UID: \"93f9918f-d2e6-4a90-9af3-372ff33abf82\") " pod="openshift-insights/insights-runtime-extractor-kb8br" Jun 08 19:29:57.307939 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.307898 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93f9918f-d2e6-4a90-9af3-372ff33abf82-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kb8br\" (UID: \"93f9918f-d2e6-4a90-9af3-372ff33abf82\") " pod="openshift-insights/insights-runtime-extractor-kb8br" Jun 08 19:29:57.307939 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.307907 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93f9918f-d2e6-4a90-9af3-372ff33abf82-crio-socket\") pod \"insights-runtime-extractor-kb8br\" (UID: \"93f9918f-d2e6-4a90-9af3-372ff33abf82\") " pod="openshift-insights/insights-runtime-extractor-kb8br" Jun 08 19:29:57.307939 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.307924 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93f9918f-d2e6-4a90-9af3-372ff33abf82-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kb8br\" (UID: \"93f9918f-d2e6-4a90-9af3-372ff33abf82\") " pod="openshift-insights/insights-runtime-extractor-kb8br" Jun 08 19:29:57.308230 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.308218 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93f9918f-d2e6-4a90-9af3-372ff33abf82-data-volume\") pod \"insights-runtime-extractor-kb8br\" (UID: \"93f9918f-d2e6-4a90-9af3-372ff33abf82\") " pod="openshift-insights/insights-runtime-extractor-kb8br" Jun 08 19:29:57.308430 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.308405 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93f9918f-d2e6-4a90-9af3-372ff33abf82-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kb8br\" (UID: \"93f9918f-d2e6-4a90-9af3-372ff33abf82\") " pod="openshift-insights/insights-runtime-extractor-kb8br" Jun 08 19:29:57.310148 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.310123 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/744ddc5a-8124-4099-a1a1-88de388de52d-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-qrjqw\" (UID: \"744ddc5a-8124-4099-a1a1-88de388de52d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qrjqw" Jun 08 19:29:57.310245 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.310127 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93f9918f-d2e6-4a90-9af3-372ff33abf82-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kb8br\" (UID: \"93f9918f-d2e6-4a90-9af3-372ff33abf82\") " pod="openshift-insights/insights-runtime-extractor-kb8br" Jun 08 19:29:57.320247 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.320219 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9z22\" (UniqueName: \"kubernetes.io/projected/93f9918f-d2e6-4a90-9af3-372ff33abf82-kube-api-access-c9z22\") pod \"insights-runtime-extractor-kb8br\" (UID: \"93f9918f-d2e6-4a90-9af3-372ff33abf82\") " pod="openshift-insights/insights-runtime-extractor-kb8br" Jun 08 19:29:57.320385 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.320270 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:57.393340 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.393250 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kb8br" Jun 08 19:29:57.399504 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.399476 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qrjqw" Jun 08 19:29:57.526083 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.526052 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kb8br"] Jun 08 19:29:57.529672 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:29:57.529643 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93f9918f_d2e6_4a90_9af3_372ff33abf82.slice/crio-61340bfa651d099ba6cb9c475f2bbcd4cc3e55ebcd1f9b543ec0c3f0ce8a7cd8 WatchSource:0}: Error finding container 61340bfa651d099ba6cb9c475f2bbcd4cc3e55ebcd1f9b543ec0c3f0ce8a7cd8: Status 404 returned error can't find the container with id 61340bfa651d099ba6cb9c475f2bbcd4cc3e55ebcd1f9b543ec0c3f0ce8a7cd8 Jun 08 19:29:57.544294 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.544273 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qrjqw"] Jun 08 19:29:57.547962 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:29:57.547938 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod744ddc5a_8124_4099_a1a1_88de388de52d.slice/crio-b212d971f5bbe5bae2db37f803219b79610903f983f0ccaa7cdc5dbcda7188f2 WatchSource:0}: Error finding container b212d971f5bbe5bae2db37f803219b79610903f983f0ccaa7cdc5dbcda7188f2: Status 404 returned error can't find the container with id b212d971f5bbe5bae2db37f803219b79610903f983f0ccaa7cdc5dbcda7188f2 Jun 08 19:29:57.913234 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.913197 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kb8br" event={"ID":"93f9918f-d2e6-4a90-9af3-372ff33abf82","Type":"ContainerStarted","Data":"090a43ff4067d2c3a3517f649423cfb42b16ecd486a8cb181443c28994c0be6c"} Jun 08 19:29:57.913405 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.913261 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kb8br" event={"ID":"93f9918f-d2e6-4a90-9af3-372ff33abf82","Type":"ContainerStarted","Data":"61340bfa651d099ba6cb9c475f2bbcd4cc3e55ebcd1f9b543ec0c3f0ce8a7cd8"} Jun 08 19:29:57.914361 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:57.914331 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qrjqw" event={"ID":"744ddc5a-8124-4099-a1a1-88de388de52d","Type":"ContainerStarted","Data":"b212d971f5bbe5bae2db37f803219b79610903f983f0ccaa7cdc5dbcda7188f2"} Jun 08 19:29:58.246101 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:58.246067 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:58.308416 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:58.308354 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:29:58.919873 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:58.919837 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kb8br" event={"ID":"93f9918f-d2e6-4a90-9af3-372ff33abf82","Type":"ContainerStarted","Data":"1680cbadc298c164aa862a1df3623bf8fe9040e653f6ecd26af37e573129d0e4"} Jun 08 19:29:58.921422 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:58.921395 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qrjqw" event={"ID":"744ddc5a-8124-4099-a1a1-88de388de52d","Type":"ContainerStarted","Data":"2cf3e9af22c40bb7cc568d778302a46734ae019fe9a23054a15a05e41a50264a"} Jun 08 19:29:58.921604 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:58.921583 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qrjqw" Jun 08 19:29:58.926573 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:58.926551 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qrjqw" Jun 08 19:29:58.938738 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:58.938683 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qrjqw" podStartSLOduration=1.03420603 podStartE2EDuration="1.938669284s" totalImagesPullingTime="904.463254ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:29:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:29:58.93821809 +0000 UTC m=+215.073674530" watchObservedRunningTime="2026-06-08 19:29:58.938669284 +0000 UTC m=+215.074125723" Jun 08 19:29:59.926346 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:59.926308 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kb8br" event={"ID":"93f9918f-d2e6-4a90-9af3-372ff33abf82","Type":"ContainerStarted","Data":"00ca46321568859de53a8eede277c644c98514e72eeb35d1100ae8b212fdacfe"} Jun 08 19:29:59.947831 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:59.947783 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kb8br" podStartSLOduration=1.170512119 podStartE2EDuration="2.947765759s" totalImagesPullingTime="1.77725364s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:29:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:29:59.946382005 +0000 UTC m=+216.081838444" watchObservedRunningTime="2026-06-08 19:29:59.947765759 +0000 UTC m=+216.083222199" Jun 08 19:29:59.992692 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:29:59.992661 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:00.080713 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:00.080668 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:00.436473 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:00.436443 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:00.940246 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:00.940210 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:01.009310 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:01.009280 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:01.075529 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:01.075487 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:02.862765 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:02.862698 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:04.315217 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:04.315173 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:04.416148 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:04.416115 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:05.153903 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.153868 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:05.475686 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.475598 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:05.560093 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.560065 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-mh4xm"] Jun 08 19:30:05.563355 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.563337 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mh4xm" Jun 08 19:30:05.566761 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.566736 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 08 19:30:05.566857 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.566783 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-fqj8x\"" Jun 08 19:30:05.567955 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.567937 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 08 19:30:05.568070 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.567938 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 19:30:05.573330 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.573310 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2"] Jun 08 19:30:05.576637 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.576615 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2" Jun 08 19:30:05.578139 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.578120 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-mh4xm"] Jun 08 19:30:05.579707 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.579685 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 08 19:30:05.580248 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.580229 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 08 19:30:05.580333 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.580293 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-5dmfw\"" Jun 08 19:30:05.580666 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.580648 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 08 19:30:05.585559 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.585538 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:05.593678 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.593647 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2"] Jun 08 19:30:05.606240 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.606222 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-l6z8s"] Jun 08 19:30:05.609196 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.609181 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:05.611945 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.611923 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 19:30:05.612137 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.612122 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 19:30:05.612231 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.612215 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zcd7h\"" Jun 08 19:30:05.612369 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.612354 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 19:30:05.670874 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.670849 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bef0989-3453-4707-b54f-2f721ee2ea4c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-mh4xm\" (UID: \"3bef0989-3453-4707-b54f-2f721ee2ea4c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mh4xm" Jun 08 19:30:05.671037 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.670885 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3bef0989-3453-4707-b54f-2f721ee2ea4c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-mh4xm\" (UID: \"3bef0989-3453-4707-b54f-2f721ee2ea4c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mh4xm" Jun 08 19:30:05.671037 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.670911 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrb6z\" (UniqueName: \"kubernetes.io/projected/3bef0989-3453-4707-b54f-2f721ee2ea4c-kube-api-access-qrb6z\") pod \"openshift-state-metrics-65f78d5c66-mh4xm\" (UID: \"3bef0989-3453-4707-b54f-2f721ee2ea4c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mh4xm" Jun 08 19:30:05.671037 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.670930 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bef0989-3453-4707-b54f-2f721ee2ea4c-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-mh4xm\" (UID: \"3bef0989-3453-4707-b54f-2f721ee2ea4c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mh4xm" Jun 08 19:30:05.671194 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.671051 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-metrics-client-ca\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:05.671194 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.671084 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsqx2\" (UniqueName: \"kubernetes.io/projected/fa14e65a-8887-47f8-aad0-e1c8058e7164-kube-api-access-qsqx2\") pod \"kube-state-metrics-57bbf8bfb5-k4jq2\" (UID: \"fa14e65a-8887-47f8-aad0-e1c8058e7164\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2" Jun 08 19:30:05.671194 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.671128 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fa14e65a-8887-47f8-aad0-e1c8058e7164-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-k4jq2\" (UID: \"fa14e65a-8887-47f8-aad0-e1c8058e7164\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2" Jun 08 19:30:05.671194 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.671151 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-node-exporter-accelerators-collector-config\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:05.671194 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.671177 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa14e65a-8887-47f8-aad0-e1c8058e7164-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-k4jq2\" (UID: \"fa14e65a-8887-47f8-aad0-e1c8058e7164\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2" Jun 08 19:30:05.671429 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.671205 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fa14e65a-8887-47f8-aad0-e1c8058e7164-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-k4jq2\" (UID: \"fa14e65a-8887-47f8-aad0-e1c8058e7164\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2" Jun 08 19:30:05.671429 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.671235 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-node-exporter-textfile\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:05.671429 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.671278 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa14e65a-8887-47f8-aad0-e1c8058e7164-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-k4jq2\" (UID: \"fa14e65a-8887-47f8-aad0-e1c8058e7164\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2" Jun 08 19:30:05.671429 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.671300 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-sys\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:05.671429 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.671355 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-node-exporter-wtmp\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:05.671429 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.671384 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa14e65a-8887-47f8-aad0-e1c8058e7164-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-k4jq2\" (UID: \"fa14e65a-8887-47f8-aad0-e1c8058e7164\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2" Jun 08 19:30:05.671783 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.671426 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:05.671783 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.671458 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-root\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:05.671783 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.671483 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-node-exporter-tls\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:05.671783 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.671507 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkn68\" (UniqueName: \"kubernetes.io/projected/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-kube-api-access-wkn68\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:05.675859 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.675836 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:05.772683 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.772610 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3bef0989-3453-4707-b54f-2f721ee2ea4c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-mh4xm\" (UID: \"3bef0989-3453-4707-b54f-2f721ee2ea4c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mh4xm" Jun 08 19:30:05.772683 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.772645 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrb6z\" (UniqueName: \"kubernetes.io/projected/3bef0989-3453-4707-b54f-2f721ee2ea4c-kube-api-access-qrb6z\") pod \"openshift-state-metrics-65f78d5c66-mh4xm\" (UID: \"3bef0989-3453-4707-b54f-2f721ee2ea4c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mh4xm" Jun 08 19:30:05.772683 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.772662 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bef0989-3453-4707-b54f-2f721ee2ea4c-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-mh4xm\" (UID: \"3bef0989-3453-4707-b54f-2f721ee2ea4c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mh4xm" Jun 08 19:30:05.772964 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.772708 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-metrics-client-ca\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:05.772964 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.772749 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsqx2\" (UniqueName: \"kubernetes.io/projected/fa14e65a-8887-47f8-aad0-e1c8058e7164-kube-api-access-qsqx2\") pod \"kube-state-metrics-57bbf8bfb5-k4jq2\" (UID: \"fa14e65a-8887-47f8-aad0-e1c8058e7164\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2" Jun 08 19:30:05.772964 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.772787 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fa14e65a-8887-47f8-aad0-e1c8058e7164-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-k4jq2\" (UID: \"fa14e65a-8887-47f8-aad0-e1c8058e7164\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2" Jun 08 19:30:05.772964 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.772812 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-node-exporter-accelerators-collector-config\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:05.772964 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.772838 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa14e65a-8887-47f8-aad0-e1c8058e7164-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-k4jq2\" (UID: \"fa14e65a-8887-47f8-aad0-e1c8058e7164\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2" Jun 08 19:30:05.772964 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.772877 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fa14e65a-8887-47f8-aad0-e1c8058e7164-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-k4jq2\" (UID: \"fa14e65a-8887-47f8-aad0-e1c8058e7164\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2" Jun 08 19:30:05.772964 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.772898 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-node-exporter-textfile\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:05.772964 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.772941 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa14e65a-8887-47f8-aad0-e1c8058e7164-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-k4jq2\" (UID: \"fa14e65a-8887-47f8-aad0-e1c8058e7164\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2" Jun 08 19:30:05.772964 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.772963 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-sys\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:05.773382 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.772986 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-node-exporter-wtmp\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:05.773382 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.773017 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa14e65a-8887-47f8-aad0-e1c8058e7164-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-k4jq2\" (UID: \"fa14e65a-8887-47f8-aad0-e1c8058e7164\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2" Jun 08 19:30:05.773382 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.773060 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:05.773382 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.773084 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-root\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:05.773382 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.773115 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-node-exporter-tls\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:05.773382 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.773155 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkn68\" (UniqueName: \"kubernetes.io/projected/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-kube-api-access-wkn68\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:05.773382 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.773184 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bef0989-3453-4707-b54f-2f721ee2ea4c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-mh4xm\" (UID: \"3bef0989-3453-4707-b54f-2f721ee2ea4c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mh4xm" Jun 08 19:30:05.773732 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.773547 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-node-exporter-accelerators-collector-config\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:05.773732 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.773572 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-metrics-client-ca\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:05.773926 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.773896 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fa14e65a-8887-47f8-aad0-e1c8058e7164-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-k4jq2\" (UID: \"fa14e65a-8887-47f8-aad0-e1c8058e7164\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2" Jun 08 19:30:05.774095 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.774073 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-node-exporter-wtmp\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:05.774175 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:30:05.774161 2573 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 08 19:30:05.774231 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:30:05.774220 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa14e65a-8887-47f8-aad0-e1c8058e7164-kube-state-metrics-tls podName:fa14e65a-8887-47f8-aad0-e1c8058e7164 nodeName:}" failed. No retries permitted until 2026-06-08 19:30:06.274200285 +0000 UTC m=+222.409656716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/fa14e65a-8887-47f8-aad0-e1c8058e7164-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-k4jq2" (UID: "fa14e65a-8887-47f8-aad0-e1c8058e7164") : secret "kube-state-metrics-tls" not found Jun 08 19:30:05.774472 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.774452 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bef0989-3453-4707-b54f-2f721ee2ea4c-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-mh4xm\" (UID: \"3bef0989-3453-4707-b54f-2f721ee2ea4c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mh4xm" Jun 08 19:30:05.774704 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.774680 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa14e65a-8887-47f8-aad0-e1c8058e7164-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-k4jq2\" (UID: \"fa14e65a-8887-47f8-aad0-e1c8058e7164\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2" Jun 08 19:30:05.774826 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.774806 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-sys\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:05.775056 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:30:05.775039 2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 08 19:30:05.775817 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:30:05.775803 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-node-exporter-tls podName:0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040 nodeName:}" failed. No retries permitted until 2026-06-08 19:30:06.275785821 +0000 UTC m=+222.411242243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-node-exporter-tls") pod "node-exporter-l6z8s" (UID: "0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040") : secret "node-exporter-tls" not found Jun 08 19:30:05.775929 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.775670 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-node-exporter-textfile\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:05.776029 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.775247 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-root\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:05.777076 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.777051 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bef0989-3453-4707-b54f-2f721ee2ea4c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-mh4xm\" (UID: \"3bef0989-3453-4707-b54f-2f721ee2ea4c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mh4xm" Jun 08 19:30:05.779080 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.778608 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa14e65a-8887-47f8-aad0-e1c8058e7164-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-k4jq2\" (UID: \"fa14e65a-8887-47f8-aad0-e1c8058e7164\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2" Jun 08 19:30:05.779080 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.778645 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:05.779080 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.778802 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fa14e65a-8887-47f8-aad0-e1c8058e7164-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-k4jq2\" (UID: \"fa14e65a-8887-47f8-aad0-e1c8058e7164\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2" Jun 08 19:30:05.779383 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.779282 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3bef0989-3453-4707-b54f-2f721ee2ea4c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-mh4xm\" (UID: \"3bef0989-3453-4707-b54f-2f721ee2ea4c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mh4xm" Jun 08 19:30:05.780156 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.780133 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:05.782283 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.782241 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsqx2\" (UniqueName: \"kubernetes.io/projected/fa14e65a-8887-47f8-aad0-e1c8058e7164-kube-api-access-qsqx2\") pod \"kube-state-metrics-57bbf8bfb5-k4jq2\" (UID: \"fa14e65a-8887-47f8-aad0-e1c8058e7164\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2" Jun 08 19:30:05.782568 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.782534 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrb6z\" (UniqueName: \"kubernetes.io/projected/3bef0989-3453-4707-b54f-2f721ee2ea4c-kube-api-access-qrb6z\") pod \"openshift-state-metrics-65f78d5c66-mh4xm\" (UID: \"3bef0989-3453-4707-b54f-2f721ee2ea4c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mh4xm" Jun 08 19:30:05.783466 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.783446 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkn68\" (UniqueName: \"kubernetes.io/projected/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-kube-api-access-wkn68\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:05.872947 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.872908 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mh4xm" Jun 08 19:30:05.882138 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.882112 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:05.984786 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:05.984752 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:06.016274 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.016252 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-mh4xm"] Jun 08 19:30:06.018146 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:30:06.018117 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bef0989_3453_4707_b54f_2f721ee2ea4c.slice/crio-c5d14b7a9855694773b719c357c6f89be20afec3a7acbacaff00a7540d550c9d WatchSource:0}: Error finding container c5d14b7a9855694773b719c357c6f89be20afec3a7acbacaff00a7540d550c9d: Status 404 returned error can't find the container with id c5d14b7a9855694773b719c357c6f89be20afec3a7acbacaff00a7540d550c9d Jun 08 19:30:06.086180 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.086155 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:06.192835 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.192803 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:06.279604 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.279511 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa14e65a-8887-47f8-aad0-e1c8058e7164-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-k4jq2\" (UID: \"fa14e65a-8887-47f8-aad0-e1c8058e7164\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2" Jun 08 19:30:06.279604 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.279582 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-node-exporter-tls\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:06.281874 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.281848 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa14e65a-8887-47f8-aad0-e1c8058e7164-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-k4jq2\" (UID: \"fa14e65a-8887-47f8-aad0-e1c8058e7164\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2" Jun 08 19:30:06.281974 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.281897 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040-node-exporter-tls\") pod \"node-exporter-l6z8s\" (UID: \"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040\") " pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:06.397822 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.397788 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:06.486846 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.486808 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2" Jun 08 19:30:06.495043 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.495008 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:06.500848 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.500827 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 19:30:06.505296 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.505277 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.508162 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.508137 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 19:30:06.508270 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.508232 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 19:30:06.508334 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.508295 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 19:30:06.508397 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.508359 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 19:30:06.508397 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.508137 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 19:30:06.508649 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.508634 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 19:30:06.508649 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.508641 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 19:30:06.508795 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.508680 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 19:30:06.508999 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.508980 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 19:30:06.509333 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.509315 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pjdr8\"" Jun 08 19:30:06.518868 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.518849 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l6z8s" Jun 08 19:30:06.524514 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.524491 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 19:30:06.530859 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:30:06.530794 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a3c8a2b_7a47_4d3b_89c6_edd79a8d8040.slice/crio-1a1739245784ceab0a9fd8b0f587d9405345784c1abbd86eaf5741ec4af1f791 WatchSource:0}: Error finding container 1a1739245784ceab0a9fd8b0f587d9405345784c1abbd86eaf5741ec4af1f791: Status 404 returned error can't find the container with id 1a1739245784ceab0a9fd8b0f587d9405345784c1abbd86eaf5741ec4af1f791 Jun 08 19:30:06.581630 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.581603 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.581786 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.581635 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.581786 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.581712 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.581786 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.581756 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-config-out\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.581786 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.581775 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.582015 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.581814 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brmgc\" (UniqueName: \"kubernetes.io/projected/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-kube-api-access-brmgc\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.582015 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.581849 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.582015 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.581873 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.582015 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.581900 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.582015 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.581917 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.582015 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.581952 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-config-volume\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.582015 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.581981 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-web-config\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.582015 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.582004 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.617546 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.617510 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:06.628254 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.628231 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2"] Jun 08 19:30:06.631415 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:30:06.631393 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa14e65a_8887_47f8_aad0_e1c8058e7164.slice/crio-91caba6eaa999790c0c3585a518f0f4ccbb053eb87768281c9c755aa008561ab WatchSource:0}: Error finding container 91caba6eaa999790c0c3585a518f0f4ccbb053eb87768281c9c755aa008561ab: Status 404 returned error can't find the container with id 91caba6eaa999790c0c3585a518f0f4ccbb053eb87768281c9c755aa008561ab Jun 08 19:30:06.683195 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.683165 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.683389 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.683214 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.683389 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.683249 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-config-volume\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.683389 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.683273 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-web-config\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.683389 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.683296 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.683389 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.683364 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.683644 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.683428 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.683644 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.683462 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.683644 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.683477 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-config-out\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.683644 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.683492 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.683644 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.683507 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brmgc\" (UniqueName: \"kubernetes.io/projected/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-kube-api-access-brmgc\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.683644 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.683523 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.683644 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.683543 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.683995 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:30:06.683657 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-alertmanager-trusted-ca-bundle podName:2f0c0a80-03d1-43ca-abe1-15f15b5ddf78 nodeName:}" failed. No retries permitted until 2026-06-08 19:30:07.183637502 +0000 UTC m=+223.319093922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "2f0c0a80-03d1-43ca-abe1-15f15b5ddf78") : configmap references non-existent config key: ca-bundle.crt Jun 08 19:30:06.684054 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.683996 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.684347 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.684262 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.687327 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.687025 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-config-out\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.687327 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.687253 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.687502 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.687338 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.687636 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.687613 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-config-volume\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.687853 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.687807 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.687999 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.687981 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-web-config\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.688387 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.688369 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.689087 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.689064 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.689340 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.689317 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.695003 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.694972 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brmgc\" (UniqueName: \"kubernetes.io/projected/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-kube-api-access-brmgc\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:06.954789 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.954748 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2" event={"ID":"fa14e65a-8887-47f8-aad0-e1c8058e7164","Type":"ContainerStarted","Data":"91caba6eaa999790c0c3585a518f0f4ccbb053eb87768281c9c755aa008561ab"} Jun 08 19:30:06.956028 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.956003 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l6z8s" event={"ID":"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040","Type":"ContainerStarted","Data":"1a1739245784ceab0a9fd8b0f587d9405345784c1abbd86eaf5741ec4af1f791"} Jun 08 19:30:06.957977 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.957937 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mh4xm" event={"ID":"3bef0989-3453-4707-b54f-2f721ee2ea4c","Type":"ContainerStarted","Data":"a7e6bdfff645b1c47635034bfe92f75df023ef4e96c4a8161ba539a79d46ffe8"} Jun 08 19:30:06.958077 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.958004 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mh4xm" event={"ID":"3bef0989-3453-4707-b54f-2f721ee2ea4c","Type":"ContainerStarted","Data":"28fa0c9c593abcc3e7e3183c8af892c6dabf102327f49063ff82acbf100613e0"} Jun 08 19:30:06.958077 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:06.958036 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mh4xm" event={"ID":"3bef0989-3453-4707-b54f-2f721ee2ea4c","Type":"ContainerStarted","Data":"c5d14b7a9855694773b719c357c6f89be20afec3a7acbacaff00a7540d550c9d"} Jun 08 19:30:07.190315 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.190263 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:07.191230 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.191197 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:07.416098 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.416065 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:30:07.502367 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.501252 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6b59b59ff-5k4kc"] Jun 08 19:30:07.511927 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.509029 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:07.511927 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.511695 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 08 19:30:07.512153 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.512065 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 08 19:30:07.516826 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.512269 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 08 19:30:07.516826 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.512552 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-b76r4gbq54i8n\"" Jun 08 19:30:07.516826 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.513110 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hzm7r\"" Jun 08 19:30:07.516826 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.513286 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 08 19:30:07.516826 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.513478 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 08 19:30:07.516826 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.515873 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b59b59ff-5k4kc"] Jun 08 19:30:07.597618 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.597578 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/496b72bc-efb8-475c-a2a5-69c9a5ad0831-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b59b59ff-5k4kc\" (UID: \"496b72bc-efb8-475c-a2a5-69c9a5ad0831\") " pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:07.597836 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.597636 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/496b72bc-efb8-475c-a2a5-69c9a5ad0831-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b59b59ff-5k4kc\" (UID: \"496b72bc-efb8-475c-a2a5-69c9a5ad0831\") " pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:07.597836 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.597683 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/496b72bc-efb8-475c-a2a5-69c9a5ad0831-secret-grpc-tls\") pod \"thanos-querier-6b59b59ff-5k4kc\" (UID: \"496b72bc-efb8-475c-a2a5-69c9a5ad0831\") " pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:07.597836 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.597752 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/496b72bc-efb8-475c-a2a5-69c9a5ad0831-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b59b59ff-5k4kc\" (UID: \"496b72bc-efb8-475c-a2a5-69c9a5ad0831\") " pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:07.597836 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.597802 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/496b72bc-efb8-475c-a2a5-69c9a5ad0831-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b59b59ff-5k4kc\" (UID: \"496b72bc-efb8-475c-a2a5-69c9a5ad0831\") " pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:07.597836 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.597831 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jk6t\" (UniqueName: \"kubernetes.io/projected/496b72bc-efb8-475c-a2a5-69c9a5ad0831-kube-api-access-7jk6t\") pod \"thanos-querier-6b59b59ff-5k4kc\" (UID: \"496b72bc-efb8-475c-a2a5-69c9a5ad0831\") " pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:07.598105 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.597929 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/496b72bc-efb8-475c-a2a5-69c9a5ad0831-secret-thanos-querier-tls\") pod \"thanos-querier-6b59b59ff-5k4kc\" (UID: \"496b72bc-efb8-475c-a2a5-69c9a5ad0831\") " pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:07.598105 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.597992 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/496b72bc-efb8-475c-a2a5-69c9a5ad0831-metrics-client-ca\") pod \"thanos-querier-6b59b59ff-5k4kc\" (UID: \"496b72bc-efb8-475c-a2a5-69c9a5ad0831\") " pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:07.607226 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.607195 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 19:30:07.699300 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.699204 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/496b72bc-efb8-475c-a2a5-69c9a5ad0831-secret-thanos-querier-tls\") pod \"thanos-querier-6b59b59ff-5k4kc\" (UID: \"496b72bc-efb8-475c-a2a5-69c9a5ad0831\") " pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:07.699300 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.699281 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/496b72bc-efb8-475c-a2a5-69c9a5ad0831-metrics-client-ca\") pod \"thanos-querier-6b59b59ff-5k4kc\" (UID: \"496b72bc-efb8-475c-a2a5-69c9a5ad0831\") " pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:07.699521 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.699316 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/496b72bc-efb8-475c-a2a5-69c9a5ad0831-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b59b59ff-5k4kc\" (UID: \"496b72bc-efb8-475c-a2a5-69c9a5ad0831\") " pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:07.699521 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.699347 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/496b72bc-efb8-475c-a2a5-69c9a5ad0831-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b59b59ff-5k4kc\" (UID: \"496b72bc-efb8-475c-a2a5-69c9a5ad0831\") " pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:07.699521 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.699371 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/496b72bc-efb8-475c-a2a5-69c9a5ad0831-secret-grpc-tls\") pod \"thanos-querier-6b59b59ff-5k4kc\" (UID: \"496b72bc-efb8-475c-a2a5-69c9a5ad0831\") " pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:07.699521 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.699408 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/496b72bc-efb8-475c-a2a5-69c9a5ad0831-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b59b59ff-5k4kc\" (UID: \"496b72bc-efb8-475c-a2a5-69c9a5ad0831\") " pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:07.699521 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.699458 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/496b72bc-efb8-475c-a2a5-69c9a5ad0831-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b59b59ff-5k4kc\" (UID: \"496b72bc-efb8-475c-a2a5-69c9a5ad0831\") " pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:07.699521 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.699492 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jk6t\" (UniqueName: \"kubernetes.io/projected/496b72bc-efb8-475c-a2a5-69c9a5ad0831-kube-api-access-7jk6t\") pod \"thanos-querier-6b59b59ff-5k4kc\" (UID: \"496b72bc-efb8-475c-a2a5-69c9a5ad0831\") " pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:07.700273 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.700200 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/496b72bc-efb8-475c-a2a5-69c9a5ad0831-metrics-client-ca\") pod \"thanos-querier-6b59b59ff-5k4kc\" (UID: \"496b72bc-efb8-475c-a2a5-69c9a5ad0831\") " pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:07.702460 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.702436 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/496b72bc-efb8-475c-a2a5-69c9a5ad0831-secret-thanos-querier-tls\") pod \"thanos-querier-6b59b59ff-5k4kc\" (UID: \"496b72bc-efb8-475c-a2a5-69c9a5ad0831\") " pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:07.702581 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.702487 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/496b72bc-efb8-475c-a2a5-69c9a5ad0831-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b59b59ff-5k4kc\" (UID: \"496b72bc-efb8-475c-a2a5-69c9a5ad0831\") " pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:07.702702 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.702679 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/496b72bc-efb8-475c-a2a5-69c9a5ad0831-secret-grpc-tls\") pod \"thanos-querier-6b59b59ff-5k4kc\" (UID: \"496b72bc-efb8-475c-a2a5-69c9a5ad0831\") " pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:07.702818 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.702703 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/496b72bc-efb8-475c-a2a5-69c9a5ad0831-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b59b59ff-5k4kc\" (UID: \"496b72bc-efb8-475c-a2a5-69c9a5ad0831\") " pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:07.702884 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.702839 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/496b72bc-efb8-475c-a2a5-69c9a5ad0831-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b59b59ff-5k4kc\" (UID: \"496b72bc-efb8-475c-a2a5-69c9a5ad0831\") " pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:07.703080 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.703056 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/496b72bc-efb8-475c-a2a5-69c9a5ad0831-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b59b59ff-5k4kc\" (UID: \"496b72bc-efb8-475c-a2a5-69c9a5ad0831\") " pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:07.712501 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.712479 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jk6t\" (UniqueName: \"kubernetes.io/projected/496b72bc-efb8-475c-a2a5-69c9a5ad0831-kube-api-access-7jk6t\") pod \"thanos-querier-6b59b59ff-5k4kc\" (UID: \"496b72bc-efb8-475c-a2a5-69c9a5ad0831\") " pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:07.743737 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.743690 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:07.755444 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:30:07.755415 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f0c0a80_03d1_43ca_abe1_15f15b5ddf78.slice/crio-d65cd7b25a9a3a887f11292d42a0137f53cc61f86557ca14b763f8e6ec398c07 WatchSource:0}: Error finding container d65cd7b25a9a3a887f11292d42a0137f53cc61f86557ca14b763f8e6ec398c07: Status 404 returned error can't find the container with id d65cd7b25a9a3a887f11292d42a0137f53cc61f86557ca14b763f8e6ec398c07 Jun 08 19:30:07.817941 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.817897 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:07.829153 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.829132 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:07.964776 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.964674 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78","Type":"ContainerStarted","Data":"d65cd7b25a9a3a887f11292d42a0137f53cc61f86557ca14b763f8e6ec398c07"} Jun 08 19:30:07.966894 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.966864 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mh4xm" event={"ID":"3bef0989-3453-4707-b54f-2f721ee2ea4c","Type":"ContainerStarted","Data":"f4652c8ce1ce3b3317fb0911602ee1a5535306dc4aafa6a3ff0acbe7aeee0db4"} Jun 08 19:30:07.985031 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:07.984965 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mh4xm" podStartSLOduration=2.027695159 podStartE2EDuration="2.984945238s" totalImagesPullingTime="957.250079ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:30:07.983882765 +0000 UTC m=+224.119339223" watchObservedRunningTime="2026-06-08 19:30:07.984945238 +0000 UTC m=+224.120401681" Jun 08 19:30:08.255787 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:08.255129 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b59b59ff-5k4kc"] Jun 08 19:30:08.260044 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:30:08.260015 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod496b72bc_efb8_475c_a2a5_69c9a5ad0831.slice/crio-368d60a09781ccc6afc2a1457bc48c1daa6506d0479611cea9ed9ca0b353d47e WatchSource:0}: Error finding container 368d60a09781ccc6afc2a1457bc48c1daa6506d0479611cea9ed9ca0b353d47e: Status 404 returned error can't find the container with id 368d60a09781ccc6afc2a1457bc48c1daa6506d0479611cea9ed9ca0b353d47e Jun 08 19:30:08.395782 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:08.395645 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:08.496139 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:08.496012 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:08.597483 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:08.597384 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:08.666135 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:08.665991 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:08.973330 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:08.973298 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2" event={"ID":"fa14e65a-8887-47f8-aad0-e1c8058e7164","Type":"ContainerStarted","Data":"8b3cb34b9cac20d0d07b85c26d127eb038b7d9997ac99e29ff999fe7c8daf55e"} Jun 08 19:30:08.973486 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:08.973365 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2" event={"ID":"fa14e65a-8887-47f8-aad0-e1c8058e7164","Type":"ContainerStarted","Data":"b52140ec8c9e53795067e2b0e66220af422bcb0f057a4cfc8d332cb971df99fb"} Jun 08 19:30:08.973486 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:08.973395 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2" event={"ID":"fa14e65a-8887-47f8-aad0-e1c8058e7164","Type":"ContainerStarted","Data":"8d8ed05b03f895fd36b10d0951c692ac75e7f7953e62bfce06632acab94c9f2f"} Jun 08 19:30:08.974980 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:08.974956 2573 generic.go:356] "Generic (PLEG): container finished" podID="0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040" containerID="cc0ab4e07e3302752968fa2ab536ced04e76ec97a224cc5ee96363593db194e0" exitCode=0 Jun 08 19:30:08.975101 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:08.975037 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l6z8s" event={"ID":"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040","Type":"ContainerDied","Data":"cc0ab4e07e3302752968fa2ab536ced04e76ec97a224cc5ee96363593db194e0"} Jun 08 19:30:08.976167 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:08.976148 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" event={"ID":"496b72bc-efb8-475c-a2a5-69c9a5ad0831","Type":"ContainerStarted","Data":"368d60a09781ccc6afc2a1457bc48c1daa6506d0479611cea9ed9ca0b353d47e"} Jun 08 19:30:08.999303 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:08.999246 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-k4jq2" podStartSLOduration=2.5159389130000003 podStartE2EDuration="3.999228094s" totalImagesPullingTime="1.483289181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:30:08.997432075 +0000 UTC m=+225.132888541" watchObservedRunningTime="2026-06-08 19:30:08.999228094 +0000 UTC m=+225.134684536" Jun 08 19:30:09.200964 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:09.200889 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:09.822016 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:09.821981 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-8588b97df8-gtzkp"] Jun 08 19:30:09.825465 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:09.825444 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" Jun 08 19:30:09.828457 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:09.828430 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 08 19:30:09.829924 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:09.829899 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2j8hgh4jeurdc\"" Jun 08 19:30:09.830056 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:09.829901 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qjzjk\"" Jun 08 19:30:09.831314 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:09.831294 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 08 19:30:09.831432 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:09.831314 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 08 19:30:09.832064 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:09.832001 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 08 19:30:09.839157 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:09.839137 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8588b97df8-gtzkp"] Jun 08 19:30:09.921111 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:09.921081 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t572s\" (UniqueName: \"kubernetes.io/projected/3f44c47f-fb48-49f3-8c3e-06c315a91917-kube-api-access-t572s\") pod \"metrics-server-8588b97df8-gtzkp\" (UID: \"3f44c47f-fb48-49f3-8c3e-06c315a91917\") " pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" Jun 08 19:30:09.921111 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:09.921115 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3f44c47f-fb48-49f3-8c3e-06c315a91917-secret-metrics-server-tls\") pod \"metrics-server-8588b97df8-gtzkp\" (UID: \"3f44c47f-fb48-49f3-8c3e-06c315a91917\") " pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" Jun 08 19:30:09.921280 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:09.921155 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f44c47f-fb48-49f3-8c3e-06c315a91917-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8588b97df8-gtzkp\" (UID: \"3f44c47f-fb48-49f3-8c3e-06c315a91917\") " pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" Jun 08 19:30:09.921280 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:09.921173 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3f44c47f-fb48-49f3-8c3e-06c315a91917-metrics-server-audit-profiles\") pod \"metrics-server-8588b97df8-gtzkp\" (UID: \"3f44c47f-fb48-49f3-8c3e-06c315a91917\") " pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" Jun 08 19:30:09.921280 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:09.921202 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3f44c47f-fb48-49f3-8c3e-06c315a91917-audit-log\") pod \"metrics-server-8588b97df8-gtzkp\" (UID: \"3f44c47f-fb48-49f3-8c3e-06c315a91917\") " pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" Jun 08 19:30:09.921403 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:09.921291 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f44c47f-fb48-49f3-8c3e-06c315a91917-client-ca-bundle\") pod \"metrics-server-8588b97df8-gtzkp\" (UID: \"3f44c47f-fb48-49f3-8c3e-06c315a91917\") " pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" Jun 08 19:30:09.921403 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:09.921320 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3f44c47f-fb48-49f3-8c3e-06c315a91917-secret-metrics-server-client-certs\") pod \"metrics-server-8588b97df8-gtzkp\" (UID: \"3f44c47f-fb48-49f3-8c3e-06c315a91917\") " pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" Jun 08 19:30:09.982131 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:09.982102 2573 generic.go:356] "Generic (PLEG): container finished" podID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerID="1aeff2fae6220d8d9e066c94d0752cb985d441ca77b2599ee9c83d38d64a3234" exitCode=0 Jun 08 19:30:09.982316 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:09.982224 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78","Type":"ContainerDied","Data":"1aeff2fae6220d8d9e066c94d0752cb985d441ca77b2599ee9c83d38d64a3234"} Jun 08 19:30:09.984859 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:09.984832 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l6z8s" event={"ID":"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040","Type":"ContainerStarted","Data":"cd670d1fa903c33d7e9d509a1f52df2f7af0b7bc5023151d6efa3261aa8f459f"} Jun 08 19:30:09.984989 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:09.984884 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l6z8s" event={"ID":"0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040","Type":"ContainerStarted","Data":"3a85a462a5500b54050ee3427092829bc97bbc4f7c07eaac9d2e565cc6f501a7"} Jun 08 19:30:10.021927 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.021896 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f44c47f-fb48-49f3-8c3e-06c315a91917-client-ca-bundle\") pod \"metrics-server-8588b97df8-gtzkp\" (UID: \"3f44c47f-fb48-49f3-8c3e-06c315a91917\") " pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" Jun 08 19:30:10.021927 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.021929 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3f44c47f-fb48-49f3-8c3e-06c315a91917-secret-metrics-server-client-certs\") pod \"metrics-server-8588b97df8-gtzkp\" (UID: \"3f44c47f-fb48-49f3-8c3e-06c315a91917\") " pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" Jun 08 19:30:10.022139 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.021954 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t572s\" (UniqueName: \"kubernetes.io/projected/3f44c47f-fb48-49f3-8c3e-06c315a91917-kube-api-access-t572s\") pod \"metrics-server-8588b97df8-gtzkp\" (UID: \"3f44c47f-fb48-49f3-8c3e-06c315a91917\") " pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" Jun 08 19:30:10.022139 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.021978 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3f44c47f-fb48-49f3-8c3e-06c315a91917-secret-metrics-server-tls\") pod \"metrics-server-8588b97df8-gtzkp\" (UID: \"3f44c47f-fb48-49f3-8c3e-06c315a91917\") " pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" Jun 08 19:30:10.022139 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.022030 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f44c47f-fb48-49f3-8c3e-06c315a91917-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8588b97df8-gtzkp\" (UID: \"3f44c47f-fb48-49f3-8c3e-06c315a91917\") " pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" Jun 08 19:30:10.022139 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.022048 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3f44c47f-fb48-49f3-8c3e-06c315a91917-metrics-server-audit-profiles\") pod \"metrics-server-8588b97df8-gtzkp\" (UID: \"3f44c47f-fb48-49f3-8c3e-06c315a91917\") " pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" Jun 08 19:30:10.022139 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.022069 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3f44c47f-fb48-49f3-8c3e-06c315a91917-audit-log\") pod \"metrics-server-8588b97df8-gtzkp\" (UID: \"3f44c47f-fb48-49f3-8c3e-06c315a91917\") " pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" Jun 08 19:30:10.022580 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.022554 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3f44c47f-fb48-49f3-8c3e-06c315a91917-audit-log\") pod \"metrics-server-8588b97df8-gtzkp\" (UID: \"3f44c47f-fb48-49f3-8c3e-06c315a91917\") " pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" Jun 08 19:30:10.028748 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.023295 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f44c47f-fb48-49f3-8c3e-06c315a91917-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8588b97df8-gtzkp\" (UID: \"3f44c47f-fb48-49f3-8c3e-06c315a91917\") " pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" Jun 08 19:30:10.028748 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.023460 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3f44c47f-fb48-49f3-8c3e-06c315a91917-metrics-server-audit-profiles\") pod \"metrics-server-8588b97df8-gtzkp\" (UID: \"3f44c47f-fb48-49f3-8c3e-06c315a91917\") " pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" Jun 08 19:30:10.028748 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.025816 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3f44c47f-fb48-49f3-8c3e-06c315a91917-secret-metrics-server-client-certs\") pod \"metrics-server-8588b97df8-gtzkp\" (UID: \"3f44c47f-fb48-49f3-8c3e-06c315a91917\") " pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" Jun 08 19:30:10.028748 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.027057 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f44c47f-fb48-49f3-8c3e-06c315a91917-client-ca-bundle\") pod \"metrics-server-8588b97df8-gtzkp\" (UID: \"3f44c47f-fb48-49f3-8c3e-06c315a91917\") " pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" Jun 08 19:30:10.031843 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.031712 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3f44c47f-fb48-49f3-8c3e-06c315a91917-secret-metrics-server-tls\") pod \"metrics-server-8588b97df8-gtzkp\" (UID: \"3f44c47f-fb48-49f3-8c3e-06c315a91917\") " pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" Jun 08 19:30:10.032011 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.031990 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t572s\" (UniqueName: \"kubernetes.io/projected/3f44c47f-fb48-49f3-8c3e-06c315a91917-kube-api-access-t572s\") pod \"metrics-server-8588b97df8-gtzkp\" (UID: \"3f44c47f-fb48-49f3-8c3e-06c315a91917\") " pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" Jun 08 19:30:10.047490 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.047440 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-l6z8s" podStartSLOduration=3.381621015 podStartE2EDuration="5.047424708s" totalImagesPullingTime="1.58207063s" totalInitContainerRuntime="83.733063ms" isStatefulPod=true podCreationTimestamp="2026-06-08 19:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:30:10.045835445 +0000 UTC m=+226.181291890" watchObservedRunningTime="2026-06-08 19:30:10.047424708 +0000 UTC m=+226.182881165" Jun 08 19:30:10.135901 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.135870 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" Jun 08 19:30:10.172422 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.172389 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:10.266233 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.266193 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:10.277136 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.276997 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8588b97df8-gtzkp"] Jun 08 19:30:10.279463 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:30:10.279425 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f44c47f_fb48_49f3_8c3e_06c315a91917.slice/crio-edbb27634887f98e850f08002039a1917e398b7cf7adfb3052b8fcb641c902b1 WatchSource:0}: Error finding container edbb27634887f98e850f08002039a1917e398b7cf7adfb3052b8fcb641c902b1: Status 404 returned error can't find the container with id edbb27634887f98e850f08002039a1917e398b7cf7adfb3052b8fcb641c902b1 Jun 08 19:30:10.561436 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.561399 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:10.756579 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.756549 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j"] Jun 08 19:30:10.760012 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.759986 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" Jun 08 19:30:10.764169 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.764148 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 08 19:30:10.764308 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.764151 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 08 19:30:10.764712 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.764539 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 08 19:30:10.764712 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.764623 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 08 19:30:10.764712 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.764656 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 08 19:30:10.766260 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.766044 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-w7fc6\"" Jun 08 19:30:10.771574 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.771552 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 08 19:30:10.774565 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.774543 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j"] Jun 08 19:30:10.931556 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.931479 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x2dz\" (UniqueName: \"kubernetes.io/projected/045290a7-123b-4bb9-ae82-55b1851dbbea-kube-api-access-4x2dz\") pod \"telemeter-client-5d878d5fcb-lbz7j\" (UID: \"045290a7-123b-4bb9-ae82-55b1851dbbea\") " pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" Jun 08 19:30:10.931556 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.931516 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/045290a7-123b-4bb9-ae82-55b1851dbbea-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d878d5fcb-lbz7j\" (UID: \"045290a7-123b-4bb9-ae82-55b1851dbbea\") " pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" Jun 08 19:30:10.931556 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.931545 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/045290a7-123b-4bb9-ae82-55b1851dbbea-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d878d5fcb-lbz7j\" (UID: \"045290a7-123b-4bb9-ae82-55b1851dbbea\") " pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" Jun 08 19:30:10.932011 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.931619 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/045290a7-123b-4bb9-ae82-55b1851dbbea-serving-certs-ca-bundle\") pod \"telemeter-client-5d878d5fcb-lbz7j\" (UID: \"045290a7-123b-4bb9-ae82-55b1851dbbea\") " pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" Jun 08 19:30:10.932011 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.931650 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/045290a7-123b-4bb9-ae82-55b1851dbbea-metrics-client-ca\") pod \"telemeter-client-5d878d5fcb-lbz7j\" (UID: \"045290a7-123b-4bb9-ae82-55b1851dbbea\") " pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" Jun 08 19:30:10.932011 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.931698 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/045290a7-123b-4bb9-ae82-55b1851dbbea-federate-client-tls\") pod \"telemeter-client-5d878d5fcb-lbz7j\" (UID: \"045290a7-123b-4bb9-ae82-55b1851dbbea\") " pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" Jun 08 19:30:10.932011 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.931805 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/045290a7-123b-4bb9-ae82-55b1851dbbea-secret-telemeter-client\") pod \"telemeter-client-5d878d5fcb-lbz7j\" (UID: \"045290a7-123b-4bb9-ae82-55b1851dbbea\") " pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" Jun 08 19:30:10.932011 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.931833 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/045290a7-123b-4bb9-ae82-55b1851dbbea-telemeter-client-tls\") pod \"telemeter-client-5d878d5fcb-lbz7j\" (UID: \"045290a7-123b-4bb9-ae82-55b1851dbbea\") " pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" Jun 08 19:30:10.990785 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:10.990757 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" event={"ID":"3f44c47f-fb48-49f3-8c3e-06c315a91917","Type":"ContainerStarted","Data":"edbb27634887f98e850f08002039a1917e398b7cf7adfb3052b8fcb641c902b1"} Jun 08 19:30:11.032712 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.032653 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/045290a7-123b-4bb9-ae82-55b1851dbbea-federate-client-tls\") pod \"telemeter-client-5d878d5fcb-lbz7j\" (UID: \"045290a7-123b-4bb9-ae82-55b1851dbbea\") " pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" Jun 08 19:30:11.032712 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.032709 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/045290a7-123b-4bb9-ae82-55b1851dbbea-secret-telemeter-client\") pod \"telemeter-client-5d878d5fcb-lbz7j\" (UID: \"045290a7-123b-4bb9-ae82-55b1851dbbea\") " pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" Jun 08 19:30:11.032855 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.032757 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/045290a7-123b-4bb9-ae82-55b1851dbbea-telemeter-client-tls\") pod \"telemeter-client-5d878d5fcb-lbz7j\" (UID: \"045290a7-123b-4bb9-ae82-55b1851dbbea\") " pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" Jun 08 19:30:11.032855 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.032778 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x2dz\" (UniqueName: \"kubernetes.io/projected/045290a7-123b-4bb9-ae82-55b1851dbbea-kube-api-access-4x2dz\") pod \"telemeter-client-5d878d5fcb-lbz7j\" (UID: \"045290a7-123b-4bb9-ae82-55b1851dbbea\") " pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" Jun 08 19:30:11.032855 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.032796 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/045290a7-123b-4bb9-ae82-55b1851dbbea-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d878d5fcb-lbz7j\" (UID: \"045290a7-123b-4bb9-ae82-55b1851dbbea\") " pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" Jun 08 19:30:11.032855 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.032826 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/045290a7-123b-4bb9-ae82-55b1851dbbea-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d878d5fcb-lbz7j\" (UID: \"045290a7-123b-4bb9-ae82-55b1851dbbea\") " pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" Jun 08 19:30:11.032855 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.032848 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/045290a7-123b-4bb9-ae82-55b1851dbbea-serving-certs-ca-bundle\") pod \"telemeter-client-5d878d5fcb-lbz7j\" (UID: \"045290a7-123b-4bb9-ae82-55b1851dbbea\") " pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" Jun 08 19:30:11.033144 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.032877 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/045290a7-123b-4bb9-ae82-55b1851dbbea-metrics-client-ca\") pod \"telemeter-client-5d878d5fcb-lbz7j\" (UID: \"045290a7-123b-4bb9-ae82-55b1851dbbea\") " pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" Jun 08 19:30:11.033653 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.033628 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/045290a7-123b-4bb9-ae82-55b1851dbbea-metrics-client-ca\") pod \"telemeter-client-5d878d5fcb-lbz7j\" (UID: \"045290a7-123b-4bb9-ae82-55b1851dbbea\") " pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" Jun 08 19:30:11.033828 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.033806 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/045290a7-123b-4bb9-ae82-55b1851dbbea-serving-certs-ca-bundle\") pod \"telemeter-client-5d878d5fcb-lbz7j\" (UID: \"045290a7-123b-4bb9-ae82-55b1851dbbea\") " pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" Jun 08 19:30:11.033892 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.033862 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/045290a7-123b-4bb9-ae82-55b1851dbbea-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d878d5fcb-lbz7j\" (UID: \"045290a7-123b-4bb9-ae82-55b1851dbbea\") " pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" Jun 08 19:30:11.035217 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.035189 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/045290a7-123b-4bb9-ae82-55b1851dbbea-secret-telemeter-client\") pod \"telemeter-client-5d878d5fcb-lbz7j\" (UID: \"045290a7-123b-4bb9-ae82-55b1851dbbea\") " pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" Jun 08 19:30:11.035489 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.035467 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/045290a7-123b-4bb9-ae82-55b1851dbbea-federate-client-tls\") pod \"telemeter-client-5d878d5fcb-lbz7j\" (UID: \"045290a7-123b-4bb9-ae82-55b1851dbbea\") " pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" Jun 08 19:30:11.035576 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.035493 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/045290a7-123b-4bb9-ae82-55b1851dbbea-telemeter-client-tls\") pod \"telemeter-client-5d878d5fcb-lbz7j\" (UID: \"045290a7-123b-4bb9-ae82-55b1851dbbea\") " pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" Jun 08 19:30:11.035633 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.035617 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/045290a7-123b-4bb9-ae82-55b1851dbbea-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d878d5fcb-lbz7j\" (UID: \"045290a7-123b-4bb9-ae82-55b1851dbbea\") " pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" Jun 08 19:30:11.041035 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.041014 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x2dz\" (UniqueName: \"kubernetes.io/projected/045290a7-123b-4bb9-ae82-55b1851dbbea-kube-api-access-4x2dz\") pod \"telemeter-client-5d878d5fcb-lbz7j\" (UID: \"045290a7-123b-4bb9-ae82-55b1851dbbea\") " pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" Jun 08 19:30:11.071639 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.071616 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" Jun 08 19:30:11.221858 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.221691 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j"] Jun 08 19:30:11.529884 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:30:11.529857 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod045290a7_123b_4bb9_ae82_55b1851dbbea.slice/crio-8eda22de7d4af76587a95b3ceeb435aaedacc0453ca3a091278939e95346b8c7 WatchSource:0}: Error finding container 8eda22de7d4af76587a95b3ceeb435aaedacc0453ca3a091278939e95346b8c7: Status 404 returned error can't find the container with id 8eda22de7d4af76587a95b3ceeb435aaedacc0453ca3a091278939e95346b8c7 Jun 08 19:30:11.691332 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.691292 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:11.697836 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.697809 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 19:30:11.702255 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.702237 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.732972 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.732950 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 08 19:30:11.733411 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.733389 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 08 19:30:11.733656 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.733613 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 08 19:30:11.733656 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.733624 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 08 19:30:11.733656 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.733632 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 08 19:30:11.734024 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.733975 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 08 19:30:11.736747 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.736711 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 08 19:30:11.736856 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.736712 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 08 19:30:11.737385 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.737367 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 08 19:30:11.737546 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.737510 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cvdivv8o0ovhm\"" Jun 08 19:30:11.737669 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.737611 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 08 19:30:11.737669 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.737617 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 08 19:30:11.737892 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.737875 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 08 19:30:11.738052 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.738041 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rk6h8\"" Jun 08 19:30:11.738113 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.738070 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 08 19:30:11.740644 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.740115 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 08 19:30:11.742395 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.740784 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 19:30:11.848747 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.848685 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.848908 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.848805 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.848908 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.848876 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.849018 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.848925 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvw5j\" (UniqueName: \"kubernetes.io/projected/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-kube-api-access-jvw5j\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.849018 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.848966 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.849018 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.848992 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.849175 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.849056 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.849175 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.849085 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.849175 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.849106 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.849175 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.849141 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.849345 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.849197 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.849345 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.849216 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.849345 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.849245 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-config\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.849345 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.849268 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.849345 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.849311 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-config-out\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.849563 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.849353 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.849563 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.849387 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.849563 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.849421 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.849563 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.849449 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.849563 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.849487 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-web-config\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.950611 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.950576 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.951082 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.950625 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvw5j\" (UniqueName: \"kubernetes.io/projected/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-kube-api-access-jvw5j\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.951082 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.950772 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.951082 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.950816 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.951082 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.950873 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.951082 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.950900 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.951082 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.950927 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.951082 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.951052 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.951452 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.951089 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.951452 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.951117 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.951452 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.951159 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-config\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.951452 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.951193 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.951452 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.951218 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-config-out\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.951452 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.951245 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.951452 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.951276 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.951452 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.951311 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.951452 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.951339 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.951452 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.951381 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-web-config\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.951955 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.951464 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.951955 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.951494 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.951955 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.951547 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.951955 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.951581 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.952184 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.952156 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.952408 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.952383 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.953380 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.953038 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.955116 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.954260 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.955116 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.954812 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.955116 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.954910 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.955331 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.955219 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.955389 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.955338 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.955731 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.955695 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.957008 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.956965 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.957008 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.956985 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-config-out\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.957177 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.957154 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.957876 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.957834 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.958270 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.958249 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-web-config\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.958368 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.958288 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-config\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.958696 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.958675 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.958804 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.958677 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.960806 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.960785 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvw5j\" (UniqueName: \"kubernetes.io/projected/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-kube-api-access-jvw5j\") pod \"prometheus-k8s-0\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:11.997635 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.997599 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78","Type":"ContainerStarted","Data":"ec3f3c41a786650efcd668913be315a8758c041eb6fed59a3f57a5bde1c29697"} Jun 08 19:30:11.999030 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:11.998998 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" event={"ID":"045290a7-123b-4bb9-ae82-55b1851dbbea","Type":"ContainerStarted","Data":"8eda22de7d4af76587a95b3ceeb435aaedacc0453ca3a091278939e95346b8c7"} Jun 08 19:30:12.001404 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:12.001377 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" event={"ID":"496b72bc-efb8-475c-a2a5-69c9a5ad0831","Type":"ContainerStarted","Data":"330847d5e16a589e5cb4e0de92587fd2b8dadf66119e229eab81462cd27259b8"} Jun 08 19:30:12.001477 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:12.001451 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" event={"ID":"496b72bc-efb8-475c-a2a5-69c9a5ad0831","Type":"ContainerStarted","Data":"9d0c8df2a070efc1f7371d1d31b0f29577d9943639fed71074ec426c23286feb"} Jun 08 19:30:12.001522 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:12.001478 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" event={"ID":"496b72bc-efb8-475c-a2a5-69c9a5ad0831","Type":"ContainerStarted","Data":"9cb197097d9a5c47739c53872e834bada7b5d847766501419b3a4cb4ec24d256"} Jun 08 19:30:12.012741 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:12.012703 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:12.188912 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:12.188880 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 19:30:12.194829 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:30:12.194804 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfaf1aa4_02d8_48ff_91b1_2b6bf769f8d2.slice/crio-f04b933f7fa4939dad534a1f3d9105eb15eaf97b7cfdb37d5d1f1bb4ceb6375e WatchSource:0}: Error finding container f04b933f7fa4939dad534a1f3d9105eb15eaf97b7cfdb37d5d1f1bb4ceb6375e: Status 404 returned error can't find the container with id f04b933f7fa4939dad534a1f3d9105eb15eaf97b7cfdb37d5d1f1bb4ceb6375e Jun 08 19:30:13.006753 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:13.006647 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" event={"ID":"3f44c47f-fb48-49f3-8c3e-06c315a91917","Type":"ContainerStarted","Data":"2d8f30a9ed6812b7be15a9ff0b7c086b6b7858e9f3291dd9c8199ecbbf3c9b32"} Jun 08 19:30:13.009611 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:13.009582 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" event={"ID":"496b72bc-efb8-475c-a2a5-69c9a5ad0831","Type":"ContainerStarted","Data":"b079b175516f10e844fa9ece63e62d9b97a06fdce723acab15bd4386a33ed3f5"} Jun 08 19:30:13.009769 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:13.009650 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" event={"ID":"496b72bc-efb8-475c-a2a5-69c9a5ad0831","Type":"ContainerStarted","Data":"e35295c2fdeb0b0d75d0c3f9de1a13ae9c61502a1f6189a90b5a5eb19c63e82a"} Jun 08 19:30:13.016516 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:13.011822 2573 generic.go:356] "Generic (PLEG): container finished" podID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerID="652208bdc62d8c34028c6e424499f9ecdf7185b9671310da3b83a2bac109b11a" exitCode=0 Jun 08 19:30:13.016516 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:13.011988 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2","Type":"ContainerDied","Data":"652208bdc62d8c34028c6e424499f9ecdf7185b9671310da3b83a2bac109b11a"} Jun 08 19:30:13.016516 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:13.012110 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2","Type":"ContainerStarted","Data":"f04b933f7fa4939dad534a1f3d9105eb15eaf97b7cfdb37d5d1f1bb4ceb6375e"} Jun 08 19:30:13.018116 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:13.018092 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78","Type":"ContainerStarted","Data":"a31984cae08a23b9ea793e57262ed0d159d1c0c1c49fc2ceed9f5c7a84485c56"} Jun 08 19:30:13.018246 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:13.018156 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78","Type":"ContainerStarted","Data":"c8cad964b711f5dc67bca291c7ba138db31e9ee2b3f0391a6326c2364b056714"} Jun 08 19:30:13.018246 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:13.018188 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78","Type":"ContainerStarted","Data":"99f22e1b41aaedc3810dbe16458d864a1e8a0ffbcda3c97cc3a29ec48e006367"} Jun 08 19:30:13.018246 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:13.018211 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78","Type":"ContainerStarted","Data":"a7251360132bd75e1a99567fb17980a5c3dbb29ad80441d70c229fecea89dfad"} Jun 08 19:30:13.018400 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:13.018249 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78","Type":"ContainerStarted","Data":"330452fdb4da81cdc21ab044d8c36c7ec683b480e5600acb8dac10db3a855e30"} Jun 08 19:30:13.029286 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:13.029248 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" podStartSLOduration=2.219744081 podStartE2EDuration="4.029214088s" totalImagesPullingTime="1.809470007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:30:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:30:13.027843547 +0000 UTC m=+229.163299988" watchObservedRunningTime="2026-06-08 19:30:13.029214088 +0000 UTC m=+229.164670528" Jun 08 19:30:13.064034 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:13.063982 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.804405223 podStartE2EDuration="7.063964835s" totalImagesPullingTime="3.2396474s" totalInitContainerRuntime="19.912212ms" isStatefulPod=false podCreationTimestamp="2026-06-08 19:30:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:30:13.062093396 +0000 UTC m=+229.197549857" watchObservedRunningTime="2026-06-08 19:30:13.063964835 +0000 UTC m=+229.199421276" Jun 08 19:30:14.024362 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:14.024325 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" event={"ID":"045290a7-123b-4bb9-ae82-55b1851dbbea","Type":"ContainerStarted","Data":"fdf457465cd52aa4ec80fdcf12a4585878f8caacc6f102aa1d391ae207e7de8d"} Jun 08 19:30:14.024824 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:14.024389 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" event={"ID":"045290a7-123b-4bb9-ae82-55b1851dbbea","Type":"ContainerStarted","Data":"448103bb959bf9af5e57ad7e1628febe2d39b68f732c836f6895dd4e69a7790a"} Jun 08 19:30:14.024824 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:14.024413 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" event={"ID":"045290a7-123b-4bb9-ae82-55b1851dbbea","Type":"ContainerStarted","Data":"5eba779e3ed68fcc3f2a6ebe56ed98f9f6fcebcc3b3a6e8d8f3781a359dd1e52"} Jun 08 19:30:14.027155 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:14.027122 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" event={"ID":"496b72bc-efb8-475c-a2a5-69c9a5ad0831","Type":"ContainerStarted","Data":"7645c07b4bc620a7cbdb7146ef4352d6ce11f17e99f9cc81fa5b0064c88ef02e"} Jun 08 19:30:14.027549 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:14.027530 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:14.050220 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:14.050172 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5d878d5fcb-lbz7j" podStartSLOduration=2.139225879 podStartE2EDuration="4.05015779s" totalImagesPullingTime="1.910931911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:30:14.048550509 +0000 UTC m=+230.184006951" watchObservedRunningTime="2026-06-08 19:30:14.05015779 +0000 UTC m=+230.185614232" Jun 08 19:30:14.073825 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:14.073774 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" podStartSLOduration=3.180086595 podStartE2EDuration="7.0737587s" totalImagesPullingTime="3.893672105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:30:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:30:14.072572009 +0000 UTC m=+230.208028463" watchObservedRunningTime="2026-06-08 19:30:14.0737587 +0000 UTC m=+230.209215142" Jun 08 19:30:16.310358 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:16.310321 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:16.411755 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:16.411702 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:17.045190 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:17.045158 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2","Type":"ContainerStarted","Data":"30d63c45d9babd888f427a945cbf74f0e42d3662fd34a2fb47916a6b64f4d36b"} Jun 08 19:30:17.045356 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:17.045219 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2","Type":"ContainerStarted","Data":"69e867ad0876fc87e2dce930e779da8461d1a368e611eb6e40cedbcc603bc6c8"} Jun 08 19:30:17.045356 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:17.045245 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2","Type":"ContainerStarted","Data":"2116a2cd6f63c3242c3bf8e9f80acadee38ccf3d803acf6dcc414f09ec26640c"} Jun 08 19:30:17.045356 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:17.045269 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2","Type":"ContainerStarted","Data":"c0da0c8fb01aa64d69c72e9a8fd8c47fa535d674972d9c4a8c430f20e94351eb"} Jun 08 19:30:17.045356 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:17.045292 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2","Type":"ContainerStarted","Data":"53d3b4655378227a05acdf65f21f5f13ed123dd701132b2ea517ba381c1203c4"} Jun 08 19:30:17.045356 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:17.045321 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2","Type":"ContainerStarted","Data":"c311d351d4146240ccbc9e9d64878805192c5374418109c6dec50a1856e683e5"} Jun 08 19:30:17.074433 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:17.074382 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.4546042 podStartE2EDuration="6.07436468s" totalImagesPullingTime="3.596163988s" totalInitContainerRuntime="23.596492ms" isStatefulPod=false podCreationTimestamp="2026-06-08 19:30:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:30:17.072384314 +0000 UTC m=+233.207840759" watchObservedRunningTime="2026-06-08 19:30:17.07436468 +0000 UTC m=+233.209821122" Jun 08 19:30:17.127878 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:17.127797 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:17.228583 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:17.228546 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:20.038642 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:20.038615 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6b59b59ff-5k4kc" Jun 08 19:30:22.013241 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:22.013191 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:30:24.700569 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:24.700534 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:24.804021 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:24.803993 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:30.136491 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:30.136462 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" Jun 08 19:30:30.136882 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:30.136512 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" Jun 08 19:30:34.306753 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:34.306660 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:34.406117 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:34.406085 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:36.063504 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:36.063455 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs\") pod \"network-metrics-daemon-7ngtn\" (UID: \"9c8290ed-a8c2-4904-a862-a9e41138d285\") " pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:30:36.065785 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:36.065763 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c8290ed-a8c2-4904-a862-a9e41138d285-metrics-certs\") pod \"network-metrics-daemon-7ngtn\" (UID: \"9c8290ed-a8c2-4904-a862-a9e41138d285\") " pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:30:36.303444 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:36.303420 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b4x6n\"" Jun 08 19:30:36.311584 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:36.311568 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ngtn" Jun 08 19:30:36.437447 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:36.437418 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7ngtn"] Jun 08 19:30:36.439941 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:30:36.439900 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c8290ed_a8c2_4904_a862_a9e41138d285.slice/crio-2f9edddf81d816dbf6d6f049bed7e084b6df122e50b6928c541b48cd458d0f3e WatchSource:0}: Error finding container 2f9edddf81d816dbf6d6f049bed7e084b6df122e50b6928c541b48cd458d0f3e: Status 404 returned error can't find the container with id 2f9edddf81d816dbf6d6f049bed7e084b6df122e50b6928c541b48cd458d0f3e Jun 08 19:30:37.130865 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:37.130829 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7ngtn" event={"ID":"9c8290ed-a8c2-4904-a862-a9e41138d285","Type":"ContainerStarted","Data":"2f9edddf81d816dbf6d6f049bed7e084b6df122e50b6928c541b48cd458d0f3e"} Jun 08 19:30:38.136747 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:38.136682 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7ngtn" event={"ID":"9c8290ed-a8c2-4904-a862-a9e41138d285","Type":"ContainerStarted","Data":"63bdac1267b0714d679c0dcb88d0cfc41ae131e29d0f8998f5975b4de7ca8b90"} Jun 08 19:30:38.136747 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:38.136754 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7ngtn" event={"ID":"9c8290ed-a8c2-4904-a862-a9e41138d285","Type":"ContainerStarted","Data":"afa95f5d4a3f6629dad51ecb3f3cabeb3481fcc103c460a006e493fa2bc00155"} Jun 08 19:30:38.156669 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:38.156615 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7ngtn" podStartSLOduration=253.136689523 podStartE2EDuration="4m14.156599426s" totalImagesPullingTime="1.019909903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:26:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:30:38.155136808 +0000 UTC m=+254.290593250" watchObservedRunningTime="2026-06-08 19:30:38.156599426 +0000 UTC m=+254.292055866" Jun 08 19:30:38.252945 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:38.252910 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:38.323411 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:38.323373 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:38.379148 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:38.379109 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:43.956825 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:43.956779 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:44.057519 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:44.057481 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:47.481149 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:47.481106 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:47.549178 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:47.549145 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:48.072441 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:48.072410 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:48.173346 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:48.173311 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:48.274229 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:48.274195 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:48.331407 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:48.331316 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:49.306789 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:49.306756 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:49.365677 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:49.365642 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:50.141409 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:50.141383 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" Jun 08 19:30:50.145198 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:50.145173 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-8588b97df8-gtzkp" Jun 08 19:30:51.760041 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:51.760009 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:51.818417 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:51.818384 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:53.098253 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:53.098223 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:53.202751 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:53.202704 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:53.380844 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:53.380768 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:53.449307 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:53.449275 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:56.691503 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:56.691469 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:56.792661 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:56.792610 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:56.895249 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:56.895220 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:56.997435 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:56.997341 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:57.607529 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:57.607489 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:57.709275 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:57.709248 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:57.810495 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:57.810464 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:30:57.912921 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:30:57.912837 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:00.864215 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:00.864178 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:00.963309 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:00.963276 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:02.520031 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:02.519999 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mv9h2_4d52db18-8dbf-4de9-9d50-1020690ab64a/dns-node-resolver/0.log" Jun 08 19:31:02.721477 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:02.721389 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59744cfc99-6bbqq_bbfe4877-4383-4442-8b5f-e9f68186901c/router/0.log" Jun 08 19:31:03.136429 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:03.136399 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:03.233922 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:03.233888 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:03.319773 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:03.319744 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vjzfq_dbf38036-cdd0-4181-9967-bdbbf4d67a1e/serve-healthcheck-canary/0.log" Jun 08 19:31:04.241830 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:04.241799 2573 generic.go:356] "Generic (PLEG): container finished" podID="4688083e-34f2-43f7-bbc0-44c7d3ff1aa4" containerID="219c08468b9e764fda2ea7937caeca36797a7c7a08f84b2e2aa6f4e6fe3dc1fc" exitCode=0 Jun 08 19:31:04.242189 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:04.241870 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6j4vn" event={"ID":"4688083e-34f2-43f7-bbc0-44c7d3ff1aa4","Type":"ContainerDied","Data":"219c08468b9e764fda2ea7937caeca36797a7c7a08f84b2e2aa6f4e6fe3dc1fc"} Jun 08 19:31:04.242189 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:04.242156 2573 scope.go:117] "RemoveContainer" containerID="219c08468b9e764fda2ea7937caeca36797a7c7a08f84b2e2aa6f4e6fe3dc1fc" Jun 08 19:31:04.635710 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:04.635679 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:04.735230 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:04.735196 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:05.247357 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:05.247324 2573 generic.go:356] "Generic (PLEG): container finished" podID="7410016e-2c37-4c20-a9c8-4b5403668213" containerID="3b06c3971e3f973bb4596f4e59fbf78d8fd7a46350fd070a901ac9b7b6a8a742" exitCode=0 Jun 08 19:31:05.247770 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:05.247394 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-j548p" event={"ID":"7410016e-2c37-4c20-a9c8-4b5403668213","Type":"ContainerDied","Data":"3b06c3971e3f973bb4596f4e59fbf78d8fd7a46350fd070a901ac9b7b6a8a742"} Jun 08 19:31:05.247845 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:05.247781 2573 scope.go:117] "RemoveContainer" containerID="3b06c3971e3f973bb4596f4e59fbf78d8fd7a46350fd070a901ac9b7b6a8a742" Jun 08 19:31:05.249227 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:05.249209 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6j4vn" event={"ID":"4688083e-34f2-43f7-bbc0-44c7d3ff1aa4","Type":"ContainerStarted","Data":"0280ccb73cac19d98b52182f3910cc6c37f483f3652f4d60dd80607a3ededad9"} Jun 08 19:31:05.751600 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:31:05.751565 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-b5k6w" podUID="d95c391c-ac01-42cf-ad49-7a5e0653ecd9" Jun 08 19:31:06.255341 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:06.255316 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b5k6w" Jun 08 19:31:06.255341 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:06.255316 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-j548p" event={"ID":"7410016e-2c37-4c20-a9c8-4b5403668213","Type":"ContainerStarted","Data":"170269aabd96a408f780c4ec4b257933343e5bbbb7ff3772d69dfc248d1f4c6a"} Jun 08 19:31:08.317453 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:08.317426 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:08.419069 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:08.419041 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:08.529388 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:08.529362 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:08.652101 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:08.652026 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls\") pod \"dns-default-b5k6w\" (UID: \"d95c391c-ac01-42cf-ad49-7a5e0653ecd9\") " pod="openshift-dns/dns-default-b5k6w" Jun 08 19:31:08.654354 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:08.654336 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d95c391c-ac01-42cf-ad49-7a5e0653ecd9-metrics-tls\") pod \"dns-default-b5k6w\" (UID: \"d95c391c-ac01-42cf-ad49-7a5e0653ecd9\") " pod="openshift-dns/dns-default-b5k6w" Jun 08 19:31:08.659071 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:08.659055 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2qd47\"" Jun 08 19:31:08.667355 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:08.667338 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b5k6w" Jun 08 19:31:08.794552 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:08.794525 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b5k6w"] Jun 08 19:31:08.796777 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:31:08.796745 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd95c391c_ac01_42cf_ad49_7a5e0653ecd9.slice/crio-3922e08b62570e7d2e9d0a60bfa770a3cd2608a60fbfde461b603eda4f710afc WatchSource:0}: Error finding container 3922e08b62570e7d2e9d0a60bfa770a3cd2608a60fbfde461b603eda4f710afc: Status 404 returned error can't find the container with id 3922e08b62570e7d2e9d0a60bfa770a3cd2608a60fbfde461b603eda4f710afc Jun 08 19:31:09.269654 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:09.269620 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b5k6w" event={"ID":"d95c391c-ac01-42cf-ad49-7a5e0653ecd9","Type":"ContainerStarted","Data":"3922e08b62570e7d2e9d0a60bfa770a3cd2608a60fbfde461b603eda4f710afc"} Jun 08 19:31:11.280145 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:11.280102 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b5k6w" event={"ID":"d95c391c-ac01-42cf-ad49-7a5e0653ecd9","Type":"ContainerStarted","Data":"feafe1dd048191388d4d4e3ea438f8de6736405da0637fe33feb22b9db046f34"} Jun 08 19:31:11.280559 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:11.280162 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b5k6w" event={"ID":"d95c391c-ac01-42cf-ad49-7a5e0653ecd9","Type":"ContainerStarted","Data":"1411cd049b8436b1ca5edf593b06e2bd0053384ce07c7f329e1a540bd03bde7c"} Jun 08 19:31:11.280559 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:11.280238 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b5k6w" Jun 08 19:31:11.299183 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:11.299140 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-b5k6w" podStartSLOduration=251.440829569 podStartE2EDuration="4m13.299122399s" totalImagesPullingTime="1.85829283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:26:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:31:11.297472571 +0000 UTC m=+287.432929006" watchObservedRunningTime="2026-06-08 19:31:11.299122399 +0000 UTC m=+287.434578835" Jun 08 19:31:12.013605 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:12.013573 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:12.030917 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:12.030889 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:12.305207 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:12.305184 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:18.092770 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:18.092737 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:18.192111 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:18.192075 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:21.287619 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:21.287590 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b5k6w" Jun 08 19:31:21.561552 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:21.561520 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:21.626235 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:21.626204 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:24.260068 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:24.260026 2573 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 19:31:25.774788 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:25.774756 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:25.851287 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:25.851259 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 19:31:25.851537 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:25.851506 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerName="alertmanager" containerID="cri-o://ec3f3c41a786650efcd668913be315a8758c041eb6fed59a3f57a5bde1c29697" gracePeriod=120 Jun 08 19:31:25.851672 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:25.851551 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerName="prom-label-proxy" containerID="cri-o://a31984cae08a23b9ea793e57262ed0d159d1c0c1c49fc2ceed9f5c7a84485c56" gracePeriod=120 Jun 08 19:31:25.851672 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:25.851552 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerName="kube-rbac-proxy-metric" containerID="cri-o://c8cad964b711f5dc67bca291c7ba138db31e9ee2b3f0391a6326c2364b056714" gracePeriod=120 Jun 08 19:31:25.851672 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:25.851564 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerName="kube-rbac-proxy-web" containerID="cri-o://a7251360132bd75e1a99567fb17980a5c3dbb29ad80441d70c229fecea89dfad" gracePeriod=120 Jun 08 19:31:25.851672 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:25.851582 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerName="config-reloader" containerID="cri-o://330452fdb4da81cdc21ab044d8c36c7ec683b480e5600acb8dac10db3a855e30" gracePeriod=120 Jun 08 19:31:25.851913 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:25.851649 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerName="kube-rbac-proxy" containerID="cri-o://99f22e1b41aaedc3810dbe16458d864a1e8a0ffbcda3c97cc3a29ec48e006367" gracePeriod=120 Jun 08 19:31:25.868999 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:25.868952 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:26.349476 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:26.349448 2573 generic.go:356] "Generic (PLEG): container finished" podID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerID="a31984cae08a23b9ea793e57262ed0d159d1c0c1c49fc2ceed9f5c7a84485c56" exitCode=0 Jun 08 19:31:26.349476 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:26.349470 2573 generic.go:356] "Generic (PLEG): container finished" podID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerID="99f22e1b41aaedc3810dbe16458d864a1e8a0ffbcda3c97cc3a29ec48e006367" exitCode=0 Jun 08 19:31:26.349476 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:26.349477 2573 generic.go:356] "Generic (PLEG): container finished" podID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerID="330452fdb4da81cdc21ab044d8c36c7ec683b480e5600acb8dac10db3a855e30" exitCode=0 Jun 08 19:31:26.349476 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:26.349483 2573 generic.go:356] "Generic (PLEG): container finished" podID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerID="ec3f3c41a786650efcd668913be315a8758c041eb6fed59a3f57a5bde1c29697" exitCode=0 Jun 08 19:31:26.349729 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:26.349521 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78","Type":"ContainerDied","Data":"a31984cae08a23b9ea793e57262ed0d159d1c0c1c49fc2ceed9f5c7a84485c56"} Jun 08 19:31:26.349729 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:26.349583 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78","Type":"ContainerDied","Data":"99f22e1b41aaedc3810dbe16458d864a1e8a0ffbcda3c97cc3a29ec48e006367"} Jun 08 19:31:26.349729 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:26.349610 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78","Type":"ContainerDied","Data":"330452fdb4da81cdc21ab044d8c36c7ec683b480e5600acb8dac10db3a855e30"} Jun 08 19:31:26.349729 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:26.349634 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78","Type":"ContainerDied","Data":"ec3f3c41a786650efcd668913be315a8758c041eb6fed59a3f57a5bde1c29697"} Jun 08 19:31:27.088432 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.088410 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.208549 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.208469 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-cluster-tls-config\") pod \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " Jun 08 19:31:27.208549 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.208505 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-tls-assets\") pod \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " Jun 08 19:31:27.208549 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.208525 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-config-volume\") pod \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " Jun 08 19:31:27.208549 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.208548 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-web-config\") pod \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " Jun 08 19:31:27.208908 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.208572 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-config-out\") pod \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " Jun 08 19:31:27.208908 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.208621 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brmgc\" (UniqueName: \"kubernetes.io/projected/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-kube-api-access-brmgc\") pod \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " Jun 08 19:31:27.208908 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.208644 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-secret-alertmanager-main-tls\") pod \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " Jun 08 19:31:27.208908 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.208681 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-alertmanager-trusted-ca-bundle\") pod \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " Jun 08 19:31:27.208908 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.208739 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-secret-alertmanager-kube-rbac-proxy-metric\") pod \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " Jun 08 19:31:27.208908 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.208773 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-secret-alertmanager-kube-rbac-proxy\") pod \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " Jun 08 19:31:27.208908 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.208803 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-metrics-client-ca\") pod \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " Jun 08 19:31:27.208908 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.208851 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-alertmanager-main-db\") pod \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " Jun 08 19:31:27.208908 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.208878 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-secret-alertmanager-kube-rbac-proxy-web\") pod \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\" (UID: \"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78\") " Jun 08 19:31:27.209700 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.209419 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" (UID: "2f0c0a80-03d1-43ca-abe1-15f15b5ddf78"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:31:27.211140 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.211113 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-config-volume" (OuterVolumeSpecName: "config-volume") pod "2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" (UID: "2f0c0a80-03d1-43ca-abe1-15f15b5ddf78"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:31:27.211434 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.211408 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" (UID: "2f0c0a80-03d1-43ca-abe1-15f15b5ddf78"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:31:27.211696 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.211673 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" (UID: "2f0c0a80-03d1-43ca-abe1-15f15b5ddf78"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:31:27.211808 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.211704 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" (UID: "2f0c0a80-03d1-43ca-abe1-15f15b5ddf78"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:31:27.211912 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.211887 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-config-out" (OuterVolumeSpecName: "config-out") pod "2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" (UID: "2f0c0a80-03d1-43ca-abe1-15f15b5ddf78"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:31:27.212038 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.212016 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" (UID: "2f0c0a80-03d1-43ca-abe1-15f15b5ddf78"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:31:27.213260 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.213231 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" (UID: "2f0c0a80-03d1-43ca-abe1-15f15b5ddf78"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:31:27.213260 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.213245 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" (UID: "2f0c0a80-03d1-43ca-abe1-15f15b5ddf78"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:31:27.213376 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.213357 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" (UID: "2f0c0a80-03d1-43ca-abe1-15f15b5ddf78"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:31:27.213545 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.213521 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-kube-api-access-brmgc" (OuterVolumeSpecName: "kube-api-access-brmgc") pod "2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" (UID: "2f0c0a80-03d1-43ca-abe1-15f15b5ddf78"). InnerVolumeSpecName "kube-api-access-brmgc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:31:27.216613 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.216477 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" (UID: "2f0c0a80-03d1-43ca-abe1-15f15b5ddf78"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:31:27.223236 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.223213 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-web-config" (OuterVolumeSpecName: "web-config") pod "2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" (UID: "2f0c0a80-03d1-43ca-abe1-15f15b5ddf78"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:31:27.310509 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.310483 2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:27.310509 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.310506 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:27.310660 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.310516 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:27.310660 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.310527 2573 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-metrics-client-ca\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:27.310660 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.310536 2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-alertmanager-main-db\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:27.310660 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.310546 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:27.310660 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.310554 2573 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-cluster-tls-config\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:27.310660 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.310562 2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-tls-assets\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:27.310660 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.310569 2573 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-config-volume\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:27.310660 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.310576 2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-web-config\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:27.310660 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.310584 2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-config-out\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:27.310660 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.310591 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brmgc\" (UniqueName: \"kubernetes.io/projected/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-kube-api-access-brmgc\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:27.310660 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.310598 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78-secret-alertmanager-main-tls\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:27.357176 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.357148 2573 generic.go:356] "Generic (PLEG): container finished" podID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerID="c8cad964b711f5dc67bca291c7ba138db31e9ee2b3f0391a6326c2364b056714" exitCode=0 Jun 08 19:31:27.357176 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.357175 2573 generic.go:356] "Generic (PLEG): container finished" podID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerID="a7251360132bd75e1a99567fb17980a5c3dbb29ad80441d70c229fecea89dfad" exitCode=0 Jun 08 19:31:27.357370 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.357205 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78","Type":"ContainerDied","Data":"c8cad964b711f5dc67bca291c7ba138db31e9ee2b3f0391a6326c2364b056714"} Jun 08 19:31:27.357370 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.357222 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.357370 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.357277 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78","Type":"ContainerDied","Data":"a7251360132bd75e1a99567fb17980a5c3dbb29ad80441d70c229fecea89dfad"} Jun 08 19:31:27.357370 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.357316 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f0c0a80-03d1-43ca-abe1-15f15b5ddf78","Type":"ContainerDied","Data":"d65cd7b25a9a3a887f11292d42a0137f53cc61f86557ca14b763f8e6ec398c07"} Jun 08 19:31:27.357370 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.357353 2573 scope.go:117] "RemoveContainer" containerID="a31984cae08a23b9ea793e57262ed0d159d1c0c1c49fc2ceed9f5c7a84485c56" Jun 08 19:31:27.366444 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.366425 2573 scope.go:117] "RemoveContainer" containerID="c8cad964b711f5dc67bca291c7ba138db31e9ee2b3f0391a6326c2364b056714" Jun 08 19:31:27.373069 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.373053 2573 scope.go:117] "RemoveContainer" containerID="99f22e1b41aaedc3810dbe16458d864a1e8a0ffbcda3c97cc3a29ec48e006367" Jun 08 19:31:27.379450 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.379431 2573 scope.go:117] "RemoveContainer" containerID="a7251360132bd75e1a99567fb17980a5c3dbb29ad80441d70c229fecea89dfad" Jun 08 19:31:27.382140 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.382121 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 19:31:27.386352 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.386333 2573 scope.go:117] "RemoveContainer" containerID="330452fdb4da81cdc21ab044d8c36c7ec683b480e5600acb8dac10db3a855e30" Jun 08 19:31:27.389840 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.389821 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 19:31:27.393879 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.393865 2573 scope.go:117] "RemoveContainer" containerID="ec3f3c41a786650efcd668913be315a8758c041eb6fed59a3f57a5bde1c29697" Jun 08 19:31:27.401055 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.401036 2573 scope.go:117] "RemoveContainer" containerID="1aeff2fae6220d8d9e066c94d0752cb985d441ca77b2599ee9c83d38d64a3234" Jun 08 19:31:27.407968 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.407953 2573 scope.go:117] "RemoveContainer" containerID="a31984cae08a23b9ea793e57262ed0d159d1c0c1c49fc2ceed9f5c7a84485c56" Jun 08 19:31:27.408239 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:31:27.408218 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a31984cae08a23b9ea793e57262ed0d159d1c0c1c49fc2ceed9f5c7a84485c56\": container with ID starting with a31984cae08a23b9ea793e57262ed0d159d1c0c1c49fc2ceed9f5c7a84485c56 not found: ID does not exist" containerID="a31984cae08a23b9ea793e57262ed0d159d1c0c1c49fc2ceed9f5c7a84485c56" Jun 08 19:31:27.408304 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.408247 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a31984cae08a23b9ea793e57262ed0d159d1c0c1c49fc2ceed9f5c7a84485c56"} err="failed to get container status \"a31984cae08a23b9ea793e57262ed0d159d1c0c1c49fc2ceed9f5c7a84485c56\": rpc error: code = NotFound desc = could not find container \"a31984cae08a23b9ea793e57262ed0d159d1c0c1c49fc2ceed9f5c7a84485c56\": container with ID starting with a31984cae08a23b9ea793e57262ed0d159d1c0c1c49fc2ceed9f5c7a84485c56 not found: ID does not exist" Jun 08 19:31:27.408304 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.408277 2573 scope.go:117] "RemoveContainer" containerID="c8cad964b711f5dc67bca291c7ba138db31e9ee2b3f0391a6326c2364b056714" Jun 08 19:31:27.408500 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:31:27.408478 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8cad964b711f5dc67bca291c7ba138db31e9ee2b3f0391a6326c2364b056714\": container with ID starting with c8cad964b711f5dc67bca291c7ba138db31e9ee2b3f0391a6326c2364b056714 not found: ID does not exist" containerID="c8cad964b711f5dc67bca291c7ba138db31e9ee2b3f0391a6326c2364b056714" Jun 08 19:31:27.408539 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.408505 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8cad964b711f5dc67bca291c7ba138db31e9ee2b3f0391a6326c2364b056714"} err="failed to get container status \"c8cad964b711f5dc67bca291c7ba138db31e9ee2b3f0391a6326c2364b056714\": rpc error: code = NotFound desc = could not find container \"c8cad964b711f5dc67bca291c7ba138db31e9ee2b3f0391a6326c2364b056714\": container with ID starting with c8cad964b711f5dc67bca291c7ba138db31e9ee2b3f0391a6326c2364b056714 not found: ID does not exist" Jun 08 19:31:27.408539 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.408519 2573 scope.go:117] "RemoveContainer" containerID="99f22e1b41aaedc3810dbe16458d864a1e8a0ffbcda3c97cc3a29ec48e006367" Jun 08 19:31:27.408750 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:31:27.408729 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99f22e1b41aaedc3810dbe16458d864a1e8a0ffbcda3c97cc3a29ec48e006367\": container with ID starting with 99f22e1b41aaedc3810dbe16458d864a1e8a0ffbcda3c97cc3a29ec48e006367 not found: ID does not exist" containerID="99f22e1b41aaedc3810dbe16458d864a1e8a0ffbcda3c97cc3a29ec48e006367" Jun 08 19:31:27.408803 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.408754 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99f22e1b41aaedc3810dbe16458d864a1e8a0ffbcda3c97cc3a29ec48e006367"} err="failed to get container status \"99f22e1b41aaedc3810dbe16458d864a1e8a0ffbcda3c97cc3a29ec48e006367\": rpc error: code = NotFound desc = could not find container \"99f22e1b41aaedc3810dbe16458d864a1e8a0ffbcda3c97cc3a29ec48e006367\": container with ID starting with 99f22e1b41aaedc3810dbe16458d864a1e8a0ffbcda3c97cc3a29ec48e006367 not found: ID does not exist" Jun 08 19:31:27.408803 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.408769 2573 scope.go:117] "RemoveContainer" containerID="a7251360132bd75e1a99567fb17980a5c3dbb29ad80441d70c229fecea89dfad" Jun 08 19:31:27.408978 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:31:27.408957 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7251360132bd75e1a99567fb17980a5c3dbb29ad80441d70c229fecea89dfad\": container with ID starting with a7251360132bd75e1a99567fb17980a5c3dbb29ad80441d70c229fecea89dfad not found: ID does not exist" containerID="a7251360132bd75e1a99567fb17980a5c3dbb29ad80441d70c229fecea89dfad" Jun 08 19:31:27.409017 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.408985 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7251360132bd75e1a99567fb17980a5c3dbb29ad80441d70c229fecea89dfad"} err="failed to get container status \"a7251360132bd75e1a99567fb17980a5c3dbb29ad80441d70c229fecea89dfad\": rpc error: code = NotFound desc = could not find container \"a7251360132bd75e1a99567fb17980a5c3dbb29ad80441d70c229fecea89dfad\": container with ID starting with a7251360132bd75e1a99567fb17980a5c3dbb29ad80441d70c229fecea89dfad not found: ID does not exist" Jun 08 19:31:27.409017 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.409001 2573 scope.go:117] "RemoveContainer" containerID="330452fdb4da81cdc21ab044d8c36c7ec683b480e5600acb8dac10db3a855e30" Jun 08 19:31:27.409265 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:31:27.409250 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"330452fdb4da81cdc21ab044d8c36c7ec683b480e5600acb8dac10db3a855e30\": container with ID starting with 330452fdb4da81cdc21ab044d8c36c7ec683b480e5600acb8dac10db3a855e30 not found: ID does not exist" containerID="330452fdb4da81cdc21ab044d8c36c7ec683b480e5600acb8dac10db3a855e30" Jun 08 19:31:27.409316 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.409267 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"330452fdb4da81cdc21ab044d8c36c7ec683b480e5600acb8dac10db3a855e30"} err="failed to get container status \"330452fdb4da81cdc21ab044d8c36c7ec683b480e5600acb8dac10db3a855e30\": rpc error: code = NotFound desc = could not find container \"330452fdb4da81cdc21ab044d8c36c7ec683b480e5600acb8dac10db3a855e30\": container with ID starting with 330452fdb4da81cdc21ab044d8c36c7ec683b480e5600acb8dac10db3a855e30 not found: ID does not exist" Jun 08 19:31:27.409316 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.409283 2573 scope.go:117] "RemoveContainer" containerID="ec3f3c41a786650efcd668913be315a8758c041eb6fed59a3f57a5bde1c29697" Jun 08 19:31:27.409517 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:31:27.409500 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec3f3c41a786650efcd668913be315a8758c041eb6fed59a3f57a5bde1c29697\": container with ID starting with ec3f3c41a786650efcd668913be315a8758c041eb6fed59a3f57a5bde1c29697 not found: ID does not exist" containerID="ec3f3c41a786650efcd668913be315a8758c041eb6fed59a3f57a5bde1c29697" Jun 08 19:31:27.409580 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.409524 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec3f3c41a786650efcd668913be315a8758c041eb6fed59a3f57a5bde1c29697"} err="failed to get container status \"ec3f3c41a786650efcd668913be315a8758c041eb6fed59a3f57a5bde1c29697\": rpc error: code = NotFound desc = could not find container \"ec3f3c41a786650efcd668913be315a8758c041eb6fed59a3f57a5bde1c29697\": container with ID starting with ec3f3c41a786650efcd668913be315a8758c041eb6fed59a3f57a5bde1c29697 not found: ID does not exist" Jun 08 19:31:27.409580 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.409543 2573 scope.go:117] "RemoveContainer" containerID="1aeff2fae6220d8d9e066c94d0752cb985d441ca77b2599ee9c83d38d64a3234" Jun 08 19:31:27.409820 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:31:27.409804 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1aeff2fae6220d8d9e066c94d0752cb985d441ca77b2599ee9c83d38d64a3234\": container with ID starting with 1aeff2fae6220d8d9e066c94d0752cb985d441ca77b2599ee9c83d38d64a3234 not found: ID does not exist" containerID="1aeff2fae6220d8d9e066c94d0752cb985d441ca77b2599ee9c83d38d64a3234" Jun 08 19:31:27.409877 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.409824 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aeff2fae6220d8d9e066c94d0752cb985d441ca77b2599ee9c83d38d64a3234"} err="failed to get container status \"1aeff2fae6220d8d9e066c94d0752cb985d441ca77b2599ee9c83d38d64a3234\": rpc error: code = NotFound desc = could not find container \"1aeff2fae6220d8d9e066c94d0752cb985d441ca77b2599ee9c83d38d64a3234\": container with ID starting with 1aeff2fae6220d8d9e066c94d0752cb985d441ca77b2599ee9c83d38d64a3234 not found: ID does not exist" Jun 08 19:31:27.409877 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.409838 2573 scope.go:117] "RemoveContainer" containerID="a31984cae08a23b9ea793e57262ed0d159d1c0c1c49fc2ceed9f5c7a84485c56" Jun 08 19:31:27.410082 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.410062 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a31984cae08a23b9ea793e57262ed0d159d1c0c1c49fc2ceed9f5c7a84485c56"} err="failed to get container status \"a31984cae08a23b9ea793e57262ed0d159d1c0c1c49fc2ceed9f5c7a84485c56\": rpc error: code = NotFound desc = could not find container \"a31984cae08a23b9ea793e57262ed0d159d1c0c1c49fc2ceed9f5c7a84485c56\": container with ID starting with a31984cae08a23b9ea793e57262ed0d159d1c0c1c49fc2ceed9f5c7a84485c56 not found: ID does not exist" Jun 08 19:31:27.410082 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.410081 2573 scope.go:117] "RemoveContainer" containerID="c8cad964b711f5dc67bca291c7ba138db31e9ee2b3f0391a6326c2364b056714" Jun 08 19:31:27.410317 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.410302 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8cad964b711f5dc67bca291c7ba138db31e9ee2b3f0391a6326c2364b056714"} err="failed to get container status \"c8cad964b711f5dc67bca291c7ba138db31e9ee2b3f0391a6326c2364b056714\": rpc error: code = NotFound desc = could not find container \"c8cad964b711f5dc67bca291c7ba138db31e9ee2b3f0391a6326c2364b056714\": container with ID starting with c8cad964b711f5dc67bca291c7ba138db31e9ee2b3f0391a6326c2364b056714 not found: ID does not exist" Jun 08 19:31:27.410361 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.410317 2573 scope.go:117] "RemoveContainer" containerID="99f22e1b41aaedc3810dbe16458d864a1e8a0ffbcda3c97cc3a29ec48e006367" Jun 08 19:31:27.410565 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.410545 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99f22e1b41aaedc3810dbe16458d864a1e8a0ffbcda3c97cc3a29ec48e006367"} err="failed to get container status \"99f22e1b41aaedc3810dbe16458d864a1e8a0ffbcda3c97cc3a29ec48e006367\": rpc error: code = NotFound desc = could not find container \"99f22e1b41aaedc3810dbe16458d864a1e8a0ffbcda3c97cc3a29ec48e006367\": container with ID starting with 99f22e1b41aaedc3810dbe16458d864a1e8a0ffbcda3c97cc3a29ec48e006367 not found: ID does not exist" Jun 08 19:31:27.410652 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.410566 2573 scope.go:117] "RemoveContainer" containerID="a7251360132bd75e1a99567fb17980a5c3dbb29ad80441d70c229fecea89dfad" Jun 08 19:31:27.410964 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.410942 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7251360132bd75e1a99567fb17980a5c3dbb29ad80441d70c229fecea89dfad"} err="failed to get container status \"a7251360132bd75e1a99567fb17980a5c3dbb29ad80441d70c229fecea89dfad\": rpc error: code = NotFound desc = could not find container \"a7251360132bd75e1a99567fb17980a5c3dbb29ad80441d70c229fecea89dfad\": container with ID starting with a7251360132bd75e1a99567fb17980a5c3dbb29ad80441d70c229fecea89dfad not found: ID does not exist" Jun 08 19:31:27.411081 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.410965 2573 scope.go:117] "RemoveContainer" containerID="330452fdb4da81cdc21ab044d8c36c7ec683b480e5600acb8dac10db3a855e30" Jun 08 19:31:27.411299 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.411271 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"330452fdb4da81cdc21ab044d8c36c7ec683b480e5600acb8dac10db3a855e30"} err="failed to get container status \"330452fdb4da81cdc21ab044d8c36c7ec683b480e5600acb8dac10db3a855e30\": rpc error: code = NotFound desc = could not find container \"330452fdb4da81cdc21ab044d8c36c7ec683b480e5600acb8dac10db3a855e30\": container with ID starting with 330452fdb4da81cdc21ab044d8c36c7ec683b480e5600acb8dac10db3a855e30 not found: ID does not exist" Jun 08 19:31:27.411299 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.411296 2573 scope.go:117] "RemoveContainer" containerID="ec3f3c41a786650efcd668913be315a8758c041eb6fed59a3f57a5bde1c29697" Jun 08 19:31:27.411575 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.411551 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec3f3c41a786650efcd668913be315a8758c041eb6fed59a3f57a5bde1c29697"} err="failed to get container status \"ec3f3c41a786650efcd668913be315a8758c041eb6fed59a3f57a5bde1c29697\": rpc error: code = NotFound desc = could not find container \"ec3f3c41a786650efcd668913be315a8758c041eb6fed59a3f57a5bde1c29697\": container with ID starting with ec3f3c41a786650efcd668913be315a8758c041eb6fed59a3f57a5bde1c29697 not found: ID does not exist" Jun 08 19:31:27.411669 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.411576 2573 scope.go:117] "RemoveContainer" containerID="1aeff2fae6220d8d9e066c94d0752cb985d441ca77b2599ee9c83d38d64a3234" Jun 08 19:31:27.411855 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.411832 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aeff2fae6220d8d9e066c94d0752cb985d441ca77b2599ee9c83d38d64a3234"} err="failed to get container status \"1aeff2fae6220d8d9e066c94d0752cb985d441ca77b2599ee9c83d38d64a3234\": rpc error: code = NotFound desc = could not find container \"1aeff2fae6220d8d9e066c94d0752cb985d441ca77b2599ee9c83d38d64a3234\": container with ID starting with 1aeff2fae6220d8d9e066c94d0752cb985d441ca77b2599ee9c83d38d64a3234 not found: ID does not exist" Jun 08 19:31:27.420574 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.420550 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 19:31:27.420898 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.420885 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerName="config-reloader" Jun 08 19:31:27.420949 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.420900 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerName="config-reloader" Jun 08 19:31:27.420949 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.420911 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerName="alertmanager" Jun 08 19:31:27.420949 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.420916 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerName="alertmanager" Jun 08 19:31:27.420949 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.420941 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerName="kube-rbac-proxy-web" Jun 08 19:31:27.420949 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.420947 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerName="kube-rbac-proxy-web" Jun 08 19:31:27.421089 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.420955 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerName="kube-rbac-proxy-metric" Jun 08 19:31:27.421089 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.420963 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerName="kube-rbac-proxy-metric" Jun 08 19:31:27.421089 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.420971 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerName="init-config-reloader" Jun 08 19:31:27.421089 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.420976 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerName="init-config-reloader" Jun 08 19:31:27.421089 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.420988 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerName="prom-label-proxy" Jun 08 19:31:27.421089 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.420994 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerName="prom-label-proxy" Jun 08 19:31:27.421089 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.421005 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerName="kube-rbac-proxy" Jun 08 19:31:27.421089 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.421010 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerName="kube-rbac-proxy" Jun 08 19:31:27.421089 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.421060 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerName="alertmanager" Jun 08 19:31:27.421089 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.421071 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerName="config-reloader" Jun 08 19:31:27.421089 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.421078 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerName="kube-rbac-proxy-web" Jun 08 19:31:27.421089 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.421083 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerName="kube-rbac-proxy" Jun 08 19:31:27.421089 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.421089 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerName="prom-label-proxy" Jun 08 19:31:27.421428 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.421096 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" containerName="kube-rbac-proxy-metric" Jun 08 19:31:27.426118 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.426100 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.428866 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.428833 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 19:31:27.428978 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.428950 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 19:31:27.429044 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.428990 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 19:31:27.429044 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.428953 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pjdr8\"" Jun 08 19:31:27.429044 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.429013 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 19:31:27.429183 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.429049 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 19:31:27.429183 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.429067 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 19:31:27.429183 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.429137 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 19:31:27.429373 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.429358 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 19:31:27.434672 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.434651 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 19:31:27.444320 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.444295 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 19:31:27.512187 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.512129 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7f104566-d149-4456-8520-8fa682d7eb9c-config-volume\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.512187 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.512164 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f104566-d149-4456-8520-8fa682d7eb9c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.512310 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.512198 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7f104566-d149-4456-8520-8fa682d7eb9c-config-out\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.512310 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.512261 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7f104566-d149-4456-8520-8fa682d7eb9c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.512374 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.512314 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7f104566-d149-4456-8520-8fa682d7eb9c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.512374 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.512342 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f104566-d149-4456-8520-8fa682d7eb9c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.512374 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.512359 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2nlg\" (UniqueName: \"kubernetes.io/projected/7f104566-d149-4456-8520-8fa682d7eb9c-kube-api-access-c2nlg\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.512472 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.512411 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7f104566-d149-4456-8520-8fa682d7eb9c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.512472 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.512438 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7f104566-d149-4456-8520-8fa682d7eb9c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.512472 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.512457 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7f104566-d149-4456-8520-8fa682d7eb9c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.512571 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.512478 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7f104566-d149-4456-8520-8fa682d7eb9c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.512571 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.512494 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7f104566-d149-4456-8520-8fa682d7eb9c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.512571 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.512511 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7f104566-d149-4456-8520-8fa682d7eb9c-web-config\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.613635 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.613612 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f104566-d149-4456-8520-8fa682d7eb9c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.613710 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.613637 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2nlg\" (UniqueName: \"kubernetes.io/projected/7f104566-d149-4456-8520-8fa682d7eb9c-kube-api-access-c2nlg\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.613710 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.613655 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7f104566-d149-4456-8520-8fa682d7eb9c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.613710 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.613669 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7f104566-d149-4456-8520-8fa682d7eb9c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.613710 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.613690 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7f104566-d149-4456-8520-8fa682d7eb9c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.613920 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.613712 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7f104566-d149-4456-8520-8fa682d7eb9c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.613920 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.613756 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7f104566-d149-4456-8520-8fa682d7eb9c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.613920 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.613786 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7f104566-d149-4456-8520-8fa682d7eb9c-web-config\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.613920 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.613838 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7f104566-d149-4456-8520-8fa682d7eb9c-config-volume\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.613920 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.613872 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f104566-d149-4456-8520-8fa682d7eb9c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.613920 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.613912 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7f104566-d149-4456-8520-8fa682d7eb9c-config-out\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.614212 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.613936 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7f104566-d149-4456-8520-8fa682d7eb9c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.614212 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.614002 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7f104566-d149-4456-8520-8fa682d7eb9c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.614526 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.614416 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7f104566-d149-4456-8520-8fa682d7eb9c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.614526 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.614456 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f104566-d149-4456-8520-8fa682d7eb9c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.615510 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.615484 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f104566-d149-4456-8520-8fa682d7eb9c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.616662 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.616608 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7f104566-d149-4456-8520-8fa682d7eb9c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.616662 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.616656 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7f104566-d149-4456-8520-8fa682d7eb9c-config-out\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.617121 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.616998 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7f104566-d149-4456-8520-8fa682d7eb9c-config-volume\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.617121 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.617069 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7f104566-d149-4456-8520-8fa682d7eb9c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.617256 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.617124 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7f104566-d149-4456-8520-8fa682d7eb9c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.617256 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.617212 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7f104566-d149-4456-8520-8fa682d7eb9c-web-config\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.617421 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.617398 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7f104566-d149-4456-8520-8fa682d7eb9c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.617455 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.617436 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7f104566-d149-4456-8520-8fa682d7eb9c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.618191 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.618178 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7f104566-d149-4456-8520-8fa682d7eb9c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.626380 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.626364 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2nlg\" (UniqueName: \"kubernetes.io/projected/7f104566-d149-4456-8520-8fa682d7eb9c-kube-api-access-c2nlg\") pod \"alertmanager-main-0\" (UID: \"7f104566-d149-4456-8520-8fa682d7eb9c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.734950 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.734926 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:31:27.868524 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:27.868444 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 19:31:27.871176 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:31:27.871149 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f104566_d149_4456_8520_8fa682d7eb9c.slice/crio-33225664e53d411a8846da63d270f2a3b2ed187c071e5a06daa76d97529b6ab1 WatchSource:0}: Error finding container 33225664e53d411a8846da63d270f2a3b2ed187c071e5a06daa76d97529b6ab1: Status 404 returned error can't find the container with id 33225664e53d411a8846da63d270f2a3b2ed187c071e5a06daa76d97529b6ab1 Jun 08 19:31:28.305229 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:28.305197 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f0c0a80-03d1-43ca-abe1-15f15b5ddf78" path="/var/lib/kubelet/pods/2f0c0a80-03d1-43ca-abe1-15f15b5ddf78/volumes" Jun 08 19:31:28.361926 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:28.361897 2573 generic.go:356] "Generic (PLEG): container finished" podID="7f104566-d149-4456-8520-8fa682d7eb9c" containerID="14ade1ca395db902230681e87810e258c1227a7bbec588049e0c0029846b5619" exitCode=0 Jun 08 19:31:28.362107 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:28.361981 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7f104566-d149-4456-8520-8fa682d7eb9c","Type":"ContainerDied","Data":"14ade1ca395db902230681e87810e258c1227a7bbec588049e0c0029846b5619"} Jun 08 19:31:28.362107 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:28.362083 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7f104566-d149-4456-8520-8fa682d7eb9c","Type":"ContainerStarted","Data":"33225664e53d411a8846da63d270f2a3b2ed187c071e5a06daa76d97529b6ab1"} Jun 08 19:31:29.369867 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:29.369835 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7f104566-d149-4456-8520-8fa682d7eb9c","Type":"ContainerStarted","Data":"c439a47acfb5f4825912ecc6c6c12f557cf253d6904a695f0e75ebdb870fd8a5"} Jun 08 19:31:29.370339 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:29.369906 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7f104566-d149-4456-8520-8fa682d7eb9c","Type":"ContainerStarted","Data":"fa48fb7a0968faf50a13c5d1cfd735f76ae9b01a09409146bccc502209d4d79c"} Jun 08 19:31:29.370339 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:29.369950 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7f104566-d149-4456-8520-8fa682d7eb9c","Type":"ContainerStarted","Data":"e77fc1a646b007824dd9956c3f136d7a043bf106f5c9119bf6a6f47ed6ca5963"} Jun 08 19:31:29.370339 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:29.369993 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7f104566-d149-4456-8520-8fa682d7eb9c","Type":"ContainerStarted","Data":"c27009dd770405da5ca859ccea4f37f9c305321eb71704fb9e223829e48da65c"} Jun 08 19:31:29.370339 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:29.370041 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7f104566-d149-4456-8520-8fa682d7eb9c","Type":"ContainerStarted","Data":"4567d89689c5f003eceecfc7cf095f35b54b5959c861b236e3ce21a29022abac"} Jun 08 19:31:29.370339 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:29.370076 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7f104566-d149-4456-8520-8fa682d7eb9c","Type":"ContainerStarted","Data":"6940d3c94baa1bce9be6a82afcac6fdf4ba6fc2c8772b8cc79623f15b60b0b3a"} Jun 08 19:31:29.407664 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:29.407619 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.391282162 podStartE2EDuration="2.407604542s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.32238ms" isStatefulPod=false podCreationTimestamp="2026-06-08 19:31:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:31:29.405945688 +0000 UTC m=+305.541402129" watchObservedRunningTime="2026-06-08 19:31:29.407604542 +0000 UTC m=+305.543060981" Jun 08 19:31:29.972700 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:29.972669 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:30.072611 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:30.072577 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:30.115760 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:30.115733 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 19:31:30.116007 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:30.115978 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerName="prometheus" containerID="cri-o://c311d351d4146240ccbc9e9d64878805192c5374418109c6dec50a1856e683e5" gracePeriod=600 Jun 08 19:31:30.116099 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:30.115995 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerName="kube-rbac-proxy" containerID="cri-o://69e867ad0876fc87e2dce930e779da8461d1a368e611eb6e40cedbcc603bc6c8" gracePeriod=600 Jun 08 19:31:30.116099 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:30.116020 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerName="thanos-sidecar" containerID="cri-o://c0da0c8fb01aa64d69c72e9a8fd8c47fa535d674972d9c4a8c430f20e94351eb" gracePeriod=600 Jun 08 19:31:30.116099 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:30.116031 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerName="kube-rbac-proxy-web" containerID="cri-o://2116a2cd6f63c3242c3bf8e9f80acadee38ccf3d803acf6dcc414f09ec26640c" gracePeriod=600 Jun 08 19:31:30.116099 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:30.116050 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerName="kube-rbac-proxy-thanos" containerID="cri-o://30d63c45d9babd888f427a945cbf74f0e42d3662fd34a2fb47916a6b64f4d36b" gracePeriod=600 Jun 08 19:31:30.116099 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:30.116060 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerName="config-reloader" containerID="cri-o://53d3b4655378227a05acdf65f21f5f13ed123dd701132b2ea517ba381c1203c4" gracePeriod=600 Jun 08 19:31:30.377384 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:30.377357 2573 generic.go:356] "Generic (PLEG): container finished" podID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerID="30d63c45d9babd888f427a945cbf74f0e42d3662fd34a2fb47916a6b64f4d36b" exitCode=0 Jun 08 19:31:30.377384 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:30.377380 2573 generic.go:356] "Generic (PLEG): container finished" podID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerID="69e867ad0876fc87e2dce930e779da8461d1a368e611eb6e40cedbcc603bc6c8" exitCode=0 Jun 08 19:31:30.377384 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:30.377386 2573 generic.go:356] "Generic (PLEG): container finished" podID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerID="c0da0c8fb01aa64d69c72e9a8fd8c47fa535d674972d9c4a8c430f20e94351eb" exitCode=0 Jun 08 19:31:30.377384 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:30.377392 2573 generic.go:356] "Generic (PLEG): container finished" podID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerID="53d3b4655378227a05acdf65f21f5f13ed123dd701132b2ea517ba381c1203c4" exitCode=0 Jun 08 19:31:30.377384 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:30.377397 2573 generic.go:356] "Generic (PLEG): container finished" podID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerID="c311d351d4146240ccbc9e9d64878805192c5374418109c6dec50a1856e683e5" exitCode=0 Jun 08 19:31:30.377847 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:30.377434 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2","Type":"ContainerDied","Data":"30d63c45d9babd888f427a945cbf74f0e42d3662fd34a2fb47916a6b64f4d36b"} Jun 08 19:31:30.377847 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:30.377495 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2","Type":"ContainerDied","Data":"69e867ad0876fc87e2dce930e779da8461d1a368e611eb6e40cedbcc603bc6c8"} Jun 08 19:31:30.377847 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:30.377523 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2","Type":"ContainerDied","Data":"c0da0c8fb01aa64d69c72e9a8fd8c47fa535d674972d9c4a8c430f20e94351eb"} Jun 08 19:31:30.377847 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:30.377546 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2","Type":"ContainerDied","Data":"53d3b4655378227a05acdf65f21f5f13ed123dd701132b2ea517ba381c1203c4"} Jun 08 19:31:30.377847 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:30.377569 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2","Type":"ContainerDied","Data":"c311d351d4146240ccbc9e9d64878805192c5374418109c6dec50a1856e683e5"} Jun 08 19:31:30.430561 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:30.430541 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:30.488266 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:30.488208 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:31.356431 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.356411 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.390008 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.389972 2573 generic.go:356] "Generic (PLEG): container finished" podID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerID="2116a2cd6f63c3242c3bf8e9f80acadee38ccf3d803acf6dcc414f09ec26640c" exitCode=0 Jun 08 19:31:31.390397 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.390058 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.390397 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.390061 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2","Type":"ContainerDied","Data":"2116a2cd6f63c3242c3bf8e9f80acadee38ccf3d803acf6dcc414f09ec26640c"} Jun 08 19:31:31.390397 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.390163 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2","Type":"ContainerDied","Data":"f04b933f7fa4939dad534a1f3d9105eb15eaf97b7cfdb37d5d1f1bb4ceb6375e"} Jun 08 19:31:31.390397 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.390213 2573 scope.go:117] "RemoveContainer" containerID="30d63c45d9babd888f427a945cbf74f0e42d3662fd34a2fb47916a6b64f4d36b" Jun 08 19:31:31.399929 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.399903 2573 scope.go:117] "RemoveContainer" containerID="69e867ad0876fc87e2dce930e779da8461d1a368e611eb6e40cedbcc603bc6c8" Jun 08 19:31:31.407219 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.407193 2573 scope.go:117] "RemoveContainer" containerID="2116a2cd6f63c3242c3bf8e9f80acadee38ccf3d803acf6dcc414f09ec26640c" Jun 08 19:31:31.413781 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.413758 2573 scope.go:117] "RemoveContainer" containerID="c0da0c8fb01aa64d69c72e9a8fd8c47fa535d674972d9c4a8c430f20e94351eb" Jun 08 19:31:31.420462 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.420444 2573 scope.go:117] "RemoveContainer" containerID="53d3b4655378227a05acdf65f21f5f13ed123dd701132b2ea517ba381c1203c4" Jun 08 19:31:31.428031 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.428012 2573 scope.go:117] "RemoveContainer" containerID="c311d351d4146240ccbc9e9d64878805192c5374418109c6dec50a1856e683e5" Jun 08 19:31:31.435891 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.435870 2573 scope.go:117] "RemoveContainer" containerID="652208bdc62d8c34028c6e424499f9ecdf7185b9671310da3b83a2bac109b11a" Jun 08 19:31:31.442894 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.442879 2573 scope.go:117] "RemoveContainer" containerID="30d63c45d9babd888f427a945cbf74f0e42d3662fd34a2fb47916a6b64f4d36b" Jun 08 19:31:31.443140 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:31:31.443122 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30d63c45d9babd888f427a945cbf74f0e42d3662fd34a2fb47916a6b64f4d36b\": container with ID starting with 30d63c45d9babd888f427a945cbf74f0e42d3662fd34a2fb47916a6b64f4d36b not found: ID does not exist" containerID="30d63c45d9babd888f427a945cbf74f0e42d3662fd34a2fb47916a6b64f4d36b" Jun 08 19:31:31.443199 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.443147 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30d63c45d9babd888f427a945cbf74f0e42d3662fd34a2fb47916a6b64f4d36b"} err="failed to get container status \"30d63c45d9babd888f427a945cbf74f0e42d3662fd34a2fb47916a6b64f4d36b\": rpc error: code = NotFound desc = could not find container \"30d63c45d9babd888f427a945cbf74f0e42d3662fd34a2fb47916a6b64f4d36b\": container with ID starting with 30d63c45d9babd888f427a945cbf74f0e42d3662fd34a2fb47916a6b64f4d36b not found: ID does not exist" Jun 08 19:31:31.443199 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.443164 2573 scope.go:117] "RemoveContainer" containerID="69e867ad0876fc87e2dce930e779da8461d1a368e611eb6e40cedbcc603bc6c8" Jun 08 19:31:31.443442 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:31:31.443415 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69e867ad0876fc87e2dce930e779da8461d1a368e611eb6e40cedbcc603bc6c8\": container with ID starting with 69e867ad0876fc87e2dce930e779da8461d1a368e611eb6e40cedbcc603bc6c8 not found: ID does not exist" containerID="69e867ad0876fc87e2dce930e779da8461d1a368e611eb6e40cedbcc603bc6c8" Jun 08 19:31:31.443525 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.443452 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69e867ad0876fc87e2dce930e779da8461d1a368e611eb6e40cedbcc603bc6c8"} err="failed to get container status \"69e867ad0876fc87e2dce930e779da8461d1a368e611eb6e40cedbcc603bc6c8\": rpc error: code = NotFound desc = could not find container \"69e867ad0876fc87e2dce930e779da8461d1a368e611eb6e40cedbcc603bc6c8\": container with ID starting with 69e867ad0876fc87e2dce930e779da8461d1a368e611eb6e40cedbcc603bc6c8 not found: ID does not exist" Jun 08 19:31:31.443525 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.443473 2573 scope.go:117] "RemoveContainer" containerID="2116a2cd6f63c3242c3bf8e9f80acadee38ccf3d803acf6dcc414f09ec26640c" Jun 08 19:31:31.443773 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:31:31.443751 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2116a2cd6f63c3242c3bf8e9f80acadee38ccf3d803acf6dcc414f09ec26640c\": container with ID starting with 2116a2cd6f63c3242c3bf8e9f80acadee38ccf3d803acf6dcc414f09ec26640c not found: ID does not exist" containerID="2116a2cd6f63c3242c3bf8e9f80acadee38ccf3d803acf6dcc414f09ec26640c" Jun 08 19:31:31.443894 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.443777 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2116a2cd6f63c3242c3bf8e9f80acadee38ccf3d803acf6dcc414f09ec26640c"} err="failed to get container status \"2116a2cd6f63c3242c3bf8e9f80acadee38ccf3d803acf6dcc414f09ec26640c\": rpc error: code = NotFound desc = could not find container \"2116a2cd6f63c3242c3bf8e9f80acadee38ccf3d803acf6dcc414f09ec26640c\": container with ID starting with 2116a2cd6f63c3242c3bf8e9f80acadee38ccf3d803acf6dcc414f09ec26640c not found: ID does not exist" Jun 08 19:31:31.443894 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.443796 2573 scope.go:117] "RemoveContainer" containerID="c0da0c8fb01aa64d69c72e9a8fd8c47fa535d674972d9c4a8c430f20e94351eb" Jun 08 19:31:31.444091 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:31:31.444075 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0da0c8fb01aa64d69c72e9a8fd8c47fa535d674972d9c4a8c430f20e94351eb\": container with ID starting with c0da0c8fb01aa64d69c72e9a8fd8c47fa535d674972d9c4a8c430f20e94351eb not found: ID does not exist" containerID="c0da0c8fb01aa64d69c72e9a8fd8c47fa535d674972d9c4a8c430f20e94351eb" Jun 08 19:31:31.444169 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.444096 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0da0c8fb01aa64d69c72e9a8fd8c47fa535d674972d9c4a8c430f20e94351eb"} err="failed to get container status \"c0da0c8fb01aa64d69c72e9a8fd8c47fa535d674972d9c4a8c430f20e94351eb\": rpc error: code = NotFound desc = could not find container \"c0da0c8fb01aa64d69c72e9a8fd8c47fa535d674972d9c4a8c430f20e94351eb\": container with ID starting with c0da0c8fb01aa64d69c72e9a8fd8c47fa535d674972d9c4a8c430f20e94351eb not found: ID does not exist" Jun 08 19:31:31.444169 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.444112 2573 scope.go:117] "RemoveContainer" containerID="53d3b4655378227a05acdf65f21f5f13ed123dd701132b2ea517ba381c1203c4" Jun 08 19:31:31.444299 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:31:31.444285 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53d3b4655378227a05acdf65f21f5f13ed123dd701132b2ea517ba381c1203c4\": container with ID starting with 53d3b4655378227a05acdf65f21f5f13ed123dd701132b2ea517ba381c1203c4 not found: ID does not exist" containerID="53d3b4655378227a05acdf65f21f5f13ed123dd701132b2ea517ba381c1203c4" Jun 08 19:31:31.444337 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.444301 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53d3b4655378227a05acdf65f21f5f13ed123dd701132b2ea517ba381c1203c4"} err="failed to get container status \"53d3b4655378227a05acdf65f21f5f13ed123dd701132b2ea517ba381c1203c4\": rpc error: code = NotFound desc = could not find container \"53d3b4655378227a05acdf65f21f5f13ed123dd701132b2ea517ba381c1203c4\": container with ID starting with 53d3b4655378227a05acdf65f21f5f13ed123dd701132b2ea517ba381c1203c4 not found: ID does not exist" Jun 08 19:31:31.444337 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.444313 2573 scope.go:117] "RemoveContainer" containerID="c311d351d4146240ccbc9e9d64878805192c5374418109c6dec50a1856e683e5" Jun 08 19:31:31.444515 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:31:31.444501 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c311d351d4146240ccbc9e9d64878805192c5374418109c6dec50a1856e683e5\": container with ID starting with c311d351d4146240ccbc9e9d64878805192c5374418109c6dec50a1856e683e5 not found: ID does not exist" containerID="c311d351d4146240ccbc9e9d64878805192c5374418109c6dec50a1856e683e5" Jun 08 19:31:31.444554 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.444518 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c311d351d4146240ccbc9e9d64878805192c5374418109c6dec50a1856e683e5"} err="failed to get container status \"c311d351d4146240ccbc9e9d64878805192c5374418109c6dec50a1856e683e5\": rpc error: code = NotFound desc = could not find container \"c311d351d4146240ccbc9e9d64878805192c5374418109c6dec50a1856e683e5\": container with ID starting with c311d351d4146240ccbc9e9d64878805192c5374418109c6dec50a1856e683e5 not found: ID does not exist" Jun 08 19:31:31.444554 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.444529 2573 scope.go:117] "RemoveContainer" containerID="652208bdc62d8c34028c6e424499f9ecdf7185b9671310da3b83a2bac109b11a" Jun 08 19:31:31.444691 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:31:31.444677 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"652208bdc62d8c34028c6e424499f9ecdf7185b9671310da3b83a2bac109b11a\": container with ID starting with 652208bdc62d8c34028c6e424499f9ecdf7185b9671310da3b83a2bac109b11a not found: ID does not exist" containerID="652208bdc62d8c34028c6e424499f9ecdf7185b9671310da3b83a2bac109b11a" Jun 08 19:31:31.444740 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.444694 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"652208bdc62d8c34028c6e424499f9ecdf7185b9671310da3b83a2bac109b11a"} err="failed to get container status \"652208bdc62d8c34028c6e424499f9ecdf7185b9671310da3b83a2bac109b11a\": rpc error: code = NotFound desc = could not find container \"652208bdc62d8c34028c6e424499f9ecdf7185b9671310da3b83a2bac109b11a\": container with ID starting with 652208bdc62d8c34028c6e424499f9ecdf7185b9671310da3b83a2bac109b11a not found: ID does not exist" Jun 08 19:31:31.446990 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.446975 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-kube-rbac-proxy\") pod \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " Jun 08 19:31:31.447035 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.447022 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-grpc-tls\") pod \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " Jun 08 19:31:31.447070 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.447042 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvw5j\" (UniqueName: \"kubernetes.io/projected/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-kube-api-access-jvw5j\") pod \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " Jun 08 19:31:31.447070 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.447064 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-k8s-rulefiles-0\") pod \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " Jun 08 19:31:31.447156 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.447139 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-web-config\") pod \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " Jun 08 19:31:31.447217 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.447201 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-configmap-serving-certs-ca-bundle\") pod \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " Jun 08 19:31:31.447271 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.447229 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-config\") pod \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " Jun 08 19:31:31.447271 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.447264 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " Jun 08 19:31:31.447367 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.447301 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-trusted-ca-bundle\") pod \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " Jun 08 19:31:31.447367 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.447329 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-configmap-kubelet-serving-ca-bundle\") pod \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " Jun 08 19:31:31.447367 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.447361 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " Jun 08 19:31:31.447511 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.447384 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-configmap-metrics-client-ca\") pod \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " Jun 08 19:31:31.447511 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.447417 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-tls-assets\") pod \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " Jun 08 19:31:31.447511 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.447447 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-k8s-db\") pod \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " Jun 08 19:31:31.447511 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.447471 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-metrics-client-certs\") pod \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " Jun 08 19:31:31.447511 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.447505 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-thanos-prometheus-http-client-file\") pod \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " Jun 08 19:31:31.447758 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.447535 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-k8s-rulefiles-1\") pod \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " Jun 08 19:31:31.447758 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.447557 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-k8s-rulefiles-2\") pod \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " Jun 08 19:31:31.447758 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.447588 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-prometheus-k8s-tls\") pod \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " Jun 08 19:31:31.447758 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.447591 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" (UID: "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:31:31.447758 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.447615 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-config-out\") pod \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\" (UID: \"bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2\") " Jun 08 19:31:31.448014 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.447942 2573 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:31.448569 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.448537 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" (UID: "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:31:31.448569 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.448548 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" (UID: "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:31:31.448704 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.448583 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" (UID: "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:31:31.449861 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.449837 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-kube-api-access-jvw5j" (OuterVolumeSpecName: "kube-api-access-jvw5j") pod "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" (UID: "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2"). InnerVolumeSpecName "kube-api-access-jvw5j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:31:31.450034 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.450012 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" (UID: "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:31:31.450430 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.450405 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" (UID: "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:31:31.450505 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.450490 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" (UID: "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:31:31.450815 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.450714 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" (UID: "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:31:31.450953 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.450920 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" (UID: "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:31:31.451162 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.451138 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" (UID: "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:31:31.451232 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.451158 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-config-out" (OuterVolumeSpecName: "config-out") pod "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" (UID: "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:31:31.451232 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.451182 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" (UID: "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:31:31.451586 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.451565 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" (UID: "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:31:31.451670 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.451635 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" (UID: "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:31:31.452385 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.452352 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-config" (OuterVolumeSpecName: "config") pod "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" (UID: "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:31:31.452620 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.452601 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" (UID: "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:31:31.452821 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.452789 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" (UID: "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:31:31.452821 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.452807 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" (UID: "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:31:31.461713 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.461689 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-web-config" (OuterVolumeSpecName: "web-config") pod "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" (UID: "bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:31:31.549177 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.549150 2573 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-kube-rbac-proxy\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:31.549177 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.549173 2573 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-grpc-tls\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:31.549177 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.549181 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvw5j\" (UniqueName: \"kubernetes.io/projected/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-kube-api-access-jvw5j\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:31.549334 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.549190 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:31.549334 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.549219 2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-web-config\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:31.549334 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.549227 2573 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-config\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:31.549334 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.549235 2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:31.549334 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.549244 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:31.549334 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.549252 2573 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:31.549334 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.549261 2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:31.549334 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.549269 2573 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-configmap-metrics-client-ca\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:31.549334 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.549277 2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-tls-assets\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:31.549334 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.549286 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-k8s-db\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:31.549334 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.549294 2573 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-metrics-client-certs\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:31.549334 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.549302 2573 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:31.549334 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.549310 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:31.549334 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.549318 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:31.549334 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.549330 2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:31.549766 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.549342 2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2-config-out\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:31:31.715549 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.715483 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 19:31:31.720358 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.720338 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 19:31:31.751610 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.751588 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 19:31:31.751922 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.751910 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerName="init-config-reloader" Jun 08 19:31:31.751967 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.751924 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerName="init-config-reloader" Jun 08 19:31:31.751967 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.751938 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerName="config-reloader" Jun 08 19:31:31.751967 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.751944 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerName="config-reloader" Jun 08 19:31:31.751967 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.751954 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerName="kube-rbac-proxy-web" Jun 08 19:31:31.751967 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.751960 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerName="kube-rbac-proxy-web" Jun 08 19:31:31.752138 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.751972 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerName="kube-rbac-proxy" Jun 08 19:31:31.752138 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.751977 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerName="kube-rbac-proxy" Jun 08 19:31:31.752138 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.751983 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerName="kube-rbac-proxy-thanos" Jun 08 19:31:31.752138 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.751989 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerName="kube-rbac-proxy-thanos" Jun 08 19:31:31.752138 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.751997 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerName="thanos-sidecar" Jun 08 19:31:31.752138 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.752001 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerName="thanos-sidecar" Jun 08 19:31:31.752138 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.752009 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerName="prometheus" Jun 08 19:31:31.752138 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.752013 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerName="prometheus" Jun 08 19:31:31.752138 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.752060 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerName="prometheus" Jun 08 19:31:31.752138 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.752070 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerName="thanos-sidecar" Jun 08 19:31:31.752138 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.752076 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerName="kube-rbac-proxy-web" Jun 08 19:31:31.752138 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.752082 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerName="config-reloader" Jun 08 19:31:31.752138 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.752087 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerName="kube-rbac-proxy" Jun 08 19:31:31.752138 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.752092 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" containerName="kube-rbac-proxy-thanos" Jun 08 19:31:31.757263 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.757249 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.763640 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.763403 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 08 19:31:31.763640 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.763492 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 08 19:31:31.763640 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.763495 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 08 19:31:31.763879 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.763865 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 08 19:31:31.763935 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.763892 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cvdivv8o0ovhm\"" Jun 08 19:31:31.764174 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.764159 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 08 19:31:31.764237 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.764179 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 08 19:31:31.764237 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.764193 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 08 19:31:31.764356 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.764236 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 08 19:31:31.764404 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.764366 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 08 19:31:31.766444 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.766428 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 08 19:31:31.766444 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.766436 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 08 19:31:31.766589 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.766446 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 08 19:31:31.766791 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.766777 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rk6h8\"" Jun 08 19:31:31.766904 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.766877 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 08 19:31:31.771609 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.771593 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 08 19:31:31.776894 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.776876 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 19:31:31.851260 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.851239 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/64a3952e-26c8-4ed5-bc5c-199a0269b706-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.851372 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.851269 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/64a3952e-26c8-4ed5-bc5c-199a0269b706-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.851372 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.851310 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/64a3952e-26c8-4ed5-bc5c-199a0269b706-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.851372 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.851339 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/64a3952e-26c8-4ed5-bc5c-199a0269b706-config\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.851372 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.851360 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64a3952e-26c8-4ed5-bc5c-199a0269b706-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.851537 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.851390 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64a3952e-26c8-4ed5-bc5c-199a0269b706-config-out\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.851537 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.851417 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64a3952e-26c8-4ed5-bc5c-199a0269b706-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.851537 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.851433 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64a3952e-26c8-4ed5-bc5c-199a0269b706-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.851537 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.851455 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64a3952e-26c8-4ed5-bc5c-199a0269b706-web-config\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.851537 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.851471 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64a3952e-26c8-4ed5-bc5c-199a0269b706-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.851537 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.851488 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/64a3952e-26c8-4ed5-bc5c-199a0269b706-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.851910 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.851541 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/64a3952e-26c8-4ed5-bc5c-199a0269b706-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.851910 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.851580 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/64a3952e-26c8-4ed5-bc5c-199a0269b706-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.851910 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.851614 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64a3952e-26c8-4ed5-bc5c-199a0269b706-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.851910 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.851641 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64a3952e-26c8-4ed5-bc5c-199a0269b706-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.851910 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.851683 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/64a3952e-26c8-4ed5-bc5c-199a0269b706-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.851910 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.851708 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfwn6\" (UniqueName: \"kubernetes.io/projected/64a3952e-26c8-4ed5-bc5c-199a0269b706-kube-api-access-rfwn6\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.851910 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.851761 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/64a3952e-26c8-4ed5-bc5c-199a0269b706-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.851910 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.851786 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64a3952e-26c8-4ed5-bc5c-199a0269b706-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.851910 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.851810 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64a3952e-26c8-4ed5-bc5c-199a0269b706-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.953020 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.952998 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64a3952e-26c8-4ed5-bc5c-199a0269b706-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.953164 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.953028 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64a3952e-26c8-4ed5-bc5c-199a0269b706-config-out\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.953164 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.953047 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64a3952e-26c8-4ed5-bc5c-199a0269b706-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.953310 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.953164 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64a3952e-26c8-4ed5-bc5c-199a0269b706-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.953310 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.953213 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64a3952e-26c8-4ed5-bc5c-199a0269b706-web-config\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.953310 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.953240 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64a3952e-26c8-4ed5-bc5c-199a0269b706-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.953310 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.953262 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/64a3952e-26c8-4ed5-bc5c-199a0269b706-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.953310 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.953288 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/64a3952e-26c8-4ed5-bc5c-199a0269b706-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.953554 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.953312 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/64a3952e-26c8-4ed5-bc5c-199a0269b706-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.953554 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.953340 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64a3952e-26c8-4ed5-bc5c-199a0269b706-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.953554 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.953369 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64a3952e-26c8-4ed5-bc5c-199a0269b706-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.953554 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.953406 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/64a3952e-26c8-4ed5-bc5c-199a0269b706-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.953554 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.953429 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfwn6\" (UniqueName: \"kubernetes.io/projected/64a3952e-26c8-4ed5-bc5c-199a0269b706-kube-api-access-rfwn6\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.953554 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.953458 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/64a3952e-26c8-4ed5-bc5c-199a0269b706-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.953554 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.953483 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64a3952e-26c8-4ed5-bc5c-199a0269b706-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.953554 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.953512 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64a3952e-26c8-4ed5-bc5c-199a0269b706-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.953554 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.953541 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/64a3952e-26c8-4ed5-bc5c-199a0269b706-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.954069 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.953569 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/64a3952e-26c8-4ed5-bc5c-199a0269b706-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.954069 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.953625 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/64a3952e-26c8-4ed5-bc5c-199a0269b706-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.954069 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.953656 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/64a3952e-26c8-4ed5-bc5c-199a0269b706-config\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.954069 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.953761 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64a3952e-26c8-4ed5-bc5c-199a0269b706-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.954069 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.953807 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/64a3952e-26c8-4ed5-bc5c-199a0269b706-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.954343 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.954189 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64a3952e-26c8-4ed5-bc5c-199a0269b706-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.954424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.954391 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/64a3952e-26c8-4ed5-bc5c-199a0269b706-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.954424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.954406 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64a3952e-26c8-4ed5-bc5c-199a0269b706-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.955475 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.955081 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64a3952e-26c8-4ed5-bc5c-199a0269b706-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.955796 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.955773 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64a3952e-26c8-4ed5-bc5c-199a0269b706-config-out\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.956469 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.956443 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64a3952e-26c8-4ed5-bc5c-199a0269b706-web-config\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.956559 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.956496 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/64a3952e-26c8-4ed5-bc5c-199a0269b706-config\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.957061 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.957038 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64a3952e-26c8-4ed5-bc5c-199a0269b706-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.957147 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.957076 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/64a3952e-26c8-4ed5-bc5c-199a0269b706-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.957265 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.957204 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64a3952e-26c8-4ed5-bc5c-199a0269b706-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.957760 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.957737 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/64a3952e-26c8-4ed5-bc5c-199a0269b706-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.957859 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.957811 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64a3952e-26c8-4ed5-bc5c-199a0269b706-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.958106 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.958084 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/64a3952e-26c8-4ed5-bc5c-199a0269b706-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.958177 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.958142 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/64a3952e-26c8-4ed5-bc5c-199a0269b706-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.958853 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.958831 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/64a3952e-26c8-4ed5-bc5c-199a0269b706-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.958960 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.958946 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/64a3952e-26c8-4ed5-bc5c-199a0269b706-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.959223 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.959207 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64a3952e-26c8-4ed5-bc5c-199a0269b706-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:31.962956 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:31.962932 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfwn6\" (UniqueName: \"kubernetes.io/projected/64a3952e-26c8-4ed5-bc5c-199a0269b706-kube-api-access-rfwn6\") pod \"prometheus-k8s-0\" (UID: \"64a3952e-26c8-4ed5-bc5c-199a0269b706\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:32.066249 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:32.066226 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:32.200767 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:32.200745 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 19:31:32.201901 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:31:32.201871 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a3952e_26c8_4ed5_bc5c_199a0269b706.slice/crio-35a39d54cb1103a113b1f64df92f4840419b21539e246aa5fe4056634f404298 WatchSource:0}: Error finding container 35a39d54cb1103a113b1f64df92f4840419b21539e246aa5fe4056634f404298: Status 404 returned error can't find the container with id 35a39d54cb1103a113b1f64df92f4840419b21539e246aa5fe4056634f404298 Jun 08 19:31:32.304605 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:32.304579 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2" path="/var/lib/kubelet/pods/bfaf1aa4-02d8-48ff-91b1-2b6bf769f8d2/volumes" Jun 08 19:31:32.394972 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:32.394911 2573 generic.go:356] "Generic (PLEG): container finished" podID="64a3952e-26c8-4ed5-bc5c-199a0269b706" containerID="6fc95760b4e5a3cc158b4662e5069e14030508c6cb26379ecda87cf36133a4a8" exitCode=0 Jun 08 19:31:32.395276 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:32.394996 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64a3952e-26c8-4ed5-bc5c-199a0269b706","Type":"ContainerDied","Data":"6fc95760b4e5a3cc158b4662e5069e14030508c6cb26379ecda87cf36133a4a8"} Jun 08 19:31:32.395276 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:32.395072 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64a3952e-26c8-4ed5-bc5c-199a0269b706","Type":"ContainerStarted","Data":"35a39d54cb1103a113b1f64df92f4840419b21539e246aa5fe4056634f404298"} Jun 08 19:31:33.071223 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:33.071188 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:33.135666 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:33.135642 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:33.403235 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:33.403160 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64a3952e-26c8-4ed5-bc5c-199a0269b706","Type":"ContainerStarted","Data":"5f90a4d60b107257b2305a96c07b772dbb9184e4afcc649b45b8f7e71233026f"} Jun 08 19:31:33.403235 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:33.403224 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64a3952e-26c8-4ed5-bc5c-199a0269b706","Type":"ContainerStarted","Data":"8c0d6538e2ae4f48038c4c4988d5a231b7a1c2f10aad95ab761dd5f67113c218"} Jun 08 19:31:33.403602 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:33.403252 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64a3952e-26c8-4ed5-bc5c-199a0269b706","Type":"ContainerStarted","Data":"e2bf06371fc5febc388fa1143679ca84db5aab8749cd584c61ceb555223e7c1b"} Jun 08 19:31:33.403602 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:33.403280 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64a3952e-26c8-4ed5-bc5c-199a0269b706","Type":"ContainerStarted","Data":"f25da84aa6cefcefbfa441b5b17cc2dd8749ab0765188f28fd7ff67bdce208b1"} Jun 08 19:31:33.403602 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:33.403313 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64a3952e-26c8-4ed5-bc5c-199a0269b706","Type":"ContainerStarted","Data":"4122889078cc14ae6d77ad5d3f3d7445be608c00ce861e80f9a33a379655f72c"} Jun 08 19:31:33.403602 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:33.403336 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64a3952e-26c8-4ed5-bc5c-199a0269b706","Type":"ContainerStarted","Data":"b53335ae73ccdd29e0ba616a05efa78277d38306a4448227e239d456bb669a82"} Jun 08 19:31:33.436026 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:33.435979 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.414323144 podStartE2EDuration="2.435960506s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.637362ms" isStatefulPod=false podCreationTimestamp="2026-06-08 19:31:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:31:33.434220233 +0000 UTC m=+309.569676685" watchObservedRunningTime="2026-06-08 19:31:33.435960506 +0000 UTC m=+309.571416947" Jun 08 19:31:34.482283 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:34.482253 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:34.544406 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:34.544377 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:37.066990 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:37.066957 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:31:39.433687 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:39.433657 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:39.493502 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:39.493465 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:40.757243 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:40.757212 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:40.866491 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:40.866460 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:40.936549 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:40.936518 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:48.088038 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:48.088005 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:31:48.156989 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:31:48.156954 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:32:12.536044 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:32:12.536010 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:32:30.560950 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:32:30.560914 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:32:30.619615 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:32:30.619581 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:32:32.066582 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:32:32.066551 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:32:32.082257 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:32:32.082232 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:32:32.670428 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:32:32.670397 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:34:21.188309 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:34:21.188267 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:35:19.937482 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:35:19.937448 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:35:21.341539 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:35:21.341506 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:35:30.594208 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:35:30.594174 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:35:30.671835 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:35:30.671798 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:35:30.740078 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:35:30.740048 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:35:33.078523 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:35:33.078489 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:35:33.176359 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:35:33.176323 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:07.577167 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:37:07.577132 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:07.679267 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:37:07.679238 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:07.731774 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:37:07.731749 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:40:43.687406 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:40:43.687370 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:42:54.639890 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:42:54.639795 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:03.828671 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:44:03.828565 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:03.917611 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:44:03.917570 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:14.340432 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:44:14.340380 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:14.395757 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:44:14.395702 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:35.635337 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:44:35.635282 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:36.444904 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:44:36.444852 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:39.246428 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:44:39.246395 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:39.347358 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:44:39.347328 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:40.447960 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:44:40.447927 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:40.545069 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:44:40.545044 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:40.976795 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:44:40.976765 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:41.097811 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:44:41.097782 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:43.752118 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:44:43.752089 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:44.346675 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:44:44.346644 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:46.047540 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:44:46.047513 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:46.100237 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:44:46.100201 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:52.053814 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:44:52.053780 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:52.152143 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:44:52.152111 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:52.351357 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:44:52.351289 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:58.499844 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:44:58.499811 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:58.583981 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:44:58.583951 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:00.580906 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:00.580871 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:01.029702 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:01.029626 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-hj275"] Jun 08 19:45:01.032017 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:01.031997 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-hj275" Jun 08 19:45:01.034629 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:01.034613 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 08 19:45:01.034990 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:01.034976 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-xl24l\"" Jun 08 19:45:01.036136 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:01.036120 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 08 19:45:01.044919 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:01.044899 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-hj275"] Jun 08 19:45:01.198764 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:01.198708 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8v72\" (UniqueName: \"kubernetes.io/projected/8e9cea4b-81cf-4f13-9f42-0742257a56e7-kube-api-access-r8v72\") pod \"cert-manager-59c77684cc-hj275\" (UID: \"8e9cea4b-81cf-4f13-9f42-0742257a56e7\") " pod="cert-manager/cert-manager-59c77684cc-hj275" Jun 08 19:45:01.198935 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:01.198776 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e9cea4b-81cf-4f13-9f42-0742257a56e7-bound-sa-token\") pod \"cert-manager-59c77684cc-hj275\" (UID: \"8e9cea4b-81cf-4f13-9f42-0742257a56e7\") " pod="cert-manager/cert-manager-59c77684cc-hj275" Jun 08 19:45:01.299709 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:01.299680 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8v72\" (UniqueName: \"kubernetes.io/projected/8e9cea4b-81cf-4f13-9f42-0742257a56e7-kube-api-access-r8v72\") pod \"cert-manager-59c77684cc-hj275\" (UID: \"8e9cea4b-81cf-4f13-9f42-0742257a56e7\") " pod="cert-manager/cert-manager-59c77684cc-hj275" Jun 08 19:45:01.299882 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:01.299741 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e9cea4b-81cf-4f13-9f42-0742257a56e7-bound-sa-token\") pod \"cert-manager-59c77684cc-hj275\" (UID: \"8e9cea4b-81cf-4f13-9f42-0742257a56e7\") " pod="cert-manager/cert-manager-59c77684cc-hj275" Jun 08 19:45:01.310899 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:01.310878 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e9cea4b-81cf-4f13-9f42-0742257a56e7-bound-sa-token\") pod \"cert-manager-59c77684cc-hj275\" (UID: \"8e9cea4b-81cf-4f13-9f42-0742257a56e7\") " pod="cert-manager/cert-manager-59c77684cc-hj275" Jun 08 19:45:01.311181 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:01.311160 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8v72\" (UniqueName: \"kubernetes.io/projected/8e9cea4b-81cf-4f13-9f42-0742257a56e7-kube-api-access-r8v72\") pod \"cert-manager-59c77684cc-hj275\" (UID: \"8e9cea4b-81cf-4f13-9f42-0742257a56e7\") " pod="cert-manager/cert-manager-59c77684cc-hj275" Jun 08 19:45:01.349981 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:01.349960 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-hj275" Jun 08 19:45:01.484072 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:01.484009 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-hj275"] Jun 08 19:45:01.486302 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:45:01.486271 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e9cea4b_81cf_4f13_9f42_0742257a56e7.slice/crio-c64defc8409c83f0974cd0c1a53dd7f5c13e3e62ace862e669d3ea4afe4a6bf9 WatchSource:0}: Error finding container c64defc8409c83f0974cd0c1a53dd7f5c13e3e62ace862e669d3ea4afe4a6bf9: Status 404 returned error can't find the container with id c64defc8409c83f0974cd0c1a53dd7f5c13e3e62ace862e669d3ea4afe4a6bf9 Jun 08 19:45:01.488256 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:01.488237 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 19:45:01.758735 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:01.758637 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-hj275" event={"ID":"8e9cea4b-81cf-4f13-9f42-0742257a56e7","Type":"ContainerStarted","Data":"c64defc8409c83f0974cd0c1a53dd7f5c13e3e62ace862e669d3ea4afe4a6bf9"} Jun 08 19:45:05.331100 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:05.331065 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:05.431544 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:05.431512 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:05.779878 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:05.779800 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-hj275" event={"ID":"8e9cea4b-81cf-4f13-9f42-0742257a56e7","Type":"ContainerStarted","Data":"d3fb947404fc459effe9f399fcb4b97cc8a5d1fdfad3966f872936243a52e50f"} Jun 08 19:45:05.800187 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:05.800142 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-hj275" podStartSLOduration=1.547805351 podStartE2EDuration="4.800126426s" totalImagesPullingTime="3.252321075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:45:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:45:05.799068776 +0000 UTC m=+1121.934525221" watchObservedRunningTime="2026-06-08 19:45:05.800126426 +0000 UTC m=+1121.935582867" Jun 08 19:45:10.934165 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:10.934121 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:10.979141 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:10.979108 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-c5d7bcdc4-bwhwx"] Jun 08 19:45:10.981428 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:10.981409 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-bwhwx" Jun 08 19:45:10.988052 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:10.988028 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 08 19:45:10.988166 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:10.988032 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 08 19:45:10.988933 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:10.988914 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 08 19:45:10.989043 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:10.988990 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 08 19:45:10.989043 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:10.988998 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-k25gf\"" Jun 08 19:45:10.989129 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:10.989106 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 08 19:45:10.996108 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:10.996086 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c5d7bcdc4-bwhwx"] Jun 08 19:45:11.021990 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:11.021965 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:11.088483 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:11.088456 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsfqp\" (UniqueName: \"kubernetes.io/projected/a681fe63-a606-4f82-af9e-0ea3964228a9-kube-api-access-vsfqp\") pod \"lws-controller-manager-c5d7bcdc4-bwhwx\" (UID: \"a681fe63-a606-4f82-af9e-0ea3964228a9\") " pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-bwhwx" Jun 08 19:45:11.088597 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:11.088503 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a681fe63-a606-4f82-af9e-0ea3964228a9-manager-config\") pod \"lws-controller-manager-c5d7bcdc4-bwhwx\" (UID: \"a681fe63-a606-4f82-af9e-0ea3964228a9\") " pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-bwhwx" Jun 08 19:45:11.088597 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:11.088550 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a681fe63-a606-4f82-af9e-0ea3964228a9-metrics-cert\") pod \"lws-controller-manager-c5d7bcdc4-bwhwx\" (UID: \"a681fe63-a606-4f82-af9e-0ea3964228a9\") " pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-bwhwx" Jun 08 19:45:11.088686 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:11.088640 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a681fe63-a606-4f82-af9e-0ea3964228a9-cert\") pod \"lws-controller-manager-c5d7bcdc4-bwhwx\" (UID: \"a681fe63-a606-4f82-af9e-0ea3964228a9\") " pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-bwhwx" Jun 08 19:45:11.190158 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:11.190081 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a681fe63-a606-4f82-af9e-0ea3964228a9-cert\") pod \"lws-controller-manager-c5d7bcdc4-bwhwx\" (UID: \"a681fe63-a606-4f82-af9e-0ea3964228a9\") " pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-bwhwx" Jun 08 19:45:11.190158 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:11.190151 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsfqp\" (UniqueName: \"kubernetes.io/projected/a681fe63-a606-4f82-af9e-0ea3964228a9-kube-api-access-vsfqp\") pod \"lws-controller-manager-c5d7bcdc4-bwhwx\" (UID: \"a681fe63-a606-4f82-af9e-0ea3964228a9\") " pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-bwhwx" Jun 08 19:45:11.190362 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:11.190180 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a681fe63-a606-4f82-af9e-0ea3964228a9-manager-config\") pod \"lws-controller-manager-c5d7bcdc4-bwhwx\" (UID: \"a681fe63-a606-4f82-af9e-0ea3964228a9\") " pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-bwhwx" Jun 08 19:45:11.190362 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:11.190201 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a681fe63-a606-4f82-af9e-0ea3964228a9-metrics-cert\") pod \"lws-controller-manager-c5d7bcdc4-bwhwx\" (UID: \"a681fe63-a606-4f82-af9e-0ea3964228a9\") " pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-bwhwx" Jun 08 19:45:11.190877 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:11.190855 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a681fe63-a606-4f82-af9e-0ea3964228a9-manager-config\") pod \"lws-controller-manager-c5d7bcdc4-bwhwx\" (UID: \"a681fe63-a606-4f82-af9e-0ea3964228a9\") " pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-bwhwx" Jun 08 19:45:11.192487 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:11.192467 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a681fe63-a606-4f82-af9e-0ea3964228a9-cert\") pod \"lws-controller-manager-c5d7bcdc4-bwhwx\" (UID: \"a681fe63-a606-4f82-af9e-0ea3964228a9\") " pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-bwhwx" Jun 08 19:45:11.192616 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:11.192601 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a681fe63-a606-4f82-af9e-0ea3964228a9-metrics-cert\") pod \"lws-controller-manager-c5d7bcdc4-bwhwx\" (UID: \"a681fe63-a606-4f82-af9e-0ea3964228a9\") " pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-bwhwx" Jun 08 19:45:11.208096 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:11.208073 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsfqp\" (UniqueName: \"kubernetes.io/projected/a681fe63-a606-4f82-af9e-0ea3964228a9-kube-api-access-vsfqp\") pod \"lws-controller-manager-c5d7bcdc4-bwhwx\" (UID: \"a681fe63-a606-4f82-af9e-0ea3964228a9\") " pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-bwhwx" Jun 08 19:45:11.297196 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:11.297157 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-bwhwx" Jun 08 19:45:11.526945 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:11.526864 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c5d7bcdc4-bwhwx"] Jun 08 19:45:11.529990 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:45:11.529962 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda681fe63_a606_4f82_af9e_0ea3964228a9.slice/crio-4bd3d46559a20235b22b52be2ef23b4708d366a89297c5cb743ab4b92f70888b WatchSource:0}: Error finding container 4bd3d46559a20235b22b52be2ef23b4708d366a89297c5cb743ab4b92f70888b: Status 404 returned error can't find the container with id 4bd3d46559a20235b22b52be2ef23b4708d366a89297c5cb743ab4b92f70888b Jun 08 19:45:11.805444 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:11.805406 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-bwhwx" event={"ID":"a681fe63-a606-4f82-af9e-0ea3964228a9","Type":"ContainerStarted","Data":"4bd3d46559a20235b22b52be2ef23b4708d366a89297c5cb743ab4b92f70888b"} Jun 08 19:45:12.142443 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:12.142364 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:12.237875 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:12.237845 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:12.764001 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:12.763967 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:13.345512 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:13.345468 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:13.531910 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:13.531870 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-fg22s"] Jun 08 19:45:13.538079 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:13.538054 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-fg22s" Jun 08 19:45:13.544661 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:13.544639 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 08 19:45:13.545347 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:13.545221 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-b26jb\"" Jun 08 19:45:13.545347 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:13.545251 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 19:45:13.545584 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:13.545567 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 19:45:13.547054 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:13.547036 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 08 19:45:13.571079 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:13.571055 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-fg22s"] Jun 08 19:45:13.612508 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:13.612433 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a6e1477b-c7f3-4004-a217-6c42670e682a-manifests\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-fg22s\" (UID: \"a6e1477b-c7f3-4004-a217-6c42670e682a\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-fg22s" Jun 08 19:45:13.612508 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:13.612486 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6e1477b-c7f3-4004-a217-6c42670e682a-tmp\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-fg22s\" (UID: \"a6e1477b-c7f3-4004-a217-6c42670e682a\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-fg22s" Jun 08 19:45:13.612744 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:13.612592 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6e1477b-c7f3-4004-a217-6c42670e682a-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-fg22s\" (UID: \"a6e1477b-c7f3-4004-a217-6c42670e682a\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-fg22s" Jun 08 19:45:13.612744 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:13.612649 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a6e1477b-c7f3-4004-a217-6c42670e682a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-fg22s\" (UID: \"a6e1477b-c7f3-4004-a217-6c42670e682a\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-fg22s" Jun 08 19:45:13.612914 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:13.612775 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jfdq\" (UniqueName: \"kubernetes.io/projected/a6e1477b-c7f3-4004-a217-6c42670e682a-kube-api-access-4jfdq\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-fg22s\" (UID: \"a6e1477b-c7f3-4004-a217-6c42670e682a\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-fg22s" Jun 08 19:45:13.630400 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:13.630373 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:13.713537 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:13.713495 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a6e1477b-c7f3-4004-a217-6c42670e682a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-fg22s\" (UID: \"a6e1477b-c7f3-4004-a217-6c42670e682a\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-fg22s" Jun 08 19:45:13.713702 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:13.713597 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jfdq\" (UniqueName: \"kubernetes.io/projected/a6e1477b-c7f3-4004-a217-6c42670e682a-kube-api-access-4jfdq\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-fg22s\" (UID: \"a6e1477b-c7f3-4004-a217-6c42670e682a\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-fg22s" Jun 08 19:45:13.713702 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:13.713642 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a6e1477b-c7f3-4004-a217-6c42670e682a-manifests\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-fg22s\" (UID: \"a6e1477b-c7f3-4004-a217-6c42670e682a\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-fg22s" Jun 08 19:45:13.713702 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:13.713667 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6e1477b-c7f3-4004-a217-6c42670e682a-tmp\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-fg22s\" (UID: \"a6e1477b-c7f3-4004-a217-6c42670e682a\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-fg22s" Jun 08 19:45:13.713925 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:13.713743 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6e1477b-c7f3-4004-a217-6c42670e682a-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-fg22s\" (UID: \"a6e1477b-c7f3-4004-a217-6c42670e682a\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-fg22s" Jun 08 19:45:13.714082 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:13.714056 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a6e1477b-c7f3-4004-a217-6c42670e682a-manifests\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-fg22s\" (UID: \"a6e1477b-c7f3-4004-a217-6c42670e682a\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-fg22s" Jun 08 19:45:13.716085 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:13.716058 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6e1477b-c7f3-4004-a217-6c42670e682a-tmp\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-fg22s\" (UID: \"a6e1477b-c7f3-4004-a217-6c42670e682a\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-fg22s" Jun 08 19:45:13.716218 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:13.716177 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a6e1477b-c7f3-4004-a217-6c42670e682a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-fg22s\" (UID: \"a6e1477b-c7f3-4004-a217-6c42670e682a\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-fg22s" Jun 08 19:45:13.716334 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:13.716311 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6e1477b-c7f3-4004-a217-6c42670e682a-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-fg22s\" (UID: \"a6e1477b-c7f3-4004-a217-6c42670e682a\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-fg22s" Jun 08 19:45:13.729022 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:13.728998 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jfdq\" (UniqueName: \"kubernetes.io/projected/a6e1477b-c7f3-4004-a217-6c42670e682a-kube-api-access-4jfdq\") pod \"opendatahub-operator-controller-manager-5b795f8b7b-fg22s\" (UID: \"a6e1477b-c7f3-4004-a217-6c42670e682a\") " pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-fg22s" Jun 08 19:45:13.850558 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:13.850525 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-fg22s" Jun 08 19:45:14.002567 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:14.002486 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:14.141206 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:14.141176 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:14.275868 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:14.275773 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:14.284191 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:14.284163 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-fg22s"] Jun 08 19:45:14.284984 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:45:14.284957 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6e1477b_c7f3_4004_a217_6c42670e682a.slice/crio-eac2717c600cba0b3cbb64c7dd1d60ab2e6fde846c0445ce46d7657aa8936830 WatchSource:0}: Error finding container eac2717c600cba0b3cbb64c7dd1d60ab2e6fde846c0445ce46d7657aa8936830: Status 404 returned error can't find the container with id eac2717c600cba0b3cbb64c7dd1d60ab2e6fde846c0445ce46d7657aa8936830 Jun 08 19:45:14.444099 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:14.444065 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:14.550550 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:14.550523 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:14.681202 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:14.681153 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:14.824046 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:14.823907 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-bwhwx" event={"ID":"a681fe63-a606-4f82-af9e-0ea3964228a9","Type":"ContainerStarted","Data":"4b6fd3c902f3c8d801e535ffa490d66f5252231bef7a1599847b39365c28c95e"} Jun 08 19:45:14.824205 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:14.824105 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-bwhwx" Jun 08 19:45:14.825711 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:14.825680 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-fg22s" event={"ID":"a6e1477b-c7f3-4004-a217-6c42670e682a","Type":"ContainerStarted","Data":"eac2717c600cba0b3cbb64c7dd1d60ab2e6fde846c0445ce46d7657aa8936830"} Jun 08 19:45:14.883751 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:14.881756 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-bwhwx" podStartSLOduration=2.252259108 podStartE2EDuration="4.881737317s" totalImagesPullingTime="2.629478209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:45:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:45:14.881269565 +0000 UTC m=+1131.016726004" watchObservedRunningTime="2026-06-08 19:45:14.881737317 +0000 UTC m=+1131.017193756" Jun 08 19:45:17.843331 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:17.843297 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-fg22s" event={"ID":"a6e1477b-c7f3-4004-a217-6c42670e682a","Type":"ContainerStarted","Data":"001381ff1128e94d133b8b1f5a73f159aeba4fc84642574e57cc6757b3e900e5"} Jun 08 19:45:18.849412 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:18.849375 2573 generic.go:356] "Generic (PLEG): container finished" podID="a6e1477b-c7f3-4004-a217-6c42670e682a" containerID="001381ff1128e94d133b8b1f5a73f159aeba4fc84642574e57cc6757b3e900e5" exitCode=0 Jun 08 19:45:18.849882 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:18.849460 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-fg22s" event={"ID":"a6e1477b-c7f3-4004-a217-6c42670e682a","Type":"ContainerDied","Data":"001381ff1128e94d133b8b1f5a73f159aeba4fc84642574e57cc6757b3e900e5"} Jun 08 19:45:19.856364 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:19.856326 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-fg22s" event={"ID":"a6e1477b-c7f3-4004-a217-6c42670e682a","Type":"ContainerStarted","Data":"3780f8297fb277fc23bbf8d5cefe6ad998b603b175d226cd3fde44ec43ba5c02"} Jun 08 19:45:19.856794 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:19.856468 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-fg22s" Jun 08 19:45:19.881908 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:19.881866 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-fg22s" podStartSLOduration=3.089300291 podStartE2EDuration="6.881854269s" totalImagesPullingTime="2.878169215s" totalInitContainerRuntime="914.384763ms" isStatefulPod=false podCreationTimestamp="2026-06-08 19:45:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:45:19.880021725 +0000 UTC m=+1136.015478167" watchObservedRunningTime="2026-06-08 19:45:19.881854269 +0000 UTC m=+1136.017310710" Jun 08 19:45:25.833370 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:25.833339 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-c5d7bcdc4-bwhwx" Jun 08 19:45:30.862689 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:30.862655 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b795f8b7b-fg22s" Jun 08 19:45:32.872683 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:32.872593 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:33.028425 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:33.028383 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:36.600932 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:36.600882 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:36.800138 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:36.800108 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7888cd9689-l95vf"] Jun 08 19:45:36.815599 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:36.815564 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7888cd9689-l95vf" Jun 08 19:45:36.818779 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:36.818756 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 08 19:45:36.819315 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:36.819298 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 08 19:45:36.819993 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:36.819974 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-m6442\"" Jun 08 19:45:36.844784 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:36.844762 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7888cd9689-l95vf"] Jun 08 19:45:36.901221 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:36.901157 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:36.918367 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:36.918343 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cfe36fc-1503-4b85-b87c-cc21bb5ba48f-tmp\") pod \"kube-auth-proxy-7888cd9689-l95vf\" (UID: \"6cfe36fc-1503-4b85-b87c-cc21bb5ba48f\") " pod="openshift-ingress/kube-auth-proxy-7888cd9689-l95vf" Jun 08 19:45:36.918455 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:36.918385 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdn6h\" (UniqueName: \"kubernetes.io/projected/6cfe36fc-1503-4b85-b87c-cc21bb5ba48f-kube-api-access-cdn6h\") pod \"kube-auth-proxy-7888cd9689-l95vf\" (UID: \"6cfe36fc-1503-4b85-b87c-cc21bb5ba48f\") " pod="openshift-ingress/kube-auth-proxy-7888cd9689-l95vf" Jun 08 19:45:36.918499 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:36.918461 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cfe36fc-1503-4b85-b87c-cc21bb5ba48f-tls-certs\") pod \"kube-auth-proxy-7888cd9689-l95vf\" (UID: \"6cfe36fc-1503-4b85-b87c-cc21bb5ba48f\") " pod="openshift-ingress/kube-auth-proxy-7888cd9689-l95vf" Jun 08 19:45:37.019625 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:37.019594 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cfe36fc-1503-4b85-b87c-cc21bb5ba48f-tls-certs\") pod \"kube-auth-proxy-7888cd9689-l95vf\" (UID: \"6cfe36fc-1503-4b85-b87c-cc21bb5ba48f\") " pod="openshift-ingress/kube-auth-proxy-7888cd9689-l95vf" Jun 08 19:45:37.019784 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:37.019664 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cfe36fc-1503-4b85-b87c-cc21bb5ba48f-tmp\") pod \"kube-auth-proxy-7888cd9689-l95vf\" (UID: \"6cfe36fc-1503-4b85-b87c-cc21bb5ba48f\") " pod="openshift-ingress/kube-auth-proxy-7888cd9689-l95vf" Jun 08 19:45:37.019784 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:37.019711 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdn6h\" (UniqueName: \"kubernetes.io/projected/6cfe36fc-1503-4b85-b87c-cc21bb5ba48f-kube-api-access-cdn6h\") pod \"kube-auth-proxy-7888cd9689-l95vf\" (UID: \"6cfe36fc-1503-4b85-b87c-cc21bb5ba48f\") " pod="openshift-ingress/kube-auth-proxy-7888cd9689-l95vf" Jun 08 19:45:37.019784 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:45:37.019769 2573 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 08 19:45:37.019923 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:45:37.019848 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cfe36fc-1503-4b85-b87c-cc21bb5ba48f-tls-certs podName:6cfe36fc-1503-4b85-b87c-cc21bb5ba48f nodeName:}" failed. No retries permitted until 2026-06-08 19:45:37.519826809 +0000 UTC m=+1153.655283231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/6cfe36fc-1503-4b85-b87c-cc21bb5ba48f-tls-certs") pod "kube-auth-proxy-7888cd9689-l95vf" (UID: "6cfe36fc-1503-4b85-b87c-cc21bb5ba48f") : secret "kube-auth-proxy-tls" not found Jun 08 19:45:37.021898 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:37.021872 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cfe36fc-1503-4b85-b87c-cc21bb5ba48f-tmp\") pod \"kube-auth-proxy-7888cd9689-l95vf\" (UID: \"6cfe36fc-1503-4b85-b87c-cc21bb5ba48f\") " pod="openshift-ingress/kube-auth-proxy-7888cd9689-l95vf" Jun 08 19:45:37.038884 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:37.038861 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdn6h\" (UniqueName: \"kubernetes.io/projected/6cfe36fc-1503-4b85-b87c-cc21bb5ba48f-kube-api-access-cdn6h\") pod \"kube-auth-proxy-7888cd9689-l95vf\" (UID: \"6cfe36fc-1503-4b85-b87c-cc21bb5ba48f\") " pod="openshift-ingress/kube-auth-proxy-7888cd9689-l95vf" Jun 08 19:45:37.107603 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:37.107552 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:37.333966 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:37.333922 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:37.521429 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:37.521401 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:37.523661 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:37.523639 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cfe36fc-1503-4b85-b87c-cc21bb5ba48f-tls-certs\") pod \"kube-auth-proxy-7888cd9689-l95vf\" (UID: \"6cfe36fc-1503-4b85-b87c-cc21bb5ba48f\") " pod="openshift-ingress/kube-auth-proxy-7888cd9689-l95vf" Jun 08 19:45:37.525985 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:37.525956 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cfe36fc-1503-4b85-b87c-cc21bb5ba48f-tls-certs\") pod \"kube-auth-proxy-7888cd9689-l95vf\" (UID: \"6cfe36fc-1503-4b85-b87c-cc21bb5ba48f\") " pod="openshift-ingress/kube-auth-proxy-7888cd9689-l95vf" Jun 08 19:45:37.688383 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:37.688310 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:37.725321 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:37.725297 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7888cd9689-l95vf" Jun 08 19:45:37.869311 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:37.869282 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7888cd9689-l95vf"] Jun 08 19:45:37.876363 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:45:37.876338 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cfe36fc_1503_4b85_b87c_cc21bb5ba48f.slice/crio-0ec1583e2000cbffc80fffb50dd393ac04d24a79016591d40941837419e1df01 WatchSource:0}: Error finding container 0ec1583e2000cbffc80fffb50dd393ac04d24a79016591d40941837419e1df01: Status 404 returned error can't find the container with id 0ec1583e2000cbffc80fffb50dd393ac04d24a79016591d40941837419e1df01 Jun 08 19:45:37.939372 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:37.939306 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7888cd9689-l95vf" event={"ID":"6cfe36fc-1503-4b85-b87c-cc21bb5ba48f","Type":"ContainerStarted","Data":"0ec1583e2000cbffc80fffb50dd393ac04d24a79016591d40941837419e1df01"} Jun 08 19:45:38.091837 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:38.091811 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:38.763397 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:38.763367 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:41.962884 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:41.962846 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7888cd9689-l95vf" event={"ID":"6cfe36fc-1503-4b85-b87c-cc21bb5ba48f","Type":"ContainerStarted","Data":"8e8be2dc69c00dcdc9bc47facbd6dbb57ca4a87ddc53ce1cf30f617d9c4d2b33"} Jun 08 19:45:41.999588 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:41.999538 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7888cd9689-l95vf" podStartSLOduration=2.6053791410000002 podStartE2EDuration="5.999522574s" totalImagesPullingTime="3.394143433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:45:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:45:41.999015945 +0000 UTC m=+1158.134472398" watchObservedRunningTime="2026-06-08 19:45:41.999522574 +0000 UTC m=+1158.134979014" Jun 08 19:45:46.148907 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:46.148873 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:47.617426 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:47.617381 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:48.308709 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:48.308678 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:48.605377 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:48.605291 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:48.832836 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:48.832804 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:49.001183 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:49.001096 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:49.376108 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:49.376072 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:49.966500 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:49.966450 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:50.215734 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:50.215676 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:50.902424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:50.902372 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:51.426902 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:51.426849 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:51.638905 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:51.638878 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:51.769556 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:45:51.769456 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:00.655126 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:46:00.655093 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:00.818855 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:46:00.818822 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:10.615673 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:46:10.615634 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:10.703050 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:46:10.703007 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:11.507542 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:46:11.507500 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:14.081238 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:46:14.081204 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:14.186612 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:46:14.186552 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:14.550949 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:46:14.550916 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:14.736485 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:46:14.736421 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:14.835671 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:46:14.835571 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:18.411558 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:46:18.411523 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:34.321703 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:46:34.321654 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:34.422014 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:46:34.421981 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:34.521508 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:46:34.521476 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:03.420013 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:03.419899 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:07.283557 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:07.283527 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:08.644962 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:08.644909 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:09.034265 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:09.034182 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:10.073574 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:10.073541 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:11.644337 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:11.644306 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:11.736973 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:11.736946 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:13.837279 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:13.837241 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:15.674659 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:15.674620 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:17.550970 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:17.550933 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:17.634249 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:17.634219 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:19.965525 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:19.965487 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:20.252888 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:20.252788 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:26.648062 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:26.648033 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:26.748730 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:26.748704 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:29.196763 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:29.196683 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:29.301665 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:29.301628 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:30.012772 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.012736 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p674f"] Jun 08 19:47:30.015921 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.015901 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p674f" Jun 08 19:47:30.019001 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.018980 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 19:47:30.019208 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.019181 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-m8ncj\"" Jun 08 19:47:30.019348 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.019331 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 19:47:30.033428 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.033407 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p674f"] Jun 08 19:47:30.101516 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.101493 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rqnf\" (UniqueName: \"kubernetes.io/projected/d6c70f6f-ef7b-454d-8b9c-0219785be385-kube-api-access-6rqnf\") pod \"kuadrant-operator-controller-manager-55467d9f7-p674f\" (UID: \"d6c70f6f-ef7b-454d-8b9c-0219785be385\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p674f" Jun 08 19:47:30.101631 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.101616 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6c70f6f-ef7b-454d-8b9c-0219785be385-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-p674f\" (UID: \"d6c70f6f-ef7b-454d-8b9c-0219785be385\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p674f" Jun 08 19:47:30.122415 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.122392 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p674f"] Jun 08 19:47:30.122612 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:47:30.122592 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-6rqnf], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p674f" podUID="d6c70f6f-ef7b-454d-8b9c-0219785be385" Jun 08 19:47:30.189842 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.189822 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p674f"] Jun 08 19:47:30.194095 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.194074 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p674f"] Jun 08 19:47:30.202708 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.202684 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6c70f6f-ef7b-454d-8b9c-0219785be385-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-p674f\" (UID: \"d6c70f6f-ef7b-454d-8b9c-0219785be385\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p674f" Jun 08 19:47:30.203049 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.202775 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rqnf\" (UniqueName: \"kubernetes.io/projected/d6c70f6f-ef7b-454d-8b9c-0219785be385-kube-api-access-6rqnf\") pod \"kuadrant-operator-controller-manager-55467d9f7-p674f\" (UID: \"d6c70f6f-ef7b-454d-8b9c-0219785be385\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p674f" Jun 08 19:47:30.203049 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.203022 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6c70f6f-ef7b-454d-8b9c-0219785be385-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-p674f\" (UID: \"d6c70f6f-ef7b-454d-8b9c-0219785be385\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p674f" Jun 08 19:47:30.205548 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:47:30.205529 2573 projected.go:196] Error preparing data for projected volume kube-api-access-6rqnf for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p674f: failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-141-14.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-141-14.ec2.internal' and this object Jun 08 19:47:30.205678 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:47:30.205608 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6c70f6f-ef7b-454d-8b9c-0219785be385-kube-api-access-6rqnf podName:d6c70f6f-ef7b-454d-8b9c-0219785be385 nodeName:}" failed. No retries permitted until 2026-06-08 19:47:30.705588472 +0000 UTC m=+1266.841044908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6rqnf" (UniqueName: "kubernetes.io/projected/d6c70f6f-ef7b-454d-8b9c-0219785be385-kube-api-access-6rqnf") pod "kuadrant-operator-controller-manager-55467d9f7-p674f" (UID: "d6c70f6f-ef7b-454d-8b9c-0219785be385") : failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-141-14.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-141-14.ec2.internal' and this object Jun 08 19:47:30.261697 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.261671 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzwxm"] Jun 08 19:47:30.265047 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.265004 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzwxm" Jun 08 19:47:30.295195 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.295174 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzwxm"] Jun 08 19:47:30.303575 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.303550 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f73162ec-701b-46cf-bfbb-4907c995e8a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tzwxm\" (UID: \"f73162ec-701b-46cf-bfbb-4907c995e8a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzwxm" Jun 08 19:47:30.303698 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.303600 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fshp\" (UniqueName: \"kubernetes.io/projected/f73162ec-701b-46cf-bfbb-4907c995e8a8-kube-api-access-2fshp\") pod \"kuadrant-operator-controller-manager-86878c769f-tzwxm\" (UID: \"f73162ec-701b-46cf-bfbb-4907c995e8a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzwxm" Jun 08 19:47:30.404886 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.404865 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f73162ec-701b-46cf-bfbb-4907c995e8a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tzwxm\" (UID: \"f73162ec-701b-46cf-bfbb-4907c995e8a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzwxm" Jun 08 19:47:30.404979 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.404898 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fshp\" (UniqueName: \"kubernetes.io/projected/f73162ec-701b-46cf-bfbb-4907c995e8a8-kube-api-access-2fshp\") pod \"kuadrant-operator-controller-manager-86878c769f-tzwxm\" (UID: \"f73162ec-701b-46cf-bfbb-4907c995e8a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzwxm" Jun 08 19:47:30.405204 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.405187 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f73162ec-701b-46cf-bfbb-4907c995e8a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tzwxm\" (UID: \"f73162ec-701b-46cf-bfbb-4907c995e8a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzwxm" Jun 08 19:47:30.412956 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.412931 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fshp\" (UniqueName: \"kubernetes.io/projected/f73162ec-701b-46cf-bfbb-4907c995e8a8-kube-api-access-2fshp\") pod \"kuadrant-operator-controller-manager-86878c769f-tzwxm\" (UID: \"f73162ec-701b-46cf-bfbb-4907c995e8a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzwxm" Jun 08 19:47:30.477345 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.477324 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p674f" Jun 08 19:47:30.483864 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.483845 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p674f" Jun 08 19:47:30.486371 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:47:30.486351 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-p674f\" is forbidden: User \"system:node:ip-10-0-141-14.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-14.ec2.internal' and this object" podUID="d6c70f6f-ef7b-454d-8b9c-0219785be385" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p674f" Jun 08 19:47:30.505703 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.505687 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6c70f6f-ef7b-454d-8b9c-0219785be385-extensions-socket-volume\") pod \"d6c70f6f-ef7b-454d-8b9c-0219785be385\" (UID: \"d6c70f6f-ef7b-454d-8b9c-0219785be385\") " Jun 08 19:47:30.505907 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.505888 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6c70f6f-ef7b-454d-8b9c-0219785be385-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d6c70f6f-ef7b-454d-8b9c-0219785be385" (UID: "d6c70f6f-ef7b-454d-8b9c-0219785be385"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:47:30.505954 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.505896 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rqnf\" (UniqueName: \"kubernetes.io/projected/d6c70f6f-ef7b-454d-8b9c-0219785be385-kube-api-access-6rqnf\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:47:30.575246 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.575216 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzwxm" Jun 08 19:47:30.607096 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.607072 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6c70f6f-ef7b-454d-8b9c-0219785be385-extensions-socket-volume\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:47:30.705841 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:30.705817 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzwxm"] Jun 08 19:47:30.708105 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:47:30.708080 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf73162ec_701b_46cf_bfbb_4907c995e8a8.slice/crio-96842b2f1ac1a2b0132f6bba66ea788f9e9ca42f2748c8c0519e65fc44f169df WatchSource:0}: Error finding container 96842b2f1ac1a2b0132f6bba66ea788f9e9ca42f2748c8c0519e65fc44f169df: Status 404 returned error can't find the container with id 96842b2f1ac1a2b0132f6bba66ea788f9e9ca42f2748c8c0519e65fc44f169df Jun 08 19:47:31.484107 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:31.484080 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p674f" Jun 08 19:47:31.484107 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:31.484101 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzwxm" event={"ID":"f73162ec-701b-46cf-bfbb-4907c995e8a8","Type":"ContainerStarted","Data":"96842b2f1ac1a2b0132f6bba66ea788f9e9ca42f2748c8c0519e65fc44f169df"} Jun 08 19:47:31.486516 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:47:31.486487 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-p674f\" is forbidden: User \"system:node:ip-10-0-141-14.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-14.ec2.internal' and this object" podUID="d6c70f6f-ef7b-454d-8b9c-0219785be385" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p674f" Jun 08 19:47:31.493439 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:47:31.493413 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-p674f\" is forbidden: User \"system:node:ip-10-0-141-14.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-14.ec2.internal' and this object" podUID="d6c70f6f-ef7b-454d-8b9c-0219785be385" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p674f" Jun 08 19:47:32.305176 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:32.305145 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6c70f6f-ef7b-454d-8b9c-0219785be385" path="/var/lib/kubelet/pods/d6c70f6f-ef7b-454d-8b9c-0219785be385/volumes" Jun 08 19:47:33.841024 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:33.840992 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:33.944984 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:33.944945 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:35.508785 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:35.508750 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzwxm" event={"ID":"f73162ec-701b-46cf-bfbb-4907c995e8a8","Type":"ContainerStarted","Data":"8a7c415e5ef9d8053f832b9b9340ebc76c6821267d6314e444e70c0dab666a1e"} Jun 08 19:47:35.509153 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:35.508869 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzwxm" Jun 08 19:47:35.530090 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:35.530036 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzwxm" podStartSLOduration=0.958641321 podStartE2EDuration="5.530018435s" totalImagesPullingTime="4.571377114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:47:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:47:35.52897947 +0000 UTC m=+1271.664435909" watchObservedRunningTime="2026-06-08 19:47:35.530018435 +0000 UTC m=+1271.665474877" Jun 08 19:47:37.649215 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:37.649183 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:37.711692 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:37.711664 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:46.412377 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:46.412345 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:46.514359 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:46.514329 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:46.515368 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:46.515350 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tzwxm" Jun 08 19:47:46.615490 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:46.615458 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:48.863538 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:48.863507 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:48.962473 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:48.962441 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:53.620206 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:53.620157 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:53.719463 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:53.719433 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:54.204978 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:54.204948 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:54.270894 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:54.270868 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:57.822791 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:57.822757 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:57.916941 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:47:57.916917 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:48:00.676714 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:00.676677 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:48:02.936021 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:02.935983 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:48:02.997319 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:02.997297 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:48:06.681433 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:06.681406 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:48:06.816698 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:06.816669 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:48:06.917191 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:06.917166 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:48:07.157092 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:07.157066 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:48:07.273862 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:07.273838 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:48:07.345897 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:07.345867 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:48:07.973324 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:07.973293 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-p498l"] Jun 08 19:48:07.975902 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:07.975885 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-p498l" Jun 08 19:48:07.978876 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:07.978852 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9wlzl\"" Jun 08 19:48:07.983447 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:07.983425 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-p498l"] Jun 08 19:48:08.016523 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:08.016502 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:48:08.105136 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:08.105114 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:48:08.117328 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:08.117310 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cfq9\" (UniqueName: \"kubernetes.io/projected/3af1a822-3ce1-4e91-860c-b3142f4a1ecb-kube-api-access-9cfq9\") pod \"authorino-58cd955675-p498l\" (UID: \"3af1a822-3ce1-4e91-860c-b3142f4a1ecb\") " pod="kuadrant-system/authorino-58cd955675-p498l" Jun 08 19:48:08.217891 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:08.217868 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cfq9\" (UniqueName: \"kubernetes.io/projected/3af1a822-3ce1-4e91-860c-b3142f4a1ecb-kube-api-access-9cfq9\") pod \"authorino-58cd955675-p498l\" (UID: \"3af1a822-3ce1-4e91-860c-b3142f4a1ecb\") " pod="kuadrant-system/authorino-58cd955675-p498l" Jun 08 19:48:08.225516 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:08.225460 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cfq9\" (UniqueName: \"kubernetes.io/projected/3af1a822-3ce1-4e91-860c-b3142f4a1ecb-kube-api-access-9cfq9\") pod \"authorino-58cd955675-p498l\" (UID: \"3af1a822-3ce1-4e91-860c-b3142f4a1ecb\") " pod="kuadrant-system/authorino-58cd955675-p498l" Jun 08 19:48:08.285469 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:08.285438 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-p498l" Jun 08 19:48:08.407713 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:08.407692 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-p498l"] Jun 08 19:48:08.409986 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:48:08.409954 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3af1a822_3ce1_4e91_860c_b3142f4a1ecb.slice/crio-c9b0ed7f49f8d613ebb4468e005d9c1aa89cb2985d4c01bb86b274ce78fb75a3 WatchSource:0}: Error finding container c9b0ed7f49f8d613ebb4468e005d9c1aa89cb2985d4c01bb86b274ce78fb75a3: Status 404 returned error can't find the container with id c9b0ed7f49f8d613ebb4468e005d9c1aa89cb2985d4c01bb86b274ce78fb75a3 Jun 08 19:48:08.665807 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:08.665779 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-p498l" event={"ID":"3af1a822-3ce1-4e91-860c-b3142f4a1ecb","Type":"ContainerStarted","Data":"c9b0ed7f49f8d613ebb4468e005d9c1aa89cb2985d4c01bb86b274ce78fb75a3"} Jun 08 19:48:09.263354 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:09.263321 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:48:09.361148 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:09.361101 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:48:11.684754 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:11.684705 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-p498l" event={"ID":"3af1a822-3ce1-4e91-860c-b3142f4a1ecb","Type":"ContainerStarted","Data":"5ad09af0c25bde8fa2671c2c7a993bf9267dc10f2fc1b94b78ab82a51117edde"} Jun 08 19:48:11.700555 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:11.700514 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-p498l" podStartSLOduration=1.8903657699999998 podStartE2EDuration="4.700499926s" totalImagesPullingTime="2.810134156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:48:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:48:11.699248284 +0000 UTC m=+1307.834704726" watchObservedRunningTime="2026-06-08 19:48:11.700499926 +0000 UTC m=+1307.835956365" Jun 08 19:48:12.858675 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:12.858640 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-p498l"] Jun 08 19:48:13.694483 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:13.694441 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-p498l" podUID="3af1a822-3ce1-4e91-860c-b3142f4a1ecb" containerName="authorino" containerID="cri-o://5ad09af0c25bde8fa2671c2c7a993bf9267dc10f2fc1b94b78ab82a51117edde" gracePeriod=30 Jun 08 19:48:13.941982 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:13.941961 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-p498l" Jun 08 19:48:14.025428 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:14.025353 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:48:14.067662 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:14.067636 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cfq9\" (UniqueName: \"kubernetes.io/projected/3af1a822-3ce1-4e91-860c-b3142f4a1ecb-kube-api-access-9cfq9\") pod \"3af1a822-3ce1-4e91-860c-b3142f4a1ecb\" (UID: \"3af1a822-3ce1-4e91-860c-b3142f4a1ecb\") " Jun 08 19:48:14.069675 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:14.069654 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3af1a822-3ce1-4e91-860c-b3142f4a1ecb-kube-api-access-9cfq9" (OuterVolumeSpecName: "kube-api-access-9cfq9") pod "3af1a822-3ce1-4e91-860c-b3142f4a1ecb" (UID: "3af1a822-3ce1-4e91-860c-b3142f4a1ecb"). InnerVolumeSpecName "kube-api-access-9cfq9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:48:14.133686 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:14.133660 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:48:14.169057 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:14.169036 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cfq9\" (UniqueName: \"kubernetes.io/projected/3af1a822-3ce1-4e91-860c-b3142f4a1ecb-kube-api-access-9cfq9\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:48:14.699180 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:14.699097 2573 generic.go:356] "Generic (PLEG): container finished" podID="3af1a822-3ce1-4e91-860c-b3142f4a1ecb" containerID="5ad09af0c25bde8fa2671c2c7a993bf9267dc10f2fc1b94b78ab82a51117edde" exitCode=0 Jun 08 19:48:14.699180 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:14.699135 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-p498l" Jun 08 19:48:14.699347 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:14.699177 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-p498l" event={"ID":"3af1a822-3ce1-4e91-860c-b3142f4a1ecb","Type":"ContainerDied","Data":"5ad09af0c25bde8fa2671c2c7a993bf9267dc10f2fc1b94b78ab82a51117edde"} Jun 08 19:48:14.699347 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:14.699219 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-p498l" event={"ID":"3af1a822-3ce1-4e91-860c-b3142f4a1ecb","Type":"ContainerDied","Data":"c9b0ed7f49f8d613ebb4468e005d9c1aa89cb2985d4c01bb86b274ce78fb75a3"} Jun 08 19:48:14.699347 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:14.699236 2573 scope.go:117] "RemoveContainer" containerID="5ad09af0c25bde8fa2671c2c7a993bf9267dc10f2fc1b94b78ab82a51117edde" Jun 08 19:48:14.707473 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:14.707455 2573 scope.go:117] "RemoveContainer" containerID="5ad09af0c25bde8fa2671c2c7a993bf9267dc10f2fc1b94b78ab82a51117edde" Jun 08 19:48:14.707712 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:48:14.707695 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ad09af0c25bde8fa2671c2c7a993bf9267dc10f2fc1b94b78ab82a51117edde\": container with ID starting with 5ad09af0c25bde8fa2671c2c7a993bf9267dc10f2fc1b94b78ab82a51117edde not found: ID does not exist" containerID="5ad09af0c25bde8fa2671c2c7a993bf9267dc10f2fc1b94b78ab82a51117edde" Jun 08 19:48:14.707787 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:14.707733 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ad09af0c25bde8fa2671c2c7a993bf9267dc10f2fc1b94b78ab82a51117edde"} err="failed to get container status \"5ad09af0c25bde8fa2671c2c7a993bf9267dc10f2fc1b94b78ab82a51117edde\": rpc error: code = NotFound desc = could not find container \"5ad09af0c25bde8fa2671c2c7a993bf9267dc10f2fc1b94b78ab82a51117edde\": container with ID starting with 5ad09af0c25bde8fa2671c2c7a993bf9267dc10f2fc1b94b78ab82a51117edde not found: ID does not exist" Jun 08 19:48:14.717247 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:14.717226 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-p498l"] Jun 08 19:48:14.722613 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:14.722592 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-p498l"] Jun 08 19:48:16.305377 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:16.305344 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3af1a822-3ce1-4e91-860c-b3142f4a1ecb" path="/var/lib/kubelet/pods/3af1a822-3ce1-4e91-860c-b3142f4a1ecb/volumes" Jun 08 19:48:28.291588 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:28.291552 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:48:37.939600 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:37.939520 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:48:38.035911 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:38.035880 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:48:38.188825 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:48:38.188797 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:49:02.984923 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:02.984892 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:49:03.085554 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:03.085522 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:49:03.186086 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:03.186055 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:49:03.383229 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:03.383199 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 19:49:03.383575 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:03.383555 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3af1a822-3ce1-4e91-860c-b3142f4a1ecb" containerName="authorino" Jun 08 19:49:03.383575 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:03.383569 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3af1a822-3ce1-4e91-860c-b3142f4a1ecb" containerName="authorino" Jun 08 19:49:03.383801 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:03.383715 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3af1a822-3ce1-4e91-860c-b3142f4a1ecb" containerName="authorino" Jun 08 19:49:03.387540 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:03.387525 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 19:49:03.390508 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:03.390484 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 19:49:03.390508 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:03.390501 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-66df7\"" Jun 08 19:49:03.391611 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:03.391592 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 19:49:03.391698 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:03.391631 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 19:49:03.396437 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:03.396417 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 19:49:03.496928 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:03.496892 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5s5j\" (UniqueName: \"kubernetes.io/projected/0b749bc2-b798-42d6-9ad4-17ca60da1682-kube-api-access-l5s5j\") pod \"maas-keycloak-0\" (UID: \"0b749bc2-b798-42d6-9ad4-17ca60da1682\") " pod="keycloak-system/maas-keycloak-0" Jun 08 19:49:03.598249 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:03.598214 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5s5j\" (UniqueName: \"kubernetes.io/projected/0b749bc2-b798-42d6-9ad4-17ca60da1682-kube-api-access-l5s5j\") pod \"maas-keycloak-0\" (UID: \"0b749bc2-b798-42d6-9ad4-17ca60da1682\") " pod="keycloak-system/maas-keycloak-0" Jun 08 19:49:03.606238 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:03.606213 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5s5j\" (UniqueName: \"kubernetes.io/projected/0b749bc2-b798-42d6-9ad4-17ca60da1682-kube-api-access-l5s5j\") pod \"maas-keycloak-0\" (UID: \"0b749bc2-b798-42d6-9ad4-17ca60da1682\") " pod="keycloak-system/maas-keycloak-0" Jun 08 19:49:03.697540 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:03.697453 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 19:49:03.826640 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:03.826611 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 19:49:03.828287 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:49:03.828253 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b749bc2_b798_42d6_9ad4_17ca60da1682.slice/crio-65e36f56dc7ba094fafcc52323e570cbbc70aa558a82811b50296358762d1fcb WatchSource:0}: Error finding container 65e36f56dc7ba094fafcc52323e570cbbc70aa558a82811b50296358762d1fcb: Status 404 returned error can't find the container with id 65e36f56dc7ba094fafcc52323e570cbbc70aa558a82811b50296358762d1fcb Jun 08 19:49:03.928826 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:03.928795 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0b749bc2-b798-42d6-9ad4-17ca60da1682","Type":"ContainerStarted","Data":"65e36f56dc7ba094fafcc52323e570cbbc70aa558a82811b50296358762d1fcb"} Jun 08 19:49:08.962822 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:08.962788 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0b749bc2-b798-42d6-9ad4-17ca60da1682","Type":"ContainerStarted","Data":"8eb95ef0b694cc3d43873a7540c580acfdba79a2b162c51fd2fb28d92dbb02d3"} Jun 08 19:49:08.979820 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:08.979771 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.535021118 podStartE2EDuration="5.9797547s" totalImagesPullingTime="4.444733582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:49:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:49:08.978757687 +0000 UTC m=+1365.114214126" watchObservedRunningTime="2026-06-08 19:49:08.9797547 +0000 UTC m=+1365.115211139" Jun 08 19:49:09.697948 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:09.697894 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 08 19:49:09.699701 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:09.699656 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0b749bc2-b798-42d6-9ad4-17ca60da1682" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 08 19:49:10.698917 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:10.698860 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0b749bc2-b798-42d6-9ad4-17ca60da1682" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 08 19:49:11.698216 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:11.698162 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0b749bc2-b798-42d6-9ad4-17ca60da1682" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 08 19:49:12.697986 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:12.697943 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0b749bc2-b798-42d6-9ad4-17ca60da1682" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 08 19:49:13.699036 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:13.698985 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0b749bc2-b798-42d6-9ad4-17ca60da1682" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 08 19:49:13.699518 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:13.699479 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 08 19:49:14.698736 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:14.698675 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0b749bc2-b798-42d6-9ad4-17ca60da1682" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 08 19:49:15.698843 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:15.698792 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0b749bc2-b798-42d6-9ad4-17ca60da1682" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 08 19:49:16.698097 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:16.698055 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0b749bc2-b798-42d6-9ad4-17ca60da1682" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 08 19:49:17.698401 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:17.698353 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0b749bc2-b798-42d6-9ad4-17ca60da1682" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 08 19:49:18.698369 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:18.698313 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0b749bc2-b798-42d6-9ad4-17ca60da1682" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 08 19:49:19.698273 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:19.698224 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0b749bc2-b798-42d6-9ad4-17ca60da1682" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 08 19:49:20.698623 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:20.698575 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0b749bc2-b798-42d6-9ad4-17ca60da1682" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 08 19:49:21.805056 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:21.803755 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 08 19:49:21.821649 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:21.821315 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="0b749bc2-b798-42d6-9ad4-17ca60da1682" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 19:49:31.810521 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:31.810487 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 08 19:49:33.143534 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:33.143478 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:49:33.198349 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:33.198320 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:49:37.845744 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:37.845702 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:49:37.851442 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:37.851416 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6968ffc74f-wq2bt"] Jun 08 19:49:37.858974 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:37.858952 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6968ffc74f-wq2bt" Jun 08 19:49:37.862189 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:37.862168 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 08 19:49:37.862413 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:37.862169 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 08 19:49:37.862508 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:37.862193 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-2w7qj\"" Jun 08 19:49:37.867742 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:37.864526 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6968ffc74f-wq2bt"] Jun 08 19:49:37.945734 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:37.945696 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:49:37.948007 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:37.947984 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hflh\" (UniqueName: \"kubernetes.io/projected/0ebd873f-ef50-4b07-a87d-e7d33c59b703-kube-api-access-6hflh\") pod \"maas-controller-6968ffc74f-wq2bt\" (UID: \"0ebd873f-ef50-4b07-a87d-e7d33c59b703\") " pod="opendatahub/maas-controller-6968ffc74f-wq2bt" Jun 08 19:49:37.948145 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:37.948126 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ebd873f-ef50-4b07-a87d-e7d33c59b703-webhook-cert\") pod \"maas-controller-6968ffc74f-wq2bt\" (UID: \"0ebd873f-ef50-4b07-a87d-e7d33c59b703\") " pod="opendatahub/maas-controller-6968ffc74f-wq2bt" Jun 08 19:49:38.034288 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:38.034239 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:49:38.039735 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:38.039696 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56b77869d6-4qzdf"] Jun 08 19:49:38.042715 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:38.042696 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56b77869d6-4qzdf" Jun 08 19:49:38.048761 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:38.048713 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gx69\" (UniqueName: \"kubernetes.io/projected/ae49ce0f-2c6f-43e2-97ee-178a405baed6-kube-api-access-6gx69\") pod \"maas-controller-56b77869d6-4qzdf\" (UID: \"ae49ce0f-2c6f-43e2-97ee-178a405baed6\") " pod="opendatahub/maas-controller-56b77869d6-4qzdf" Jun 08 19:49:38.048873 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:38.048815 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae49ce0f-2c6f-43e2-97ee-178a405baed6-webhook-cert\") pod \"maas-controller-56b77869d6-4qzdf\" (UID: \"ae49ce0f-2c6f-43e2-97ee-178a405baed6\") " pod="opendatahub/maas-controller-56b77869d6-4qzdf" Jun 08 19:49:38.048935 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:38.048877 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ebd873f-ef50-4b07-a87d-e7d33c59b703-webhook-cert\") pod \"maas-controller-6968ffc74f-wq2bt\" (UID: \"0ebd873f-ef50-4b07-a87d-e7d33c59b703\") " pod="opendatahub/maas-controller-6968ffc74f-wq2bt" Jun 08 19:49:38.048994 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:49:38.048948 2573 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 08 19:49:38.048994 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:38.048955 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hflh\" (UniqueName: \"kubernetes.io/projected/0ebd873f-ef50-4b07-a87d-e7d33c59b703-kube-api-access-6hflh\") pod \"maas-controller-6968ffc74f-wq2bt\" (UID: \"0ebd873f-ef50-4b07-a87d-e7d33c59b703\") " pod="opendatahub/maas-controller-6968ffc74f-wq2bt" Jun 08 19:49:38.049109 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:49:38.049021 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ebd873f-ef50-4b07-a87d-e7d33c59b703-webhook-cert podName:0ebd873f-ef50-4b07-a87d-e7d33c59b703 nodeName:}" failed. No retries permitted until 2026-06-08 19:49:38.548993097 +0000 UTC m=+1394.684449535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/0ebd873f-ef50-4b07-a87d-e7d33c59b703-webhook-cert") pod "maas-controller-6968ffc74f-wq2bt" (UID: "0ebd873f-ef50-4b07-a87d-e7d33c59b703") : secret "maas-controller-webhook-cert" not found Jun 08 19:49:38.053767 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:38.053742 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56b77869d6-4qzdf"] Jun 08 19:49:38.065785 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:38.065764 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hflh\" (UniqueName: \"kubernetes.io/projected/0ebd873f-ef50-4b07-a87d-e7d33c59b703-kube-api-access-6hflh\") pod \"maas-controller-6968ffc74f-wq2bt\" (UID: \"0ebd873f-ef50-4b07-a87d-e7d33c59b703\") " pod="opendatahub/maas-controller-6968ffc74f-wq2bt" Jun 08 19:49:38.098247 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:38.098188 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:49:38.149624 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:38.149592 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gx69\" (UniqueName: \"kubernetes.io/projected/ae49ce0f-2c6f-43e2-97ee-178a405baed6-kube-api-access-6gx69\") pod \"maas-controller-56b77869d6-4qzdf\" (UID: \"ae49ce0f-2c6f-43e2-97ee-178a405baed6\") " pod="opendatahub/maas-controller-56b77869d6-4qzdf" Jun 08 19:49:38.149816 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:38.149640 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae49ce0f-2c6f-43e2-97ee-178a405baed6-webhook-cert\") pod \"maas-controller-56b77869d6-4qzdf\" (UID: \"ae49ce0f-2c6f-43e2-97ee-178a405baed6\") " pod="opendatahub/maas-controller-56b77869d6-4qzdf" Jun 08 19:49:38.152011 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:38.151991 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae49ce0f-2c6f-43e2-97ee-178a405baed6-webhook-cert\") pod \"maas-controller-56b77869d6-4qzdf\" (UID: \"ae49ce0f-2c6f-43e2-97ee-178a405baed6\") " pod="opendatahub/maas-controller-56b77869d6-4qzdf" Jun 08 19:49:38.157285 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:38.157261 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gx69\" (UniqueName: \"kubernetes.io/projected/ae49ce0f-2c6f-43e2-97ee-178a405baed6-kube-api-access-6gx69\") pod \"maas-controller-56b77869d6-4qzdf\" (UID: \"ae49ce0f-2c6f-43e2-97ee-178a405baed6\") " pod="opendatahub/maas-controller-56b77869d6-4qzdf" Jun 08 19:49:38.354118 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:38.354032 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56b77869d6-4qzdf" Jun 08 19:49:38.479821 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:38.479795 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56b77869d6-4qzdf"] Jun 08 19:49:38.481043 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:49:38.481022 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae49ce0f_2c6f_43e2_97ee_178a405baed6.slice/crio-0748dda1b4f7f87d3d5370040e949c80c0ea2bd9ec2d13342e9ef1689910b4a0 WatchSource:0}: Error finding container 0748dda1b4f7f87d3d5370040e949c80c0ea2bd9ec2d13342e9ef1689910b4a0: Status 404 returned error can't find the container with id 0748dda1b4f7f87d3d5370040e949c80c0ea2bd9ec2d13342e9ef1689910b4a0 Jun 08 19:49:38.553068 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:38.553025 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ebd873f-ef50-4b07-a87d-e7d33c59b703-webhook-cert\") pod \"maas-controller-6968ffc74f-wq2bt\" (UID: \"0ebd873f-ef50-4b07-a87d-e7d33c59b703\") " pod="opendatahub/maas-controller-6968ffc74f-wq2bt" Jun 08 19:49:38.555372 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:38.555345 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ebd873f-ef50-4b07-a87d-e7d33c59b703-webhook-cert\") pod \"maas-controller-6968ffc74f-wq2bt\" (UID: \"0ebd873f-ef50-4b07-a87d-e7d33c59b703\") " pod="opendatahub/maas-controller-6968ffc74f-wq2bt" Jun 08 19:49:38.774112 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:38.774006 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6968ffc74f-wq2bt" Jun 08 19:49:38.900428 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:38.900402 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6968ffc74f-wq2bt"] Jun 08 19:49:38.902182 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:49:38.902155 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ebd873f_ef50_4b07_a87d_e7d33c59b703.slice/crio-9e7b0537b85753d7a51de966aa9df71d4644eed61b973acabaeb26f3a95357c4 WatchSource:0}: Error finding container 9e7b0537b85753d7a51de966aa9df71d4644eed61b973acabaeb26f3a95357c4: Status 404 returned error can't find the container with id 9e7b0537b85753d7a51de966aa9df71d4644eed61b973acabaeb26f3a95357c4 Jun 08 19:49:39.137629 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:39.137596 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6968ffc74f-wq2bt" event={"ID":"0ebd873f-ef50-4b07-a87d-e7d33c59b703","Type":"ContainerStarted","Data":"9e7b0537b85753d7a51de966aa9df71d4644eed61b973acabaeb26f3a95357c4"} Jun 08 19:49:39.138834 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:39.138804 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56b77869d6-4qzdf" event={"ID":"ae49ce0f-2c6f-43e2-97ee-178a405baed6","Type":"ContainerStarted","Data":"0748dda1b4f7f87d3d5370040e949c80c0ea2bd9ec2d13342e9ef1689910b4a0"} Jun 08 19:49:41.153457 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:41.153317 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6968ffc74f-wq2bt" event={"ID":"0ebd873f-ef50-4b07-a87d-e7d33c59b703","Type":"ContainerStarted","Data":"c45516962dc9776dfa95d80e8eeda87af7afe858c01fffbf6470d3c8d02a480a"} Jun 08 19:49:41.153457 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:41.153388 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6968ffc74f-wq2bt" Jun 08 19:49:41.155283 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:41.155248 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56b77869d6-4qzdf" event={"ID":"ae49ce0f-2c6f-43e2-97ee-178a405baed6","Type":"ContainerStarted","Data":"5872d4fc93b8bc7700eb4459e2612266248e3e5a6d3e6189e6ed49e9e625ad8f"} Jun 08 19:49:41.155435 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:41.155379 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56b77869d6-4qzdf" Jun 08 19:49:41.181271 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:41.181218 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6968ffc74f-wq2bt" podStartSLOduration=2.06123846 podStartE2EDuration="4.181191107s" totalImagesPullingTime="2.119952647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:49:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:49:41.178967926 +0000 UTC m=+1397.314424366" watchObservedRunningTime="2026-06-08 19:49:41.181191107 +0000 UTC m=+1397.316647548" Jun 08 19:49:41.207559 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:41.207509 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-56b77869d6-4qzdf" podStartSLOduration=0.672703559 podStartE2EDuration="3.207493665s" totalImagesPullingTime="2.534790106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:49:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:49:41.205448279 +0000 UTC m=+1397.340904723" watchObservedRunningTime="2026-06-08 19:49:41.207493665 +0000 UTC m=+1397.342950104" Jun 08 19:49:41.220402 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:41.220377 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:49:41.320202 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:41.320170 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:49:52.165132 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:52.165106 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6968ffc74f-wq2bt" Jun 08 19:49:52.165509 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:52.165170 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56b77869d6-4qzdf" Jun 08 19:49:52.216391 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:52.216357 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6968ffc74f-wq2bt"] Jun 08 19:49:52.216564 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:52.216541 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6968ffc74f-wq2bt" podUID="0ebd873f-ef50-4b07-a87d-e7d33c59b703" containerName="manager" containerID="cri-o://c45516962dc9776dfa95d80e8eeda87af7afe858c01fffbf6470d3c8d02a480a" gracePeriod=30 Jun 08 19:49:52.466438 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:52.466410 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6968ffc74f-wq2bt" Jun 08 19:49:52.577789 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:52.577756 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hflh\" (UniqueName: \"kubernetes.io/projected/0ebd873f-ef50-4b07-a87d-e7d33c59b703-kube-api-access-6hflh\") pod \"0ebd873f-ef50-4b07-a87d-e7d33c59b703\" (UID: \"0ebd873f-ef50-4b07-a87d-e7d33c59b703\") " Jun 08 19:49:52.577966 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:52.577809 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ebd873f-ef50-4b07-a87d-e7d33c59b703-webhook-cert\") pod \"0ebd873f-ef50-4b07-a87d-e7d33c59b703\" (UID: \"0ebd873f-ef50-4b07-a87d-e7d33c59b703\") " Jun 08 19:49:52.579826 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:52.579797 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ebd873f-ef50-4b07-a87d-e7d33c59b703-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0ebd873f-ef50-4b07-a87d-e7d33c59b703" (UID: "0ebd873f-ef50-4b07-a87d-e7d33c59b703"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:49:52.579941 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:52.579834 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ebd873f-ef50-4b07-a87d-e7d33c59b703-kube-api-access-6hflh" (OuterVolumeSpecName: "kube-api-access-6hflh") pod "0ebd873f-ef50-4b07-a87d-e7d33c59b703" (UID: "0ebd873f-ef50-4b07-a87d-e7d33c59b703"). InnerVolumeSpecName "kube-api-access-6hflh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:49:52.678624 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:52.678597 2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ebd873f-ef50-4b07-a87d-e7d33c59b703-webhook-cert\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:49:52.678624 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:52.678621 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hflh\" (UniqueName: \"kubernetes.io/projected/0ebd873f-ef50-4b07-a87d-e7d33c59b703-kube-api-access-6hflh\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:49:53.213230 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:53.213191 2573 generic.go:356] "Generic (PLEG): container finished" podID="0ebd873f-ef50-4b07-a87d-e7d33c59b703" containerID="c45516962dc9776dfa95d80e8eeda87af7afe858c01fffbf6470d3c8d02a480a" exitCode=0 Jun 08 19:49:53.213230 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:53.213236 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6968ffc74f-wq2bt" Jun 08 19:49:53.213696 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:53.213280 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6968ffc74f-wq2bt" event={"ID":"0ebd873f-ef50-4b07-a87d-e7d33c59b703","Type":"ContainerDied","Data":"c45516962dc9776dfa95d80e8eeda87af7afe858c01fffbf6470d3c8d02a480a"} Jun 08 19:49:53.213696 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:53.213335 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6968ffc74f-wq2bt" event={"ID":"0ebd873f-ef50-4b07-a87d-e7d33c59b703","Type":"ContainerDied","Data":"9e7b0537b85753d7a51de966aa9df71d4644eed61b973acabaeb26f3a95357c4"} Jun 08 19:49:53.213696 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:53.213359 2573 scope.go:117] "RemoveContainer" containerID="c45516962dc9776dfa95d80e8eeda87af7afe858c01fffbf6470d3c8d02a480a" Jun 08 19:49:53.222738 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:53.222580 2573 scope.go:117] "RemoveContainer" containerID="c45516962dc9776dfa95d80e8eeda87af7afe858c01fffbf6470d3c8d02a480a" Jun 08 19:49:53.222863 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:49:53.222841 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c45516962dc9776dfa95d80e8eeda87af7afe858c01fffbf6470d3c8d02a480a\": container with ID starting with c45516962dc9776dfa95d80e8eeda87af7afe858c01fffbf6470d3c8d02a480a not found: ID does not exist" containerID="c45516962dc9776dfa95d80e8eeda87af7afe858c01fffbf6470d3c8d02a480a" Jun 08 19:49:53.222903 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:53.222871 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c45516962dc9776dfa95d80e8eeda87af7afe858c01fffbf6470d3c8d02a480a"} err="failed to get container status \"c45516962dc9776dfa95d80e8eeda87af7afe858c01fffbf6470d3c8d02a480a\": rpc error: code = NotFound desc = could not find container \"c45516962dc9776dfa95d80e8eeda87af7afe858c01fffbf6470d3c8d02a480a\": container with ID starting with c45516962dc9776dfa95d80e8eeda87af7afe858c01fffbf6470d3c8d02a480a not found: ID does not exist" Jun 08 19:49:53.235406 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:53.235378 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6968ffc74f-wq2bt"] Jun 08 19:49:53.239742 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:53.239703 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6968ffc74f-wq2bt"] Jun 08 19:49:54.305831 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:49:54.305793 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ebd873f-ef50-4b07-a87d-e7d33c59b703" path="/var/lib/kubelet/pods/0ebd873f-ef50-4b07-a87d-e7d33c59b703/volumes" Jun 08 19:50:12.615679 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:12.615596 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:50:12.671431 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:12.671404 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-d784c457d-bzx9c"] Jun 08 19:50:12.671863 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:12.671847 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ebd873f-ef50-4b07-a87d-e7d33c59b703" containerName="manager" Jun 08 19:50:12.671924 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:12.671865 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ebd873f-ef50-4b07-a87d-e7d33c59b703" containerName="manager" Jun 08 19:50:12.671964 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:12.671956 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ebd873f-ef50-4b07-a87d-e7d33c59b703" containerName="manager" Jun 08 19:50:12.674917 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:12.674901 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-d784c457d-bzx9c" Jun 08 19:50:12.677373 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:12.677351 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 08 19:50:12.677510 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:12.677443 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-dsr8m\"" Jun 08 19:50:12.683813 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:12.683778 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-d784c457d-bzx9c"] Jun 08 19:50:12.768398 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:12.768372 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e9237f7-3935-4d45-8edf-a376439b02e8-maas-api-tls\") pod \"maas-api-d784c457d-bzx9c\" (UID: \"0e9237f7-3935-4d45-8edf-a376439b02e8\") " pod="opendatahub/maas-api-d784c457d-bzx9c" Jun 08 19:50:12.768554 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:12.768420 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f88dl\" (UniqueName: \"kubernetes.io/projected/0e9237f7-3935-4d45-8edf-a376439b02e8-kube-api-access-f88dl\") pod \"maas-api-d784c457d-bzx9c\" (UID: \"0e9237f7-3935-4d45-8edf-a376439b02e8\") " pod="opendatahub/maas-api-d784c457d-bzx9c" Jun 08 19:50:12.869876 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:12.869799 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e9237f7-3935-4d45-8edf-a376439b02e8-maas-api-tls\") pod \"maas-api-d784c457d-bzx9c\" (UID: \"0e9237f7-3935-4d45-8edf-a376439b02e8\") " pod="opendatahub/maas-api-d784c457d-bzx9c" Jun 08 19:50:12.869876 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:12.869859 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f88dl\" (UniqueName: \"kubernetes.io/projected/0e9237f7-3935-4d45-8edf-a376439b02e8-kube-api-access-f88dl\") pod \"maas-api-d784c457d-bzx9c\" (UID: \"0e9237f7-3935-4d45-8edf-a376439b02e8\") " pod="opendatahub/maas-api-d784c457d-bzx9c" Jun 08 19:50:12.870078 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:50:12.869952 2573 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 08 19:50:12.870078 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:50:12.870036 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e9237f7-3935-4d45-8edf-a376439b02e8-maas-api-tls podName:0e9237f7-3935-4d45-8edf-a376439b02e8 nodeName:}" failed. No retries permitted until 2026-06-08 19:50:13.37001423 +0000 UTC m=+1429.505470648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0e9237f7-3935-4d45-8edf-a376439b02e8-maas-api-tls") pod "maas-api-d784c457d-bzx9c" (UID: "0e9237f7-3935-4d45-8edf-a376439b02e8") : secret "maas-api-serving-cert" not found Jun 08 19:50:12.880355 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:12.880333 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f88dl\" (UniqueName: \"kubernetes.io/projected/0e9237f7-3935-4d45-8edf-a376439b02e8-kube-api-access-f88dl\") pod \"maas-api-d784c457d-bzx9c\" (UID: \"0e9237f7-3935-4d45-8edf-a376439b02e8\") " pod="opendatahub/maas-api-d784c457d-bzx9c" Jun 08 19:50:13.031139 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:13.031104 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:50:13.133857 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:13.133777 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:50:13.203578 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:13.203542 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-6gv74"] Jun 08 19:50:13.207246 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:13.207228 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-6gv74" Jun 08 19:50:13.209865 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:13.209843 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 08 19:50:13.222861 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:13.222839 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-6gv74"] Jun 08 19:50:13.246762 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:13.246707 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:50:13.375447 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:13.375413 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e9237f7-3935-4d45-8edf-a376439b02e8-maas-api-tls\") pod \"maas-api-d784c457d-bzx9c\" (UID: \"0e9237f7-3935-4d45-8edf-a376439b02e8\") " pod="opendatahub/maas-api-d784c457d-bzx9c" Jun 08 19:50:13.375669 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:13.375518 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sllpm\" (UniqueName: \"kubernetes.io/projected/d26756f7-2f03-4beb-878f-66f98f611bec-kube-api-access-sllpm\") pod \"payload-pre-processing-67d7689b65-6gv74\" (UID: \"d26756f7-2f03-4beb-878f-66f98f611bec\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-6gv74" Jun 08 19:50:13.377915 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:13.377888 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e9237f7-3935-4d45-8edf-a376439b02e8-maas-api-tls\") pod \"maas-api-d784c457d-bzx9c\" (UID: \"0e9237f7-3935-4d45-8edf-a376439b02e8\") " pod="opendatahub/maas-api-d784c457d-bzx9c" Jun 08 19:50:13.476596 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:13.476506 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sllpm\" (UniqueName: \"kubernetes.io/projected/d26756f7-2f03-4beb-878f-66f98f611bec-kube-api-access-sllpm\") pod \"payload-pre-processing-67d7689b65-6gv74\" (UID: \"d26756f7-2f03-4beb-878f-66f98f611bec\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-6gv74" Jun 08 19:50:13.484708 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:13.484674 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sllpm\" (UniqueName: \"kubernetes.io/projected/d26756f7-2f03-4beb-878f-66f98f611bec-kube-api-access-sllpm\") pod \"payload-pre-processing-67d7689b65-6gv74\" (UID: \"d26756f7-2f03-4beb-878f-66f98f611bec\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-6gv74" Jun 08 19:50:13.517754 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:13.517709 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-6gv74" Jun 08 19:50:13.587139 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:13.587114 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-d784c457d-bzx9c" Jun 08 19:50:13.656443 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:13.656415 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-6gv74"] Jun 08 19:50:13.657130 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:50:13.657005 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd26756f7_2f03_4beb_878f_66f98f611bec.slice/crio-c3052cc9568ad61091a1c55cfa8d367201e2c73c1417b984d974a803bf6b5261 WatchSource:0}: Error finding container c3052cc9568ad61091a1c55cfa8d367201e2c73c1417b984d974a803bf6b5261: Status 404 returned error can't find the container with id c3052cc9568ad61091a1c55cfa8d367201e2c73c1417b984d974a803bf6b5261 Jun 08 19:50:13.659059 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:13.659041 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 19:50:13.721257 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:13.721232 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-d784c457d-bzx9c"] Jun 08 19:50:13.722889 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:50:13.722856 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e9237f7_3935_4d45_8edf_a376439b02e8.slice/crio-3c3a10224dafc0d83925d764f3bbce2c8cdf8a93334a307814beeab8079a07a2 WatchSource:0}: Error finding container 3c3a10224dafc0d83925d764f3bbce2c8cdf8a93334a307814beeab8079a07a2: Status 404 returned error can't find the container with id 3c3a10224dafc0d83925d764f3bbce2c8cdf8a93334a307814beeab8079a07a2 Jun 08 19:50:14.318966 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:14.318883 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-d784c457d-bzx9c" event={"ID":"0e9237f7-3935-4d45-8edf-a376439b02e8","Type":"ContainerStarted","Data":"3c3a10224dafc0d83925d764f3bbce2c8cdf8a93334a307814beeab8079a07a2"} Jun 08 19:50:14.320634 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:14.320568 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-6gv74" event={"ID":"d26756f7-2f03-4beb-878f-66f98f611bec","Type":"ContainerStarted","Data":"c3052cc9568ad61091a1c55cfa8d367201e2c73c1417b984d974a803bf6b5261"} Jun 08 19:50:16.332102 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:16.332067 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-d784c457d-bzx9c" event={"ID":"0e9237f7-3935-4d45-8edf-a376439b02e8","Type":"ContainerStarted","Data":"f60c0e61f8fd7d136e132c2a4a3481a95f26e2e9c796fe56ec00c6a4e168253d"} Jun 08 19:50:16.332564 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:16.332195 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-d784c457d-bzx9c" Jun 08 19:50:16.333653 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:16.333629 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-6gv74" event={"ID":"d26756f7-2f03-4beb-878f-66f98f611bec","Type":"ContainerStarted","Data":"26cb78656b5c3381168ca8cc309b84a049727339740e7cf090abc0cdc72fe8fa"} Jun 08 19:50:16.333785 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:16.333674 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-6gv74" Jun 08 19:50:16.349734 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:16.349674 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-d784c457d-bzx9c" podStartSLOduration=2.656703202 podStartE2EDuration="4.349656665s" totalImagesPullingTime="1.692953463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:50:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:50:16.349289922 +0000 UTC m=+1432.484746374" watchObservedRunningTime="2026-06-08 19:50:16.349656665 +0000 UTC m=+1432.485113106" Jun 08 19:50:16.363926 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:16.363886 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-6gv74" podStartSLOduration=1.608390089 podStartE2EDuration="3.363871115s" totalImagesPullingTime="1.755481026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:50:16.363434777 +0000 UTC m=+1432.498891218" watchObservedRunningTime="2026-06-08 19:50:16.363871115 +0000 UTC m=+1432.499327590" Jun 08 19:50:22.343901 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:22.343875 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-d784c457d-bzx9c" Jun 08 19:50:24.182815 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:24.182784 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 19:50:24.183191 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:24.182968 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="0b749bc2-b798-42d6-9ad4-17ca60da1682" containerName="keycloak" containerID="cri-o://8eb95ef0b694cc3d43873a7540c580acfdba79a2b162c51fd2fb28d92dbb02d3" gracePeriod=30 Jun 08 19:50:26.216753 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.216708 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 19:50:26.288463 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.288437 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5s5j\" (UniqueName: \"kubernetes.io/projected/0b749bc2-b798-42d6-9ad4-17ca60da1682-kube-api-access-l5s5j\") pod \"0b749bc2-b798-42d6-9ad4-17ca60da1682\" (UID: \"0b749bc2-b798-42d6-9ad4-17ca60da1682\") " Jun 08 19:50:26.290424 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.290394 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b749bc2-b798-42d6-9ad4-17ca60da1682-kube-api-access-l5s5j" (OuterVolumeSpecName: "kube-api-access-l5s5j") pod "0b749bc2-b798-42d6-9ad4-17ca60da1682" (UID: "0b749bc2-b798-42d6-9ad4-17ca60da1682"). InnerVolumeSpecName "kube-api-access-l5s5j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:50:26.383421 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.383344 2573 generic.go:356] "Generic (PLEG): container finished" podID="0b749bc2-b798-42d6-9ad4-17ca60da1682" containerID="8eb95ef0b694cc3d43873a7540c580acfdba79a2b162c51fd2fb28d92dbb02d3" exitCode=143 Jun 08 19:50:26.383421 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.383389 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 19:50:26.383578 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.383429 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0b749bc2-b798-42d6-9ad4-17ca60da1682","Type":"ContainerDied","Data":"8eb95ef0b694cc3d43873a7540c580acfdba79a2b162c51fd2fb28d92dbb02d3"} Jun 08 19:50:26.383578 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.383479 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0b749bc2-b798-42d6-9ad4-17ca60da1682","Type":"ContainerDied","Data":"65e36f56dc7ba094fafcc52323e570cbbc70aa558a82811b50296358762d1fcb"} Jun 08 19:50:26.383578 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.383498 2573 scope.go:117] "RemoveContainer" containerID="8eb95ef0b694cc3d43873a7540c580acfdba79a2b162c51fd2fb28d92dbb02d3" Jun 08 19:50:26.389883 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.389860 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5s5j\" (UniqueName: \"kubernetes.io/projected/0b749bc2-b798-42d6-9ad4-17ca60da1682-kube-api-access-l5s5j\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:50:26.392513 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.392499 2573 scope.go:117] "RemoveContainer" containerID="8eb95ef0b694cc3d43873a7540c580acfdba79a2b162c51fd2fb28d92dbb02d3" Jun 08 19:50:26.392780 ip-10-0-141-14 kubenswrapper[2573]: E0608 19:50:26.392759 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eb95ef0b694cc3d43873a7540c580acfdba79a2b162c51fd2fb28d92dbb02d3\": container with ID starting with 8eb95ef0b694cc3d43873a7540c580acfdba79a2b162c51fd2fb28d92dbb02d3 not found: ID does not exist" containerID="8eb95ef0b694cc3d43873a7540c580acfdba79a2b162c51fd2fb28d92dbb02d3" Jun 08 19:50:26.392847 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.392791 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eb95ef0b694cc3d43873a7540c580acfdba79a2b162c51fd2fb28d92dbb02d3"} err="failed to get container status \"8eb95ef0b694cc3d43873a7540c580acfdba79a2b162c51fd2fb28d92dbb02d3\": rpc error: code = NotFound desc = could not find container \"8eb95ef0b694cc3d43873a7540c580acfdba79a2b162c51fd2fb28d92dbb02d3\": container with ID starting with 8eb95ef0b694cc3d43873a7540c580acfdba79a2b162c51fd2fb28d92dbb02d3 not found: ID does not exist" Jun 08 19:50:26.400471 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.400453 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 19:50:26.404111 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.404090 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 19:50:26.424232 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.424209 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 19:50:26.424585 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.424573 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b749bc2-b798-42d6-9ad4-17ca60da1682" containerName="keycloak" Jun 08 19:50:26.424637 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.424586 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b749bc2-b798-42d6-9ad4-17ca60da1682" containerName="keycloak" Jun 08 19:50:26.424679 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.424670 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b749bc2-b798-42d6-9ad4-17ca60da1682" containerName="keycloak" Jun 08 19:50:26.429201 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.429186 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 19:50:26.431699 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.431671 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 19:50:26.431811 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.431772 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 19:50:26.431891 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.431806 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 08 19:50:26.431943 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.431901 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 19:50:26.432138 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.432123 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-66df7\"" Jun 08 19:50:26.437848 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.437830 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 19:50:26.491114 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.491092 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b67826d5-3912-47cd-b5e2-fbaa20ee2f4f-test-realms\") pod \"maas-keycloak-0\" (UID: \"b67826d5-3912-47cd-b5e2-fbaa20ee2f4f\") " pod="keycloak-system/maas-keycloak-0" Jun 08 19:50:26.491188 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.491135 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvn5h\" (UniqueName: \"kubernetes.io/projected/b67826d5-3912-47cd-b5e2-fbaa20ee2f4f-kube-api-access-zvn5h\") pod \"maas-keycloak-0\" (UID: \"b67826d5-3912-47cd-b5e2-fbaa20ee2f4f\") " pod="keycloak-system/maas-keycloak-0" Jun 08 19:50:26.591638 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.591618 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b67826d5-3912-47cd-b5e2-fbaa20ee2f4f-test-realms\") pod \"maas-keycloak-0\" (UID: \"b67826d5-3912-47cd-b5e2-fbaa20ee2f4f\") " pod="keycloak-system/maas-keycloak-0" Jun 08 19:50:26.591753 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.591662 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvn5h\" (UniqueName: \"kubernetes.io/projected/b67826d5-3912-47cd-b5e2-fbaa20ee2f4f-kube-api-access-zvn5h\") pod \"maas-keycloak-0\" (UID: \"b67826d5-3912-47cd-b5e2-fbaa20ee2f4f\") " pod="keycloak-system/maas-keycloak-0" Jun 08 19:50:26.592245 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.592230 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b67826d5-3912-47cd-b5e2-fbaa20ee2f4f-test-realms\") pod \"maas-keycloak-0\" (UID: \"b67826d5-3912-47cd-b5e2-fbaa20ee2f4f\") " pod="keycloak-system/maas-keycloak-0" Jun 08 19:50:26.600016 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.599994 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvn5h\" (UniqueName: \"kubernetes.io/projected/b67826d5-3912-47cd-b5e2-fbaa20ee2f4f-kube-api-access-zvn5h\") pod \"maas-keycloak-0\" (UID: \"b67826d5-3912-47cd-b5e2-fbaa20ee2f4f\") " pod="keycloak-system/maas-keycloak-0" Jun 08 19:50:26.739711 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.739648 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 19:50:26.863578 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:26.863552 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 19:50:26.864875 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:50:26.864852 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb67826d5_3912_47cd_b5e2_fbaa20ee2f4f.slice/crio-eab3d74968e479019ef5e22e10fe25f935924f573ed1b76fd5a9027b05b8408b WatchSource:0}: Error finding container eab3d74968e479019ef5e22e10fe25f935924f573ed1b76fd5a9027b05b8408b: Status 404 returned error can't find the container with id eab3d74968e479019ef5e22e10fe25f935924f573ed1b76fd5a9027b05b8408b Jun 08 19:50:27.340447 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:27.340419 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-6gv74" Jun 08 19:50:27.381758 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:27.381705 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:50:27.390946 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:27.390917 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b67826d5-3912-47cd-b5e2-fbaa20ee2f4f","Type":"ContainerStarted","Data":"fd9218cc9434f3fd0f720711a4024097feb499af56a37067094280ca53479221"} Jun 08 19:50:27.391082 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:27.390962 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b67826d5-3912-47cd-b5e2-fbaa20ee2f4f","Type":"ContainerStarted","Data":"eab3d74968e479019ef5e22e10fe25f935924f573ed1b76fd5a9027b05b8408b"} Jun 08 19:50:27.410199 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:27.410152 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.052910822 podStartE2EDuration="1.410129473s" totalImagesPullingTime="357.218651ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:50:27.407604385 +0000 UTC m=+1443.543060825" watchObservedRunningTime="2026-06-08 19:50:27.410129473 +0000 UTC m=+1443.545585912" Jun 08 19:50:27.740135 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:27.740098 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 08 19:50:27.741860 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:27.741824 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b67826d5-3912-47cd-b5e2-fbaa20ee2f4f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 08 19:50:28.308485 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:28.308450 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b749bc2-b798-42d6-9ad4-17ca60da1682" path="/var/lib/kubelet/pods/0b749bc2-b798-42d6-9ad4-17ca60da1682/volumes" Jun 08 19:50:28.598371 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:28.598274 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:50:28.740746 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:28.740665 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b67826d5-3912-47cd-b5e2-fbaa20ee2f4f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 08 19:50:29.740581 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:29.740535 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b67826d5-3912-47cd-b5e2-fbaa20ee2f4f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 08 19:50:30.740334 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:30.740272 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b67826d5-3912-47cd-b5e2-fbaa20ee2f4f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 08 19:50:31.740544 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:31.740503 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b67826d5-3912-47cd-b5e2-fbaa20ee2f4f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 08 19:50:32.740794 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:32.740348 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b67826d5-3912-47cd-b5e2-fbaa20ee2f4f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 08 19:50:33.741643 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:33.741580 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b67826d5-3912-47cd-b5e2-fbaa20ee2f4f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 08 19:50:34.740959 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:34.740909 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b67826d5-3912-47cd-b5e2-fbaa20ee2f4f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 08 19:50:35.740991 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:35.740944 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b67826d5-3912-47cd-b5e2-fbaa20ee2f4f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 08 19:50:36.740534 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:36.740498 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 08 19:50:36.740803 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:36.740771 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b67826d5-3912-47cd-b5e2-fbaa20ee2f4f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 08 19:50:37.740894 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:37.740845 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b67826d5-3912-47cd-b5e2-fbaa20ee2f4f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 08 19:50:38.740647 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:38.740607 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b67826d5-3912-47cd-b5e2-fbaa20ee2f4f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 08 19:50:39.740068 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:39.740014 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b67826d5-3912-47cd-b5e2-fbaa20ee2f4f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 08 19:50:40.860182 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:40.860147 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 08 19:50:40.876973 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:40.876936 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="b67826d5-3912-47cd-b5e2-fbaa20ee2f4f" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 19:50:50.866503 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:50:50.866471 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 08 19:51:03.255705 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:03.255670 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:51:04.497215 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:04.497183 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:51:17.291515 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.291485 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p"] Jun 08 19:51:17.294243 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.294221 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" Jun 08 19:51:17.298384 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.298310 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 08 19:51:17.298384 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.298371 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 08 19:51:17.299116 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.299090 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 08 19:51:17.299246 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.299095 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8pmmg\"" Jun 08 19:51:17.321810 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.321784 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p"] Jun 08 19:51:17.323841 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.323807 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:51:17.375408 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.375378 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99121da5-0f62-4d5c-873e-258375e55ac3-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p\" (UID: \"99121da5-0f62-4d5c-873e-258375e55ac3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" Jun 08 19:51:17.375545 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.375426 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vv7n\" (UniqueName: \"kubernetes.io/projected/99121da5-0f62-4d5c-873e-258375e55ac3-kube-api-access-7vv7n\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p\" (UID: \"99121da5-0f62-4d5c-873e-258375e55ac3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" Jun 08 19:51:17.375545 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.375508 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/99121da5-0f62-4d5c-873e-258375e55ac3-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p\" (UID: \"99121da5-0f62-4d5c-873e-258375e55ac3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" Jun 08 19:51:17.375545 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.375529 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99121da5-0f62-4d5c-873e-258375e55ac3-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p\" (UID: \"99121da5-0f62-4d5c-873e-258375e55ac3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" Jun 08 19:51:17.375674 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.375568 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99121da5-0f62-4d5c-873e-258375e55ac3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p\" (UID: \"99121da5-0f62-4d5c-873e-258375e55ac3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" Jun 08 19:51:17.375674 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.375617 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99121da5-0f62-4d5c-873e-258375e55ac3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p\" (UID: \"99121da5-0f62-4d5c-873e-258375e55ac3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" Jun 08 19:51:17.476825 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.476787 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vv7n\" (UniqueName: \"kubernetes.io/projected/99121da5-0f62-4d5c-873e-258375e55ac3-kube-api-access-7vv7n\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p\" (UID: \"99121da5-0f62-4d5c-873e-258375e55ac3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" Jun 08 19:51:17.477000 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.476861 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/99121da5-0f62-4d5c-873e-258375e55ac3-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p\" (UID: \"99121da5-0f62-4d5c-873e-258375e55ac3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" Jun 08 19:51:17.477000 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.476885 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99121da5-0f62-4d5c-873e-258375e55ac3-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p\" (UID: \"99121da5-0f62-4d5c-873e-258375e55ac3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" Jun 08 19:51:17.477000 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.476926 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99121da5-0f62-4d5c-873e-258375e55ac3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p\" (UID: \"99121da5-0f62-4d5c-873e-258375e55ac3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" Jun 08 19:51:17.477000 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.476962 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99121da5-0f62-4d5c-873e-258375e55ac3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p\" (UID: \"99121da5-0f62-4d5c-873e-258375e55ac3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" Jun 08 19:51:17.477000 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.476995 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99121da5-0f62-4d5c-873e-258375e55ac3-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p\" (UID: \"99121da5-0f62-4d5c-873e-258375e55ac3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" Jun 08 19:51:17.477361 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.477325 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/99121da5-0f62-4d5c-873e-258375e55ac3-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p\" (UID: \"99121da5-0f62-4d5c-873e-258375e55ac3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" Jun 08 19:51:17.477491 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.477385 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99121da5-0f62-4d5c-873e-258375e55ac3-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p\" (UID: \"99121da5-0f62-4d5c-873e-258375e55ac3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" Jun 08 19:51:17.477491 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.477425 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99121da5-0f62-4d5c-873e-258375e55ac3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p\" (UID: \"99121da5-0f62-4d5c-873e-258375e55ac3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" Jun 08 19:51:17.479262 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.479231 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99121da5-0f62-4d5c-873e-258375e55ac3-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p\" (UID: \"99121da5-0f62-4d5c-873e-258375e55ac3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" Jun 08 19:51:17.479530 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.479513 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99121da5-0f62-4d5c-873e-258375e55ac3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p\" (UID: \"99121da5-0f62-4d5c-873e-258375e55ac3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" Jun 08 19:51:17.486153 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.486133 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vv7n\" (UniqueName: \"kubernetes.io/projected/99121da5-0f62-4d5c-873e-258375e55ac3-kube-api-access-7vv7n\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p\" (UID: \"99121da5-0f62-4d5c-873e-258375e55ac3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" Jun 08 19:51:17.609886 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.609855 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" Jun 08 19:51:17.742619 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:17.742594 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p"] Jun 08 19:51:17.744733 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:51:17.744694 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99121da5_0f62_4d5c_873e_258375e55ac3.slice/crio-b8e277c12c016c1c376948c6a29e67aef506be83291a207fa52359d566b64c0d WatchSource:0}: Error finding container b8e277c12c016c1c376948c6a29e67aef506be83291a207fa52359d566b64c0d: Status 404 returned error can't find the container with id b8e277c12c016c1c376948c6a29e67aef506be83291a207fa52359d566b64c0d Jun 08 19:51:18.678366 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:18.678328 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" event={"ID":"99121da5-0f62-4d5c-873e-258375e55ac3","Type":"ContainerStarted","Data":"b8e277c12c016c1c376948c6a29e67aef506be83291a207fa52359d566b64c0d"} Jun 08 19:51:21.695142 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:21.695109 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" event={"ID":"99121da5-0f62-4d5c-873e-258375e55ac3","Type":"ContainerStarted","Data":"a1850b5bdb01ad8aadc52d37fa279446031fecec3aae161532e5ad812cdbab4a"} Jun 08 19:51:22.701554 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:22.701523 2573 generic.go:356] "Generic (PLEG): container finished" podID="99121da5-0f62-4d5c-873e-258375e55ac3" containerID="a1850b5bdb01ad8aadc52d37fa279446031fecec3aae161532e5ad812cdbab4a" exitCode=0 Jun 08 19:51:22.701925 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:22.701605 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" event={"ID":"99121da5-0f62-4d5c-873e-258375e55ac3","Type":"ContainerDied","Data":"a1850b5bdb01ad8aadc52d37fa279446031fecec3aae161532e5ad812cdbab4a"} Jun 08 19:51:24.714659 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:24.714571 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" event={"ID":"99121da5-0f62-4d5c-873e-258375e55ac3","Type":"ContainerStarted","Data":"9cedb421b434e78b86833a9bb4a23c2cd66585421561f02a4014c256a13752d0"} Jun 08 19:51:24.733213 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:24.733168 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" podStartSLOduration=1.899078993 podStartE2EDuration="7.733152147s" totalImagesPullingTime="4.59955862s" totalInitContainerRuntime="1.234514534s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:51:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:51:24.732267737 +0000 UTC m=+1500.867724175" watchObservedRunningTime="2026-06-08 19:51:24.733152147 +0000 UTC m=+1500.868608587" Jun 08 19:51:27.610343 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:27.610311 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" Jun 08 19:51:27.610741 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:27.610379 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" Jun 08 19:51:27.622628 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:27.622608 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" Jun 08 19:51:27.740398 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:27.740368 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p" Jun 08 19:51:37.272105 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:37.272027 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c"] Jun 08 19:51:37.285926 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:37.285904 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" Jun 08 19:51:37.288335 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:37.288310 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c"] Jun 08 19:51:37.288753 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:37.288734 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 08 19:51:37.396950 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:37.396923 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:51:37.466369 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:37.466337 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klfbs\" (UniqueName: \"kubernetes.io/projected/95840335-9273-4f4b-9832-4bead641cd85-kube-api-access-klfbs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9pb4c\" (UID: \"95840335-9273-4f4b-9832-4bead641cd85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" Jun 08 19:51:37.466555 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:37.466377 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95840335-9273-4f4b-9832-4bead641cd85-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9pb4c\" (UID: \"95840335-9273-4f4b-9832-4bead641cd85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" Jun 08 19:51:37.466555 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:37.466481 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95840335-9273-4f4b-9832-4bead641cd85-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9pb4c\" (UID: \"95840335-9273-4f4b-9832-4bead641cd85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" Jun 08 19:51:37.466684 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:37.466615 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/95840335-9273-4f4b-9832-4bead641cd85-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9pb4c\" (UID: \"95840335-9273-4f4b-9832-4bead641cd85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" Jun 08 19:51:37.466783 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:37.466747 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95840335-9273-4f4b-9832-4bead641cd85-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9pb4c\" (UID: \"95840335-9273-4f4b-9832-4bead641cd85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" Jun 08 19:51:37.467031 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:37.466896 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95840335-9273-4f4b-9832-4bead641cd85-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9pb4c\" (UID: \"95840335-9273-4f4b-9832-4bead641cd85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" Jun 08 19:51:37.568280 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:37.568255 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/95840335-9273-4f4b-9832-4bead641cd85-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9pb4c\" (UID: \"95840335-9273-4f4b-9832-4bead641cd85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" Jun 08 19:51:37.568437 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:37.568312 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95840335-9273-4f4b-9832-4bead641cd85-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9pb4c\" (UID: \"95840335-9273-4f4b-9832-4bead641cd85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" Jun 08 19:51:37.568437 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:37.568373 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95840335-9273-4f4b-9832-4bead641cd85-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9pb4c\" (UID: \"95840335-9273-4f4b-9832-4bead641cd85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" Jun 08 19:51:37.568437 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:37.568429 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klfbs\" (UniqueName: \"kubernetes.io/projected/95840335-9273-4f4b-9832-4bead641cd85-kube-api-access-klfbs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9pb4c\" (UID: \"95840335-9273-4f4b-9832-4bead641cd85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" Jun 08 19:51:37.568630 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:37.568607 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/95840335-9273-4f4b-9832-4bead641cd85-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9pb4c\" (UID: \"95840335-9273-4f4b-9832-4bead641cd85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" Jun 08 19:51:37.568672 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:37.568634 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95840335-9273-4f4b-9832-4bead641cd85-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9pb4c\" (UID: \"95840335-9273-4f4b-9832-4bead641cd85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" Jun 08 19:51:37.568740 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:37.568690 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95840335-9273-4f4b-9832-4bead641cd85-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9pb4c\" (UID: \"95840335-9273-4f4b-9832-4bead641cd85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" Jun 08 19:51:37.568828 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:37.568785 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95840335-9273-4f4b-9832-4bead641cd85-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9pb4c\" (UID: \"95840335-9273-4f4b-9832-4bead641cd85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" Jun 08 19:51:37.569001 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:37.568980 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95840335-9273-4f4b-9832-4bead641cd85-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9pb4c\" (UID: \"95840335-9273-4f4b-9832-4bead641cd85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" Jun 08 19:51:37.570628 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:37.570611 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95840335-9273-4f4b-9832-4bead641cd85-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9pb4c\" (UID: \"95840335-9273-4f4b-9832-4bead641cd85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" Jun 08 19:51:37.570681 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:37.570646 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95840335-9273-4f4b-9832-4bead641cd85-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9pb4c\" (UID: \"95840335-9273-4f4b-9832-4bead641cd85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" Jun 08 19:51:37.577334 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:37.577306 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klfbs\" (UniqueName: \"kubernetes.io/projected/95840335-9273-4f4b-9832-4bead641cd85-kube-api-access-klfbs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9pb4c\" (UID: \"95840335-9273-4f4b-9832-4bead641cd85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" Jun 08 19:51:37.598475 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:37.598270 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" Jun 08 19:51:37.731739 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:37.731701 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c"] Jun 08 19:51:37.733965 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:51:37.733922 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95840335_9273_4f4b_9832_4bead641cd85.slice/crio-6f7c26c97772a08ab805dda531ad6a8211a4aa2498c63551bece248940f3c1a6 WatchSource:0}: Error finding container 6f7c26c97772a08ab805dda531ad6a8211a4aa2498c63551bece248940f3c1a6: Status 404 returned error can't find the container with id 6f7c26c97772a08ab805dda531ad6a8211a4aa2498c63551bece248940f3c1a6 Jun 08 19:51:37.779834 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:37.779810 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" event={"ID":"95840335-9273-4f4b-9832-4bead641cd85","Type":"ContainerStarted","Data":"6f7c26c97772a08ab805dda531ad6a8211a4aa2498c63551bece248940f3c1a6"} Jun 08 19:51:38.786405 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:38.786373 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" event={"ID":"95840335-9273-4f4b-9832-4bead641cd85","Type":"ContainerStarted","Data":"fe9d314fef307e88d548bf7c45cef9a771e5284d6801c56f0e8879c0fe78a114"} Jun 08 19:51:39.792113 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:39.792078 2573 generic.go:356] "Generic (PLEG): container finished" podID="95840335-9273-4f4b-9832-4bead641cd85" containerID="fe9d314fef307e88d548bf7c45cef9a771e5284d6801c56f0e8879c0fe78a114" exitCode=0 Jun 08 19:51:39.792572 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:39.792126 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" event={"ID":"95840335-9273-4f4b-9832-4bead641cd85","Type":"ContainerDied","Data":"fe9d314fef307e88d548bf7c45cef9a771e5284d6801c56f0e8879c0fe78a114"} Jun 08 19:51:40.798568 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:40.798528 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" event={"ID":"95840335-9273-4f4b-9832-4bead641cd85","Type":"ContainerStarted","Data":"8e1fe22cb24f3aa5072f6d0c674d3dd2c7d27be83116c5625a53ea2ae681a8e5"} Jun 08 19:51:40.821226 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:40.821179 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" podStartSLOduration=2.358527491 podStartE2EDuration="3.821165474s" totalImagesPullingTime="203.336848ms" totalInitContainerRuntime="1.259301135s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:51:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:51:40.818379579 +0000 UTC m=+1516.953836018" watchObservedRunningTime="2026-06-08 19:51:40.821165474 +0000 UTC m=+1516.956621913" Jun 08 19:51:43.996067 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:43.996036 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs"] Jun 08 19:51:44.000550 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:44.000534 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" Jun 08 19:51:44.003243 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:44.003222 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 08 19:51:44.007575 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:44.007430 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs"] Jun 08 19:51:44.021297 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:44.021281 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:51:44.030975 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:44.030953 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83a453db-9986-435e-8762-cb9ccce2b250-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs\" (UID: \"83a453db-9986-435e-8762-cb9ccce2b250\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" Jun 08 19:51:44.031058 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:44.031020 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83a453db-9986-435e-8762-cb9ccce2b250-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs\" (UID: \"83a453db-9986-435e-8762-cb9ccce2b250\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" Jun 08 19:51:44.031058 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:44.031053 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/83a453db-9986-435e-8762-cb9ccce2b250-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs\" (UID: \"83a453db-9986-435e-8762-cb9ccce2b250\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" Jun 08 19:51:44.031166 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:44.031089 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83a453db-9986-435e-8762-cb9ccce2b250-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs\" (UID: \"83a453db-9986-435e-8762-cb9ccce2b250\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" Jun 08 19:51:44.031166 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:44.031150 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83a453db-9986-435e-8762-cb9ccce2b250-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs\" (UID: \"83a453db-9986-435e-8762-cb9ccce2b250\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" Jun 08 19:51:44.031262 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:44.031192 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k745\" (UniqueName: \"kubernetes.io/projected/83a453db-9986-435e-8762-cb9ccce2b250-kube-api-access-5k745\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs\" (UID: \"83a453db-9986-435e-8762-cb9ccce2b250\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" Jun 08 19:51:44.131890 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:44.131866 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83a453db-9986-435e-8762-cb9ccce2b250-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs\" (UID: \"83a453db-9986-435e-8762-cb9ccce2b250\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" Jun 08 19:51:44.131994 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:44.131936 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83a453db-9986-435e-8762-cb9ccce2b250-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs\" (UID: \"83a453db-9986-435e-8762-cb9ccce2b250\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" Jun 08 19:51:44.131994 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:44.131967 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/83a453db-9986-435e-8762-cb9ccce2b250-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs\" (UID: \"83a453db-9986-435e-8762-cb9ccce2b250\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" Jun 08 19:51:44.132066 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:44.132036 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83a453db-9986-435e-8762-cb9ccce2b250-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs\" (UID: \"83a453db-9986-435e-8762-cb9ccce2b250\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" Jun 08 19:51:44.132110 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:44.132073 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83a453db-9986-435e-8762-cb9ccce2b250-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs\" (UID: \"83a453db-9986-435e-8762-cb9ccce2b250\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" Jun 08 19:51:44.132110 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:44.132094 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k745\" (UniqueName: \"kubernetes.io/projected/83a453db-9986-435e-8762-cb9ccce2b250-kube-api-access-5k745\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs\" (UID: \"83a453db-9986-435e-8762-cb9ccce2b250\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" Jun 08 19:51:44.132325 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:44.132305 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83a453db-9986-435e-8762-cb9ccce2b250-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs\" (UID: \"83a453db-9986-435e-8762-cb9ccce2b250\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" Jun 08 19:51:44.132393 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:44.132321 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/83a453db-9986-435e-8762-cb9ccce2b250-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs\" (UID: \"83a453db-9986-435e-8762-cb9ccce2b250\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" Jun 08 19:51:44.132445 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:44.132416 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83a453db-9986-435e-8762-cb9ccce2b250-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs\" (UID: \"83a453db-9986-435e-8762-cb9ccce2b250\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" Jun 08 19:51:44.134198 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:44.134179 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83a453db-9986-435e-8762-cb9ccce2b250-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs\" (UID: \"83a453db-9986-435e-8762-cb9ccce2b250\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" Jun 08 19:51:44.134533 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:44.134515 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83a453db-9986-435e-8762-cb9ccce2b250-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs\" (UID: \"83a453db-9986-435e-8762-cb9ccce2b250\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" Jun 08 19:51:44.140878 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:44.140862 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k745\" (UniqueName: \"kubernetes.io/projected/83a453db-9986-435e-8762-cb9ccce2b250-kube-api-access-5k745\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs\" (UID: \"83a453db-9986-435e-8762-cb9ccce2b250\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" Jun 08 19:51:44.311638 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:44.311602 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" Jun 08 19:51:44.443233 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:44.443209 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs"] Jun 08 19:51:44.445785 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:51:44.445759 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83a453db_9986_435e_8762_cb9ccce2b250.slice/crio-9c9ce6354375574c90054f5dc3cfe9c1c1785931ab5eb6e8fa46a26bbedfffe6 WatchSource:0}: Error finding container 9c9ce6354375574c90054f5dc3cfe9c1c1785931ab5eb6e8fa46a26bbedfffe6: Status 404 returned error can't find the container with id 9c9ce6354375574c90054f5dc3cfe9c1c1785931ab5eb6e8fa46a26bbedfffe6 Jun 08 19:51:44.819039 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:44.818998 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" event={"ID":"83a453db-9986-435e-8762-cb9ccce2b250","Type":"ContainerStarted","Data":"43ff978797962480d9fe5c0c03d21a397776e9a77e75e6635879a6a5e24ce26f"} Jun 08 19:51:44.819199 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:44.819059 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" event={"ID":"83a453db-9986-435e-8762-cb9ccce2b250","Type":"ContainerStarted","Data":"9c9ce6354375574c90054f5dc3cfe9c1c1785931ab5eb6e8fa46a26bbedfffe6"} Jun 08 19:51:45.825676 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:45.825646 2573 generic.go:356] "Generic (PLEG): container finished" podID="83a453db-9986-435e-8762-cb9ccce2b250" containerID="43ff978797962480d9fe5c0c03d21a397776e9a77e75e6635879a6a5e24ce26f" exitCode=0 Jun 08 19:51:45.826005 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:45.825743 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" event={"ID":"83a453db-9986-435e-8762-cb9ccce2b250","Type":"ContainerDied","Data":"43ff978797962480d9fe5c0c03d21a397776e9a77e75e6635879a6a5e24ce26f"} Jun 08 19:51:46.832790 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:46.832754 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" event={"ID":"83a453db-9986-435e-8762-cb9ccce2b250","Type":"ContainerStarted","Data":"03d4b1213e71ad7c34ff6901202589d1a751cebf3480d11a62ad8de2d9efb1f0"} Jun 08 19:51:46.851242 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:46.851193 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" podStartSLOduration=2.413992489 podStartE2EDuration="3.851178151s" totalImagesPullingTime="214.715661ms" totalInitContainerRuntime="1.222470001s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:51:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:51:46.85040904 +0000 UTC m=+1522.985865481" watchObservedRunningTime="2026-06-08 19:51:46.851178151 +0000 UTC m=+1522.986634591" Jun 08 19:51:47.601288 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:47.601257 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" Jun 08 19:51:47.601479 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:47.601332 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" Jun 08 19:51:47.613981 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:47.613961 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" Jun 08 19:51:47.849229 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:47.849199 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9pb4c" Jun 08 19:51:48.127883 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:48.127848 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:51:53.330991 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:53.330961 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:51:54.311900 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:54.311870 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" Jun 08 19:51:54.312046 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:54.311932 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" Jun 08 19:51:54.323832 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:54.323812 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" Jun 08 19:51:54.885190 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:51:54.885165 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs" Jun 08 19:52:01.254968 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:01.254929 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt"] Jun 08 19:52:01.260173 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:01.260154 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" Jun 08 19:52:01.265138 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:01.265119 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 08 19:52:01.286252 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:01.286222 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt"] Jun 08 19:52:01.394533 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:01.394489 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:52:01.406791 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:01.406732 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b63997d5-8d5f-4895-872a-91b671daaa90-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9v8mt\" (UID: \"b63997d5-8d5f-4895-872a-91b671daaa90\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" Jun 08 19:52:01.406949 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:01.406819 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b63997d5-8d5f-4895-872a-91b671daaa90-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9v8mt\" (UID: \"b63997d5-8d5f-4895-872a-91b671daaa90\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" Jun 08 19:52:01.406949 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:01.406867 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b63997d5-8d5f-4895-872a-91b671daaa90-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9v8mt\" (UID: \"b63997d5-8d5f-4895-872a-91b671daaa90\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" Jun 08 19:52:01.406949 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:01.406935 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxsgx\" (UniqueName: \"kubernetes.io/projected/b63997d5-8d5f-4895-872a-91b671daaa90-kube-api-access-jxsgx\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9v8mt\" (UID: \"b63997d5-8d5f-4895-872a-91b671daaa90\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" Jun 08 19:52:01.407103 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:01.406975 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b63997d5-8d5f-4895-872a-91b671daaa90-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9v8mt\" (UID: \"b63997d5-8d5f-4895-872a-91b671daaa90\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" Jun 08 19:52:01.407103 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:01.407000 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b63997d5-8d5f-4895-872a-91b671daaa90-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9v8mt\" (UID: \"b63997d5-8d5f-4895-872a-91b671daaa90\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" Jun 08 19:52:01.508394 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:01.508310 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b63997d5-8d5f-4895-872a-91b671daaa90-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9v8mt\" (UID: \"b63997d5-8d5f-4895-872a-91b671daaa90\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" Jun 08 19:52:01.508394 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:01.508359 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxsgx\" (UniqueName: \"kubernetes.io/projected/b63997d5-8d5f-4895-872a-91b671daaa90-kube-api-access-jxsgx\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9v8mt\" (UID: \"b63997d5-8d5f-4895-872a-91b671daaa90\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" Jun 08 19:52:01.508577 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:01.508482 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b63997d5-8d5f-4895-872a-91b671daaa90-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9v8mt\" (UID: \"b63997d5-8d5f-4895-872a-91b671daaa90\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" Jun 08 19:52:01.508577 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:01.508519 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b63997d5-8d5f-4895-872a-91b671daaa90-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9v8mt\" (UID: \"b63997d5-8d5f-4895-872a-91b671daaa90\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" Jun 08 19:52:01.508656 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:01.508610 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b63997d5-8d5f-4895-872a-91b671daaa90-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9v8mt\" (UID: \"b63997d5-8d5f-4895-872a-91b671daaa90\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" Jun 08 19:52:01.508699 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:01.508683 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b63997d5-8d5f-4895-872a-91b671daaa90-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9v8mt\" (UID: \"b63997d5-8d5f-4895-872a-91b671daaa90\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" Jun 08 19:52:01.508842 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:01.508820 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b63997d5-8d5f-4895-872a-91b671daaa90-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9v8mt\" (UID: \"b63997d5-8d5f-4895-872a-91b671daaa90\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" Jun 08 19:52:01.508936 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:01.508917 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b63997d5-8d5f-4895-872a-91b671daaa90-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9v8mt\" (UID: \"b63997d5-8d5f-4895-872a-91b671daaa90\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" Jun 08 19:52:01.509056 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:01.509034 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b63997d5-8d5f-4895-872a-91b671daaa90-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9v8mt\" (UID: \"b63997d5-8d5f-4895-872a-91b671daaa90\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" Jun 08 19:52:01.510546 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:01.510528 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b63997d5-8d5f-4895-872a-91b671daaa90-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9v8mt\" (UID: \"b63997d5-8d5f-4895-872a-91b671daaa90\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" Jun 08 19:52:01.511050 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:01.511029 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b63997d5-8d5f-4895-872a-91b671daaa90-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9v8mt\" (UID: \"b63997d5-8d5f-4895-872a-91b671daaa90\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" Jun 08 19:52:01.516853 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:01.516829 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxsgx\" (UniqueName: \"kubernetes.io/projected/b63997d5-8d5f-4895-872a-91b671daaa90-kube-api-access-jxsgx\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9v8mt\" (UID: \"b63997d5-8d5f-4895-872a-91b671daaa90\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" Jun 08 19:52:01.569327 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:01.569289 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" Jun 08 19:52:01.713218 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:01.713190 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt"] Jun 08 19:52:01.714520 ip-10-0-141-14 kubenswrapper[2573]: W0608 19:52:01.714495 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb63997d5_8d5f_4895_872a_91b671daaa90.slice/crio-cda7ad07d03918056312240c3915368977cdfe6690b10e4d2c928b6a324c87d2 WatchSource:0}: Error finding container cda7ad07d03918056312240c3915368977cdfe6690b10e4d2c928b6a324c87d2: Status 404 returned error can't find the container with id cda7ad07d03918056312240c3915368977cdfe6690b10e4d2c928b6a324c87d2 Jun 08 19:52:01.918098 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:01.918065 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" event={"ID":"b63997d5-8d5f-4895-872a-91b671daaa90","Type":"ContainerStarted","Data":"749a9f7894dc6310504d698af9f04dca596aa611c9d658d0d89639081533c5f6"} Jun 08 19:52:01.918098 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:01.918103 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" event={"ID":"b63997d5-8d5f-4895-872a-91b671daaa90","Type":"ContainerStarted","Data":"cda7ad07d03918056312240c3915368977cdfe6690b10e4d2c928b6a324c87d2"} Jun 08 19:52:03.930262 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:03.930231 2573 generic.go:356] "Generic (PLEG): container finished" podID="b63997d5-8d5f-4895-872a-91b671daaa90" containerID="749a9f7894dc6310504d698af9f04dca596aa611c9d658d0d89639081533c5f6" exitCode=0 Jun 08 19:52:03.930756 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:03.930314 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" event={"ID":"b63997d5-8d5f-4895-872a-91b671daaa90","Type":"ContainerDied","Data":"749a9f7894dc6310504d698af9f04dca596aa611c9d658d0d89639081533c5f6"} Jun 08 19:52:04.622657 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:04.622626 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:52:04.938078 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:04.937994 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" event={"ID":"b63997d5-8d5f-4895-872a-91b671daaa90","Type":"ContainerStarted","Data":"3d342bfed8d5f10d31ef53366cac9e6ba89c0f924f8cfb3fae84539e95c69021"} Jun 08 19:52:04.962229 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:04.962180 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" podStartSLOduration=2.558220619 podStartE2EDuration="3.962154815s" totalImagesPullingTime="211.066395ms" totalInitContainerRuntime="1.192867801s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:52:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:52:04.960845832 +0000 UTC m=+1541.096302269" watchObservedRunningTime="2026-06-08 19:52:04.962154815 +0000 UTC m=+1541.097611287" Jun 08 19:52:11.569571 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:11.569542 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" Jun 08 19:52:11.569984 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:11.569696 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" Jun 08 19:52:11.581814 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:11.581789 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" Jun 08 19:52:11.984707 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:11.984624 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9v8mt" Jun 08 19:52:35.606508 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:35.606479 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:52:35.675651 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:52:35.675624 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:53:03.752691 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:53:03.752621 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:53:03.984294 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:53:03.984264 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:53:25.457712 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:53:25.457677 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:53:25.740791 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:53:25.740688 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:53:26.826634 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:53:26.826600 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:53:27.064085 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:53:27.064056 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:53:36.405118 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:53:36.405088 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:54:56.570677 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:54:56.570640 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:54:56.672844 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:54:56.672809 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56b77869d6-4qzdf"] Jun 08 19:54:56.673087 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:54:56.673063 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-56b77869d6-4qzdf" podUID="ae49ce0f-2c6f-43e2-97ee-178a405baed6" containerName="manager" containerID="cri-o://5872d4fc93b8bc7700eb4459e2612266248e3e5a6d3e6189e6ed49e9e625ad8f" gracePeriod=30 Jun 08 19:54:56.824082 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:54:56.824017 2573 generic.go:356] "Generic (PLEG): container finished" podID="ae49ce0f-2c6f-43e2-97ee-178a405baed6" containerID="5872d4fc93b8bc7700eb4459e2612266248e3e5a6d3e6189e6ed49e9e625ad8f" exitCode=0 Jun 08 19:54:56.824195 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:54:56.824121 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56b77869d6-4qzdf" event={"ID":"ae49ce0f-2c6f-43e2-97ee-178a405baed6","Type":"ContainerDied","Data":"5872d4fc93b8bc7700eb4459e2612266248e3e5a6d3e6189e6ed49e9e625ad8f"} Jun 08 19:54:56.916816 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:54:56.916796 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56b77869d6-4qzdf" Jun 08 19:54:56.974084 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:54:56.974058 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gx69\" (UniqueName: \"kubernetes.io/projected/ae49ce0f-2c6f-43e2-97ee-178a405baed6-kube-api-access-6gx69\") pod \"ae49ce0f-2c6f-43e2-97ee-178a405baed6\" (UID: \"ae49ce0f-2c6f-43e2-97ee-178a405baed6\") " Jun 08 19:54:56.974261 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:54:56.974122 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae49ce0f-2c6f-43e2-97ee-178a405baed6-webhook-cert\") pod \"ae49ce0f-2c6f-43e2-97ee-178a405baed6\" (UID: \"ae49ce0f-2c6f-43e2-97ee-178a405baed6\") " Jun 08 19:54:56.975978 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:54:56.975951 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae49ce0f-2c6f-43e2-97ee-178a405baed6-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ae49ce0f-2c6f-43e2-97ee-178a405baed6" (UID: "ae49ce0f-2c6f-43e2-97ee-178a405baed6"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:54:56.976093 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:54:56.976044 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae49ce0f-2c6f-43e2-97ee-178a405baed6-kube-api-access-6gx69" (OuterVolumeSpecName: "kube-api-access-6gx69") pod "ae49ce0f-2c6f-43e2-97ee-178a405baed6" (UID: "ae49ce0f-2c6f-43e2-97ee-178a405baed6"). InnerVolumeSpecName "kube-api-access-6gx69". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:54:57.075086 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:54:57.075021 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gx69\" (UniqueName: \"kubernetes.io/projected/ae49ce0f-2c6f-43e2-97ee-178a405baed6-kube-api-access-6gx69\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:54:57.075086 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:54:57.075042 2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae49ce0f-2c6f-43e2-97ee-178a405baed6-webhook-cert\") on node \"ip-10-0-141-14.ec2.internal\" DevicePath \"\"" Jun 08 19:54:57.830628 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:54:57.830597 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56b77869d6-4qzdf" Jun 08 19:54:57.830628 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:54:57.830618 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56b77869d6-4qzdf" event={"ID":"ae49ce0f-2c6f-43e2-97ee-178a405baed6","Type":"ContainerDied","Data":"0748dda1b4f7f87d3d5370040e949c80c0ea2bd9ec2d13342e9ef1689910b4a0"} Jun 08 19:54:57.831139 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:54:57.830705 2573 scope.go:117] "RemoveContainer" containerID="5872d4fc93b8bc7700eb4459e2612266248e3e5a6d3e6189e6ed49e9e625ad8f" Jun 08 19:54:57.852708 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:54:57.852685 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56b77869d6-4qzdf"] Jun 08 19:54:57.858692 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:54:57.858671 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-56b77869d6-4qzdf"] Jun 08 19:54:58.305973 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:54:58.305930 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae49ce0f-2c6f-43e2-97ee-178a405baed6" path="/var/lib/kubelet/pods/ae49ce0f-2c6f-43e2-97ee-178a405baed6/volumes" Jun 08 19:54:58.521960 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:54:58.521924 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:55:40.801671 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:55:40.801639 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:55:40.898367 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:55:40.898330 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:55:49.344136 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:55:49.344106 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:55:55.475948 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:55:55.475915 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:55:55.542643 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:55:55.542612 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:56:27.673637 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:56:27.673607 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:56:28.955492 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:56:28.955456 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:56:51.669684 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:56:51.669653 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:56:57.513137 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:56:57.513100 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:56:57.624559 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:56:57.624531 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:56:57.717037 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:56:57.717004 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:56:57.897768 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:56:57.897736 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:56:57.998741 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:56:57.998691 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:57:00.849092 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:57:00.849055 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:57:14.526129 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:57:14.526096 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:57:14.628712 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:57:14.628680 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:57:14.744349 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:57:14.744305 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:57:20.688181 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:57:20.688147 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:57:20.787623 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:57:20.787599 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:57:28.858876 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:57:28.858832 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:57:28.950466 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:57:28.950435 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:57:29.052218 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:57:29.052191 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:57:29.152837 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:57:29.152714 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:57:45.649418 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:57:45.649377 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:57:45.770382 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:57:45.770347 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:57:45.949990 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:57:45.949910 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:57:51.529179 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:57:51.529146 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:57:51.629179 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:57:51.629141 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:58:12.051333 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:58:12.051301 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:58:12.146940 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:58:12.146912 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:58:12.257550 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:58:12.257526 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:58:14.037481 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:58:14.037450 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:58:14.138623 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:58:14.138582 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:58:18.189608 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:58:18.189573 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:58:18.294768 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:58:18.294709 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:58:18.389495 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:58:18.389465 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:58:18.531657 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:58:18.531565 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:58:25.979422 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:58:25.979394 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:58:26.161035 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:58:26.161006 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:58:27.735497 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:58:27.735460 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 19:58:27.834526 ip-10-0-141-14 kubenswrapper[2573]: I0608 19:58:27.834496 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 20:02:58.586266 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:02:58.586224 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-d784c457d-bzx9c_0e9237f7-3935-4d45-8edf-a376439b02e8/maas-api/0.log" Jun 08 20:02:59.355911 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:02:59.355885 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b795f8b7b-fg22s_a6e1477b-c7f3-4004-a217-6c42670e682a/copy-manifests/0.log" Jun 08 20:02:59.363626 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:02:59.363603 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b795f8b7b-fg22s_a6e1477b-c7f3-4004-a217-6c42670e682a/manager/0.log" Jun 08 20:03:01.786270 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:01.786240 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-tzwxm_f73162ec-701b-46cf-bfbb-4907c995e8a8/manager/0.log" Jun 08 20:03:02.724469 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:02.724398 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7888cd9689-l95vf_6cfe36fc-1503-4b85-b87c-cc21bb5ba48f/kube-auth-proxy/0.log" Jun 08 20:03:03.101363 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:03.101333 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-6gv74_d26756f7-2f03-4beb-878f-66f98f611bec/payload-pre-processing/0.log" Jun 08 20:03:03.340659 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:03.340631 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59744cfc99-6bbqq_bbfe4877-4383-4442-8b5f-e9f68186901c/router/0.log" Jun 08 20:03:03.812601 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:03.812575 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p_99121da5-0f62-4d5c-873e-258375e55ac3/storage-initializer/0.log" Jun 08 20:03:03.824979 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:03.824946 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-wcr9p_99121da5-0f62-4d5c-873e-258375e55ac3/main/0.log" Jun 08 20:03:03.943568 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:03.943538 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-9pb4c_95840335-9273-4f4b-9832-4bead641cd85/storage-initializer/0.log" Jun 08 20:03:03.954931 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:03.954904 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-9pb4c_95840335-9273-4f4b-9832-4bead641cd85/main/0.log" Jun 08 20:03:04.078715 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:04.078617 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs_83a453db-9986-435e-8762-cb9ccce2b250/storage-initializer/0.log" Jun 08 20:03:04.091439 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:04.091418 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-hr6fs_83a453db-9986-435e-8762-cb9ccce2b250/main/0.log" Jun 08 20:03:04.497369 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:04.497285 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-9v8mt_b63997d5-8d5f-4895-872a-91b671daaa90/storage-initializer/0.log" Jun 08 20:03:04.508424 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:04.508401 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-9v8mt_b63997d5-8d5f-4895-872a-91b671daaa90/main/0.log" Jun 08 20:03:08.946950 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:08.946914 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 20:03:10.381420 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:10.381387 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 20:03:12.843489 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:12.843450 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tdj7t_117928d5-6f02-4a5e-b96b-4a2cc6e507eb/global-pull-secret-syncer/0.log" Jun 08 20:03:13.031433 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:13.031408 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" Jun 08 20:03:13.289257 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:13.289188 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-14.ec2.internal_d234ad56bfcf5710e49217980ee8b515/haproxy/0.log" Jun 08 20:03:19.255014 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:19.254931 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-tzwxm_f73162ec-701b-46cf-bfbb-4907c995e8a8/manager/0.log" Jun 08 20:03:21.377589 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:21.377563 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7f104566-d149-4456-8520-8fa682d7eb9c/alertmanager/0.log" Jun 08 20:03:21.414341 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:21.414318 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7f104566-d149-4456-8520-8fa682d7eb9c/config-reloader/0.log" Jun 08 20:03:21.494076 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:21.494046 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7f104566-d149-4456-8520-8fa682d7eb9c/kube-rbac-proxy-web/0.log" Jun 08 20:03:21.540994 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:21.540971 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7f104566-d149-4456-8520-8fa682d7eb9c/kube-rbac-proxy/0.log" Jun 08 20:03:21.603461 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:21.603437 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7f104566-d149-4456-8520-8fa682d7eb9c/kube-rbac-proxy-metric/0.log" Jun 08 20:03:21.652880 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:21.652820 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7f104566-d149-4456-8520-8fa682d7eb9c/prom-label-proxy/0.log" Jun 08 20:03:21.711995 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:21.711977 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7f104566-d149-4456-8520-8fa682d7eb9c/init-config-reloader/0.log" Jun 08 20:03:21.769623 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:21.769598 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-dcdzf_6af04de5-f785-4b47-9ddf-9e4cee87aa45/cluster-monitoring-operator/0.log" Jun 08 20:03:21.800687 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:21.800663 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-k4jq2_fa14e65a-8887-47f8-aad0-e1c8058e7164/kube-state-metrics/0.log" Jun 08 20:03:21.848939 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:21.848922 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-k4jq2_fa14e65a-8887-47f8-aad0-e1c8058e7164/kube-rbac-proxy-main/0.log" Jun 08 20:03:21.899788 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:21.899770 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-k4jq2_fa14e65a-8887-47f8-aad0-e1c8058e7164/kube-rbac-proxy-self/0.log" Jun 08 20:03:21.980649 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:21.980594 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-8588b97df8-gtzkp_3f44c47f-fb48-49f3-8c3e-06c315a91917/metrics-server/0.log" Jun 08 20:03:22.298321 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:22.298300 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l6z8s_0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040/node-exporter/0.log" Jun 08 20:03:22.397824 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:22.397798 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l6z8s_0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040/kube-rbac-proxy/0.log" Jun 08 20:03:22.447188 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:22.447170 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l6z8s_0a3c8a2b-7a47-4d3b-89c6-edd79a8d8040/init-textfile/0.log" Jun 08 20:03:22.685868 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:22.685802 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-mh4xm_3bef0989-3453-4707-b54f-2f721ee2ea4c/kube-rbac-proxy-main/0.log" Jun 08 20:03:22.761314 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:22.761291 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-mh4xm_3bef0989-3453-4707-b54f-2f721ee2ea4c/kube-rbac-proxy-self/0.log" Jun 08 20:03:22.822581 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:22.822560 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-mh4xm_3bef0989-3453-4707-b54f-2f721ee2ea4c/openshift-state-metrics/0.log" Jun 08 20:03:22.886012 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:22.885991 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64a3952e-26c8-4ed5-bc5c-199a0269b706/prometheus/0.log" Jun 08 20:03:22.968620 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:22.968559 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64a3952e-26c8-4ed5-bc5c-199a0269b706/config-reloader/0.log" Jun 08 20:03:23.047334 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.047312 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64a3952e-26c8-4ed5-bc5c-199a0269b706/thanos-sidecar/0.log" Jun 08 20:03:23.109502 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.109473 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64a3952e-26c8-4ed5-bc5c-199a0269b706/kube-rbac-proxy-web/0.log" Jun 08 20:03:23.179753 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.179711 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64a3952e-26c8-4ed5-bc5c-199a0269b706/kube-rbac-proxy/0.log" Jun 08 20:03:23.249379 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.249314 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64a3952e-26c8-4ed5-bc5c-199a0269b706/kube-rbac-proxy-thanos/0.log" Jun 08 20:03:23.327001 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.326980 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64a3952e-26c8-4ed5-bc5c-199a0269b706/init-config-reloader/0.log" Jun 08 20:03:23.507268 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.507199 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-qrjqw_744ddc5a-8124-4099-a1a1-88de388de52d/prometheus-operator-admission-webhook/0.log" Jun 08 20:03:23.598092 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.598069 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d878d5fcb-lbz7j_045290a7-123b-4bb9-ae82-55b1851dbbea/telemeter-client/0.log" Jun 08 20:03:23.647498 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.647477 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d878d5fcb-lbz7j_045290a7-123b-4bb9-ae82-55b1851dbbea/reload/0.log" Jun 08 20:03:23.790968 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.790891 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t9btz/perf-node-gather-daemonset-24njj"] Jun 08 20:03:23.791415 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.791393 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae49ce0f-2c6f-43e2-97ee-178a405baed6" containerName="manager" Jun 08 20:03:23.791506 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.791418 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae49ce0f-2c6f-43e2-97ee-178a405baed6" containerName="manager" Jun 08 20:03:23.791506 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.791431 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d878d5fcb-lbz7j_045290a7-123b-4bb9-ae82-55b1851dbbea/kube-rbac-proxy/0.log" Jun 08 20:03:23.791610 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.791548 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae49ce0f-2c6f-43e2-97ee-178a405baed6" containerName="manager" Jun 08 20:03:23.794586 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.794567 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-24njj" Jun 08 20:03:23.805641 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.805624 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t9btz\"/\"openshift-service-ca.crt\"" Jun 08 20:03:23.805759 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.805627 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t9btz\"/\"kube-root-ca.crt\"" Jun 08 20:03:23.805759 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.805628 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t9btz\"/\"default-dockercfg-vbxdv\"" Jun 08 20:03:23.846415 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.846387 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t9btz/perf-node-gather-daemonset-24njj"] Jun 08 20:03:23.867777 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.867753 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/66b884fe-af1f-42e2-aa9b-9a4979b369ff-podres\") pod \"perf-node-gather-daemonset-24njj\" (UID: \"66b884fe-af1f-42e2-aa9b-9a4979b369ff\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-24njj" Jun 08 20:03:23.867883 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.867795 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/66b884fe-af1f-42e2-aa9b-9a4979b369ff-proc\") pod \"perf-node-gather-daemonset-24njj\" (UID: \"66b884fe-af1f-42e2-aa9b-9a4979b369ff\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-24njj" Jun 08 20:03:23.867926 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.867891 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2bcs\" (UniqueName: \"kubernetes.io/projected/66b884fe-af1f-42e2-aa9b-9a4979b369ff-kube-api-access-g2bcs\") pod \"perf-node-gather-daemonset-24njj\" (UID: \"66b884fe-af1f-42e2-aa9b-9a4979b369ff\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-24njj" Jun 08 20:03:23.867961 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.867925 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66b884fe-af1f-42e2-aa9b-9a4979b369ff-sys\") pod \"perf-node-gather-daemonset-24njj\" (UID: \"66b884fe-af1f-42e2-aa9b-9a4979b369ff\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-24njj" Jun 08 20:03:23.867961 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.867948 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66b884fe-af1f-42e2-aa9b-9a4979b369ff-lib-modules\") pod \"perf-node-gather-daemonset-24njj\" (UID: \"66b884fe-af1f-42e2-aa9b-9a4979b369ff\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-24njj" Jun 08 20:03:23.931008 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.930980 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b59b59ff-5k4kc_496b72bc-efb8-475c-a2a5-69c9a5ad0831/thanos-query/0.log" Jun 08 20:03:23.968985 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.968956 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2bcs\" (UniqueName: \"kubernetes.io/projected/66b884fe-af1f-42e2-aa9b-9a4979b369ff-kube-api-access-g2bcs\") pod \"perf-node-gather-daemonset-24njj\" (UID: \"66b884fe-af1f-42e2-aa9b-9a4979b369ff\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-24njj" Jun 08 20:03:23.969121 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.968994 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66b884fe-af1f-42e2-aa9b-9a4979b369ff-sys\") pod \"perf-node-gather-daemonset-24njj\" (UID: \"66b884fe-af1f-42e2-aa9b-9a4979b369ff\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-24njj" Jun 08 20:03:23.969121 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.969016 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66b884fe-af1f-42e2-aa9b-9a4979b369ff-lib-modules\") pod \"perf-node-gather-daemonset-24njj\" (UID: \"66b884fe-af1f-42e2-aa9b-9a4979b369ff\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-24njj" Jun 08 20:03:23.969121 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.969050 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/66b884fe-af1f-42e2-aa9b-9a4979b369ff-podres\") pod \"perf-node-gather-daemonset-24njj\" (UID: \"66b884fe-af1f-42e2-aa9b-9a4979b369ff\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-24njj" Jun 08 20:03:23.969121 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.969076 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/66b884fe-af1f-42e2-aa9b-9a4979b369ff-proc\") pod \"perf-node-gather-daemonset-24njj\" (UID: \"66b884fe-af1f-42e2-aa9b-9a4979b369ff\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-24njj" Jun 08 20:03:23.969121 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.969082 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66b884fe-af1f-42e2-aa9b-9a4979b369ff-sys\") pod \"perf-node-gather-daemonset-24njj\" (UID: \"66b884fe-af1f-42e2-aa9b-9a4979b369ff\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-24njj" Jun 08 20:03:23.969287 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.969159 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/66b884fe-af1f-42e2-aa9b-9a4979b369ff-proc\") pod \"perf-node-gather-daemonset-24njj\" (UID: \"66b884fe-af1f-42e2-aa9b-9a4979b369ff\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-24njj" Jun 08 20:03:23.969287 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.969218 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66b884fe-af1f-42e2-aa9b-9a4979b369ff-lib-modules\") pod \"perf-node-gather-daemonset-24njj\" (UID: \"66b884fe-af1f-42e2-aa9b-9a4979b369ff\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-24njj" Jun 08 20:03:23.969287 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.969246 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/66b884fe-af1f-42e2-aa9b-9a4979b369ff-podres\") pod \"perf-node-gather-daemonset-24njj\" (UID: \"66b884fe-af1f-42e2-aa9b-9a4979b369ff\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-24njj" Jun 08 20:03:23.984049 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.984029 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2bcs\" (UniqueName: \"kubernetes.io/projected/66b884fe-af1f-42e2-aa9b-9a4979b369ff-kube-api-access-g2bcs\") pod \"perf-node-gather-daemonset-24njj\" (UID: \"66b884fe-af1f-42e2-aa9b-9a4979b369ff\") " pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-24njj" Jun 08 20:03:23.997041 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:23.997012 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b59b59ff-5k4kc_496b72bc-efb8-475c-a2a5-69c9a5ad0831/kube-rbac-proxy-web/0.log" Jun 08 20:03:24.078346 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:24.078325 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b59b59ff-5k4kc_496b72bc-efb8-475c-a2a5-69c9a5ad0831/kube-rbac-proxy/0.log" Jun 08 20:03:24.103552 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:24.103531 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-24njj" Jun 08 20:03:24.140071 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:24.140048 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b59b59ff-5k4kc_496b72bc-efb8-475c-a2a5-69c9a5ad0831/prom-label-proxy/0.log" Jun 08 20:03:24.213932 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:24.213906 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b59b59ff-5k4kc_496b72bc-efb8-475c-a2a5-69c9a5ad0831/kube-rbac-proxy-rules/0.log" Jun 08 20:03:24.268039 ip-10-0-141-14 kubenswrapper[2573]: W0608 20:03:24.268011 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod66b884fe_af1f_42e2_aa9b_9a4979b369ff.slice/crio-4213b9727e2117a76c3c74cdc52041fefc1d4e6617bff8db7d3578bafef29165 WatchSource:0}: Error finding container 4213b9727e2117a76c3c74cdc52041fefc1d4e6617bff8db7d3578bafef29165: Status 404 returned error can't find the container with id 4213b9727e2117a76c3c74cdc52041fefc1d4e6617bff8db7d3578bafef29165 Jun 08 20:03:24.269007 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:24.268989 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t9btz/perf-node-gather-daemonset-24njj"] Jun 08 20:03:24.299211 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:24.299191 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b59b59ff-5k4kc_496b72bc-efb8-475c-a2a5-69c9a5ad0831/kube-rbac-proxy-metrics/0.log" Jun 08 20:03:24.383574 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:24.383552 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-24njj" event={"ID":"66b884fe-af1f-42e2-aa9b-9a4979b369ff","Type":"ContainerStarted","Data":"be20155900cc0bb7fc6e0bcc4ac62cb46e3a373daa0482fefa75f4b9f8b7bae0"} Jun 08 20:03:24.383660 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:24.383595 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-24njj" event={"ID":"66b884fe-af1f-42e2-aa9b-9a4979b369ff","Type":"ContainerStarted","Data":"4213b9727e2117a76c3c74cdc52041fefc1d4e6617bff8db7d3578bafef29165"} Jun 08 20:03:24.383741 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:24.383709 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-24njj" Jun 08 20:03:24.417158 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:24.417115 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-24njj" podStartSLOduration=1.417103424 podStartE2EDuration="1.417103424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 20:03:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 20:03:24.416398377 +0000 UTC m=+2220.551854818" watchObservedRunningTime="2026-06-08 20:03:24.417103424 +0000 UTC m=+2220.552559863" Jun 08 20:03:27.848417 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:27.848386 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-ld5nh_7d8d5585-6f29-4aed-be79-7292fea196a5/volume-data-source-validator/0.log" Jun 08 20:03:29.535392 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:29.535365 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b5k6w_d95c391c-ac01-42cf-ad49-7a5e0653ecd9/dns/0.log" Jun 08 20:03:29.596091 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:29.596066 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b5k6w_d95c391c-ac01-42cf-ad49-7a5e0653ecd9/kube-rbac-proxy/0.log" Jun 08 20:03:29.932489 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:29.932460 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mv9h2_4d52db18-8dbf-4de9-9d50-1020690ab64a/dns-node-resolver/0.log" Jun 08 20:03:30.398219 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:30.398194 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t9btz/perf-node-gather-daemonset-24njj" Jun 08 20:03:30.869761 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:30.869734 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lvnmk_529224c9-b129-4c0b-baf2-096ad4106daa/node-ca/0.log" Jun 08 20:03:32.488602 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:32.488572 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7888cd9689-l95vf_6cfe36fc-1503-4b85-b87c-cc21bb5ba48f/kube-auth-proxy/0.log" Jun 08 20:03:32.702463 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:32.702378 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-6gv74_d26756f7-2f03-4beb-878f-66f98f611bec/payload-pre-processing/0.log" Jun 08 20:03:32.855774 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:32.855713 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59744cfc99-6bbqq_bbfe4877-4383-4442-8b5f-e9f68186901c/router/0.log" Jun 08 20:03:34.092907 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:34.092877 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vjzfq_dbf38036-cdd0-4181-9967-bdbbf4d67a1e/serve-healthcheck-canary/0.log" Jun 08 20:03:34.288745 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:34.288691 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mckqj_26f426a9-91e2-47d1-adc2-fa6a36f8ced0/konnectivity-agent/0.log" limit=1024 Jun 08 20:03:35.185579 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:35.185554 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kb8br_93f9918f-d2e6-4a90-9af3-372ff33abf82/kube-rbac-proxy/0.log" Jun 08 20:03:35.224202 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:35.224176 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kb8br_93f9918f-d2e6-4a90-9af3-372ff33abf82/exporter/0.log" Jun 08 20:03:35.271196 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:35.271173 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kb8br_93f9918f-d2e6-4a90-9af3-372ff33abf82/extractor/0.log" Jun 08 20:03:38.675434 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:38.675405 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7888cd9689-l95vf_6cfe36fc-1503-4b85-b87c-cc21bb5ba48f/kube-auth-proxy/0.log" Jun 08 20:03:38.838316 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:38.838290 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-6gv74_d26756f7-2f03-4beb-878f-66f98f611bec/payload-pre-processing/0.log" Jun 08 20:03:38.992455 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:38.992385 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59744cfc99-6bbqq_bbfe4877-4383-4442-8b5f-e9f68186901c/router/0.log" Jun 08 20:03:39.111497 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:39.111472 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-d784c457d-bzx9c_0e9237f7-3935-4d45-8edf-a376439b02e8/maas-api/0.log" Jun 08 20:03:39.838597 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:39.838573 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b795f8b7b-fg22s_a6e1477b-c7f3-4004-a217-6c42670e682a/manager/0.log" Jun 08 20:03:39.902614 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:39.902594 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b795f8b7b-fg22s_a6e1477b-c7f3-4004-a217-6c42670e682a/copy-manifests/0.log" Jun 08 20:03:40.556106 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:40.556082 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7888cd9689-l95vf_6cfe36fc-1503-4b85-b87c-cc21bb5ba48f/kube-auth-proxy/0.log" Jun 08 20:03:40.694349 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:40.694319 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-6gv74_d26756f7-2f03-4beb-878f-66f98f611bec/payload-pre-processing/0.log" Jun 08 20:03:40.791606 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:40.791532 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59744cfc99-6bbqq_bbfe4877-4383-4442-8b5f-e9f68186901c/router/0.log" Jun 08 20:03:41.961090 ip-10-0-141-14 kubenswrapper[2573]: I0608 20:03:41.961061 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-c5d7bcdc4-bwhwx_a681fe63-a606-4f82-af9e-0ea3964228a9/manager/0.log"