Jul 14 11:11:21.929943 ip-10-0-141-138 systemd[1]: Starting Kubernetes Kubelet... Jul 14 11:11:22.351402 ip-10-0-141-138 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 11:11:22.351402 ip-10-0-141-138 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 14 11:11:22.351402 ip-10-0-141-138 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 11:11:22.351402 ip-10-0-141-138 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 14 11:11:22.351402 ip-10-0-141-138 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 11:11:22.352513 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.352424 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 14 11:11:22.359519 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359493 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 11:11:22.359519 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359515 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 11:11:22.359519 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359519 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 11:11:22.359519 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359522 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 11:11:22.359519 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359526 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 11:11:22.359519 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359529 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 11:11:22.359768 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359532 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 11:11:22.359768 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359553 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 11:11:22.359768 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359556 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 11:11:22.359768 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359558 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 11:11:22.359768 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359561 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 11:11:22.359768 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359564 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 11:11:22.359768 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359566 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 11:11:22.359768 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359570 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 11:11:22.359768 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359573 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 11:11:22.359768 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359577 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 11:11:22.359768 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359581 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 11:11:22.359768 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359585 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 11:11:22.359768 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359588 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 11:11:22.359768 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359590 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 11:11:22.359768 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359593 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 11:11:22.359768 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359595 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 11:11:22.359768 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359598 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 11:11:22.359768 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359600 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 11:11:22.359768 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359603 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 11:11:22.359768 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359605 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 11:11:22.360240 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359608 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 11:11:22.360240 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359610 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 11:11:22.360240 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359612 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 11:11:22.360240 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359615 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 11:11:22.360240 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359617 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 11:11:22.360240 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359620 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 11:11:22.360240 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359623 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 11:11:22.360240 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359626 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 11:11:22.360240 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359628 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 11:11:22.360240 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359630 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 11:11:22.360240 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359633 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 11:11:22.360240 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359637 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 11:11:22.360240 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359641 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 11:11:22.360240 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359645 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 11:11:22.360240 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359648 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 11:11:22.360240 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359651 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 11:11:22.360240 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359654 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 11:11:22.360240 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359657 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 11:11:22.360240 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359660 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 11:11:22.360724 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359662 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 11:11:22.360724 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359665 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 11:11:22.360724 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359667 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 11:11:22.360724 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359670 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 11:11:22.360724 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359672 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 11:11:22.360724 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359675 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 11:11:22.360724 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359678 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 11:11:22.360724 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359681 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 14 11:11:22.360724 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359683 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 11:11:22.360724 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359686 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 11:11:22.360724 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359688 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 11:11:22.360724 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359691 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 11:11:22.360724 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359693 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 11:11:22.360724 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359696 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 11:11:22.360724 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359698 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 11:11:22.360724 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359700 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 11:11:22.360724 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359703 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 11:11:22.360724 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359705 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 11:11:22.360724 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359708 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 11:11:22.361175 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359712 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 11:11:22.361175 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359715 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 11:11:22.361175 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359718 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 11:11:22.361175 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359722 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 11:11:22.361175 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359725 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 11:11:22.361175 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359728 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 11:11:22.361175 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359731 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 11:11:22.361175 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359734 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 11:11:22.361175 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359736 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 11:11:22.361175 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359739 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 11:11:22.361175 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359742 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 11:11:22.361175 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359744 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 11:11:22.361175 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359747 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 11:11:22.361175 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359749 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 11:11:22.361175 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359751 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 11:11:22.361175 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359754 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 11:11:22.361175 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359756 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 11:11:22.361175 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359759 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 11:11:22.361175 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359761 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 11:11:22.361655 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359765 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 11:11:22.361655 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359767 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 11:11:22.361655 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359770 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 11:11:22.361655 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359772 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 11:11:22.361655 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359775 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 11:11:22.361655 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359778 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 11:11:22.361655 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359780 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 11:11:22.361655 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359783 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 11:11:22.361655 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359785 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 11:11:22.361655 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359788 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 11:11:22.361655 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359791 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 11:11:22.361655 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359794 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 11:11:22.361655 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359796 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 11:11:22.361655 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359799 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 11:11:22.361655 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359801 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 11:11:22.361655 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.359804 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 11:11:22.361655 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360497 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 11:11:22.361655 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360503 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 11:11:22.361655 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360507 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 11:11:22.361655 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360510 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 11:11:22.362127 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360513 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 11:11:22.362127 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360516 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 11:11:22.362127 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360518 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 11:11:22.362127 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360521 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 11:11:22.362127 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360524 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 11:11:22.362127 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360526 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 11:11:22.362127 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360529 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 11:11:22.362127 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360531 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 11:11:22.362127 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360552 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 11:11:22.362127 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360557 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 11:11:22.362127 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360561 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 11:11:22.362127 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360564 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 11:11:22.362127 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360567 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 11:11:22.362127 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360572 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 11:11:22.362127 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360574 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 11:11:22.362127 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360577 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 11:11:22.362127 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360579 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 11:11:22.362127 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360582 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 11:11:22.362127 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360585 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 11:11:22.362628 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360588 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 11:11:22.362628 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360590 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 11:11:22.362628 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360593 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 11:11:22.362628 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360596 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 11:11:22.362628 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360599 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 11:11:22.362628 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360601 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 11:11:22.362628 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360604 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 11:11:22.362628 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360606 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 11:11:22.362628 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360609 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 11:11:22.362628 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360611 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 11:11:22.362628 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360614 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 11:11:22.362628 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360617 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 11:11:22.362628 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360619 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 11:11:22.362628 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360624 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 11:11:22.362628 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360626 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 11:11:22.362628 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360629 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 11:11:22.362628 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360631 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 11:11:22.362628 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360634 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 11:11:22.362628 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360636 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 11:11:22.363086 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360639 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 11:11:22.363086 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360642 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 14 11:11:22.363086 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360644 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 11:11:22.363086 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360647 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 11:11:22.363086 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360649 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 11:11:22.363086 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360651 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 11:11:22.363086 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360654 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 11:11:22.363086 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360656 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 11:11:22.363086 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360659 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 11:11:22.363086 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360662 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 11:11:22.363086 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360664 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 11:11:22.363086 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360666 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 11:11:22.363086 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360669 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 11:11:22.363086 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360672 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 11:11:22.363086 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360674 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 11:11:22.363086 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360677 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 11:11:22.363086 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360679 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 11:11:22.363086 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360682 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 11:11:22.363086 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360684 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 11:11:22.363086 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360688 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 11:11:22.363579 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360691 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 11:11:22.363579 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360694 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 11:11:22.363579 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360696 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 11:11:22.363579 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360698 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 11:11:22.363579 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360702 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 11:11:22.363579 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360705 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 11:11:22.363579 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360708 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 11:11:22.363579 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360710 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 11:11:22.363579 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360713 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 11:11:22.363579 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360715 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 11:11:22.363579 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360718 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 11:11:22.363579 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360722 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 11:11:22.363579 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360725 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 11:11:22.363579 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360728 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 11:11:22.363579 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360731 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 11:11:22.363579 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360734 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 11:11:22.363579 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360737 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 11:11:22.363579 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360739 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 11:11:22.363579 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360742 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 11:11:22.364033 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360745 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 11:11:22.364033 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360747 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 11:11:22.364033 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360751 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 11:11:22.364033 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360753 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 11:11:22.364033 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360755 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 11:11:22.364033 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360758 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 11:11:22.364033 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360761 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 11:11:22.364033 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360764 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 11:11:22.364033 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360766 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 11:11:22.364033 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360769 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 11:11:22.364033 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360771 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 11:11:22.364033 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360774 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 11:11:22.364033 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360777 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 11:11:22.364033 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360779 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 11:11:22.364033 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360782 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 11:11:22.364033 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360784 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 11:11:22.364033 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360787 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 11:11:22.364033 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.360789 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 11:11:22.364033 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361200 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 11:11:22.364033 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361205 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 11:11:22.364516 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361208 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 11:11:22.364516 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361211 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 11:11:22.364516 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361214 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 11:11:22.364516 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361217 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 11:11:22.364516 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361220 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 11:11:22.364516 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361223 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 11:11:22.364516 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361227 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 11:11:22.364516 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361231 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 11:11:22.364516 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361234 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 11:11:22.364516 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361237 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 11:11:22.364516 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361240 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 11:11:22.364516 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361242 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 11:11:22.364516 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361245 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 11:11:22.364516 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361248 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 11:11:22.364516 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361251 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 11:11:22.364516 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361253 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 11:11:22.364516 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361256 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 11:11:22.364516 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361260 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 11:11:22.364516 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361264 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 11:11:22.365011 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361267 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 11:11:22.365011 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361270 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 14 11:11:22.365011 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361272 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 11:11:22.365011 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361275 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 11:11:22.365011 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361278 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 11:11:22.365011 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361281 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 11:11:22.365011 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361284 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 11:11:22.365011 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361287 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 11:11:22.365011 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361290 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 11:11:22.365011 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361292 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 11:11:22.365011 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361295 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 11:11:22.365011 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361297 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 11:11:22.365011 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361300 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 11:11:22.365011 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361302 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 11:11:22.365011 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361304 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 11:11:22.365011 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361307 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 11:11:22.365011 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361309 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 11:11:22.365011 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361311 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 11:11:22.365011 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361314 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 11:11:22.365011 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361316 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 11:11:22.365511 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361319 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 11:11:22.365511 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361321 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 11:11:22.365511 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361323 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 11:11:22.365511 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361325 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 11:11:22.365511 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361328 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 11:11:22.365511 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361330 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 11:11:22.365511 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361333 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 11:11:22.365511 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361335 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 11:11:22.365511 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361338 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 11:11:22.365511 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361341 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 11:11:22.365511 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361345 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 11:11:22.365511 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361347 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 11:11:22.365511 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361350 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 11:11:22.365511 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361352 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 11:11:22.365511 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361355 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 11:11:22.365511 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361357 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 11:11:22.365511 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361360 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 11:11:22.365511 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361362 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 11:11:22.365511 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361365 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 11:11:22.365511 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361367 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 11:11:22.366008 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361369 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 11:11:22.366008 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361373 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 11:11:22.366008 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361376 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 11:11:22.366008 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361379 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 11:11:22.366008 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361382 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 11:11:22.366008 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361385 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 11:11:22.366008 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361388 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 11:11:22.366008 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361391 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 11:11:22.366008 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361393 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 11:11:22.366008 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361396 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 11:11:22.366008 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361398 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 11:11:22.366008 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361400 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 11:11:22.366008 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361403 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 11:11:22.366008 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361405 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 11:11:22.366008 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361408 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 11:11:22.366008 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361410 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 11:11:22.366008 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361412 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 11:11:22.366008 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361415 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 11:11:22.366008 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361417 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 11:11:22.366509 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361419 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 11:11:22.366509 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361422 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 11:11:22.366509 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361424 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 11:11:22.366509 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361427 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 11:11:22.366509 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361430 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 11:11:22.366509 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361432 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 11:11:22.366509 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361435 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 11:11:22.366509 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361437 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 11:11:22.366509 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361440 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 11:11:22.366509 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361442 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 11:11:22.366509 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361444 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 11:11:22.366509 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361447 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 11:11:22.366509 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361449 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 11:11:22.366509 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361451 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 11:11:22.366509 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361454 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 11:11:22.366509 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361456 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 11:11:22.366509 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361459 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 11:11:22.366509 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361463 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 11:11:22.366509 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.361466 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 11:11:22.366509 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361549 2580 flags.go:64] FLAG: --address="0.0.0.0" Jul 14 11:11:22.366509 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361558 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 14 11:11:22.367021 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361566 2580 flags.go:64] FLAG: --anonymous-auth="true" Jul 14 11:11:22.367021 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361570 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 14 11:11:22.367021 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361574 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 14 11:11:22.367021 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361577 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 14 11:11:22.367021 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361582 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 14 11:11:22.367021 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361585 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 14 11:11:22.367021 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361588 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 14 11:11:22.367021 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361592 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 14 11:11:22.367021 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361595 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 14 11:11:22.367021 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361598 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 14 11:11:22.367021 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361601 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 14 11:11:22.367021 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361604 2580 flags.go:64] FLAG: --cgroup-root="" Jul 14 11:11:22.367021 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361607 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 14 11:11:22.367021 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361610 2580 flags.go:64] FLAG: --client-ca-file="" Jul 14 11:11:22.367021 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361613 2580 flags.go:64] FLAG: --cloud-provider="external" Jul 14 11:11:22.367021 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361616 2580 flags.go:64] FLAG: --cluster-dns="[]" Jul 14 11:11:22.367021 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361620 2580 flags.go:64] FLAG: --cluster-domain="" Jul 14 11:11:22.367021 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361623 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 14 11:11:22.367021 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361625 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 14 11:11:22.367021 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361628 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 14 11:11:22.367021 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361632 2580 flags.go:64] FLAG: --container-log-max-files="5" Jul 14 11:11:22.367021 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361635 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 14 11:11:22.367021 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361638 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 14 11:11:22.367594 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361641 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 14 11:11:22.367594 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361644 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 14 11:11:22.367594 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361647 2580 flags.go:64] FLAG: --contention-profiling="false" Jul 14 11:11:22.367594 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361649 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 14 11:11:22.367594 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361652 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 14 11:11:22.367594 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361657 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 14 11:11:22.367594 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361660 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 14 11:11:22.367594 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361665 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 14 11:11:22.367594 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361668 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 14 11:11:22.367594 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361671 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 14 11:11:22.367594 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361674 2580 flags.go:64] FLAG: --enable-load-reader="false" Jul 14 11:11:22.367594 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361677 2580 flags.go:64] FLAG: --enable-server="true" Jul 14 11:11:22.367594 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361679 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 14 11:11:22.367594 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361685 2580 flags.go:64] FLAG: --event-burst="100" Jul 14 11:11:22.367594 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361688 2580 flags.go:64] FLAG: --event-qps="50" Jul 14 11:11:22.367594 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361691 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 14 11:11:22.367594 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361693 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 14 11:11:22.367594 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361696 2580 flags.go:64] FLAG: --eviction-hard="" Jul 14 11:11:22.367594 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361700 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 14 11:11:22.367594 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361703 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 14 11:11:22.367594 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361705 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 14 11:11:22.367594 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361710 2580 flags.go:64] FLAG: --eviction-soft="" Jul 14 11:11:22.367594 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361713 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 14 11:11:22.367594 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361716 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 14 11:11:22.367594 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361720 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 14 11:11:22.368339 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361723 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jul 14 11:11:22.368339 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361725 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 14 11:11:22.368339 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361728 2580 flags.go:64] FLAG: --fail-swap-on="true" Jul 14 11:11:22.368339 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361731 2580 flags.go:64] FLAG: --feature-gates="" Jul 14 11:11:22.368339 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361735 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jul 14 11:11:22.368339 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361737 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 14 11:11:22.368339 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361740 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 14 11:11:22.368339 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361743 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 14 11:11:22.368339 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361746 2580 flags.go:64] FLAG: --healthz-port="10248" Jul 14 11:11:22.368339 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361749 2580 flags.go:64] FLAG: --help="false" Jul 14 11:11:22.368339 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361752 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-141-138.ec2.internal" Jul 14 11:11:22.368339 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361755 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 14 11:11:22.368339 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361759 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jul 14 11:11:22.368339 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361763 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 14 11:11:22.368339 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361766 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 14 11:11:22.368339 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361769 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 14 11:11:22.368339 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361772 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 14 11:11:22.368339 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361774 2580 flags.go:64] FLAG: --image-service-endpoint="" Jul 14 11:11:22.368339 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361777 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 14 11:11:22.368339 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361780 2580 flags.go:64] FLAG: --kube-api-burst="100" Jul 14 11:11:22.368339 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361782 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 14 11:11:22.368339 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361785 2580 flags.go:64] FLAG: --kube-api-qps="50" Jul 14 11:11:22.368339 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361788 2580 flags.go:64] FLAG: --kube-reserved="" Jul 14 11:11:22.368339 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361791 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 14 11:11:22.368943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361794 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 14 11:11:22.368943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361797 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jul 14 11:11:22.368943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361799 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 14 11:11:22.368943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361802 2580 flags.go:64] FLAG: --lock-file="" Jul 14 11:11:22.368943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361806 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 14 11:11:22.368943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361809 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 14 11:11:22.368943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361812 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 14 11:11:22.368943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361817 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jul 14 11:11:22.368943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361821 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 14 11:11:22.368943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361823 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jul 14 11:11:22.368943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361826 2580 flags.go:64] FLAG: --logging-format="text" Jul 14 11:11:22.368943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361829 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 14 11:11:22.368943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361832 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 14 11:11:22.368943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361834 2580 flags.go:64] FLAG: --manifest-url="" Jul 14 11:11:22.368943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361837 2580 flags.go:64] FLAG: --manifest-url-header="" Jul 14 11:11:22.368943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361841 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 14 11:11:22.368943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361844 2580 flags.go:64] FLAG: --max-open-files="1000000" Jul 14 11:11:22.368943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361848 2580 flags.go:64] FLAG: --max-pods="110" Jul 14 11:11:22.368943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361851 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 14 11:11:22.368943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361854 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 14 11:11:22.368943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361858 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jul 14 11:11:22.368943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361861 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 14 11:11:22.368943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361864 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 14 11:11:22.368943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361867 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 14 11:11:22.368943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361870 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 14 11:11:22.369557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361877 2580 flags.go:64] FLAG: --node-status-max-images="50" Jul 14 11:11:22.369557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361880 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 14 11:11:22.369557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361883 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jul 14 11:11:22.369557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361886 2580 flags.go:64] FLAG: --pod-cidr="" Jul 14 11:11:22.369557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361888 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 14 11:11:22.369557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361894 2580 flags.go:64] FLAG: --pod-manifest-path="" Jul 14 11:11:22.369557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361896 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jul 14 11:11:22.369557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361899 2580 flags.go:64] FLAG: --pods-per-core="0" Jul 14 11:11:22.369557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361902 2580 flags.go:64] FLAG: --port="10250" Jul 14 11:11:22.369557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361905 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 14 11:11:22.369557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361908 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-086156c386fc9a8ca" Jul 14 11:11:22.369557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361911 2580 flags.go:64] FLAG: --qos-reserved="" Jul 14 11:11:22.369557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361915 2580 flags.go:64] FLAG: --read-only-port="10255" Jul 14 11:11:22.369557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361918 2580 flags.go:64] FLAG: --register-node="true" Jul 14 11:11:22.369557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361921 2580 flags.go:64] FLAG: --register-with-taints="" Jul 14 11:11:22.369557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361924 2580 flags.go:64] FLAG: --registry-burst="10" Jul 14 11:11:22.369557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361928 2580 flags.go:64] FLAG: --registry-qps="5" Jul 14 11:11:22.369557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361931 2580 flags.go:64] FLAG: --reserved-cpus="" Jul 14 11:11:22.369557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361933 2580 flags.go:64] FLAG: --reserved-memory="" Jul 14 11:11:22.369557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361937 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 14 11:11:22.369557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361940 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 14 11:11:22.369557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361943 2580 flags.go:64] FLAG: --rotate-certificates="false" Jul 14 11:11:22.369557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361945 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 14 11:11:22.369557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361948 2580 flags.go:64] FLAG: --runonce="false" Jul 14 11:11:22.369557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361951 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 14 11:11:22.370175 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361954 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 14 11:11:22.370175 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361956 2580 flags.go:64] FLAG: --seccomp-default="false" Jul 14 11:11:22.370175 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361961 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 14 11:11:22.370175 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361963 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 14 11:11:22.370175 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361966 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 14 11:11:22.370175 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361969 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 14 11:11:22.370175 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361972 2580 flags.go:64] FLAG: --storage-driver-password="root" Jul 14 11:11:22.370175 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361975 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jul 14 11:11:22.370175 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361978 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jul 14 11:11:22.370175 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361980 2580 flags.go:64] FLAG: --storage-driver-user="root" Jul 14 11:11:22.370175 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361983 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 14 11:11:22.370175 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361986 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 14 11:11:22.370175 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361989 2580 flags.go:64] FLAG: --system-cgroups="" Jul 14 11:11:22.370175 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361992 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 14 11:11:22.370175 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.361997 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 14 11:11:22.370175 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.362000 2580 flags.go:64] FLAG: --tls-cert-file="" Jul 14 11:11:22.370175 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.362003 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 14 11:11:22.370175 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.362006 2580 flags.go:64] FLAG: --tls-min-version="" Jul 14 11:11:22.370175 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.362009 2580 flags.go:64] FLAG: --tls-private-key-file="" Jul 14 11:11:22.370175 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.362013 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jul 14 11:11:22.370175 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.362016 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 14 11:11:22.370175 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.362019 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jul 14 11:11:22.370175 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.362021 2580 flags.go:64] FLAG: --v="2" Jul 14 11:11:22.370175 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.362025 2580 flags.go:64] FLAG: --version="false" Jul 14 11:11:22.370175 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.362030 2580 flags.go:64] FLAG: --vmodule="" Jul 14 11:11:22.370885 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.362033 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 14 11:11:22.370885 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.362037 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 14 11:11:22.370885 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362156 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 11:11:22.370885 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362160 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 11:11:22.370885 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362163 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 11:11:22.370885 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362166 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 11:11:22.370885 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362169 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 11:11:22.370885 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362172 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 11:11:22.370885 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362174 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 11:11:22.370885 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362178 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 11:11:22.370885 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362181 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 11:11:22.370885 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362183 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 11:11:22.370885 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362186 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 11:11:22.370885 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362188 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 11:11:22.370885 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362191 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 11:11:22.370885 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362194 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 11:11:22.370885 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362197 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 11:11:22.370885 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362199 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 11:11:22.370885 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362202 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 11:11:22.370885 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362204 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 11:11:22.371411 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362207 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 11:11:22.371411 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362210 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 11:11:22.371411 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362212 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 11:11:22.371411 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362215 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 11:11:22.371411 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362217 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 11:11:22.371411 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362220 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 11:11:22.371411 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362224 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 11:11:22.371411 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362228 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 11:11:22.371411 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362231 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 11:11:22.371411 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362234 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 11:11:22.371411 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362237 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 11:11:22.371411 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362240 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 11:11:22.371411 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362243 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 11:11:22.371411 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362246 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 11:11:22.371411 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362249 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 11:11:22.371411 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362251 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 11:11:22.371411 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362254 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 11:11:22.371411 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362257 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 11:11:22.371411 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362259 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 11:11:22.371899 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362261 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 11:11:22.371899 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362264 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 11:11:22.371899 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362268 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 11:11:22.371899 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362270 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 11:11:22.371899 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362273 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 11:11:22.371899 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362275 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 11:11:22.371899 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362277 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 11:11:22.371899 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362280 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 11:11:22.371899 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362282 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 14 11:11:22.371899 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362284 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 11:11:22.371899 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362287 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 11:11:22.371899 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362290 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 11:11:22.371899 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362292 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 11:11:22.371899 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362295 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 11:11:22.371899 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362297 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 11:11:22.371899 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362299 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 11:11:22.371899 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362302 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 11:11:22.371899 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362304 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 11:11:22.371899 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362306 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 11:11:22.371899 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362310 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 11:11:22.372390 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362320 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 11:11:22.372390 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362324 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 11:11:22.372390 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362327 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 11:11:22.372390 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362329 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 11:11:22.372390 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362332 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 11:11:22.372390 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362335 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 11:11:22.372390 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362338 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 11:11:22.372390 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362341 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 11:11:22.372390 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362344 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 11:11:22.372390 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362346 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 11:11:22.372390 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362349 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 11:11:22.372390 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362351 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 11:11:22.372390 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362354 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 11:11:22.372390 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362356 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 11:11:22.372390 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362360 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 11:11:22.372390 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362362 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 11:11:22.372390 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362365 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 11:11:22.372390 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362367 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 11:11:22.372390 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362370 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 11:11:22.372390 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362372 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 11:11:22.372875 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362375 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 11:11:22.372875 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362377 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 11:11:22.372875 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362381 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 11:11:22.372875 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362384 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 11:11:22.372875 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362386 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 11:11:22.372875 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362389 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 11:11:22.372875 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362392 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 11:11:22.372875 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362394 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 11:11:22.372875 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362397 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 11:11:22.372875 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362399 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 11:11:22.372875 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362401 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 11:11:22.372875 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362405 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 11:11:22.372875 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362408 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 11:11:22.372875 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362411 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 11:11:22.372875 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362413 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 11:11:22.372875 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362415 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 11:11:22.372875 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362418 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 11:11:22.372875 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362420 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 11:11:22.372875 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362423 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 11:11:22.373348 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362426 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 11:11:22.373348 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362430 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 11:11:22.373348 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.362437 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 11:11:22.373348 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.362446 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 11:11:22.373348 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.369203 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 14 11:11:22.373348 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.369218 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 14 11:11:22.373348 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.370019 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 14 11:11:22.373348 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.370028 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 14 11:11:22.373348 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370084 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 11:11:22.373348 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370090 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 11:11:22.373348 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370094 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 11:11:22.373348 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370098 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 11:11:22.373348 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370100 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 11:11:22.373348 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370103 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 11:11:22.373712 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370106 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 11:11:22.373712 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370108 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 11:11:22.373712 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370111 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 11:11:22.373712 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370114 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 11:11:22.373712 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370116 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 11:11:22.373712 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370119 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 11:11:22.373712 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370121 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 11:11:22.373712 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370124 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 11:11:22.373712 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370126 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 11:11:22.373712 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370129 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 11:11:22.373712 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370131 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 11:11:22.373712 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370134 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 11:11:22.373712 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370136 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 11:11:22.373712 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370138 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 11:11:22.373712 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370141 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 11:11:22.373712 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370143 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 11:11:22.373712 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370145 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 11:11:22.373712 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370148 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 11:11:22.373712 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370150 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 11:11:22.373712 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370153 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 11:11:22.374182 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370155 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 11:11:22.374182 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370158 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 11:11:22.374182 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370160 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 11:11:22.374182 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370164 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 11:11:22.374182 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370167 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 11:11:22.374182 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370169 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 11:11:22.374182 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370172 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 11:11:22.374182 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370174 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 11:11:22.374182 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370177 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 11:11:22.374182 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370179 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 11:11:22.374182 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370182 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 11:11:22.374182 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370186 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 11:11:22.374182 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370190 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 11:11:22.374182 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370193 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 11:11:22.374182 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370195 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 11:11:22.374182 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370198 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 11:11:22.374182 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370200 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 11:11:22.374182 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370202 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 11:11:22.374182 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370205 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 11:11:22.374182 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370207 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 11:11:22.374754 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370210 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 11:11:22.374754 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370212 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 11:11:22.374754 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370215 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 11:11:22.374754 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370217 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 11:11:22.374754 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370220 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 11:11:22.374754 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370222 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 11:11:22.374754 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370224 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 11:11:22.374754 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370227 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 11:11:22.374754 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370229 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 11:11:22.374754 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370232 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 11:11:22.374754 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370234 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 11:11:22.374754 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370237 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 11:11:22.374754 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370239 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 11:11:22.374754 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370242 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 11:11:22.374754 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370244 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 11:11:22.374754 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370247 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 11:11:22.374754 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370250 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 11:11:22.374754 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370253 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 11:11:22.374754 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370255 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 11:11:22.374754 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370258 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 11:11:22.375230 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370260 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 11:11:22.375230 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370263 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 11:11:22.375230 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370265 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 11:11:22.375230 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370269 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 11:11:22.375230 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370272 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 11:11:22.375230 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370275 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 11:11:22.375230 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370278 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 11:11:22.375230 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370281 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 11:11:22.375230 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370283 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 11:11:22.375230 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370286 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 11:11:22.375230 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370289 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 11:11:22.375230 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370291 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 14 11:11:22.375230 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370293 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 11:11:22.375230 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370296 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 11:11:22.375230 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370298 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 11:11:22.375230 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370300 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 11:11:22.375230 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370303 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 11:11:22.375230 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370305 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 11:11:22.375230 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370307 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 11:11:22.375778 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370310 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 11:11:22.375778 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370312 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 11:11:22.375778 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370323 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 11:11:22.375778 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370325 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 11:11:22.375778 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370328 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 11:11:22.375778 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370332 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 11:11:22.375778 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370335 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 11:11:22.375778 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370338 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 11:11:22.375778 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370341 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 11:11:22.375778 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370344 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 11:11:22.375778 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370347 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 11:11:22.375778 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370351 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 11:11:22.375778 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370354 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 11:11:22.375778 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370356 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 11:11:22.376109 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.370361 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 11:11:22.376109 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370477 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 11:11:22.376109 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370482 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 11:11:22.376109 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370485 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 11:11:22.376109 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370487 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 11:11:22.376109 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370490 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 11:11:22.376109 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370493 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 11:11:22.376109 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370495 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 11:11:22.376109 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370498 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 11:11:22.376109 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370500 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 11:11:22.376109 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370502 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 11:11:22.376109 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370505 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 11:11:22.376109 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370508 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 11:11:22.376109 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370510 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 11:11:22.376109 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370512 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 11:11:22.376464 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370515 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 11:11:22.376464 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370517 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 11:11:22.376464 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370519 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 11:11:22.376464 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370522 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 11:11:22.376464 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370524 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 11:11:22.376464 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370527 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 11:11:22.376464 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370529 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 11:11:22.376464 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370532 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 11:11:22.376464 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370547 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 11:11:22.376464 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370550 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 11:11:22.376464 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370553 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 11:11:22.376464 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370555 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 11:11:22.376464 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370558 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 11:11:22.376464 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370560 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 11:11:22.376464 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370563 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 11:11:22.376464 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370566 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 11:11:22.376464 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370568 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 11:11:22.376464 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370571 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 11:11:22.376464 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370573 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 11:11:22.376464 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370576 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 11:11:22.376982 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370578 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 11:11:22.376982 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370581 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 11:11:22.376982 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370583 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 11:11:22.376982 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370586 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 11:11:22.376982 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370588 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 11:11:22.376982 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370590 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 11:11:22.376982 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370593 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 11:11:22.376982 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370595 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 11:11:22.376982 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370597 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 11:11:22.376982 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370600 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 11:11:22.376982 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370602 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 11:11:22.376982 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370605 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 11:11:22.376982 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370608 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 11:11:22.376982 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370610 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 11:11:22.376982 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370613 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 11:11:22.376982 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370615 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 11:11:22.376982 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370617 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 11:11:22.376982 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370620 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 11:11:22.376982 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370622 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 11:11:22.376982 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370625 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 11:11:22.377465 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370627 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 11:11:22.377465 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370629 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 11:11:22.377465 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370632 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 11:11:22.377465 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370635 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 11:11:22.377465 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370637 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 11:11:22.377465 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370639 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 11:11:22.377465 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370642 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 11:11:22.377465 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370645 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 11:11:22.377465 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370648 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 11:11:22.377465 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370650 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 11:11:22.377465 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370653 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 11:11:22.377465 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370655 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 11:11:22.377465 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370659 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 11:11:22.377465 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370662 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 11:11:22.377465 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370665 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 11:11:22.377465 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370667 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 11:11:22.377465 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370670 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 11:11:22.377465 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370673 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 11:11:22.377465 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370675 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 11:11:22.377940 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370678 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 11:11:22.377940 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370680 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 11:11:22.377940 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370683 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 11:11:22.377940 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370685 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 11:11:22.377940 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370687 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 11:11:22.377940 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370690 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 11:11:22.377940 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370693 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 11:11:22.377940 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370695 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 11:11:22.377940 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370699 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 11:11:22.377940 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370702 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 11:11:22.377940 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370705 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 11:11:22.377940 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370708 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 11:11:22.377940 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370710 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 11:11:22.377940 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370712 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 11:11:22.377940 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370715 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 11:11:22.377940 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370717 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 14 11:11:22.377940 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370720 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 11:11:22.377940 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370722 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 11:11:22.377940 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370725 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 11:11:22.377940 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370727 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 11:11:22.378424 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370730 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 11:11:22.378424 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370737 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 11:11:22.378424 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370740 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 11:11:22.378424 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370743 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 11:11:22.378424 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370745 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 11:11:22.378424 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:22.370748 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 11:11:22.378424 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.370753 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 11:11:22.378424 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.370865 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jul 14 11:11:22.378424 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.372837 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 14 11:11:22.378424 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.374304 2580 server.go:1019] "Starting client certificate rotation" Jul 14 11:11:22.378424 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.374410 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 11:11:22.378424 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.374439 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 11:11:22.378424 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.376798 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 11:11:22.383577 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.383562 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 11:11:22.397242 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.397215 2580 log.go:25] "Validated CRI v1 runtime API" Jul 14 11:11:22.399223 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.399208 2580 log.go:25] "Validated CRI v1 image API" Jul 14 11:11:22.400891 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.400870 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 14 11:11:22.406874 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.406850 2580 fs.go:135] Filesystem UUIDs: map[4c5c7273-4c10-4547-95f8-1ecd01e9cd42:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d5ce1ff9-7ba4-4f9f-a16a-101e637ffebd:/dev/nvme0n1p3] Jul 14 11:11:22.406953 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.406874 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 14 11:11:22.409328 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.409307 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 11:11:22.411527 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.411411 2580 manager.go:216] Machine: {Timestamp:2026-07-14 11:11:22.410887138 +0000 UTC m=+0.351715153 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100446 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2beddc33c2dc0031a7b2563ec44b65 SystemUUID:ec2beddc-33c2-dc00-31a7-b2563ec44b65 BootID:e1082866-fc4b-4d8a-ae23-a29e74e00e1f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:39:84:cd:c6:63 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:39:84:cd:c6:63 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:1d:7b:5f:eb:3d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 14 11:11:22.411527 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.411525 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 14 11:11:22.411648 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.411614 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 14 11:11:22.414637 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.414613 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 14 11:11:22.414774 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.414641 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-138.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 14 11:11:22.415390 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.415380 2580 topology_manager.go:138] "Creating topology manager with none policy" Jul 14 11:11:22.415422 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.415393 2580 container_manager_linux.go:309] "Creating device plugin manager" Jul 14 11:11:22.415422 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.415401 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 11:11:22.415422 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.415411 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 11:11:22.416689 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.416678 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 14 11:11:22.419800 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.419788 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 14 11:11:22.419913 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.419904 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 14 11:11:22.419947 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.419934 2580 kubelet.go:486] "Attempting to sync node with API server" Jul 14 11:11:22.419947 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.419944 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 14 11:11:22.420018 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.419958 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 14 11:11:22.420018 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.419967 2580 kubelet.go:398] "Adding apiserver pod source" Jul 14 11:11:22.420018 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.419976 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 14 11:11:22.420380 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.420368 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 11:11:22.420436 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.420389 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 11:11:22.422824 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.422806 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 14 11:11:22.424760 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.424748 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 14 11:11:22.424807 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.424778 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 14 11:11:22.424934 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.424924 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 14 11:11:22.424982 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.424939 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 14 11:11:22.424982 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.424945 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 14 11:11:22.424982 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.424950 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 14 11:11:22.424982 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.424957 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 14 11:11:22.424982 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.424962 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 14 11:11:22.425516 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.425506 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 14 11:11:22.425557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.425516 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 14 11:11:22.425557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.425523 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 14 11:11:22.425557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.425529 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 14 11:11:22.425557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.425553 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 14 11:11:22.425663 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.425561 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 14 11:11:22.426442 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.426432 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 14 11:11:22.426475 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.426444 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 14 11:11:22.429780 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.429766 2580 server.go:1268] "Started kubelet" Jul 14 11:11:22.429854 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.429834 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 14 11:11:22.429902 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.429851 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 14 11:11:22.429946 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.429899 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 14 11:11:22.430785 ip-10-0-141-138 systemd[1]: Started Kubernetes Kubelet. Jul 14 11:11:22.435267 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.435245 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 14 11:11:22.436766 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.436746 2580 server.go:310] "Adding debug handlers to kubelet server" Jul 14 11:11:22.437902 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:22.437881 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 14 11:11:22.438836 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.438818 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-138.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 14 11:11:22.439386 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:22.439353 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 14 11:11:22.439420 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:22.439352 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-138.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 14 11:11:22.440254 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.440233 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 14 11:11:22.440254 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.440245 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 14 11:11:22.440413 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:22.440298 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-138.ec2.internal\" not found" Jul 14 11:11:22.440807 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.440789 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 14 11:11:22.440950 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.440937 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 14 11:11:22.441009 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.440955 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 14 11:11:22.441066 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.441038 2580 reconstruct.go:97] "Volume reconstruction finished" Jul 14 11:11:22.441066 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.441048 2580 reconciler.go:29] "Reconciler: start to sync state" Jul 14 11:11:22.441154 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.441090 2580 factory.go:55] Registering systemd factory Jul 14 11:11:22.441154 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.441105 2580 factory.go:223] Registration of the systemd container factory successfully Jul 14 11:11:22.442796 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.442770 2580 factory.go:153] Registering CRI-O factory Jul 14 11:11:22.442796 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.442789 2580 factory.go:223] Registration of the crio container factory successfully Jul 14 11:11:22.442933 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.442851 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 14 11:11:22.442933 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.442872 2580 factory.go:103] Registering Raw factory Jul 14 11:11:22.442933 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.442886 2580 manager.go:1196] Started watching for new ooms in manager Jul 14 11:11:22.443282 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.443248 2580 manager.go:349] Starting recovery of all containers Jul 14 11:11:22.444308 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:22.444276 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 14 11:11:22.445452 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:22.444379 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-138.ec2.internal.18c2238b07c24fcd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-138.ec2.internal,UID:ip-10-0-141-138.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-138.ec2.internal,},FirstTimestamp:2026-07-14 11:11:22.429738957 +0000 UTC m=+0.370566970,LastTimestamp:2026-07-14 11:11:22.429738957 +0000 UTC m=+0.370566970,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-138.ec2.internal,}" Jul 14 11:11:22.447190 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:22.447163 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-138.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 14 11:11:22.449455 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.449313 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 14 11:11:22.453269 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.453199 2580 manager.go:354] Recovery completed Jul 14 11:11:22.457967 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.457952 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:11:22.461759 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.461734 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-138.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:11:22.461827 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.461772 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-138.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:11:22.461827 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.461785 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-138.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:11:22.462270 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.462257 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 14 11:11:22.462342 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.462272 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 14 11:11:22.462342 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.462291 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 14 11:11:22.462342 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.462309 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:11:22.463464 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.463449 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vqfvl" Jul 14 11:11:22.463682 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.463659 2580 policy_none.go:49] "None policy: Start" Jul 14 11:11:22.463682 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.463674 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 14 11:11:22.463742 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.463684 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 14 11:11:22.464383 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:22.464316 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-138.ec2.internal.18c2238b09aae299 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-138.ec2.internal,UID:ip-10-0-141-138.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-138.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-138.ec2.internal,},FirstTimestamp:2026-07-14 11:11:22.461758105 +0000 UTC m=+0.402586119,LastTimestamp:2026-07-14 11:11:22.461758105 +0000 UTC m=+0.402586119,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-138.ec2.internal,}" Jul 14 11:11:22.464915 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.464903 2580 policy_none.go:47] "Start" Jul 14 11:11:22.465175 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.465158 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-138.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:11:22.465229 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.465198 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-138.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:11:22.465229 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.465218 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-138.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:11:22.474185 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:22.474089 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-138.ec2.internal.18c2238b09ab2ec9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-138.ec2.internal,UID:ip-10-0-141-138.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-138.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-138.ec2.internal,},FirstTimestamp:2026-07-14 11:11:22.461777609 +0000 UTC m=+0.402605622,LastTimestamp:2026-07-14 11:11:22.461777609 +0000 UTC m=+0.402605622,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-138.ec2.internal,}" Jul 14 11:11:22.480770 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.480752 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vqfvl" Jul 14 11:11:22.486779 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:22.486720 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-138.ec2.internal.18c2238b09ab587a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-138.ec2.internal,UID:ip-10-0-141-138.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-138.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-138.ec2.internal,},FirstTimestamp:2026-07-14 11:11:22.461788282 +0000 UTC m=+0.402616296,LastTimestamp:2026-07-14 11:11:22.461788282 +0000 UTC m=+0.402616296,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-138.ec2.internal,}" Jul 14 11:11:22.513149 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.513131 2580 manager.go:337] "Starting Device Plugin manager" Jul 14 11:11:22.513263 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:22.513175 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 14 11:11:22.513263 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.513188 2580 server.go:87] "Starting device plugin registration server" Jul 14 11:11:22.513463 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.513449 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 14 11:11:22.513529 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.513464 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 14 11:11:22.513596 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.513552 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 14 11:11:22.513649 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.513630 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 14 11:11:22.513649 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.513639 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 14 11:11:22.514163 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:22.514144 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 14 11:11:22.514225 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:22.514197 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-138.ec2.internal\" not found" Jul 14 11:11:22.601629 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.601565 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 14 11:11:22.601629 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.601613 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 14 11:11:22.601629 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.601639 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jul 14 11:11:22.602818 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:22.601681 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 14 11:11:22.605091 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.605074 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 11:11:22.614414 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.614399 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:11:22.615459 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.615433 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-138.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:11:22.615561 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.615466 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-138.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:11:22.615561 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.615478 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-138.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:11:22.615561 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.615499 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-138.ec2.internal" Jul 14 11:11:22.630294 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.630275 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-138.ec2.internal" Jul 14 11:11:22.630361 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:22.630297 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-138.ec2.internal\": node \"ip-10-0-141-138.ec2.internal\" not found" Jul 14 11:11:22.685516 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:22.685485 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-138.ec2.internal\" not found" Jul 14 11:11:22.702052 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.702026 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-138.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-138.ec2.internal"] Jul 14 11:11:22.702162 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.702110 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:11:22.703712 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.703696 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-138.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:11:22.703794 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.703731 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-138.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:11:22.703794 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.703747 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-138.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:11:22.704924 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.704913 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:11:22.705051 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.705037 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-138.ec2.internal" Jul 14 11:11:22.705087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.705066 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:11:22.705650 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.705623 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-138.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:11:22.705650 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.705635 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-138.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:11:22.705787 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.705656 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-138.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:11:22.705787 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.705658 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-138.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:11:22.705787 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.705667 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-138.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:11:22.705787 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.705675 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-138.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:11:22.706725 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.706709 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-138.ec2.internal" Jul 14 11:11:22.706768 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.706742 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:11:22.707350 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.707331 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-138.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:11:22.707427 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.707364 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-138.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:11:22.707427 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.707378 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-138.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:11:22.728079 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:22.728059 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-138.ec2.internal\" not found" node="ip-10-0-141-138.ec2.internal" Jul 14 11:11:22.732513 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:22.732498 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-138.ec2.internal\" not found" node="ip-10-0-141-138.ec2.internal" Jul 14 11:11:22.742743 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.742721 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/97ec19dc8784cd4e66084e3ae9d73ee5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-138.ec2.internal\" (UID: \"97ec19dc8784cd4e66084e3ae9d73ee5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-138.ec2.internal" Jul 14 11:11:22.742826 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.742749 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97ec19dc8784cd4e66084e3ae9d73ee5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-138.ec2.internal\" (UID: \"97ec19dc8784cd4e66084e3ae9d73ee5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-138.ec2.internal" Jul 14 11:11:22.742826 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.742767 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b34c804ba21769735646d070057ea2e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-138.ec2.internal\" (UID: \"3b34c804ba21769735646d070057ea2e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-138.ec2.internal" Jul 14 11:11:22.785996 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:22.785948 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-138.ec2.internal\" not found" Jul 14 11:11:22.843164 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.843129 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97ec19dc8784cd4e66084e3ae9d73ee5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-138.ec2.internal\" (UID: \"97ec19dc8784cd4e66084e3ae9d73ee5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-138.ec2.internal" Jul 14 11:11:22.843311 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.843171 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b34c804ba21769735646d070057ea2e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-138.ec2.internal\" (UID: \"3b34c804ba21769735646d070057ea2e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-138.ec2.internal" Jul 14 11:11:22.843311 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.843194 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/97ec19dc8784cd4e66084e3ae9d73ee5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-138.ec2.internal\" (UID: \"97ec19dc8784cd4e66084e3ae9d73ee5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-138.ec2.internal" Jul 14 11:11:22.843311 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.843234 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97ec19dc8784cd4e66084e3ae9d73ee5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-138.ec2.internal\" (UID: \"97ec19dc8784cd4e66084e3ae9d73ee5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-138.ec2.internal" Jul 14 11:11:22.843311 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.843246 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/97ec19dc8784cd4e66084e3ae9d73ee5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-138.ec2.internal\" (UID: \"97ec19dc8784cd4e66084e3ae9d73ee5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-138.ec2.internal" Jul 14 11:11:22.843311 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:22.843247 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b34c804ba21769735646d070057ea2e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-138.ec2.internal\" (UID: \"3b34c804ba21769735646d070057ea2e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-138.ec2.internal" Jul 14 11:11:22.886259 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:22.886192 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-138.ec2.internal\" not found" Jul 14 11:11:24.613171 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:24.613128 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-138.ec2.internal\" not found" Jul 14 11:11:24.657530 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:24.657487 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-138.ec2.internal" Jul 14 11:11:24.661512 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:24.661393 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-138.ec2.internal" Jul 14 11:11:24.713383 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:24.713352 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-138.ec2.internal\" not found" Jul 14 11:11:24.813894 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:24.813830 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-138.ec2.internal\" not found" Jul 14 11:11:24.914315 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:24.914286 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-138.ec2.internal\" not found" Jul 14 11:11:25.000892 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:25.000861 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 14 11:11:25.001490 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:25.001045 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 11:11:25.015165 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:25.015145 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-138.ec2.internal\" not found" Jul 14 11:11:25.111237 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:25.111206 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 11:06:24 +0000 UTC" deadline="2028-01-21 05:00:16.280350478 +0000 UTC" Jul 14 11:11:25.111377 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:25.111250 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13337h48m51.169104078s" Jul 14 11:11:25.115361 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:25.115341 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-138.ec2.internal\" not found" Jul 14 11:11:25.159510 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:25.159485 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 11:11:25.216135 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:25.216094 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-138.ec2.internal\" not found" Jul 14 11:11:25.264696 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:25.264666 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97ec19dc8784cd4e66084e3ae9d73ee5.slice/crio-f2271e837e5b410034ad385c6b2cda38e2321f46be07babe6954dcd77af590ca WatchSource:0}: Error finding container f2271e837e5b410034ad385c6b2cda38e2321f46be07babe6954dcd77af590ca: Status 404 returned error can't find the container with id f2271e837e5b410034ad385c6b2cda38e2321f46be07babe6954dcd77af590ca Jul 14 11:11:25.264932 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:25.264913 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b34c804ba21769735646d070057ea2e.slice/crio-6b586bf4a37e210d1f294900f19abc53c2332e61e3971ffd406879cd2b77a14a WatchSource:0}: Error finding container 6b586bf4a37e210d1f294900f19abc53c2332e61e3971ffd406879cd2b77a14a: Status 404 returned error can't find the container with id 6b586bf4a37e210d1f294900f19abc53c2332e61e3971ffd406879cd2b77a14a Jul 14 11:11:25.270693 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:25.270678 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 11:11:25.270890 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:25.270876 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:11:25.271930 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:25.271908 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-138.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:11:25.272025 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:25.271940 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-138.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:11:25.272025 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:25.271952 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-138.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:11:25.316467 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:25.316436 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-138.ec2.internal\" not found" Jul 14 11:11:25.416955 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:25.416892 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-138.ec2.internal\" not found" Jul 14 11:11:25.517565 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:25.517528 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-138.ec2.internal\" not found" Jul 14 11:11:25.599025 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:25.599000 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 11:11:25.618313 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:25.618279 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-138.ec2.internal\" not found" Jul 14 11:11:25.667084 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:25.667013 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 11:11:25.667262 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:25.667109 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-138.ec2.internal" Jul 14 11:11:25.683852 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:25.683824 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 11:11:25.684853 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:25.684834 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-138.ec2.internal" Jul 14 11:11:25.696482 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:25.696458 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 11:11:26.047525 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.047453 2580 apiserver.go:52] "Watching apiserver" Jul 14 11:11:26.056881 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.056846 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 14 11:11:26.058366 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.057934 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-s6hzg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-138.ec2.internal","openshift-multus/multus-5z692","openshift-multus/multus-additional-cni-plugins-g4jtd","openshift-multus/network-metrics-daemon-q2stq","kube-system/kube-apiserver-proxy-ip-10-0-141-138.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv","openshift-image-registry/node-ca-hvb4s","openshift-network-diagnostics/network-check-target-pkpr6","openshift-network-operator/iptables-alerter-s2nwz","openshift-ovn-kubernetes/ovnkube-node-ndktj","kube-system/global-pull-secret-syncer-lzzhb","kube-system/konnectivity-agent-qjq7w","openshift-cluster-node-tuning-operator/tuned-s5d9z"] Jul 14 11:11:26.060323 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.059356 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" Jul 14 11:11:26.060629 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.060591 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qjq7w" Jul 14 11:11:26.061810 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.061780 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5z692" Jul 14 11:11:26.062131 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.062108 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 14 11:11:26.065069 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.062493 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 14 11:11:26.065069 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.062730 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4pr82\"" Jul 14 11:11:26.065069 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.062889 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 14 11:11:26.065069 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.063219 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g4jtd" Jul 14 11:11:26.065069 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.064225 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 14 11:11:26.065069 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.064706 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:26.065069 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:26.064796 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2stq" podUID="d333f07a-92a3-4c63-8f62-5a5eec2496b7" Jul 14 11:11:26.065544 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.065528 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9r85h\"" Jul 14 11:11:26.065616 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.065583 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 14 11:11:26.065797 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.065781 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 14 11:11:26.065872 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.065808 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 14 11:11:26.066041 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.066020 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 14 11:11:26.066215 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.066200 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 14 11:11:26.066412 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.066398 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.066630 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.066612 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jkjgp\"" Jul 14 11:11:26.066870 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.066854 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 14 11:11:26.066948 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.066871 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 14 11:11:26.067122 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.067059 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ph787\"" Jul 14 11:11:26.067211 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.067191 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 14 11:11:26.067828 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.067742 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:11:26.067828 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:26.067806 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkpr6" podUID="53bd384d-a054-45b7-83a6-e18ea91b6567" Jul 14 11:11:26.069446 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.069253 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s6hzg" Jul 14 11:11:26.070943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.070927 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hvb4s" Jul 14 11:11:26.072739 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.072713 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s2nwz" Jul 14 11:11:26.075678 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.074378 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.075678 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.075649 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:26.075812 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:26.075711 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzzhb" podUID="4432fb72-2ee9-49e5-bc93-73462d52ed6e" Jul 14 11:11:26.076366 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.076264 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 14 11:11:26.076461 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.076376 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pd8nn\"" Jul 14 11:11:26.076993 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.076976 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 14 11:11:26.078830 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.078505 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52kqv\" (UniqueName: \"kubernetes.io/projected/71534e4d-e566-4147-9654-a966dc87100e-kube-api-access-52kqv\") pod \"aws-ebs-csi-driver-node-slkvv\" (UID: \"71534e4d-e566-4147-9654-a966dc87100e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" Jul 14 11:11:26.078830 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.078527 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-multus-conf-dir\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.078830 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.078551 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-os-release\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.078830 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.078568 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4b66bf7-506a-4e2e-bcca-3b29f9b7b5df-tmp-dir\") pod \"node-resolver-s6hzg\" (UID: \"e4b66bf7-506a-4e2e-bcca-3b29f9b7b5df\") " pod="openshift-dns/node-resolver-s6hzg" Jul 14 11:11:26.078830 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.078590 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/71534e4d-e566-4147-9654-a966dc87100e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-slkvv\" (UID: \"71534e4d-e566-4147-9654-a966dc87100e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" Jul 14 11:11:26.078830 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.078610 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-etc-kubernetes\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.078830 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.078650 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-run\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.078830 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.078687 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj5jr\" (UniqueName: \"kubernetes.io/projected/53bd384d-a054-45b7-83a6-e18ea91b6567-kube-api-access-qj5jr\") pod \"network-check-target-pkpr6\" (UID: \"53bd384d-a054-45b7-83a6-e18ea91b6567\") " pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:11:26.078830 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.078805 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-host-var-lib-cni-bin\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.078830 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.078830 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-host-var-lib-kubelet\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.079292 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.078856 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-etc-tuned\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.079292 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.078885 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-etc-sysconfig\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.079292 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.078913 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-sys\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.079292 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.078934 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-host\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.079292 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.078975 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/71534e4d-e566-4147-9654-a966dc87100e-registration-dir\") pod \"aws-ebs-csi-driver-node-slkvv\" (UID: \"71534e4d-e566-4147-9654-a966dc87100e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" Jul 14 11:11:26.079292 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.079007 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dklx\" (UniqueName: \"kubernetes.io/projected/d333f07a-92a3-4c63-8f62-5a5eec2496b7-kube-api-access-4dklx\") pod \"network-metrics-daemon-q2stq\" (UID: \"d333f07a-92a3-4c63-8f62-5a5eec2496b7\") " pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:26.079292 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.079034 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nz7v\" (UniqueName: \"kubernetes.io/projected/e4b66bf7-506a-4e2e-bcca-3b29f9b7b5df-kube-api-access-5nz7v\") pod \"node-resolver-s6hzg\" (UID: \"e4b66bf7-506a-4e2e-bcca-3b29f9b7b5df\") " pod="openshift-dns/node-resolver-s6hzg" Jul 14 11:11:26.079292 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.079070 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-multus-cni-dir\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.079292 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.079092 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/71534e4d-e566-4147-9654-a966dc87100e-sys-fs\") pod \"aws-ebs-csi-driver-node-slkvv\" (UID: \"71534e4d-e566-4147-9654-a966dc87100e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" Jul 14 11:11:26.079292 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.079122 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a8dc1f8e-58c9-4aac-994a-95422c85bad5-konnectivity-ca\") pod \"konnectivity-agent-qjq7w\" (UID: \"a8dc1f8e-58c9-4aac-994a-95422c85bad5\") " pod="kube-system/konnectivity-agent-qjq7w" Jul 14 11:11:26.079292 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.079137 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/912fc3c9-3b68-4149-a747-635958c35d35-cni-binary-copy\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.079292 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.079170 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-host-run-k8s-cni-cncf-io\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.079292 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.079201 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmlfh\" (UniqueName: \"kubernetes.io/projected/69c7be6f-e4a5-4d78-9f39-418ad8ad136a-kube-api-access-dmlfh\") pod \"multus-additional-cni-plugins-g4jtd\" (UID: \"69c7be6f-e4a5-4d78-9f39-418ad8ad136a\") " pod="openshift-multus/multus-additional-cni-plugins-g4jtd" Jul 14 11:11:26.079292 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.079225 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-etc-modprobe-d\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.079292 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.079271 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-host-run-netns\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.079831 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.079560 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69c7be6f-e4a5-4d78-9f39-418ad8ad136a-system-cni-dir\") pod \"multus-additional-cni-plugins-g4jtd\" (UID: \"69c7be6f-e4a5-4d78-9f39-418ad8ad136a\") " pod="openshift-multus/multus-additional-cni-plugins-g4jtd" Jul 14 11:11:26.079831 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.079585 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69c7be6f-e4a5-4d78-9f39-418ad8ad136a-cni-binary-copy\") pod \"multus-additional-cni-plugins-g4jtd\" (UID: \"69c7be6f-e4a5-4d78-9f39-418ad8ad136a\") " pod="openshift-multus/multus-additional-cni-plugins-g4jtd" Jul 14 11:11:26.079831 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.079615 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-var-lib-kubelet\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.079831 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.079655 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/912fc3c9-3b68-4149-a747-635958c35d35-multus-daemon-config\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.079831 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.079685 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/69c7be6f-e4a5-4d78-9f39-418ad8ad136a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g4jtd\" (UID: \"69c7be6f-e4a5-4d78-9f39-418ad8ad136a\") " pod="openshift-multus/multus-additional-cni-plugins-g4jtd" Jul 14 11:11:26.079831 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.079719 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-etc-sysctl-d\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.079831 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.079743 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-cnibin\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.079831 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.079765 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-etc-kubernetes\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.079831 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.079798 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a8dc1f8e-58c9-4aac-994a-95422c85bad5-agent-certs\") pod \"konnectivity-agent-qjq7w\" (UID: \"a8dc1f8e-58c9-4aac-994a-95422c85bad5\") " pod="kube-system/konnectivity-agent-qjq7w" Jul 14 11:11:26.079831 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.079820 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-host-var-lib-cni-multus\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.079831 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.079836 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69c7be6f-e4a5-4d78-9f39-418ad8ad136a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g4jtd\" (UID: \"69c7be6f-e4a5-4d78-9f39-418ad8ad136a\") " pod="openshift-multus/multus-additional-cni-plugins-g4jtd" Jul 14 11:11:26.080254 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.079863 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-lib-modules\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.080254 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.079885 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpmgc\" (UniqueName: \"kubernetes.io/projected/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-kube-api-access-vpmgc\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.080254 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.079906 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggjl2\" (UniqueName: \"kubernetes.io/projected/912fc3c9-3b68-4149-a747-635958c35d35-kube-api-access-ggjl2\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.080254 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.079932 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-etc-sysctl-conf\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.080254 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.079946 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-etc-systemd\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.080254 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.079990 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e4b66bf7-506a-4e2e-bcca-3b29f9b7b5df-hosts-file\") pod \"node-resolver-s6hzg\" (UID: \"e4b66bf7-506a-4e2e-bcca-3b29f9b7b5df\") " pod="openshift-dns/node-resolver-s6hzg" Jul 14 11:11:26.080254 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.080028 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69c7be6f-e4a5-4d78-9f39-418ad8ad136a-os-release\") pod \"multus-additional-cni-plugins-g4jtd\" (UID: \"69c7be6f-e4a5-4d78-9f39-418ad8ad136a\") " pod="openshift-multus/multus-additional-cni-plugins-g4jtd" Jul 14 11:11:26.080254 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.080061 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/69c7be6f-e4a5-4d78-9f39-418ad8ad136a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g4jtd\" (UID: \"69c7be6f-e4a5-4d78-9f39-418ad8ad136a\") " pod="openshift-multus/multus-additional-cni-plugins-g4jtd" Jul 14 11:11:26.080254 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.080088 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-tmp\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.080254 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.080111 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-multus-socket-dir-parent\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.080254 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.080149 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/71534e4d-e566-4147-9654-a966dc87100e-etc-selinux\") pod \"aws-ebs-csi-driver-node-slkvv\" (UID: \"71534e4d-e566-4147-9654-a966dc87100e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" Jul 14 11:11:26.080254 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.080167 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-hostroot\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.080254 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.080181 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/71534e4d-e566-4147-9654-a966dc87100e-socket-dir\") pod \"aws-ebs-csi-driver-node-slkvv\" (UID: \"71534e4d-e566-4147-9654-a966dc87100e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" Jul 14 11:11:26.080254 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.080195 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/71534e4d-e566-4147-9654-a966dc87100e-device-dir\") pod \"aws-ebs-csi-driver-node-slkvv\" (UID: \"71534e4d-e566-4147-9654-a966dc87100e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" Jul 14 11:11:26.080254 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.080209 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs\") pod \"network-metrics-daemon-q2stq\" (UID: \"d333f07a-92a3-4c63-8f62-5a5eec2496b7\") " pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:26.080683 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.080260 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69c7be6f-e4a5-4d78-9f39-418ad8ad136a-cnibin\") pod \"multus-additional-cni-plugins-g4jtd\" (UID: \"69c7be6f-e4a5-4d78-9f39-418ad8ad136a\") " pod="openshift-multus/multus-additional-cni-plugins-g4jtd" Jul 14 11:11:26.080683 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.080277 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-system-cni-dir\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.080683 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.080291 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-host-run-multus-certs\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.081197 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.081035 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 14 11:11:26.081197 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.081075 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 14 11:11:26.081197 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.081076 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 14 11:11:26.081197 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.081077 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 14 11:11:26.081197 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.081079 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 14 11:11:26.081197 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.081107 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 14 11:11:26.081197 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.081185 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-46tk9\"" Jul 14 11:11:26.082336 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.082302 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6c78x\"" Jul 14 11:11:26.082336 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.082325 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 14 11:11:26.082473 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.082328 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 14 11:11:26.082473 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.082308 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 14 11:11:26.082473 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.082404 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 14 11:11:26.088850 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.088830 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 14 11:11:26.090118 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.090092 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 14 11:11:26.090386 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.090366 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 14 11:11:26.090846 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.090652 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 14 11:11:26.090846 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.090681 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-npkh5\"" Jul 14 11:11:26.091400 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.091223 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rgkcg\"" Jul 14 11:11:26.107857 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.107829 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 11:11:26.142822 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.142798 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xncx6" Jul 14 11:11:26.152860 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.152837 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xncx6" Jul 14 11:11:26.168782 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.168757 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 14 11:11:26.180881 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.180850 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a8dc1f8e-58c9-4aac-994a-95422c85bad5-agent-certs\") pod \"konnectivity-agent-qjq7w\" (UID: \"a8dc1f8e-58c9-4aac-994a-95422c85bad5\") " pod="kube-system/konnectivity-agent-qjq7w" Jul 14 11:11:26.180881 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.180881 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-host-var-lib-cni-multus\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.181082 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.180901 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69c7be6f-e4a5-4d78-9f39-418ad8ad136a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g4jtd\" (UID: \"69c7be6f-e4a5-4d78-9f39-418ad8ad136a\") " pod="openshift-multus/multus-additional-cni-plugins-g4jtd" Jul 14 11:11:26.181082 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.180922 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-lib-modules\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.181082 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.180940 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpmgc\" (UniqueName: \"kubernetes.io/projected/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-kube-api-access-vpmgc\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.181082 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.180960 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-host-cni-bin\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.181082 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.180985 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-ovnkube-script-lib\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.181082 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181019 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggjl2\" (UniqueName: \"kubernetes.io/projected/912fc3c9-3b68-4149-a747-635958c35d35-kube-api-access-ggjl2\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.181082 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181044 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-etc-sysctl-conf\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.181082 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181067 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-etc-systemd\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.181494 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181090 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-run-ovn\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.181494 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181110 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e4b66bf7-506a-4e2e-bcca-3b29f9b7b5df-hosts-file\") pod \"node-resolver-s6hzg\" (UID: \"e4b66bf7-506a-4e2e-bcca-3b29f9b7b5df\") " pod="openshift-dns/node-resolver-s6hzg" Jul 14 11:11:26.181494 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181132 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c9729993-471c-42e3-8723-7c1982f23e0a-serviceca\") pod \"node-ca-hvb4s\" (UID: \"c9729993-471c-42e3-8723-7c1982f23e0a\") " pod="openshift-image-registry/node-ca-hvb4s" Jul 14 11:11:26.181494 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181155 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-var-lib-openvswitch\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.181494 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181180 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69c7be6f-e4a5-4d78-9f39-418ad8ad136a-os-release\") pod \"multus-additional-cni-plugins-g4jtd\" (UID: \"69c7be6f-e4a5-4d78-9f39-418ad8ad136a\") " pod="openshift-multus/multus-additional-cni-plugins-g4jtd" Jul 14 11:11:26.181494 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181202 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/69c7be6f-e4a5-4d78-9f39-418ad8ad136a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g4jtd\" (UID: \"69c7be6f-e4a5-4d78-9f39-418ad8ad136a\") " pod="openshift-multus/multus-additional-cni-plugins-g4jtd" Jul 14 11:11:26.181494 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181244 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-tmp\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.181494 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181266 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-multus-socket-dir-parent\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.181494 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181282 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/71534e4d-e566-4147-9654-a966dc87100e-etc-selinux\") pod \"aws-ebs-csi-driver-node-slkvv\" (UID: \"71534e4d-e566-4147-9654-a966dc87100e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" Jul 14 11:11:26.181494 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181296 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-hostroot\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.181494 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181310 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4432fb72-2ee9-49e5-bc93-73462d52ed6e-dbus\") pod \"global-pull-secret-syncer-lzzhb\" (UID: \"4432fb72-2ee9-49e5-bc93-73462d52ed6e\") " pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:26.181494 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181326 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-host-run-ovn-kubernetes\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.181494 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181340 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/71534e4d-e566-4147-9654-a966dc87100e-socket-dir\") pod \"aws-ebs-csi-driver-node-slkvv\" (UID: \"71534e4d-e566-4147-9654-a966dc87100e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" Jul 14 11:11:26.181494 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181357 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/71534e4d-e566-4147-9654-a966dc87100e-device-dir\") pod \"aws-ebs-csi-driver-node-slkvv\" (UID: \"71534e4d-e566-4147-9654-a966dc87100e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" Jul 14 11:11:26.181494 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181372 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs\") pod \"network-metrics-daemon-q2stq\" (UID: \"d333f07a-92a3-4c63-8f62-5a5eec2496b7\") " pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:26.181494 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181395 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69c7be6f-e4a5-4d78-9f39-418ad8ad136a-cnibin\") pod \"multus-additional-cni-plugins-g4jtd\" (UID: \"69c7be6f-e4a5-4d78-9f39-418ad8ad136a\") " pod="openshift-multus/multus-additional-cni-plugins-g4jtd" Jul 14 11:11:26.181494 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181425 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkmwl\" (UniqueName: \"kubernetes.io/projected/c9729993-471c-42e3-8723-7c1982f23e0a-kube-api-access-gkmwl\") pod \"node-ca-hvb4s\" (UID: \"c9729993-471c-42e3-8723-7c1982f23e0a\") " pod="openshift-image-registry/node-ca-hvb4s" Jul 14 11:11:26.182309 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181455 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f7ac09b-952a-4a9d-9500-9706d77b1db3-host-slash\") pod \"iptables-alerter-s2nwz\" (UID: \"4f7ac09b-952a-4a9d-9500-9706d77b1db3\") " pod="openshift-network-operator/iptables-alerter-s2nwz" Jul 14 11:11:26.182309 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181477 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-run-openvswitch\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.182309 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181492 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-log-socket\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.182309 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181507 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-system-cni-dir\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.182309 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181522 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-host-run-multus-certs\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.182309 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181536 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-host-slash\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.182309 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181554 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-host-run-netns\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.182309 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181572 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-env-overrides\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.182309 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181589 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52kqv\" (UniqueName: \"kubernetes.io/projected/71534e4d-e566-4147-9654-a966dc87100e-kube-api-access-52kqv\") pod \"aws-ebs-csi-driver-node-slkvv\" (UID: \"71534e4d-e566-4147-9654-a966dc87100e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" Jul 14 11:11:26.182309 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181609 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-multus-conf-dir\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.182309 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181632 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhfck\" (UniqueName: \"kubernetes.io/projected/4f7ac09b-952a-4a9d-9500-9706d77b1db3-kube-api-access-rhfck\") pod \"iptables-alerter-s2nwz\" (UID: \"4f7ac09b-952a-4a9d-9500-9706d77b1db3\") " pod="openshift-network-operator/iptables-alerter-s2nwz" Jul 14 11:11:26.182309 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181652 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-run-systemd\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.182309 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181667 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-host-cni-netd\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.182309 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181682 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.182309 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181698 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-os-release\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.182309 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181714 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4b66bf7-506a-4e2e-bcca-3b29f9b7b5df-tmp-dir\") pod \"node-resolver-s6hzg\" (UID: \"e4b66bf7-506a-4e2e-bcca-3b29f9b7b5df\") " pod="openshift-dns/node-resolver-s6hzg" Jul 14 11:11:26.182309 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181728 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-node-log\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.183111 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181748 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/71534e4d-e566-4147-9654-a966dc87100e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-slkvv\" (UID: \"71534e4d-e566-4147-9654-a966dc87100e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" Jul 14 11:11:26.183111 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181772 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-etc-kubernetes\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.183111 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181787 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-run\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.183111 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181810 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-ovn-node-metrics-cert\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.183111 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181834 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj5jr\" (UniqueName: \"kubernetes.io/projected/53bd384d-a054-45b7-83a6-e18ea91b6567-kube-api-access-qj5jr\") pod \"network-check-target-pkpr6\" (UID: \"53bd384d-a054-45b7-83a6-e18ea91b6567\") " pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:11:26.183111 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181850 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-host-var-lib-cni-bin\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.183111 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181867 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-host-var-lib-kubelet\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.183111 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181881 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-etc-tuned\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.183111 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181900 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-etc-sysconfig\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.183111 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181914 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-sys\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.183111 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181927 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-host\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.183111 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181943 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/71534e4d-e566-4147-9654-a966dc87100e-registration-dir\") pod \"aws-ebs-csi-driver-node-slkvv\" (UID: \"71534e4d-e566-4147-9654-a966dc87100e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" Jul 14 11:11:26.183111 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181958 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dklx\" (UniqueName: \"kubernetes.io/projected/d333f07a-92a3-4c63-8f62-5a5eec2496b7-kube-api-access-4dklx\") pod \"network-metrics-daemon-q2stq\" (UID: \"d333f07a-92a3-4c63-8f62-5a5eec2496b7\") " pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:26.183111 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181974 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nz7v\" (UniqueName: \"kubernetes.io/projected/e4b66bf7-506a-4e2e-bcca-3b29f9b7b5df-kube-api-access-5nz7v\") pod \"node-resolver-s6hzg\" (UID: \"e4b66bf7-506a-4e2e-bcca-3b29f9b7b5df\") " pod="openshift-dns/node-resolver-s6hzg" Jul 14 11:11:26.183111 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.181989 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-multus-cni-dir\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.183111 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.182006 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/71534e4d-e566-4147-9654-a966dc87100e-sys-fs\") pod \"aws-ebs-csi-driver-node-slkvv\" (UID: \"71534e4d-e566-4147-9654-a966dc87100e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" Jul 14 11:11:26.183111 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.182021 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a8dc1f8e-58c9-4aac-994a-95422c85bad5-konnectivity-ca\") pod \"konnectivity-agent-qjq7w\" (UID: \"a8dc1f8e-58c9-4aac-994a-95422c85bad5\") " pod="kube-system/konnectivity-agent-qjq7w" Jul 14 11:11:26.183651 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.182036 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/912fc3c9-3b68-4149-a747-635958c35d35-cni-binary-copy\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.183651 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.182060 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-host-run-k8s-cni-cncf-io\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.183651 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.182086 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmlfh\" (UniqueName: \"kubernetes.io/projected/69c7be6f-e4a5-4d78-9f39-418ad8ad136a-kube-api-access-dmlfh\") pod \"multus-additional-cni-plugins-g4jtd\" (UID: \"69c7be6f-e4a5-4d78-9f39-418ad8ad136a\") " pod="openshift-multus/multus-additional-cni-plugins-g4jtd" Jul 14 11:11:26.183651 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.182102 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-etc-modprobe-d\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.183651 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.182120 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9729993-471c-42e3-8723-7c1982f23e0a-host\") pod \"node-ca-hvb4s\" (UID: \"c9729993-471c-42e3-8723-7c1982f23e0a\") " pod="openshift-image-registry/node-ca-hvb4s" Jul 14 11:11:26.183651 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.182135 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4432fb72-2ee9-49e5-bc93-73462d52ed6e-kubelet-config\") pod \"global-pull-secret-syncer-lzzhb\" (UID: \"4432fb72-2ee9-49e5-bc93-73462d52ed6e\") " pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:26.183651 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.182153 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-host-run-netns\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.183651 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.182175 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69c7be6f-e4a5-4d78-9f39-418ad8ad136a-system-cni-dir\") pod \"multus-additional-cni-plugins-g4jtd\" (UID: \"69c7be6f-e4a5-4d78-9f39-418ad8ad136a\") " pod="openshift-multus/multus-additional-cni-plugins-g4jtd" Jul 14 11:11:26.183651 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.182192 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69c7be6f-e4a5-4d78-9f39-418ad8ad136a-cni-binary-copy\") pod \"multus-additional-cni-plugins-g4jtd\" (UID: \"69c7be6f-e4a5-4d78-9f39-418ad8ad136a\") " pod="openshift-multus/multus-additional-cni-plugins-g4jtd" Jul 14 11:11:26.183651 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.182215 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-var-lib-kubelet\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.183651 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.182243 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-host-kubelet\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.183651 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.182260 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-systemd-units\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.183651 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.182275 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/912fc3c9-3b68-4149-a747-635958c35d35-multus-daemon-config\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.183651 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.182291 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/69c7be6f-e4a5-4d78-9f39-418ad8ad136a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g4jtd\" (UID: \"69c7be6f-e4a5-4d78-9f39-418ad8ad136a\") " pod="openshift-multus/multus-additional-cni-plugins-g4jtd" Jul 14 11:11:26.183651 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.182312 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-etc-sysctl-d\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.183651 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.182344 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4432fb72-2ee9-49e5-bc93-73462d52ed6e-original-pull-secret\") pod \"global-pull-secret-syncer-lzzhb\" (UID: \"4432fb72-2ee9-49e5-bc93-73462d52ed6e\") " pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:26.183651 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.182362 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4f7ac09b-952a-4a9d-9500-9706d77b1db3-iptables-alerter-script\") pod \"iptables-alerter-s2nwz\" (UID: \"4f7ac09b-952a-4a9d-9500-9706d77b1db3\") " pod="openshift-network-operator/iptables-alerter-s2nwz" Jul 14 11:11:26.184560 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.182377 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-ovnkube-config\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.184560 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.182393 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-cnibin\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.184560 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.182411 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-etc-kubernetes\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.184560 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.182428 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-etc-openvswitch\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.184560 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.182445 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qr8v\" (UniqueName: \"kubernetes.io/projected/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-kube-api-access-6qr8v\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.184560 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.182767 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 14 11:11:26.184560 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.183067 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-os-release\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.184560 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.183302 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-host-run-netns\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.184560 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.183294 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-host-run-k8s-cni-cncf-io\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.184560 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.183330 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-host-run-multus-certs\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.184560 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.183353 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e4b66bf7-506a-4e2e-bcca-3b29f9b7b5df-hosts-file\") pod \"node-resolver-s6hzg\" (UID: \"e4b66bf7-506a-4e2e-bcca-3b29f9b7b5df\") " pod="openshift-dns/node-resolver-s6hzg" Jul 14 11:11:26.184560 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.183365 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69c7be6f-e4a5-4d78-9f39-418ad8ad136a-system-cni-dir\") pod \"multus-additional-cni-plugins-g4jtd\" (UID: \"69c7be6f-e4a5-4d78-9f39-418ad8ad136a\") " pod="openshift-multus/multus-additional-cni-plugins-g4jtd" Jul 14 11:11:26.184560 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.183449 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-etc-modprobe-d\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.184560 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.183485 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-etc-kubernetes\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.184560 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.183583 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-etc-sysctl-d\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.184560 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.183593 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-multus-socket-dir-parent\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.184560 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.183639 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-var-lib-kubelet\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.184560 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.183678 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/912fc3c9-3b68-4149-a747-635958c35d35-cni-binary-copy\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.185462 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.183686 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-host-var-lib-cni-multus\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.185462 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.183771 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/71534e4d-e566-4147-9654-a966dc87100e-socket-dir\") pod \"aws-ebs-csi-driver-node-slkvv\" (UID: \"71534e4d-e566-4147-9654-a966dc87100e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" Jul 14 11:11:26.185462 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.183762 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69c7be6f-e4a5-4d78-9f39-418ad8ad136a-cnibin\") pod \"multus-additional-cni-plugins-g4jtd\" (UID: \"69c7be6f-e4a5-4d78-9f39-418ad8ad136a\") " pod="openshift-multus/multus-additional-cni-plugins-g4jtd" Jul 14 11:11:26.185462 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.183830 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-cnibin\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.185462 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.184015 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69c7be6f-e4a5-4d78-9f39-418ad8ad136a-cni-binary-copy\") pod \"multus-additional-cni-plugins-g4jtd\" (UID: \"69c7be6f-e4a5-4d78-9f39-418ad8ad136a\") " pod="openshift-multus/multus-additional-cni-plugins-g4jtd" Jul 14 11:11:26.185462 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.184051 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-multus-conf-dir\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.185462 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.184082 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69c7be6f-e4a5-4d78-9f39-418ad8ad136a-os-release\") pod \"multus-additional-cni-plugins-g4jtd\" (UID: \"69c7be6f-e4a5-4d78-9f39-418ad8ad136a\") " pod="openshift-multus/multus-additional-cni-plugins-g4jtd" Jul 14 11:11:26.185462 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.184108 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/71534e4d-e566-4147-9654-a966dc87100e-etc-selinux\") pod \"aws-ebs-csi-driver-node-slkvv\" (UID: \"71534e4d-e566-4147-9654-a966dc87100e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" Jul 14 11:11:26.185462 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.184132 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-hostroot\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.185462 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.184181 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/912fc3c9-3b68-4149-a747-635958c35d35-multus-daemon-config\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.185462 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.184196 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-etc-sysctl-conf\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.185462 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.184259 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-etc-kubernetes\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.185462 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.184307 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-host-var-lib-kubelet\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.185462 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.184326 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69c7be6f-e4a5-4d78-9f39-418ad8ad136a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g4jtd\" (UID: \"69c7be6f-e4a5-4d78-9f39-418ad8ad136a\") " pod="openshift-multus/multus-additional-cni-plugins-g4jtd" Jul 14 11:11:26.185462 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.184363 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-sys\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.185462 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.184408 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-host-var-lib-cni-bin\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.185462 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.184420 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-lib-modules\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.185462 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.184461 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/71534e4d-e566-4147-9654-a966dc87100e-device-dir\") pod \"aws-ebs-csi-driver-node-slkvv\" (UID: \"71534e4d-e566-4147-9654-a966dc87100e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" Jul 14 11:11:26.186331 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.184497 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4b66bf7-506a-4e2e-bcca-3b29f9b7b5df-tmp-dir\") pod \"node-resolver-s6hzg\" (UID: \"e4b66bf7-506a-4e2e-bcca-3b29f9b7b5df\") " pod="openshift-dns/node-resolver-s6hzg" Jul 14 11:11:26.186331 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.184561 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-host\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.186331 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.184625 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-etc-sysconfig\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.186331 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.184650 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-run\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.186331 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.184674 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/71534e4d-e566-4147-9654-a966dc87100e-registration-dir\") pod \"aws-ebs-csi-driver-node-slkvv\" (UID: \"71534e4d-e566-4147-9654-a966dc87100e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" Jul 14 11:11:26.186331 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.184712 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/71534e4d-e566-4147-9654-a966dc87100e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-slkvv\" (UID: \"71534e4d-e566-4147-9654-a966dc87100e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" Jul 14 11:11:26.186331 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:26.184713 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:26.186331 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.184787 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-multus-cni-dir\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.186331 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:26.184846 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs podName:d333f07a-92a3-4c63-8f62-5a5eec2496b7 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:26.684824383 +0000 UTC m=+2.998957880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs") pod "network-metrics-daemon-q2stq" (UID: "d333f07a-92a3-4c63-8f62-5a5eec2496b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:26.186331 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.184885 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/69c7be6f-e4a5-4d78-9f39-418ad8ad136a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g4jtd\" (UID: \"69c7be6f-e4a5-4d78-9f39-418ad8ad136a\") " pod="openshift-multus/multus-additional-cni-plugins-g4jtd" Jul 14 11:11:26.186331 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.184944 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/71534e4d-e566-4147-9654-a966dc87100e-sys-fs\") pod \"aws-ebs-csi-driver-node-slkvv\" (UID: \"71534e4d-e566-4147-9654-a966dc87100e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" Jul 14 11:11:26.186331 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.184993 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/912fc3c9-3b68-4149-a747-635958c35d35-system-cni-dir\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.186331 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.184993 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-etc-systemd\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.186331 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.185177 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a8dc1f8e-58c9-4aac-994a-95422c85bad5-konnectivity-ca\") pod \"konnectivity-agent-qjq7w\" (UID: \"a8dc1f8e-58c9-4aac-994a-95422c85bad5\") " pod="kube-system/konnectivity-agent-qjq7w" Jul 14 11:11:26.187002 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.186365 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a8dc1f8e-58c9-4aac-994a-95422c85bad5-agent-certs\") pod \"konnectivity-agent-qjq7w\" (UID: \"a8dc1f8e-58c9-4aac-994a-95422c85bad5\") " pod="kube-system/konnectivity-agent-qjq7w" Jul 14 11:11:26.187002 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.186461 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-tmp\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.187002 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.186508 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-etc-tuned\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.187149 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.187071 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/69c7be6f-e4a5-4d78-9f39-418ad8ad136a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g4jtd\" (UID: \"69c7be6f-e4a5-4d78-9f39-418ad8ad136a\") " pod="openshift-multus/multus-additional-cni-plugins-g4jtd" Jul 14 11:11:26.193102 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.192608 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggjl2\" (UniqueName: \"kubernetes.io/projected/912fc3c9-3b68-4149-a747-635958c35d35-kube-api-access-ggjl2\") pod \"multus-5z692\" (UID: \"912fc3c9-3b68-4149-a747-635958c35d35\") " pod="openshift-multus/multus-5z692" Jul 14 11:11:26.193102 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:26.193090 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:11:26.193342 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:26.193117 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:11:26.193342 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:26.193131 2580 projected.go:196] Error preparing data for projected volume kube-api-access-qj5jr for pod openshift-network-diagnostics/network-check-target-pkpr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:26.193342 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:26.193193 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53bd384d-a054-45b7-83a6-e18ea91b6567-kube-api-access-qj5jr podName:53bd384d-a054-45b7-83a6-e18ea91b6567 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:26.693174453 +0000 UTC m=+3.007308162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qj5jr" (UniqueName: "kubernetes.io/projected/53bd384d-a054-45b7-83a6-e18ea91b6567-kube-api-access-qj5jr") pod "network-check-target-pkpr6" (UID: "53bd384d-a054-45b7-83a6-e18ea91b6567") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:26.194217 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.194191 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52kqv\" (UniqueName: \"kubernetes.io/projected/71534e4d-e566-4147-9654-a966dc87100e-kube-api-access-52kqv\") pod \"aws-ebs-csi-driver-node-slkvv\" (UID: \"71534e4d-e566-4147-9654-a966dc87100e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" Jul 14 11:11:26.194705 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.194680 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmlfh\" (UniqueName: \"kubernetes.io/projected/69c7be6f-e4a5-4d78-9f39-418ad8ad136a-kube-api-access-dmlfh\") pod \"multus-additional-cni-plugins-g4jtd\" (UID: \"69c7be6f-e4a5-4d78-9f39-418ad8ad136a\") " pod="openshift-multus/multus-additional-cni-plugins-g4jtd" Jul 14 11:11:26.195902 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.195877 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpmgc\" (UniqueName: \"kubernetes.io/projected/690e6cee-8e09-4149-8cbc-c7d5d4e0d268-kube-api-access-vpmgc\") pod \"tuned-s5d9z\" (UID: \"690e6cee-8e09-4149-8cbc-c7d5d4e0d268\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.197187 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.197165 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nz7v\" (UniqueName: \"kubernetes.io/projected/e4b66bf7-506a-4e2e-bcca-3b29f9b7b5df-kube-api-access-5nz7v\") pod \"node-resolver-s6hzg\" (UID: \"e4b66bf7-506a-4e2e-bcca-3b29f9b7b5df\") " pod="openshift-dns/node-resolver-s6hzg" Jul 14 11:11:26.197611 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.197592 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dklx\" (UniqueName: \"kubernetes.io/projected/d333f07a-92a3-4c63-8f62-5a5eec2496b7-kube-api-access-4dklx\") pod \"network-metrics-daemon-q2stq\" (UID: \"d333f07a-92a3-4c63-8f62-5a5eec2496b7\") " pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:26.235633 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.235576 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-138.ec2.internal" event={"ID":"3b34c804ba21769735646d070057ea2e","Type":"ContainerStarted","Data":"6b586bf4a37e210d1f294900f19abc53c2332e61e3971ffd406879cd2b77a14a"} Jul 14 11:11:26.237430 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.237396 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-138.ec2.internal" event={"ID":"97ec19dc8784cd4e66084e3ae9d73ee5","Type":"ContainerStarted","Data":"f2271e837e5b410034ad385c6b2cda38e2321f46be07babe6954dcd77af590ca"} Jul 14 11:11:26.283484 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.283452 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9729993-471c-42e3-8723-7c1982f23e0a-host\") pod \"node-ca-hvb4s\" (UID: \"c9729993-471c-42e3-8723-7c1982f23e0a\") " pod="openshift-image-registry/node-ca-hvb4s" Jul 14 11:11:26.283484 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.283491 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4432fb72-2ee9-49e5-bc93-73462d52ed6e-kubelet-config\") pod \"global-pull-secret-syncer-lzzhb\" (UID: \"4432fb72-2ee9-49e5-bc93-73462d52ed6e\") " pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:26.283704 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.283520 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-host-kubelet\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.283704 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.283543 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-systemd-units\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.283704 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.283563 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9729993-471c-42e3-8723-7c1982f23e0a-host\") pod \"node-ca-hvb4s\" (UID: \"c9729993-471c-42e3-8723-7c1982f23e0a\") " pod="openshift-image-registry/node-ca-hvb4s" Jul 14 11:11:26.283704 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.283599 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4432fb72-2ee9-49e5-bc93-73462d52ed6e-kubelet-config\") pod \"global-pull-secret-syncer-lzzhb\" (UID: \"4432fb72-2ee9-49e5-bc93-73462d52ed6e\") " pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:26.283704 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.283609 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-host-kubelet\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.283704 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.283607 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-systemd-units\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.283704 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:26.283657 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:26.283704 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.283568 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4432fb72-2ee9-49e5-bc93-73462d52ed6e-original-pull-secret\") pod \"global-pull-secret-syncer-lzzhb\" (UID: \"4432fb72-2ee9-49e5-bc93-73462d52ed6e\") " pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:26.283704 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.283699 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4f7ac09b-952a-4a9d-9500-9706d77b1db3-iptables-alerter-script\") pod \"iptables-alerter-s2nwz\" (UID: \"4f7ac09b-952a-4a9d-9500-9706d77b1db3\") " pod="openshift-network-operator/iptables-alerter-s2nwz" Jul 14 11:11:26.283704 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:26.283710 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4432fb72-2ee9-49e5-bc93-73462d52ed6e-original-pull-secret podName:4432fb72-2ee9-49e5-bc93-73462d52ed6e nodeName:}" failed. No retries permitted until 2026-07-14 11:11:26.783691436 +0000 UTC m=+3.097824933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4432fb72-2ee9-49e5-bc93-73462d52ed6e-original-pull-secret") pod "global-pull-secret-syncer-lzzhb" (UID: "4432fb72-2ee9-49e5-bc93-73462d52ed6e") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:26.284180 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.283738 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-ovnkube-config\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.284180 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.283768 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-etc-openvswitch\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.284180 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.283785 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qr8v\" (UniqueName: \"kubernetes.io/projected/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-kube-api-access-6qr8v\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.284180 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.283804 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-host-cni-bin\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.284180 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.283817 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-ovnkube-script-lib\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.284180 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.283835 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-run-ovn\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.284180 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.283857 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c9729993-471c-42e3-8723-7c1982f23e0a-serviceca\") pod \"node-ca-hvb4s\" (UID: \"c9729993-471c-42e3-8723-7c1982f23e0a\") " pod="openshift-image-registry/node-ca-hvb4s" Jul 14 11:11:26.284180 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.283871 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-var-lib-openvswitch\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.284180 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.283889 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4432fb72-2ee9-49e5-bc93-73462d52ed6e-dbus\") pod \"global-pull-secret-syncer-lzzhb\" (UID: \"4432fb72-2ee9-49e5-bc93-73462d52ed6e\") " pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:26.284180 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.283904 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-host-run-ovn-kubernetes\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.284180 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.283939 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkmwl\" (UniqueName: \"kubernetes.io/projected/c9729993-471c-42e3-8723-7c1982f23e0a-kube-api-access-gkmwl\") pod \"node-ca-hvb4s\" (UID: \"c9729993-471c-42e3-8723-7c1982f23e0a\") " pod="openshift-image-registry/node-ca-hvb4s" Jul 14 11:11:26.284180 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.283973 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f7ac09b-952a-4a9d-9500-9706d77b1db3-host-slash\") pod \"iptables-alerter-s2nwz\" (UID: \"4f7ac09b-952a-4a9d-9500-9706d77b1db3\") " pod="openshift-network-operator/iptables-alerter-s2nwz" Jul 14 11:11:26.284180 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.283998 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-run-openvswitch\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.284180 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.284021 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-log-socket\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.284180 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.284046 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-host-slash\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.284180 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.284062 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-host-run-netns\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.284180 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.284077 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-env-overrides\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.285059 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.284097 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhfck\" (UniqueName: \"kubernetes.io/projected/4f7ac09b-952a-4a9d-9500-9706d77b1db3-kube-api-access-rhfck\") pod \"iptables-alerter-s2nwz\" (UID: \"4f7ac09b-952a-4a9d-9500-9706d77b1db3\") " pod="openshift-network-operator/iptables-alerter-s2nwz" Jul 14 11:11:26.285059 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.284117 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-run-systemd\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.285059 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.284141 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-host-cni-netd\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.285059 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.284166 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.285059 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.284194 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-node-log\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.285059 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.284200 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-host-run-ovn-kubernetes\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.285059 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.284222 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-ovn-node-metrics-cert\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.285059 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.284266 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-host-cni-bin\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.285059 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.284690 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-ovnkube-script-lib\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.285059 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.284735 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-run-ovn\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.285059 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.284922 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-ovnkube-config\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.285059 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.284979 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-etc-openvswitch\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.285059 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.285062 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c9729993-471c-42e3-8723-7c1982f23e0a-serviceca\") pod \"node-ca-hvb4s\" (UID: \"c9729993-471c-42e3-8723-7c1982f23e0a\") " pod="openshift-image-registry/node-ca-hvb4s" Jul 14 11:11:26.285672 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.285120 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f7ac09b-952a-4a9d-9500-9706d77b1db3-host-slash\") pod \"iptables-alerter-s2nwz\" (UID: \"4f7ac09b-952a-4a9d-9500-9706d77b1db3\") " pod="openshift-network-operator/iptables-alerter-s2nwz" Jul 14 11:11:26.285672 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.285176 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-var-lib-openvswitch\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.285672 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.285198 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4432fb72-2ee9-49e5-bc93-73462d52ed6e-dbus\") pod \"global-pull-secret-syncer-lzzhb\" (UID: \"4432fb72-2ee9-49e5-bc93-73462d52ed6e\") " pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:26.285672 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.285208 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-run-openvswitch\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.285672 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.284165 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4f7ac09b-952a-4a9d-9500-9706d77b1db3-iptables-alerter-script\") pod \"iptables-alerter-s2nwz\" (UID: \"4f7ac09b-952a-4a9d-9500-9706d77b1db3\") " pod="openshift-network-operator/iptables-alerter-s2nwz" Jul 14 11:11:26.285672 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.285254 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-host-run-netns\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.285672 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.285254 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-run-systemd\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.285672 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.285266 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-node-log\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.285672 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.285303 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-log-socket\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.285672 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.285368 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-host-cni-netd\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.285672 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.285404 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-host-slash\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.285672 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.285484 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.286075 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.285708 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-env-overrides\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.286824 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.286803 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-ovn-node-metrics-cert\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.294626 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.294591 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhfck\" (UniqueName: \"kubernetes.io/projected/4f7ac09b-952a-4a9d-9500-9706d77b1db3-kube-api-access-rhfck\") pod \"iptables-alerter-s2nwz\" (UID: \"4f7ac09b-952a-4a9d-9500-9706d77b1db3\") " pod="openshift-network-operator/iptables-alerter-s2nwz" Jul 14 11:11:26.295032 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.295015 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qr8v\" (UniqueName: \"kubernetes.io/projected/62d784b5-2a7b-4330-84a3-e8cd167dd1ce-kube-api-access-6qr8v\") pod \"ovnkube-node-ndktj\" (UID: \"62d784b5-2a7b-4330-84a3-e8cd167dd1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.295160 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.295140 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkmwl\" (UniqueName: \"kubernetes.io/projected/c9729993-471c-42e3-8723-7c1982f23e0a-kube-api-access-gkmwl\") pod \"node-ca-hvb4s\" (UID: \"c9729993-471c-42e3-8723-7c1982f23e0a\") " pod="openshift-image-registry/node-ca-hvb4s" Jul 14 11:11:26.314553 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.314486 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 11:11:26.373944 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.373907 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" Jul 14 11:11:26.384654 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.384629 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qjq7w" Jul 14 11:11:26.395321 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.395295 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5z692" Jul 14 11:11:26.401934 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.401912 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g4jtd" Jul 14 11:11:26.413794 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.413772 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" Jul 14 11:11:26.421434 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.421412 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s6hzg" Jul 14 11:11:26.429125 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.429103 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hvb4s" Jul 14 11:11:26.438746 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.438727 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s2nwz" Jul 14 11:11:26.443960 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.443939 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:26.686304 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.686269 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs\") pod \"network-metrics-daemon-q2stq\" (UID: \"d333f07a-92a3-4c63-8f62-5a5eec2496b7\") " pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:26.686506 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:26.686400 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:26.686506 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:26.686471 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs podName:d333f07a-92a3-4c63-8f62-5a5eec2496b7 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:27.68645358 +0000 UTC m=+4.000587081 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs") pod "network-metrics-daemon-q2stq" (UID: "d333f07a-92a3-4c63-8f62-5a5eec2496b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:26.787076 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.787042 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj5jr\" (UniqueName: \"kubernetes.io/projected/53bd384d-a054-45b7-83a6-e18ea91b6567-kube-api-access-qj5jr\") pod \"network-check-target-pkpr6\" (UID: \"53bd384d-a054-45b7-83a6-e18ea91b6567\") " pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:11:26.787224 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:26.787097 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4432fb72-2ee9-49e5-bc93-73462d52ed6e-original-pull-secret\") pod \"global-pull-secret-syncer-lzzhb\" (UID: \"4432fb72-2ee9-49e5-bc93-73462d52ed6e\") " pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:26.787224 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:26.787191 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:26.787224 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:26.787204 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:11:26.787224 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:26.787223 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:11:26.787397 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:26.787249 2580 projected.go:196] Error preparing data for projected volume kube-api-access-qj5jr for pod openshift-network-diagnostics/network-check-target-pkpr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:26.787397 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:26.787281 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4432fb72-2ee9-49e5-bc93-73462d52ed6e-original-pull-secret podName:4432fb72-2ee9-49e5-bc93-73462d52ed6e nodeName:}" failed. No retries permitted until 2026-07-14 11:11:27.787266216 +0000 UTC m=+4.101399711 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4432fb72-2ee9-49e5-bc93-73462d52ed6e-original-pull-secret") pod "global-pull-secret-syncer-lzzhb" (UID: "4432fb72-2ee9-49e5-bc93-73462d52ed6e") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:26.787397 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:26.787297 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53bd384d-a054-45b7-83a6-e18ea91b6567-kube-api-access-qj5jr podName:53bd384d-a054-45b7-83a6-e18ea91b6567 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:27.78729001 +0000 UTC m=+4.101423506 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qj5jr" (UniqueName: "kubernetes.io/projected/53bd384d-a054-45b7-83a6-e18ea91b6567-kube-api-access-qj5jr") pod "network-check-target-pkpr6" (UID: "53bd384d-a054-45b7-83a6-e18ea91b6567") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:27.134477 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:27.134451 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod690e6cee_8e09_4149_8cbc_c7d5d4e0d268.slice/crio-3d204eb5c4416b4291e7fd98f3c1f9b346a235a7da95349bebf3493cdfbaa50d WatchSource:0}: Error finding container 3d204eb5c4416b4291e7fd98f3c1f9b346a235a7da95349bebf3493cdfbaa50d: Status 404 returned error can't find the container with id 3d204eb5c4416b4291e7fd98f3c1f9b346a235a7da95349bebf3493cdfbaa50d Jul 14 11:11:27.146464 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:27.146434 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62d784b5_2a7b_4330_84a3_e8cd167dd1ce.slice/crio-fd77b7030063cf30f1a7de5f6ca4fee5eb404cb6f79fd538a25b6a5613f7884d WatchSource:0}: Error finding container fd77b7030063cf30f1a7de5f6ca4fee5eb404cb6f79fd538a25b6a5613f7884d: Status 404 returned error can't find the container with id fd77b7030063cf30f1a7de5f6ca4fee5eb404cb6f79fd538a25b6a5613f7884d Jul 14 11:11:27.154823 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:27.154640 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71534e4d_e566_4147_9654_a966dc87100e.slice/crio-e6e9c08d9626fa19b77d272ae12a17c354db7f79fabd3d0273558ce9a7b45b15 WatchSource:0}: Error finding container e6e9c08d9626fa19b77d272ae12a17c354db7f79fabd3d0273558ce9a7b45b15: Status 404 returned error can't find the container with id e6e9c08d9626fa19b77d272ae12a17c354db7f79fabd3d0273558ce9a7b45b15 Jul 14 11:11:27.154823 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:27.154656 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 11:06:26 +0000 UTC" deadline="2028-04-18 17:28:48.929511488 +0000 UTC" Jul 14 11:11:27.154823 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:27.154819 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15462h17m21.774697063s" Jul 14 11:11:27.155899 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:27.155531 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8dc1f8e_58c9_4aac_994a_95422c85bad5.slice/crio-8ac4d7a3ba5813f6b2f1b8359e76b0a73a649fcc403a11c52edeb19c649e244e WatchSource:0}: Error finding container 8ac4d7a3ba5813f6b2f1b8359e76b0a73a649fcc403a11c52edeb19c649e244e: Status 404 returned error can't find the container with id 8ac4d7a3ba5813f6b2f1b8359e76b0a73a649fcc403a11c52edeb19c649e244e Jul 14 11:11:27.156083 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:27.155968 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9729993_471c_42e3_8723_7c1982f23e0a.slice/crio-67c7758edfd2e4fe6b80641555d7fc7250d8e6aa9a37bf2e7585f5ff98d8489a WatchSource:0}: Error finding container 67c7758edfd2e4fe6b80641555d7fc7250d8e6aa9a37bf2e7585f5ff98d8489a: Status 404 returned error can't find the container with id 67c7758edfd2e4fe6b80641555d7fc7250d8e6aa9a37bf2e7585f5ff98d8489a Jul 14 11:11:27.157928 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:27.157898 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f7ac09b_952a_4a9d_9500_9706d77b1db3.slice/crio-b75a469b67e2c03879e9d3c1f8057e297ecc2ffaf9856d70c5e8201ca7f959cb WatchSource:0}: Error finding container b75a469b67e2c03879e9d3c1f8057e297ecc2ffaf9856d70c5e8201ca7f959cb: Status 404 returned error can't find the container with id b75a469b67e2c03879e9d3c1f8057e297ecc2ffaf9856d70c5e8201ca7f959cb Jul 14 11:11:27.158821 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:27.158800 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4b66bf7_506a_4e2e_bcca_3b29f9b7b5df.slice/crio-8b6d30cc21a1afb5850c82158ccca527aa03374c681349c40fc42a990115517e WatchSource:0}: Error finding container 8b6d30cc21a1afb5850c82158ccca527aa03374c681349c40fc42a990115517e: Status 404 returned error can't find the container with id 8b6d30cc21a1afb5850c82158ccca527aa03374c681349c40fc42a990115517e Jul 14 11:11:27.161630 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:27.161252 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod912fc3c9_3b68_4149_a747_635958c35d35.slice/crio-ad3e8b3b4e75a34bbc925fbc661533372755a8c733c2b8318ee64411ce8b48f2 WatchSource:0}: Error finding container ad3e8b3b4e75a34bbc925fbc661533372755a8c733c2b8318ee64411ce8b48f2: Status 404 returned error can't find the container with id ad3e8b3b4e75a34bbc925fbc661533372755a8c733c2b8318ee64411ce8b48f2 Jul 14 11:11:27.162666 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:27.162553 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69c7be6f_e4a5_4d78_9f39_418ad8ad136a.slice/crio-77fba9f56eb2fd16648969dd6c9f95e83ffc8564bdf2a877467b5a1a0888ca39 WatchSource:0}: Error finding container 77fba9f56eb2fd16648969dd6c9f95e83ffc8564bdf2a877467b5a1a0888ca39: Status 404 returned error can't find the container with id 77fba9f56eb2fd16648969dd6c9f95e83ffc8564bdf2a877467b5a1a0888ca39 Jul 14 11:11:27.228542 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:27.228515 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:11:27.228657 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:27.228547 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:27.228657 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:27.228634 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkpr6" podUID="53bd384d-a054-45b7-83a6-e18ea91b6567" Jul 14 11:11:27.228725 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:27.228711 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzzhb" podUID="4432fb72-2ee9-49e5-bc93-73462d52ed6e" Jul 14 11:11:27.241871 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:27.241842 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hvb4s" event={"ID":"c9729993-471c-42e3-8723-7c1982f23e0a","Type":"ContainerStarted","Data":"67c7758edfd2e4fe6b80641555d7fc7250d8e6aa9a37bf2e7585f5ff98d8489a"} Jul 14 11:11:27.243914 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:27.243889 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" event={"ID":"62d784b5-2a7b-4330-84a3-e8cd167dd1ce","Type":"ContainerStarted","Data":"fd77b7030063cf30f1a7de5f6ca4fee5eb404cb6f79fd538a25b6a5613f7884d"} Jul 14 11:11:27.245003 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:27.244980 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" event={"ID":"690e6cee-8e09-4149-8cbc-c7d5d4e0d268","Type":"ContainerStarted","Data":"3d204eb5c4416b4291e7fd98f3c1f9b346a235a7da95349bebf3493cdfbaa50d"} Jul 14 11:11:27.250764 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:27.250733 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g4jtd" event={"ID":"69c7be6f-e4a5-4d78-9f39-418ad8ad136a","Type":"ContainerStarted","Data":"77fba9f56eb2fd16648969dd6c9f95e83ffc8564bdf2a877467b5a1a0888ca39"} Jul 14 11:11:27.251947 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:27.251922 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qjq7w" event={"ID":"a8dc1f8e-58c9-4aac-994a-95422c85bad5","Type":"ContainerStarted","Data":"8ac4d7a3ba5813f6b2f1b8359e76b0a73a649fcc403a11c52edeb19c649e244e"} Jul 14 11:11:27.253000 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:27.252937 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" event={"ID":"71534e4d-e566-4147-9654-a966dc87100e","Type":"ContainerStarted","Data":"e6e9c08d9626fa19b77d272ae12a17c354db7f79fabd3d0273558ce9a7b45b15"} Jul 14 11:11:27.254120 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:27.254094 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5z692" event={"ID":"912fc3c9-3b68-4149-a747-635958c35d35","Type":"ContainerStarted","Data":"ad3e8b3b4e75a34bbc925fbc661533372755a8c733c2b8318ee64411ce8b48f2"} Jul 14 11:11:27.255577 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:27.255553 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s6hzg" event={"ID":"e4b66bf7-506a-4e2e-bcca-3b29f9b7b5df","Type":"ContainerStarted","Data":"8b6d30cc21a1afb5850c82158ccca527aa03374c681349c40fc42a990115517e"} Jul 14 11:11:27.256615 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:27.256588 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s2nwz" event={"ID":"4f7ac09b-952a-4a9d-9500-9706d77b1db3","Type":"ContainerStarted","Data":"b75a469b67e2c03879e9d3c1f8057e297ecc2ffaf9856d70c5e8201ca7f959cb"} Jul 14 11:11:27.694857 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:27.694777 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs\") pod \"network-metrics-daemon-q2stq\" (UID: \"d333f07a-92a3-4c63-8f62-5a5eec2496b7\") " pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:27.695126 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:27.694943 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:27.695126 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:27.695005 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs podName:d333f07a-92a3-4c63-8f62-5a5eec2496b7 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:29.69498742 +0000 UTC m=+6.009120921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs") pod "network-metrics-daemon-q2stq" (UID: "d333f07a-92a3-4c63-8f62-5a5eec2496b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:27.795927 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:27.795887 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj5jr\" (UniqueName: \"kubernetes.io/projected/53bd384d-a054-45b7-83a6-e18ea91b6567-kube-api-access-qj5jr\") pod \"network-check-target-pkpr6\" (UID: \"53bd384d-a054-45b7-83a6-e18ea91b6567\") " pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:11:27.796119 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:27.795957 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4432fb72-2ee9-49e5-bc93-73462d52ed6e-original-pull-secret\") pod \"global-pull-secret-syncer-lzzhb\" (UID: \"4432fb72-2ee9-49e5-bc93-73462d52ed6e\") " pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:27.796119 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:27.796109 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:27.796355 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:27.796170 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4432fb72-2ee9-49e5-bc93-73462d52ed6e-original-pull-secret podName:4432fb72-2ee9-49e5-bc93-73462d52ed6e nodeName:}" failed. No retries permitted until 2026-07-14 11:11:29.796152567 +0000 UTC m=+6.110286064 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4432fb72-2ee9-49e5-bc93-73462d52ed6e-original-pull-secret") pod "global-pull-secret-syncer-lzzhb" (UID: "4432fb72-2ee9-49e5-bc93-73462d52ed6e") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:27.796610 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:27.796592 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:11:27.796683 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:27.796616 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:11:27.796683 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:27.796629 2580 projected.go:196] Error preparing data for projected volume kube-api-access-qj5jr for pod openshift-network-diagnostics/network-check-target-pkpr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:27.796683 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:27.796672 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53bd384d-a054-45b7-83a6-e18ea91b6567-kube-api-access-qj5jr podName:53bd384d-a054-45b7-83a6-e18ea91b6567 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:29.796657392 +0000 UTC m=+6.110790890 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qj5jr" (UniqueName: "kubernetes.io/projected/53bd384d-a054-45b7-83a6-e18ea91b6567-kube-api-access-qj5jr") pod "network-check-target-pkpr6" (UID: "53bd384d-a054-45b7-83a6-e18ea91b6567") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:28.156720 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:28.156652 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 11:06:26 +0000 UTC" deadline="2028-03-21 10:28:47.537611046 +0000 UTC" Jul 14 11:11:28.156720 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:28.156718 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14783h17m19.380897257s" Jul 14 11:11:28.230387 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:28.230358 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:28.230567 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:28.230499 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2stq" podUID="d333f07a-92a3-4c63-8f62-5a5eec2496b7" Jul 14 11:11:28.264898 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:28.264860 2580 generic.go:356] "Generic (PLEG): container finished" podID="97ec19dc8784cd4e66084e3ae9d73ee5" containerID="bc7664b876336ae14df9e316f17b3042cdaffb331104d259d8ff2971eaf754c9" exitCode=0 Jul 14 11:11:28.265061 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:28.264962 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-138.ec2.internal" event={"ID":"97ec19dc8784cd4e66084e3ae9d73ee5","Type":"ContainerDied","Data":"bc7664b876336ae14df9e316f17b3042cdaffb331104d259d8ff2971eaf754c9"} Jul 14 11:11:28.272404 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:28.272373 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-138.ec2.internal" event={"ID":"3b34c804ba21769735646d070057ea2e","Type":"ContainerStarted","Data":"1e26550e772e37962dbcbb8a047b62e391dce1b0db6d9dabd29831215abc8d8e"} Jul 14 11:11:28.286053 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:28.285736 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-138.ec2.internal" podStartSLOduration=3.285714532 podStartE2EDuration="3.285714532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:27.27992061 +0000 UTC m=+3.594054130" watchObservedRunningTime="2026-07-14 11:11:28.285714532 +0000 UTC m=+4.599848052" Jul 14 11:11:29.229027 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:29.228991 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:29.229547 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:29.229137 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzzhb" podUID="4432fb72-2ee9-49e5-bc93-73462d52ed6e" Jul 14 11:11:29.229547 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:29.229538 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:11:29.229686 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:29.229624 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkpr6" podUID="53bd384d-a054-45b7-83a6-e18ea91b6567" Jul 14 11:11:29.297294 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:29.297253 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-138.ec2.internal" event={"ID":"97ec19dc8784cd4e66084e3ae9d73ee5","Type":"ContainerStarted","Data":"7f7bd5f571c5a40cbb4590d7ff8bef19acff21b856349be9462106691b0bbaca"} Jul 14 11:11:29.314316 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:29.314135 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-138.ec2.internal" podStartSLOduration=4.314112909 podStartE2EDuration="4.314112909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:29.31343498 +0000 UTC m=+5.627568500" watchObservedRunningTime="2026-07-14 11:11:29.314112909 +0000 UTC m=+5.628246428" Jul 14 11:11:29.711728 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:29.711689 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs\") pod \"network-metrics-daemon-q2stq\" (UID: \"d333f07a-92a3-4c63-8f62-5a5eec2496b7\") " pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:29.711910 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:29.711891 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:29.711968 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:29.711954 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs podName:d333f07a-92a3-4c63-8f62-5a5eec2496b7 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:33.711935264 +0000 UTC m=+10.026068774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs") pod "network-metrics-daemon-q2stq" (UID: "d333f07a-92a3-4c63-8f62-5a5eec2496b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:29.813149 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:29.812379 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4432fb72-2ee9-49e5-bc93-73462d52ed6e-original-pull-secret\") pod \"global-pull-secret-syncer-lzzhb\" (UID: \"4432fb72-2ee9-49e5-bc93-73462d52ed6e\") " pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:29.813149 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:29.812470 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj5jr\" (UniqueName: \"kubernetes.io/projected/53bd384d-a054-45b7-83a6-e18ea91b6567-kube-api-access-qj5jr\") pod \"network-check-target-pkpr6\" (UID: \"53bd384d-a054-45b7-83a6-e18ea91b6567\") " pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:11:29.813149 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:29.812617 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:11:29.813149 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:29.812637 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:11:29.813149 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:29.812650 2580 projected.go:196] Error preparing data for projected volume kube-api-access-qj5jr for pod openshift-network-diagnostics/network-check-target-pkpr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:29.813149 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:29.812708 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53bd384d-a054-45b7-83a6-e18ea91b6567-kube-api-access-qj5jr podName:53bd384d-a054-45b7-83a6-e18ea91b6567 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:33.812688841 +0000 UTC m=+10.126822345 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qj5jr" (UniqueName: "kubernetes.io/projected/53bd384d-a054-45b7-83a6-e18ea91b6567-kube-api-access-qj5jr") pod "network-check-target-pkpr6" (UID: "53bd384d-a054-45b7-83a6-e18ea91b6567") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:29.813149 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:29.812780 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:29.813149 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:29.812813 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4432fb72-2ee9-49e5-bc93-73462d52ed6e-original-pull-secret podName:4432fb72-2ee9-49e5-bc93-73462d52ed6e nodeName:}" failed. No retries permitted until 2026-07-14 11:11:33.812801579 +0000 UTC m=+10.126935081 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4432fb72-2ee9-49e5-bc93-73462d52ed6e-original-pull-secret") pod "global-pull-secret-syncer-lzzhb" (UID: "4432fb72-2ee9-49e5-bc93-73462d52ed6e") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:30.231717 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:30.231269 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:30.231717 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:30.231397 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2stq" podUID="d333f07a-92a3-4c63-8f62-5a5eec2496b7" Jul 14 11:11:31.228749 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:31.228711 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:11:31.228943 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:31.228844 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkpr6" podUID="53bd384d-a054-45b7-83a6-e18ea91b6567" Jul 14 11:11:31.229269 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:31.229225 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:31.229370 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:31.229325 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzzhb" podUID="4432fb72-2ee9-49e5-bc93-73462d52ed6e" Jul 14 11:11:32.231484 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:32.231407 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:32.231854 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:32.231553 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2stq" podUID="d333f07a-92a3-4c63-8f62-5a5eec2496b7" Jul 14 11:11:33.229557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:33.229511 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:33.229733 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:33.229642 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzzhb" podUID="4432fb72-2ee9-49e5-bc93-73462d52ed6e" Jul 14 11:11:33.229921 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:33.229512 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:11:33.230258 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:33.229989 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkpr6" podUID="53bd384d-a054-45b7-83a6-e18ea91b6567" Jul 14 11:11:33.745737 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:33.745694 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs\") pod \"network-metrics-daemon-q2stq\" (UID: \"d333f07a-92a3-4c63-8f62-5a5eec2496b7\") " pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:33.746250 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:33.745857 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:33.746250 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:33.745934 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs podName:d333f07a-92a3-4c63-8f62-5a5eec2496b7 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:41.745914048 +0000 UTC m=+18.060047545 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs") pod "network-metrics-daemon-q2stq" (UID: "d333f07a-92a3-4c63-8f62-5a5eec2496b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:33.847362 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:33.846569 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj5jr\" (UniqueName: \"kubernetes.io/projected/53bd384d-a054-45b7-83a6-e18ea91b6567-kube-api-access-qj5jr\") pod \"network-check-target-pkpr6\" (UID: \"53bd384d-a054-45b7-83a6-e18ea91b6567\") " pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:11:33.847362 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:33.846641 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4432fb72-2ee9-49e5-bc93-73462d52ed6e-original-pull-secret\") pod \"global-pull-secret-syncer-lzzhb\" (UID: \"4432fb72-2ee9-49e5-bc93-73462d52ed6e\") " pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:33.847362 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:33.846793 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:33.847362 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:33.846859 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4432fb72-2ee9-49e5-bc93-73462d52ed6e-original-pull-secret podName:4432fb72-2ee9-49e5-bc93-73462d52ed6e nodeName:}" failed. No retries permitted until 2026-07-14 11:11:41.84684159 +0000 UTC m=+18.160975091 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4432fb72-2ee9-49e5-bc93-73462d52ed6e-original-pull-secret") pod "global-pull-secret-syncer-lzzhb" (UID: "4432fb72-2ee9-49e5-bc93-73462d52ed6e") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:33.847362 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:33.847269 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:11:33.847362 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:33.847288 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:11:33.847362 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:33.847299 2580 projected.go:196] Error preparing data for projected volume kube-api-access-qj5jr for pod openshift-network-diagnostics/network-check-target-pkpr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:33.847362 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:33.847340 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53bd384d-a054-45b7-83a6-e18ea91b6567-kube-api-access-qj5jr podName:53bd384d-a054-45b7-83a6-e18ea91b6567 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:41.847329363 +0000 UTC m=+18.161462860 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qj5jr" (UniqueName: "kubernetes.io/projected/53bd384d-a054-45b7-83a6-e18ea91b6567-kube-api-access-qj5jr") pod "network-check-target-pkpr6" (UID: "53bd384d-a054-45b7-83a6-e18ea91b6567") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:34.229476 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:34.229408 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:34.230397 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:34.230362 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2stq" podUID="d333f07a-92a3-4c63-8f62-5a5eec2496b7" Jul 14 11:11:35.228771 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:35.228736 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:11:35.229168 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:35.228856 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkpr6" podUID="53bd384d-a054-45b7-83a6-e18ea91b6567" Jul 14 11:11:35.229246 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:35.228735 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:35.229298 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:35.229262 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzzhb" podUID="4432fb72-2ee9-49e5-bc93-73462d52ed6e" Jul 14 11:11:36.230932 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:36.230437 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:36.230932 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:36.230565 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2stq" podUID="d333f07a-92a3-4c63-8f62-5a5eec2496b7" Jul 14 11:11:37.228889 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:37.228858 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:11:37.229087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:37.228890 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:37.229087 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:37.228990 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkpr6" podUID="53bd384d-a054-45b7-83a6-e18ea91b6567" Jul 14 11:11:37.229206 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:37.229107 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzzhb" podUID="4432fb72-2ee9-49e5-bc93-73462d52ed6e" Jul 14 11:11:38.229211 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:38.229173 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:38.229652 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:38.229317 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2stq" podUID="d333f07a-92a3-4c63-8f62-5a5eec2496b7" Jul 14 11:11:39.229540 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:39.229501 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:11:39.229994 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:39.229509 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:39.229994 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:39.229626 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkpr6" podUID="53bd384d-a054-45b7-83a6-e18ea91b6567" Jul 14 11:11:39.229994 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:39.229728 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzzhb" podUID="4432fb72-2ee9-49e5-bc93-73462d52ed6e" Jul 14 11:11:40.231918 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:40.231889 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:40.232348 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:40.232005 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2stq" podUID="d333f07a-92a3-4c63-8f62-5a5eec2496b7" Jul 14 11:11:41.228936 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:41.228896 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:11:41.229124 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:41.228903 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:41.229124 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:41.229025 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkpr6" podUID="53bd384d-a054-45b7-83a6-e18ea91b6567" Jul 14 11:11:41.229124 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:41.229109 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzzhb" podUID="4432fb72-2ee9-49e5-bc93-73462d52ed6e" Jul 14 11:11:41.810510 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:41.810473 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs\") pod \"network-metrics-daemon-q2stq\" (UID: \"d333f07a-92a3-4c63-8f62-5a5eec2496b7\") " pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:41.810978 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:41.810644 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:41.810978 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:41.810724 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs podName:d333f07a-92a3-4c63-8f62-5a5eec2496b7 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:57.810702758 +0000 UTC m=+34.124836255 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs") pod "network-metrics-daemon-q2stq" (UID: "d333f07a-92a3-4c63-8f62-5a5eec2496b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:41.911052 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:41.911022 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4432fb72-2ee9-49e5-bc93-73462d52ed6e-original-pull-secret\") pod \"global-pull-secret-syncer-lzzhb\" (UID: \"4432fb72-2ee9-49e5-bc93-73462d52ed6e\") " pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:41.911261 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:41.911082 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj5jr\" (UniqueName: \"kubernetes.io/projected/53bd384d-a054-45b7-83a6-e18ea91b6567-kube-api-access-qj5jr\") pod \"network-check-target-pkpr6\" (UID: \"53bd384d-a054-45b7-83a6-e18ea91b6567\") " pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:11:41.911261 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:41.911164 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:41.911261 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:41.911171 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:11:41.911261 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:41.911191 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:11:41.911261 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:41.911199 2580 projected.go:196] Error preparing data for projected volume kube-api-access-qj5jr for pod openshift-network-diagnostics/network-check-target-pkpr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:41.911261 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:41.911242 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4432fb72-2ee9-49e5-bc93-73462d52ed6e-original-pull-secret podName:4432fb72-2ee9-49e5-bc93-73462d52ed6e nodeName:}" failed. No retries permitted until 2026-07-14 11:11:57.911212941 +0000 UTC m=+34.225346436 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4432fb72-2ee9-49e5-bc93-73462d52ed6e-original-pull-secret") pod "global-pull-secret-syncer-lzzhb" (UID: "4432fb72-2ee9-49e5-bc93-73462d52ed6e") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:41.911261 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:41.911259 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53bd384d-a054-45b7-83a6-e18ea91b6567-kube-api-access-qj5jr podName:53bd384d-a054-45b7-83a6-e18ea91b6567 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:57.911251699 +0000 UTC m=+34.225385198 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qj5jr" (UniqueName: "kubernetes.io/projected/53bd384d-a054-45b7-83a6-e18ea91b6567-kube-api-access-qj5jr") pod "network-check-target-pkpr6" (UID: "53bd384d-a054-45b7-83a6-e18ea91b6567") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:42.232073 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:42.232046 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:42.232269 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:42.232171 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2stq" podUID="d333f07a-92a3-4c63-8f62-5a5eec2496b7" Jul 14 11:11:43.228673 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:43.228641 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:43.229082 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:43.228769 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzzhb" podUID="4432fb72-2ee9-49e5-bc93-73462d52ed6e" Jul 14 11:11:43.229082 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:43.228817 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:11:43.229082 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:43.228900 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkpr6" podUID="53bd384d-a054-45b7-83a6-e18ea91b6567" Jul 14 11:11:44.229201 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:44.229163 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:44.229666 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:44.229298 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2stq" podUID="d333f07a-92a3-4c63-8f62-5a5eec2496b7" Jul 14 11:11:45.229575 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:45.229541 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:11:45.230050 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:45.229547 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:45.230050 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:45.229663 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkpr6" podUID="53bd384d-a054-45b7-83a6-e18ea91b6567" Jul 14 11:11:45.230050 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:45.229740 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzzhb" podUID="4432fb72-2ee9-49e5-bc93-73462d52ed6e" Jul 14 11:11:46.229326 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:46.229073 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:46.229481 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:46.229453 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2stq" podUID="d333f07a-92a3-4c63-8f62-5a5eec2496b7" Jul 14 11:11:46.332634 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:46.332604 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g4jtd" event={"ID":"69c7be6f-e4a5-4d78-9f39-418ad8ad136a","Type":"ContainerStarted","Data":"ceb2c5d561feb6eb344f91c8520bcea0f38c7380616262d043db27372139ef40"} Jul 14 11:11:46.334268 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:46.334179 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qjq7w" event={"ID":"a8dc1f8e-58c9-4aac-994a-95422c85bad5","Type":"ContainerStarted","Data":"ddcea1dd1a5327c61277b57138566aee7f1ca8334702a735d3f29372427ac1c9"} Jul 14 11:11:46.335939 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:46.335908 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" event={"ID":"71534e4d-e566-4147-9654-a966dc87100e","Type":"ContainerStarted","Data":"99817031bce3734813a7dbc5fec4c01af2dfd96721747c9de240486788e8ab32"} Jul 14 11:11:46.337414 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:46.337380 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5z692" event={"ID":"912fc3c9-3b68-4149-a747-635958c35d35","Type":"ContainerStarted","Data":"faf8293622f07dbc338e13cf1bc0c4ff8d6390de3abc74d8ed13399e68d7501f"} Jul 14 11:11:46.338983 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:46.338962 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s6hzg" event={"ID":"e4b66bf7-506a-4e2e-bcca-3b29f9b7b5df","Type":"ContainerStarted","Data":"a79dfeee780cadb236d256be094a66be5ed229b01cd203f6a4e60b0a9ad4094f"} Jul 14 11:11:46.340647 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:46.340622 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hvb4s" event={"ID":"c9729993-471c-42e3-8723-7c1982f23e0a","Type":"ContainerStarted","Data":"5dbfe507d831e08e495d10dc253d1899aa101d2cda2f9e60a30a97a063d76ffd"} Jul 14 11:11:46.342442 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:46.342415 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" event={"ID":"62d784b5-2a7b-4330-84a3-e8cd167dd1ce","Type":"ContainerStarted","Data":"a8fcc1add7524d438e620c2c66b5c37bab2b5e4e06bc6222946c5b0da97fd86e"} Jul 14 11:11:46.343716 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:46.343698 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" event={"ID":"690e6cee-8e09-4149-8cbc-c7d5d4e0d268","Type":"ContainerStarted","Data":"83a9d8c98951b5150fae6ab6e10785561631be0b4acd799c83fe4b5c7b1c91d7"} Jul 14 11:11:46.395470 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:46.395424 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qjq7w" podStartSLOduration=3.520191692 podStartE2EDuration="22.395408638s" totalImagesPullingTime="18.875216946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:46.395253329 +0000 UTC m=+22.709386838" watchObservedRunningTime="2026-07-14 11:11:46.395408638 +0000 UTC m=+22.709542156" Jul 14 11:11:46.451171 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:46.451114 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5z692" podStartSLOduration=3.550902888 podStartE2EDuration="22.451095976s" totalImagesPullingTime="18.900193088s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:46.421174248 +0000 UTC m=+22.735307767" watchObservedRunningTime="2026-07-14 11:11:46.451095976 +0000 UTC m=+22.765229495" Jul 14 11:11:46.476892 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:46.476761 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-s5d9z" podStartSLOduration=3.586462369 podStartE2EDuration="22.47674549s" totalImagesPullingTime="18.890283121s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:46.451031346 +0000 UTC m=+22.765164866" watchObservedRunningTime="2026-07-14 11:11:46.47674549 +0000 UTC m=+22.790879024" Jul 14 11:11:46.477030 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:46.476982 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-s6hzg" podStartSLOduration=3.605849946 podStartE2EDuration="22.476972424s" totalImagesPullingTime="18.871122478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:46.476629144 +0000 UTC m=+22.790762722" watchObservedRunningTime="2026-07-14 11:11:46.476972424 +0000 UTC m=+22.791105942" Jul 14 11:11:46.498284 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:46.498218 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hvb4s" podStartSLOduration=11.956675195 podStartE2EDuration="22.498203594s" totalImagesPullingTime="10.541528399s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:46.497911956 +0000 UTC m=+22.812045474" watchObservedRunningTime="2026-07-14 11:11:46.498203594 +0000 UTC m=+22.812337112" Jul 14 11:11:47.124415 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:47.124379 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qjq7w" Jul 14 11:11:47.125001 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:47.124982 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qjq7w" Jul 14 11:11:47.228995 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:47.228972 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:11:47.229165 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:47.229073 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkpr6" podUID="53bd384d-a054-45b7-83a6-e18ea91b6567" Jul 14 11:11:47.229165 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:47.229124 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:47.229267 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:47.229223 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzzhb" podUID="4432fb72-2ee9-49e5-bc93-73462d52ed6e" Jul 14 11:11:47.347058 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:47.347030 2580 generic.go:356] "Generic (PLEG): container finished" podID="69c7be6f-e4a5-4d78-9f39-418ad8ad136a" containerID="ceb2c5d561feb6eb344f91c8520bcea0f38c7380616262d043db27372139ef40" exitCode=0 Jul 14 11:11:47.347536 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:47.347110 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g4jtd" event={"ID":"69c7be6f-e4a5-4d78-9f39-418ad8ad136a","Type":"ContainerDied","Data":"ceb2c5d561feb6eb344f91c8520bcea0f38c7380616262d043db27372139ef40"} Jul 14 11:11:47.348517 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:47.348496 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s2nwz" event={"ID":"4f7ac09b-952a-4a9d-9500-9706d77b1db3","Type":"ContainerStarted","Data":"d161b25aab94d80a3b82fb0c21b0dd3cdfa35a0e324a66a0f22b7492cd189d63"} Jul 14 11:11:47.350940 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:47.350927 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndktj_62d784b5-2a7b-4330-84a3-e8cd167dd1ce/ovn-acl-logging/0.log" Jul 14 11:11:47.351244 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:47.351212 2580 generic.go:356] "Generic (PLEG): container finished" podID="62d784b5-2a7b-4330-84a3-e8cd167dd1ce" containerID="c2a535502fe972166c306c99eefa11843ec68aed4b4d55fdacaf7772c1c41035" exitCode=1 Jul 14 11:11:47.351296 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:47.351261 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" event={"ID":"62d784b5-2a7b-4330-84a3-e8cd167dd1ce","Type":"ContainerDied","Data":"c2a535502fe972166c306c99eefa11843ec68aed4b4d55fdacaf7772c1c41035"} Jul 14 11:11:47.351349 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:47.351331 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" event={"ID":"62d784b5-2a7b-4330-84a3-e8cd167dd1ce","Type":"ContainerStarted","Data":"1dd2a517138317374bffb9e23ea5b47b11f70d6763f52abb42bb292a5d437c3e"} Jul 14 11:11:47.351399 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:47.351365 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" event={"ID":"62d784b5-2a7b-4330-84a3-e8cd167dd1ce","Type":"ContainerStarted","Data":"ffaca43e4c5333d3ce3965a99f0e8f33fa0329321e3266e9e16efdf4b364223a"} Jul 14 11:11:47.351436 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:47.351406 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" event={"ID":"62d784b5-2a7b-4330-84a3-e8cd167dd1ce","Type":"ContainerStarted","Data":"2c4afa51fbc33590d745e655cc877da4442eeb1daf69c4f6929a31ed9f4215cd"} Jul 14 11:11:47.351509 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:47.351491 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qjq7w" Jul 14 11:11:47.351565 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:47.351534 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" event={"ID":"62d784b5-2a7b-4330-84a3-e8cd167dd1ce","Type":"ContainerStarted","Data":"0336b9c54e29bb5b9405e4f851eb8144cea3e3d5a82288b9c5095a599cca66bb"} Jul 14 11:11:47.352412 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:47.352395 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qjq7w" Jul 14 11:11:47.581393 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:47.581369 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 14 11:11:48.154267 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:48.153992 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T11:11:47.581386683Z","UUID":"78e4f014-2d3d-4eb1-aa13-9dd255ac79b5","Handler":null,"Name":"","Endpoint":""} Jul 14 11:11:48.155789 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:48.155718 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 14 11:11:48.155789 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:48.155762 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 14 11:11:48.228783 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:48.228756 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:48.228955 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:48.228900 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2stq" podUID="d333f07a-92a3-4c63-8f62-5a5eec2496b7" Jul 14 11:11:48.356285 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:48.356247 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" event={"ID":"71534e4d-e566-4147-9654-a966dc87100e","Type":"ContainerStarted","Data":"cd48fc13482922f01459812c410ae24c7c3cfaf105d0286e2af20b8dc9a234c9"} Jul 14 11:11:48.371801 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:48.371741 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s2nwz" podStartSLOduration=5.498889182 podStartE2EDuration="24.37172186s" totalImagesPullingTime="18.872832678s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:48.371269946 +0000 UTC m=+24.685403466" watchObservedRunningTime="2026-07-14 11:11:48.37172186 +0000 UTC m=+24.685855378" Jul 14 11:11:49.229247 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:49.229214 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:49.229441 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:49.229214 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:11:49.229441 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:49.229341 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzzhb" podUID="4432fb72-2ee9-49e5-bc93-73462d52ed6e" Jul 14 11:11:49.229561 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:49.229435 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkpr6" podUID="53bd384d-a054-45b7-83a6-e18ea91b6567" Jul 14 11:11:49.361715 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:49.361678 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" event={"ID":"71534e4d-e566-4147-9654-a966dc87100e","Type":"ContainerStarted","Data":"24fe7645e54165cf2c7ad125233b4e4e5f4b283f9b68553a0bd777084c1aaf15"} Jul 14 11:11:49.365109 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:49.365083 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndktj_62d784b5-2a7b-4330-84a3-e8cd167dd1ce/ovn-acl-logging/0.log" Jul 14 11:11:49.365515 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:49.365491 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" event={"ID":"62d784b5-2a7b-4330-84a3-e8cd167dd1ce","Type":"ContainerStarted","Data":"617d040b2a238c5e69ce9b12a15bea37d8672bcb05e694a811019b8b4a8ee3e3"} Jul 14 11:11:49.386751 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:49.386704 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slkvv" podStartSLOduration=4.322292985 podStartE2EDuration="25.386690539s" totalImagesPullingTime="21.064397554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:49.386451247 +0000 UTC m=+25.700584766" watchObservedRunningTime="2026-07-14 11:11:49.386690539 +0000 UTC m=+25.700824056" Jul 14 11:11:50.229572 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:50.229327 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:50.229752 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:50.229687 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2stq" podUID="d333f07a-92a3-4c63-8f62-5a5eec2496b7" Jul 14 11:11:51.228900 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:51.228825 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:51.228900 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:51.228864 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:11:51.229457 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:51.228950 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzzhb" podUID="4432fb72-2ee9-49e5-bc93-73462d52ed6e" Jul 14 11:11:51.229457 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:51.229079 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkpr6" podUID="53bd384d-a054-45b7-83a6-e18ea91b6567" Jul 14 11:11:52.229592 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:52.229335 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:52.230223 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:52.229605 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2stq" podUID="d333f07a-92a3-4c63-8f62-5a5eec2496b7" Jul 14 11:11:52.375074 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:52.375047 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndktj_62d784b5-2a7b-4330-84a3-e8cd167dd1ce/ovn-acl-logging/0.log" Jul 14 11:11:52.375436 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:52.375409 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" event={"ID":"62d784b5-2a7b-4330-84a3-e8cd167dd1ce","Type":"ContainerStarted","Data":"7147908eac5d19be1296e147a7bf70215129abbe98544a51bff5a0a1a17eab98"} Jul 14 11:11:52.375647 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:52.375628 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:52.375855 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:52.375836 2580 scope.go:117] "RemoveContainer" containerID="c2a535502fe972166c306c99eefa11843ec68aed4b4d55fdacaf7772c1c41035" Jul 14 11:11:52.377415 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:52.377394 2580 generic.go:356] "Generic (PLEG): container finished" podID="69c7be6f-e4a5-4d78-9f39-418ad8ad136a" containerID="eb680f8e3c0a39cd93e7114d36540f4f9812dae77d27a314417ac987d2892162" exitCode=0 Jul 14 11:11:52.377511 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:52.377444 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g4jtd" event={"ID":"69c7be6f-e4a5-4d78-9f39-418ad8ad136a","Type":"ContainerDied","Data":"eb680f8e3c0a39cd93e7114d36540f4f9812dae77d27a314417ac987d2892162"} Jul 14 11:11:52.392838 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:52.392817 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:53.229384 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:53.229354 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:53.229508 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:53.229472 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzzhb" podUID="4432fb72-2ee9-49e5-bc93-73462d52ed6e" Jul 14 11:11:53.229560 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:53.229542 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:11:53.229601 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:53.229589 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkpr6" podUID="53bd384d-a054-45b7-83a6-e18ea91b6567" Jul 14 11:11:53.383468 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:53.383445 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndktj_62d784b5-2a7b-4330-84a3-e8cd167dd1ce/ovn-acl-logging/0.log" Jul 14 11:11:53.383869 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:53.383840 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" event={"ID":"62d784b5-2a7b-4330-84a3-e8cd167dd1ce","Type":"ContainerStarted","Data":"197be75a2e9003c7d7aa50a78596a64b4897724ffa41c421bc6e9b4d0eca16a0"} Jul 14 11:11:53.384059 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:53.384034 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:53.384152 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:53.384113 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:53.386268 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:53.386243 2580 generic.go:356] "Generic (PLEG): container finished" podID="69c7be6f-e4a5-4d78-9f39-418ad8ad136a" containerID="8784e2af83031e0a978254c7fa0e486270160c3681c4cd03df1fc409669d5395" exitCode=0 Jul 14 11:11:53.386364 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:53.386290 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g4jtd" event={"ID":"69c7be6f-e4a5-4d78-9f39-418ad8ad136a","Type":"ContainerDied","Data":"8784e2af83031e0a978254c7fa0e486270160c3681c4cd03df1fc409669d5395"} Jul 14 11:11:53.399527 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:53.399503 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:11:53.422257 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:53.422197 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" podStartSLOduration=10.477234463 podStartE2EDuration="29.422181513s" totalImagesPullingTime="18.94494705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:53.421949196 +0000 UTC m=+29.736082715" watchObservedRunningTime="2026-07-14 11:11:53.422181513 +0000 UTC m=+29.736315030" Jul 14 11:11:54.096037 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:54.095997 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lzzhb"] Jul 14 11:11:54.096171 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:54.096158 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:54.096283 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:54.096260 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzzhb" podUID="4432fb72-2ee9-49e5-bc93-73462d52ed6e" Jul 14 11:11:54.099892 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:54.099867 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pkpr6"] Jul 14 11:11:54.099996 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:54.099920 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q2stq"] Jul 14 11:11:54.100068 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:54.100000 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:54.100119 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:54.100000 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:11:54.100166 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:54.100111 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2stq" podUID="d333f07a-92a3-4c63-8f62-5a5eec2496b7" Jul 14 11:11:54.100206 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:54.100166 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkpr6" podUID="53bd384d-a054-45b7-83a6-e18ea91b6567" Jul 14 11:11:54.390861 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:54.390828 2580 generic.go:356] "Generic (PLEG): container finished" podID="69c7be6f-e4a5-4d78-9f39-418ad8ad136a" containerID="c4f1bdd734d8ae698b196db49979f40bc0c35eb43cc10797f4cf682e0782a960" exitCode=0 Jul 14 11:11:54.391217 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:54.390920 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g4jtd" event={"ID":"69c7be6f-e4a5-4d78-9f39-418ad8ad136a","Type":"ContainerDied","Data":"c4f1bdd734d8ae698b196db49979f40bc0c35eb43cc10797f4cf682e0782a960"} Jul 14 11:11:56.228944 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:56.228689 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:56.229413 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:56.229051 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2stq" podUID="d333f07a-92a3-4c63-8f62-5a5eec2496b7" Jul 14 11:11:56.229413 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:56.228887 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:56.229413 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:56.229146 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzzhb" podUID="4432fb72-2ee9-49e5-bc93-73462d52ed6e" Jul 14 11:11:56.229413 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:56.228847 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:11:56.229413 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:56.229214 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkpr6" podUID="53bd384d-a054-45b7-83a6-e18ea91b6567" Jul 14 11:11:57.824317 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:57.824270 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs\") pod \"network-metrics-daemon-q2stq\" (UID: \"d333f07a-92a3-4c63-8f62-5a5eec2496b7\") " pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:57.824934 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:57.824444 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:57.824934 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:57.824530 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs podName:d333f07a-92a3-4c63-8f62-5a5eec2496b7 nodeName:}" failed. No retries permitted until 2026-07-14 11:12:29.82451012 +0000 UTC m=+66.138643620 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs") pod "network-metrics-daemon-q2stq" (UID: "d333f07a-92a3-4c63-8f62-5a5eec2496b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:57.925030 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:57.924979 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj5jr\" (UniqueName: \"kubernetes.io/projected/53bd384d-a054-45b7-83a6-e18ea91b6567-kube-api-access-qj5jr\") pod \"network-check-target-pkpr6\" (UID: \"53bd384d-a054-45b7-83a6-e18ea91b6567\") " pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:11:57.925030 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:57.925031 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4432fb72-2ee9-49e5-bc93-73462d52ed6e-original-pull-secret\") pod \"global-pull-secret-syncer-lzzhb\" (UID: \"4432fb72-2ee9-49e5-bc93-73462d52ed6e\") " pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:57.925260 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:57.925155 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:57.925260 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:57.925158 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:11:57.925260 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:57.925181 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:11:57.925260 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:57.925194 2580 projected.go:196] Error preparing data for projected volume kube-api-access-qj5jr for pod openshift-network-diagnostics/network-check-target-pkpr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:57.925260 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:57.925221 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4432fb72-2ee9-49e5-bc93-73462d52ed6e-original-pull-secret podName:4432fb72-2ee9-49e5-bc93-73462d52ed6e nodeName:}" failed. No retries permitted until 2026-07-14 11:12:29.925202726 +0000 UTC m=+66.239336242 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4432fb72-2ee9-49e5-bc93-73462d52ed6e-original-pull-secret") pod "global-pull-secret-syncer-lzzhb" (UID: "4432fb72-2ee9-49e5-bc93-73462d52ed6e") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:57.925260 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:57.925254 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53bd384d-a054-45b7-83a6-e18ea91b6567-kube-api-access-qj5jr podName:53bd384d-a054-45b7-83a6-e18ea91b6567 nodeName:}" failed. No retries permitted until 2026-07-14 11:12:29.925245961 +0000 UTC m=+66.239379457 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qj5jr" (UniqueName: "kubernetes.io/projected/53bd384d-a054-45b7-83a6-e18ea91b6567-kube-api-access-qj5jr") pod "network-check-target-pkpr6" (UID: "53bd384d-a054-45b7-83a6-e18ea91b6567") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:58.228514 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:58.228473 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:11:58.228722 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:58.228482 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:11:58.228722 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:58.228616 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzzhb" podUID="4432fb72-2ee9-49e5-bc93-73462d52ed6e" Jul 14 11:11:58.228722 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:58.228482 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:11:58.228871 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:58.228699 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkpr6" podUID="53bd384d-a054-45b7-83a6-e18ea91b6567" Jul 14 11:11:58.228871 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:58.228847 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2stq" podUID="d333f07a-92a3-4c63-8f62-5a5eec2496b7" Jul 14 11:11:58.971481 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:58.971459 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-138.ec2.internal" event="NodeReady" Jul 14 11:11:58.971951 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:58.971582 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 14 11:11:59.037542 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.037515 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6jzwh"] Jul 14 11:11:59.065803 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.065772 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-m7wqs"] Jul 14 11:11:59.065969 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.065904 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6jzwh" Jul 14 11:11:59.068778 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.068751 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 14 11:11:59.068923 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.068806 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9dwb8\"" Jul 14 11:11:59.069305 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.069289 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 14 11:11:59.087958 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.087927 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m7wqs"] Jul 14 11:11:59.088122 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.087976 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m7wqs" Jul 14 11:11:59.088377 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.088360 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6jzwh"] Jul 14 11:11:59.091957 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.091928 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 14 11:11:59.091957 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.091945 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 14 11:11:59.092164 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.092028 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-78vw8\"" Jul 14 11:11:59.092575 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.092553 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 14 11:11:59.133133 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.133101 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ff56a558-60cb-416a-b1cd-9da387c9c905-config-volume\") pod \"dns-default-6jzwh\" (UID: \"ff56a558-60cb-416a-b1cd-9da387c9c905\") " pod="openshift-dns/dns-default-6jzwh" Jul 14 11:11:59.133271 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.133146 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls\") pod \"dns-default-6jzwh\" (UID: \"ff56a558-60cb-416a-b1cd-9da387c9c905\") " pod="openshift-dns/dns-default-6jzwh" Jul 14 11:11:59.133271 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.133177 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg8ft\" (UniqueName: \"kubernetes.io/projected/ff56a558-60cb-416a-b1cd-9da387c9c905-kube-api-access-mg8ft\") pod \"dns-default-6jzwh\" (UID: \"ff56a558-60cb-416a-b1cd-9da387c9c905\") " pod="openshift-dns/dns-default-6jzwh" Jul 14 11:11:59.133393 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.133334 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff56a558-60cb-416a-b1cd-9da387c9c905-tmp-dir\") pod \"dns-default-6jzwh\" (UID: \"ff56a558-60cb-416a-b1cd-9da387c9c905\") " pod="openshift-dns/dns-default-6jzwh" Jul 14 11:11:59.234570 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.234474 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ff56a558-60cb-416a-b1cd-9da387c9c905-config-volume\") pod \"dns-default-6jzwh\" (UID: \"ff56a558-60cb-416a-b1cd-9da387c9c905\") " pod="openshift-dns/dns-default-6jzwh" Jul 14 11:11:59.234570 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.234513 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls\") pod \"dns-default-6jzwh\" (UID: \"ff56a558-60cb-416a-b1cd-9da387c9c905\") " pod="openshift-dns/dns-default-6jzwh" Jul 14 11:11:59.234570 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.234534 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg8ft\" (UniqueName: \"kubernetes.io/projected/ff56a558-60cb-416a-b1cd-9da387c9c905-kube-api-access-mg8ft\") pod \"dns-default-6jzwh\" (UID: \"ff56a558-60cb-416a-b1cd-9da387c9c905\") " pod="openshift-dns/dns-default-6jzwh" Jul 14 11:11:59.234570 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.234563 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wksbx\" (UniqueName: \"kubernetes.io/projected/b6473f89-ff70-4b55-9c7c-b19f4e27e564-kube-api-access-wksbx\") pod \"ingress-canary-m7wqs\" (UID: \"b6473f89-ff70-4b55-9c7c-b19f4e27e564\") " pod="openshift-ingress-canary/ingress-canary-m7wqs" Jul 14 11:11:59.234887 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.234616 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6473f89-ff70-4b55-9c7c-b19f4e27e564-cert\") pod \"ingress-canary-m7wqs\" (UID: \"b6473f89-ff70-4b55-9c7c-b19f4e27e564\") " pod="openshift-ingress-canary/ingress-canary-m7wqs" Jul 14 11:11:59.234887 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.234641 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff56a558-60cb-416a-b1cd-9da387c9c905-tmp-dir\") pod \"dns-default-6jzwh\" (UID: \"ff56a558-60cb-416a-b1cd-9da387c9c905\") " pod="openshift-dns/dns-default-6jzwh" Jul 14 11:11:59.234887 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:59.234658 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:11:59.234887 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:59.234736 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls podName:ff56a558-60cb-416a-b1cd-9da387c9c905 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:59.734715334 +0000 UTC m=+36.048848829 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls") pod "dns-default-6jzwh" (UID: "ff56a558-60cb-416a-b1cd-9da387c9c905") : secret "dns-default-metrics-tls" not found Jul 14 11:11:59.235050 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.234980 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff56a558-60cb-416a-b1cd-9da387c9c905-tmp-dir\") pod \"dns-default-6jzwh\" (UID: \"ff56a558-60cb-416a-b1cd-9da387c9c905\") " pod="openshift-dns/dns-default-6jzwh" Jul 14 11:11:59.235085 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.235070 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ff56a558-60cb-416a-b1cd-9da387c9c905-config-volume\") pod \"dns-default-6jzwh\" (UID: \"ff56a558-60cb-416a-b1cd-9da387c9c905\") " pod="openshift-dns/dns-default-6jzwh" Jul 14 11:11:59.245457 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.245433 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg8ft\" (UniqueName: \"kubernetes.io/projected/ff56a558-60cb-416a-b1cd-9da387c9c905-kube-api-access-mg8ft\") pod \"dns-default-6jzwh\" (UID: \"ff56a558-60cb-416a-b1cd-9da387c9c905\") " pod="openshift-dns/dns-default-6jzwh" Jul 14 11:11:59.335120 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.335083 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wksbx\" (UniqueName: \"kubernetes.io/projected/b6473f89-ff70-4b55-9c7c-b19f4e27e564-kube-api-access-wksbx\") pod \"ingress-canary-m7wqs\" (UID: \"b6473f89-ff70-4b55-9c7c-b19f4e27e564\") " pod="openshift-ingress-canary/ingress-canary-m7wqs" Jul 14 11:11:59.335318 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.335133 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6473f89-ff70-4b55-9c7c-b19f4e27e564-cert\") pod \"ingress-canary-m7wqs\" (UID: \"b6473f89-ff70-4b55-9c7c-b19f4e27e564\") " pod="openshift-ingress-canary/ingress-canary-m7wqs" Jul 14 11:11:59.337578 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.337557 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6473f89-ff70-4b55-9c7c-b19f4e27e564-cert\") pod \"ingress-canary-m7wqs\" (UID: \"b6473f89-ff70-4b55-9c7c-b19f4e27e564\") " pod="openshift-ingress-canary/ingress-canary-m7wqs" Jul 14 11:11:59.344638 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.344613 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wksbx\" (UniqueName: \"kubernetes.io/projected/b6473f89-ff70-4b55-9c7c-b19f4e27e564-kube-api-access-wksbx\") pod \"ingress-canary-m7wqs\" (UID: \"b6473f89-ff70-4b55-9c7c-b19f4e27e564\") " pod="openshift-ingress-canary/ingress-canary-m7wqs" Jul 14 11:11:59.397516 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.397478 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m7wqs" Jul 14 11:11:59.406104 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.406077 2580 generic.go:356] "Generic (PLEG): container finished" podID="69c7be6f-e4a5-4d78-9f39-418ad8ad136a" containerID="07bb90f32413760e1f218728cd6538e2eba84da28f49f063e881494e4aa32f0b" exitCode=0 Jul 14 11:11:59.406288 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.406134 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g4jtd" event={"ID":"69c7be6f-e4a5-4d78-9f39-418ad8ad136a","Type":"ContainerDied","Data":"07bb90f32413760e1f218728cd6538e2eba84da28f49f063e881494e4aa32f0b"} Jul 14 11:11:59.596419 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.596213 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m7wqs"] Jul 14 11:11:59.600582 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:11:59.600559 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6473f89_ff70_4b55_9c7c_b19f4e27e564.slice/crio-bea1693ef4f8f3905cdd8f36c435231c663b2c25803fc0c715efb136432443d9 WatchSource:0}: Error finding container bea1693ef4f8f3905cdd8f36c435231c663b2c25803fc0c715efb136432443d9: Status 404 returned error can't find the container with id bea1693ef4f8f3905cdd8f36c435231c663b2c25803fc0c715efb136432443d9 Jul 14 11:11:59.739026 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:11:59.738992 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls\") pod \"dns-default-6jzwh\" (UID: \"ff56a558-60cb-416a-b1cd-9da387c9c905\") " pod="openshift-dns/dns-default-6jzwh" Jul 14 11:11:59.739259 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:59.739167 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:11:59.739341 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:11:59.739274 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls podName:ff56a558-60cb-416a-b1cd-9da387c9c905 nodeName:}" failed. No retries permitted until 2026-07-14 11:12:00.739227391 +0000 UTC m=+37.053360898 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls") pod "dns-default-6jzwh" (UID: "ff56a558-60cb-416a-b1cd-9da387c9c905") : secret "dns-default-metrics-tls" not found Jul 14 11:12:00.229453 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:00.229398 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:12:00.230140 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:00.229398 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:12:00.230140 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:00.229398 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:12:00.235276 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:00.235120 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qblx9\"" Jul 14 11:12:00.235276 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:00.235144 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 11:12:00.235276 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:00.235168 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 11:12:00.235276 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:00.235120 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-56vkg\"" Jul 14 11:12:00.235540 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:00.235469 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 11:12:00.235540 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:00.235483 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 11:12:00.409706 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:00.409652 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m7wqs" event={"ID":"b6473f89-ff70-4b55-9c7c-b19f4e27e564","Type":"ContainerStarted","Data":"bea1693ef4f8f3905cdd8f36c435231c663b2c25803fc0c715efb136432443d9"} Jul 14 11:12:00.413204 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:00.413171 2580 generic.go:356] "Generic (PLEG): container finished" podID="69c7be6f-e4a5-4d78-9f39-418ad8ad136a" containerID="afdde9152c5472bf79176d96e66b4782bda2ad576a1a8b982f48159b35ece002" exitCode=0 Jul 14 11:12:00.413363 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:00.413219 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g4jtd" event={"ID":"69c7be6f-e4a5-4d78-9f39-418ad8ad136a","Type":"ContainerDied","Data":"afdde9152c5472bf79176d96e66b4782bda2ad576a1a8b982f48159b35ece002"} Jul 14 11:12:00.748294 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:00.748201 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls\") pod \"dns-default-6jzwh\" (UID: \"ff56a558-60cb-416a-b1cd-9da387c9c905\") " pod="openshift-dns/dns-default-6jzwh" Jul 14 11:12:00.748444 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:12:00.748356 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:12:00.748444 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:12:00.748417 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls podName:ff56a558-60cb-416a-b1cd-9da387c9c905 nodeName:}" failed. No retries permitted until 2026-07-14 11:12:02.748400596 +0000 UTC m=+39.062534096 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls") pod "dns-default-6jzwh" (UID: "ff56a558-60cb-416a-b1cd-9da387c9c905") : secret "dns-default-metrics-tls" not found Jul 14 11:12:01.419384 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:01.419316 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g4jtd" event={"ID":"69c7be6f-e4a5-4d78-9f39-418ad8ad136a","Type":"ContainerStarted","Data":"50c5f859da4657de62de674bce388f147ca967930c54508ddc883c74a02bfafd"} Jul 14 11:12:01.451813 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:01.451755 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-g4jtd" podStartSLOduration=8.436505257 podStartE2EDuration="37.451736367s" totalImagesPullingTime="29.01523111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:12:01.445398593 +0000 UTC m=+37.759532110" watchObservedRunningTime="2026-07-14 11:12:01.451736367 +0000 UTC m=+37.765869885" Jul 14 11:12:02.423492 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:02.423275 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m7wqs" event={"ID":"b6473f89-ff70-4b55-9c7c-b19f4e27e564","Type":"ContainerStarted","Data":"034c23083d795a691b362c871e2ea77b4dcd5951338a53714c169facf27a86b6"} Jul 14 11:12:02.439382 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:02.439337 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-m7wqs" podStartSLOduration=1.033975273 podStartE2EDuration="3.43931705s" totalImagesPullingTime="2.405341777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:11:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:12:02.439087618 +0000 UTC m=+38.753221136" watchObservedRunningTime="2026-07-14 11:12:02.43931705 +0000 UTC m=+38.753450567" Jul 14 11:12:02.763130 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:02.763038 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls\") pod \"dns-default-6jzwh\" (UID: \"ff56a558-60cb-416a-b1cd-9da387c9c905\") " pod="openshift-dns/dns-default-6jzwh" Jul 14 11:12:02.763322 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:12:02.763177 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:12:02.763322 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:12:02.763253 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls podName:ff56a558-60cb-416a-b1cd-9da387c9c905 nodeName:}" failed. No retries permitted until 2026-07-14 11:12:06.763219464 +0000 UTC m=+43.077352960 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls") pod "dns-default-6jzwh" (UID: "ff56a558-60cb-416a-b1cd-9da387c9c905") : secret "dns-default-metrics-tls" not found Jul 14 11:12:06.789348 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:06.789296 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls\") pod \"dns-default-6jzwh\" (UID: \"ff56a558-60cb-416a-b1cd-9da387c9c905\") " pod="openshift-dns/dns-default-6jzwh" Jul 14 11:12:06.789879 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:12:06.789422 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:12:06.789879 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:12:06.789478 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls podName:ff56a558-60cb-416a-b1cd-9da387c9c905 nodeName:}" failed. No retries permitted until 2026-07-14 11:12:14.789465225 +0000 UTC m=+51.103598720 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls") pod "dns-default-6jzwh" (UID: "ff56a558-60cb-416a-b1cd-9da387c9c905") : secret "dns-default-metrics-tls" not found Jul 14 11:12:14.844855 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:14.844811 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls\") pod \"dns-default-6jzwh\" (UID: \"ff56a558-60cb-416a-b1cd-9da387c9c905\") " pod="openshift-dns/dns-default-6jzwh" Jul 14 11:12:14.845262 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:12:14.844980 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:12:14.845262 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:12:14.845047 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls podName:ff56a558-60cb-416a-b1cd-9da387c9c905 nodeName:}" failed. No retries permitted until 2026-07-14 11:12:30.845029431 +0000 UTC m=+67.159162950 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls") pod "dns-default-6jzwh" (UID: "ff56a558-60cb-416a-b1cd-9da387c9c905") : secret "dns-default-metrics-tls" not found Jul 14 11:12:25.403896 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:25.403866 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ndktj" Jul 14 11:12:29.852680 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:29.852640 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs\") pod \"network-metrics-daemon-q2stq\" (UID: \"d333f07a-92a3-4c63-8f62-5a5eec2496b7\") " pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:12:29.855353 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:29.855333 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 11:12:29.862878 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:12:29.862860 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 14 11:12:29.862937 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:12:29.862929 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs podName:d333f07a-92a3-4c63-8f62-5a5eec2496b7 nodeName:}" failed. No retries permitted until 2026-07-14 11:13:33.862908228 +0000 UTC m=+130.177041724 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs") pod "network-metrics-daemon-q2stq" (UID: "d333f07a-92a3-4c63-8f62-5a5eec2496b7") : secret "metrics-daemon-secret" not found Jul 14 11:12:29.953415 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:29.953381 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4432fb72-2ee9-49e5-bc93-73462d52ed6e-original-pull-secret\") pod \"global-pull-secret-syncer-lzzhb\" (UID: \"4432fb72-2ee9-49e5-bc93-73462d52ed6e\") " pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:12:29.953533 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:29.953455 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj5jr\" (UniqueName: \"kubernetes.io/projected/53bd384d-a054-45b7-83a6-e18ea91b6567-kube-api-access-qj5jr\") pod \"network-check-target-pkpr6\" (UID: \"53bd384d-a054-45b7-83a6-e18ea91b6567\") " pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:12:29.956937 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:29.956921 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 11:12:29.957040 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:29.957024 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 11:12:29.966744 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:29.966719 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 11:12:29.968097 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:29.968069 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4432fb72-2ee9-49e5-bc93-73462d52ed6e-original-pull-secret\") pod \"global-pull-secret-syncer-lzzhb\" (UID: \"4432fb72-2ee9-49e5-bc93-73462d52ed6e\") " pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:12:29.977578 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:29.977554 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj5jr\" (UniqueName: \"kubernetes.io/projected/53bd384d-a054-45b7-83a6-e18ea91b6567-kube-api-access-qj5jr\") pod \"network-check-target-pkpr6\" (UID: \"53bd384d-a054-45b7-83a6-e18ea91b6567\") " pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:12:30.248291 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:30.248200 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzzhb" Jul 14 11:12:30.256770 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:30.256753 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-56vkg\"" Jul 14 11:12:30.265101 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:30.265083 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:12:30.416461 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:30.416430 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lzzhb"] Jul 14 11:12:30.421449 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:12:30.421420 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4432fb72_2ee9_49e5_bc93_73462d52ed6e.slice/crio-a566934488cd79c6869462949d94573ced76dcf6cc615f4df192389f7af8f9a5 WatchSource:0}: Error finding container a566934488cd79c6869462949d94573ced76dcf6cc615f4df192389f7af8f9a5: Status 404 returned error can't find the container with id a566934488cd79c6869462949d94573ced76dcf6cc615f4df192389f7af8f9a5 Jul 14 11:12:30.431545 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:30.430967 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pkpr6"] Jul 14 11:12:30.436017 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:12:30.435992 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53bd384d_a054_45b7_83a6_e18ea91b6567.slice/crio-0fb5567e7f3c3277d447903c8048966b2cd2315d272826b6aa534fb154ca72fd WatchSource:0}: Error finding container 0fb5567e7f3c3277d447903c8048966b2cd2315d272826b6aa534fb154ca72fd: Status 404 returned error can't find the container with id 0fb5567e7f3c3277d447903c8048966b2cd2315d272826b6aa534fb154ca72fd Jul 14 11:12:30.489112 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:30.489066 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pkpr6" event={"ID":"53bd384d-a054-45b7-83a6-e18ea91b6567","Type":"ContainerStarted","Data":"0fb5567e7f3c3277d447903c8048966b2cd2315d272826b6aa534fb154ca72fd"} Jul 14 11:12:30.490090 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:30.490068 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lzzhb" event={"ID":"4432fb72-2ee9-49e5-bc93-73462d52ed6e","Type":"ContainerStarted","Data":"a566934488cd79c6869462949d94573ced76dcf6cc615f4df192389f7af8f9a5"} Jul 14 11:12:30.858023 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:30.857975 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls\") pod \"dns-default-6jzwh\" (UID: \"ff56a558-60cb-416a-b1cd-9da387c9c905\") " pod="openshift-dns/dns-default-6jzwh" Jul 14 11:12:30.858585 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:12:30.858113 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:12:30.858585 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:12:30.858265 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls podName:ff56a558-60cb-416a-b1cd-9da387c9c905 nodeName:}" failed. No retries permitted until 2026-07-14 11:13:02.858222616 +0000 UTC m=+99.172356115 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls") pod "dns-default-6jzwh" (UID: "ff56a558-60cb-416a-b1cd-9da387c9c905") : secret "dns-default-metrics-tls" not found Jul 14 11:12:35.504363 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:35.504253 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pkpr6" event={"ID":"53bd384d-a054-45b7-83a6-e18ea91b6567","Type":"ContainerStarted","Data":"1a2df013cf3c68c6e5647eb9a8f5ce44d3c8bc069cc2498fe0cc73d8ef1adea8"} Jul 14 11:12:35.504755 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:35.504367 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:12:35.505616 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:35.505595 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lzzhb" event={"ID":"4432fb72-2ee9-49e5-bc93-73462d52ed6e","Type":"ContainerStarted","Data":"15c5e230d33e299d4f0c37b898f8dfd93c71ee49defd08c08fc417286194456b"} Jul 14 11:12:35.524536 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:35.524484 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pkpr6" podStartSLOduration=66.781575515 podStartE2EDuration="1m11.524471066s" totalImagesPullingTime="4.742895551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:12:35.524120059 +0000 UTC m=+71.838253591" watchObservedRunningTime="2026-07-14 11:12:35.524471066 +0000 UTC m=+71.838604584" Jul 14 11:12:57.201254 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.201059 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lzzhb" podStartSLOduration=88.445478733 podStartE2EDuration="1m33.201042782s" totalImagesPullingTime="4.755564049s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:12:35.541317174 +0000 UTC m=+71.855450691" watchObservedRunningTime="2026-07-14 11:12:57.201042782 +0000 UTC m=+93.515176301" Jul 14 11:12:57.201803 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.201785 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb97644cb-k9r4v"] Jul 14 11:12:57.205858 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.205843 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb97644cb-k9r4v" Jul 14 11:12:57.209846 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.209820 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 14 11:12:57.209846 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.209833 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 14 11:12:57.209846 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.209840 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 14 11:12:57.209846 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.209821 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 14 11:12:57.216619 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.216598 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb97644cb-k9r4v"] Jul 14 11:12:57.219365 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.219345 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25"] Jul 14 11:12:57.222358 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.222343 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" Jul 14 11:12:57.224901 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.224885 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 14 11:12:57.225019 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.224915 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 14 11:12:57.225065 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.225043 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 14 11:12:57.225110 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.225088 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 14 11:12:57.232874 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.232851 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25"] Jul 14 11:12:57.234195 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.234172 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/46e251fe-159a-439e-9687-184a8305db8c-klusterlet-config\") pod \"klusterlet-addon-workmgr-7bb97644cb-k9r4v\" (UID: \"46e251fe-159a-439e-9687-184a8305db8c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb97644cb-k9r4v" Jul 14 11:12:57.234314 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.234200 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrnz4\" (UniqueName: \"kubernetes.io/projected/46e251fe-159a-439e-9687-184a8305db8c-kube-api-access-mrnz4\") pod \"klusterlet-addon-workmgr-7bb97644cb-k9r4v\" (UID: \"46e251fe-159a-439e-9687-184a8305db8c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb97644cb-k9r4v" Jul 14 11:12:57.234314 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.234293 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46e251fe-159a-439e-9687-184a8305db8c-tmp\") pod \"klusterlet-addon-workmgr-7bb97644cb-k9r4v\" (UID: \"46e251fe-159a-439e-9687-184a8305db8c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb97644cb-k9r4v" Jul 14 11:12:57.335066 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.335024 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e4b72377-8f3b-4f11-9ce5-cf1e37a5f004-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-795546dfb5-8hm25\" (UID: \"e4b72377-8f3b-4f11-9ce5-cf1e37a5f004\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" Jul 14 11:12:57.335066 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.335066 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e4b72377-8f3b-4f11-9ce5-cf1e37a5f004-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-795546dfb5-8hm25\" (UID: \"e4b72377-8f3b-4f11-9ce5-cf1e37a5f004\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" Jul 14 11:12:57.335302 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.335087 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx6sm\" (UniqueName: \"kubernetes.io/projected/e4b72377-8f3b-4f11-9ce5-cf1e37a5f004-kube-api-access-vx6sm\") pod \"cluster-proxy-proxy-agent-795546dfb5-8hm25\" (UID: \"e4b72377-8f3b-4f11-9ce5-cf1e37a5f004\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" Jul 14 11:12:57.335302 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.335133 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4b72377-8f3b-4f11-9ce5-cf1e37a5f004-additional-service-ca\") pod \"cluster-proxy-proxy-agent-795546dfb5-8hm25\" (UID: \"e4b72377-8f3b-4f11-9ce5-cf1e37a5f004\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" Jul 14 11:12:57.335302 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.335221 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/46e251fe-159a-439e-9687-184a8305db8c-klusterlet-config\") pod \"klusterlet-addon-workmgr-7bb97644cb-k9r4v\" (UID: \"46e251fe-159a-439e-9687-184a8305db8c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb97644cb-k9r4v" Jul 14 11:12:57.335302 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.335277 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrnz4\" (UniqueName: \"kubernetes.io/projected/46e251fe-159a-439e-9687-184a8305db8c-kube-api-access-mrnz4\") pod \"klusterlet-addon-workmgr-7bb97644cb-k9r4v\" (UID: \"46e251fe-159a-439e-9687-184a8305db8c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb97644cb-k9r4v" Jul 14 11:12:57.335302 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.335293 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e4b72377-8f3b-4f11-9ce5-cf1e37a5f004-hub\") pod \"cluster-proxy-proxy-agent-795546dfb5-8hm25\" (UID: \"e4b72377-8f3b-4f11-9ce5-cf1e37a5f004\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" Jul 14 11:12:57.335462 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.335342 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46e251fe-159a-439e-9687-184a8305db8c-tmp\") pod \"klusterlet-addon-workmgr-7bb97644cb-k9r4v\" (UID: \"46e251fe-159a-439e-9687-184a8305db8c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb97644cb-k9r4v" Jul 14 11:12:57.335462 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.335356 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e4b72377-8f3b-4f11-9ce5-cf1e37a5f004-ca\") pod \"cluster-proxy-proxy-agent-795546dfb5-8hm25\" (UID: \"e4b72377-8f3b-4f11-9ce5-cf1e37a5f004\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" Jul 14 11:12:57.335715 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.335698 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46e251fe-159a-439e-9687-184a8305db8c-tmp\") pod \"klusterlet-addon-workmgr-7bb97644cb-k9r4v\" (UID: \"46e251fe-159a-439e-9687-184a8305db8c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb97644cb-k9r4v" Jul 14 11:12:57.337802 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.337782 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/46e251fe-159a-439e-9687-184a8305db8c-klusterlet-config\") pod \"klusterlet-addon-workmgr-7bb97644cb-k9r4v\" (UID: \"46e251fe-159a-439e-9687-184a8305db8c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb97644cb-k9r4v" Jul 14 11:12:57.343531 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.343511 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrnz4\" (UniqueName: \"kubernetes.io/projected/46e251fe-159a-439e-9687-184a8305db8c-kube-api-access-mrnz4\") pod \"klusterlet-addon-workmgr-7bb97644cb-k9r4v\" (UID: \"46e251fe-159a-439e-9687-184a8305db8c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb97644cb-k9r4v" Jul 14 11:12:57.436658 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.436612 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e4b72377-8f3b-4f11-9ce5-cf1e37a5f004-ca\") pod \"cluster-proxy-proxy-agent-795546dfb5-8hm25\" (UID: \"e4b72377-8f3b-4f11-9ce5-cf1e37a5f004\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" Jul 14 11:12:57.436658 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.436660 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e4b72377-8f3b-4f11-9ce5-cf1e37a5f004-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-795546dfb5-8hm25\" (UID: \"e4b72377-8f3b-4f11-9ce5-cf1e37a5f004\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" Jul 14 11:12:57.436658 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.436680 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e4b72377-8f3b-4f11-9ce5-cf1e37a5f004-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-795546dfb5-8hm25\" (UID: \"e4b72377-8f3b-4f11-9ce5-cf1e37a5f004\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" Jul 14 11:12:57.436958 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.436706 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx6sm\" (UniqueName: \"kubernetes.io/projected/e4b72377-8f3b-4f11-9ce5-cf1e37a5f004-kube-api-access-vx6sm\") pod \"cluster-proxy-proxy-agent-795546dfb5-8hm25\" (UID: \"e4b72377-8f3b-4f11-9ce5-cf1e37a5f004\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" Jul 14 11:12:57.436958 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.436761 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4b72377-8f3b-4f11-9ce5-cf1e37a5f004-additional-service-ca\") pod \"cluster-proxy-proxy-agent-795546dfb5-8hm25\" (UID: \"e4b72377-8f3b-4f11-9ce5-cf1e37a5f004\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" Jul 14 11:12:57.436958 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.436827 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e4b72377-8f3b-4f11-9ce5-cf1e37a5f004-hub\") pod \"cluster-proxy-proxy-agent-795546dfb5-8hm25\" (UID: \"e4b72377-8f3b-4f11-9ce5-cf1e37a5f004\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" Jul 14 11:12:57.437814 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.437783 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4b72377-8f3b-4f11-9ce5-cf1e37a5f004-additional-service-ca\") pod \"cluster-proxy-proxy-agent-795546dfb5-8hm25\" (UID: \"e4b72377-8f3b-4f11-9ce5-cf1e37a5f004\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" Jul 14 11:12:57.439281 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.439255 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e4b72377-8f3b-4f11-9ce5-cf1e37a5f004-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-795546dfb5-8hm25\" (UID: \"e4b72377-8f3b-4f11-9ce5-cf1e37a5f004\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" Jul 14 11:12:57.439391 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.439297 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e4b72377-8f3b-4f11-9ce5-cf1e37a5f004-ca\") pod \"cluster-proxy-proxy-agent-795546dfb5-8hm25\" (UID: \"e4b72377-8f3b-4f11-9ce5-cf1e37a5f004\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" Jul 14 11:12:57.439541 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.439522 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e4b72377-8f3b-4f11-9ce5-cf1e37a5f004-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-795546dfb5-8hm25\" (UID: \"e4b72377-8f3b-4f11-9ce5-cf1e37a5f004\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" Jul 14 11:12:57.439597 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.439520 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e4b72377-8f3b-4f11-9ce5-cf1e37a5f004-hub\") pod \"cluster-proxy-proxy-agent-795546dfb5-8hm25\" (UID: \"e4b72377-8f3b-4f11-9ce5-cf1e37a5f004\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" Jul 14 11:12:57.444511 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.444493 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx6sm\" (UniqueName: \"kubernetes.io/projected/e4b72377-8f3b-4f11-9ce5-cf1e37a5f004-kube-api-access-vx6sm\") pod \"cluster-proxy-proxy-agent-795546dfb5-8hm25\" (UID: \"e4b72377-8f3b-4f11-9ce5-cf1e37a5f004\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" Jul 14 11:12:57.514556 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.514468 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb97644cb-k9r4v" Jul 14 11:12:57.542902 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.542874 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" Jul 14 11:12:57.649168 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.649140 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb97644cb-k9r4v"] Jul 14 11:12:57.651449 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:12:57.651423 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46e251fe_159a_439e_9687_184a8305db8c.slice/crio-c2ecfa4e3801c3ad57ae504bb9b5786b9439f0802fb430694dd6de159c84fdb5 WatchSource:0}: Error finding container c2ecfa4e3801c3ad57ae504bb9b5786b9439f0802fb430694dd6de159c84fdb5: Status 404 returned error can't find the container with id c2ecfa4e3801c3ad57ae504bb9b5786b9439f0802fb430694dd6de159c84fdb5 Jul 14 11:12:57.674746 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:57.674715 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25"] Jul 14 11:12:57.678996 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:12:57.678968 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4b72377_8f3b_4f11_9ce5_cf1e37a5f004.slice/crio-4e8bc2c3beff0cf313c6d58f2655f21f4aab17c9fcda17d4f2f6d500dc6ec622 WatchSource:0}: Error finding container 4e8bc2c3beff0cf313c6d58f2655f21f4aab17c9fcda17d4f2f6d500dc6ec622: Status 404 returned error can't find the container with id 4e8bc2c3beff0cf313c6d58f2655f21f4aab17c9fcda17d4f2f6d500dc6ec622 Jul 14 11:12:58.565035 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:58.564956 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" event={"ID":"e4b72377-8f3b-4f11-9ce5-cf1e37a5f004","Type":"ContainerStarted","Data":"4e8bc2c3beff0cf313c6d58f2655f21f4aab17c9fcda17d4f2f6d500dc6ec622"} Jul 14 11:12:58.567103 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:12:58.567033 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb97644cb-k9r4v" event={"ID":"46e251fe-159a-439e-9687-184a8305db8c","Type":"ContainerStarted","Data":"c2ecfa4e3801c3ad57ae504bb9b5786b9439f0802fb430694dd6de159c84fdb5"} Jul 14 11:13:02.882582 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:13:02.882480 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls\") pod \"dns-default-6jzwh\" (UID: \"ff56a558-60cb-416a-b1cd-9da387c9c905\") " pod="openshift-dns/dns-default-6jzwh" Jul 14 11:13:02.883003 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:13:02.882601 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:13:02.883003 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:13:02.882655 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls podName:ff56a558-60cb-416a-b1cd-9da387c9c905 nodeName:}" failed. No retries permitted until 2026-07-14 11:14:06.882641472 +0000 UTC m=+163.196774968 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls") pod "dns-default-6jzwh" (UID: "ff56a558-60cb-416a-b1cd-9da387c9c905") : secret "dns-default-metrics-tls" not found Jul 14 11:13:03.584758 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:13:03.584723 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" event={"ID":"e4b72377-8f3b-4f11-9ce5-cf1e37a5f004","Type":"ContainerStarted","Data":"02347e5f2075bdb33734b52d49f3ba19b55c26824cc4f5ad53f7e2ac89a30d10"} Jul 14 11:13:03.584934 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:13:03.584774 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" event={"ID":"e4b72377-8f3b-4f11-9ce5-cf1e37a5f004","Type":"ContainerStarted","Data":"ae7146197e33d5c4a08a43d0944dc6a5f77c516e0411f8727a2fb324a6a917b3"} Jul 14 11:13:03.584934 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:13:03.584795 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" event={"ID":"e4b72377-8f3b-4f11-9ce5-cf1e37a5f004","Type":"ContainerStarted","Data":"630cae31c52ec5a6bc666918b4f631fb92e2d88ca8aa53ffd2edc651e93c3df8"} Jul 14 11:13:03.586067 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:13:03.586037 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb97644cb-k9r4v" event={"ID":"46e251fe-159a-439e-9687-184a8305db8c","Type":"ContainerStarted","Data":"819a629c11e32d1212b75936f87414328e7cdc543bf8cd4969715fadc33141c6"} Jul 14 11:13:03.586176 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:13:03.586157 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb97644cb-k9r4v" Jul 14 11:13:03.587645 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:13:03.587629 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb97644cb-k9r4v" Jul 14 11:13:03.611880 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:13:03.611814 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" podStartSLOduration=1.681826949 podStartE2EDuration="6.611795311s" totalImagesPullingTime="4.929968362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:13:03.611453516 +0000 UTC m=+99.925587035" watchObservedRunningTime="2026-07-14 11:13:03.611795311 +0000 UTC m=+99.925928812" Jul 14 11:13:03.634317 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:13:03.634269 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb97644cb-k9r4v" podStartSLOduration=1.675115863 podStartE2EDuration="6.634252575s" totalImagesPullingTime="4.959136712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:13:03.633035065 +0000 UTC m=+99.947168585" watchObservedRunningTime="2026-07-14 11:13:03.634252575 +0000 UTC m=+99.948386088" Jul 14 11:13:06.510502 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:13:06.510474 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pkpr6" Jul 14 11:13:33.901392 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:13:33.901354 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs\") pod \"network-metrics-daemon-q2stq\" (UID: \"d333f07a-92a3-4c63-8f62-5a5eec2496b7\") " pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:13:33.901871 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:13:33.901476 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 14 11:13:33.901871 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:13:33.901540 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs podName:d333f07a-92a3-4c63-8f62-5a5eec2496b7 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:35.901524688 +0000 UTC m=+252.215658184 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs") pod "network-metrics-daemon-q2stq" (UID: "d333f07a-92a3-4c63-8f62-5a5eec2496b7") : secret "metrics-daemon-secret" not found Jul 14 11:14:02.075091 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:14:02.075040 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6jzwh" podUID="ff56a558-60cb-416a-b1cd-9da387c9c905" Jul 14 11:14:02.753518 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:14:02.753487 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6jzwh" Jul 14 11:14:03.242044 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:14:03.242000 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-q2stq" podUID="d333f07a-92a3-4c63-8f62-5a5eec2496b7" Jul 14 11:14:06.940963 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:14:06.940922 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls\") pod \"dns-default-6jzwh\" (UID: \"ff56a558-60cb-416a-b1cd-9da387c9c905\") " pod="openshift-dns/dns-default-6jzwh" Jul 14 11:14:06.941474 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:14:06.941046 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:14:06.941474 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:14:06.941114 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls podName:ff56a558-60cb-416a-b1cd-9da387c9c905 nodeName:}" failed. No retries permitted until 2026-07-14 11:16:08.941096247 +0000 UTC m=+285.255229742 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls") pod "dns-default-6jzwh" (UID: "ff56a558-60cb-416a-b1cd-9da387c9c905") : secret "dns-default-metrics-tls" not found Jul 14 11:14:17.228997 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:14:17.228908 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:15:02.928132 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:02.928084 2580 generic.go:356] "Generic (PLEG): container finished" podID="46e251fe-159a-439e-9687-184a8305db8c" containerID="819a629c11e32d1212b75936f87414328e7cdc543bf8cd4969715fadc33141c6" exitCode=1 Jul 14 11:15:02.928571 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:02.928150 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb97644cb-k9r4v" event={"ID":"46e251fe-159a-439e-9687-184a8305db8c","Type":"ContainerDied","Data":"819a629c11e32d1212b75936f87414328e7cdc543bf8cd4969715fadc33141c6"} Jul 14 11:15:02.928571 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:02.928450 2580 scope.go:117] "RemoveContainer" containerID="819a629c11e32d1212b75936f87414328e7cdc543bf8cd4969715fadc33141c6" Jul 14 11:15:03.586300 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:03.586248 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb97644cb-k9r4v" Jul 14 11:15:03.932685 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:03.932645 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb97644cb-k9r4v" event={"ID":"46e251fe-159a-439e-9687-184a8305db8c","Type":"ContainerStarted","Data":"bc97a2662e0578dc638a7a2cfb7960b568e80aa8b00b20608cc10b949fc840e6"} Jul 14 11:15:03.933130 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:03.932944 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb97644cb-k9r4v" Jul 14 11:15:03.933492 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:03.933473 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb97644cb-k9r4v" Jul 14 11:15:35.954741 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:35.954698 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs\") pod \"network-metrics-daemon-q2stq\" (UID: \"d333f07a-92a3-4c63-8f62-5a5eec2496b7\") " pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:15:35.955214 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:15:35.954842 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 14 11:15:35.955214 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:15:35.954922 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs podName:d333f07a-92a3-4c63-8f62-5a5eec2496b7 nodeName:}" failed. No retries permitted until 2026-07-14 11:17:37.954903243 +0000 UTC m=+374.269036741 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs") pod "network-metrics-daemon-q2stq" (UID: "d333f07a-92a3-4c63-8f62-5a5eec2496b7") : secret "metrics-daemon-secret" not found Jul 14 11:15:47.395564 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:47.395482 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-76l9d"] Jul 14 11:15:47.397398 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:47.397382 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-76l9d" Jul 14 11:15:47.401988 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:47.401967 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 14 11:15:47.401988 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:47.401981 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 14 11:15:47.402176 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:47.401981 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 14 11:15:47.402946 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:47.402925 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v758q\"" Jul 14 11:15:47.403672 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:47.403333 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 14 11:15:47.422907 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:47.422879 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-76l9d"] Jul 14 11:15:47.526996 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:47.526960 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-data-volume\") pod \"insights-runtime-extractor-76l9d\" (UID: \"31faf0e2-46a2-4e11-a48d-ec2afc6130cd\") " pod="openshift-insights/insights-runtime-extractor-76l9d" Jul 14 11:15:47.526996 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:47.526994 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqhfd\" (UniqueName: \"kubernetes.io/projected/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-kube-api-access-vqhfd\") pod \"insights-runtime-extractor-76l9d\" (UID: \"31faf0e2-46a2-4e11-a48d-ec2afc6130cd\") " pod="openshift-insights/insights-runtime-extractor-76l9d" Jul 14 11:15:47.527210 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:47.527014 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-76l9d\" (UID: \"31faf0e2-46a2-4e11-a48d-ec2afc6130cd\") " pod="openshift-insights/insights-runtime-extractor-76l9d" Jul 14 11:15:47.527210 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:47.527052 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-76l9d\" (UID: \"31faf0e2-46a2-4e11-a48d-ec2afc6130cd\") " pod="openshift-insights/insights-runtime-extractor-76l9d" Jul 14 11:15:47.527210 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:47.527090 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-crio-socket\") pod \"insights-runtime-extractor-76l9d\" (UID: \"31faf0e2-46a2-4e11-a48d-ec2afc6130cd\") " pod="openshift-insights/insights-runtime-extractor-76l9d" Jul 14 11:15:47.627539 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:47.627501 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-crio-socket\") pod \"insights-runtime-extractor-76l9d\" (UID: \"31faf0e2-46a2-4e11-a48d-ec2afc6130cd\") " pod="openshift-insights/insights-runtime-extractor-76l9d" Jul 14 11:15:47.627703 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:47.627556 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-data-volume\") pod \"insights-runtime-extractor-76l9d\" (UID: \"31faf0e2-46a2-4e11-a48d-ec2afc6130cd\") " pod="openshift-insights/insights-runtime-extractor-76l9d" Jul 14 11:15:47.627703 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:47.627583 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqhfd\" (UniqueName: \"kubernetes.io/projected/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-kube-api-access-vqhfd\") pod \"insights-runtime-extractor-76l9d\" (UID: \"31faf0e2-46a2-4e11-a48d-ec2afc6130cd\") " pod="openshift-insights/insights-runtime-extractor-76l9d" Jul 14 11:15:47.627703 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:47.627603 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-76l9d\" (UID: \"31faf0e2-46a2-4e11-a48d-ec2afc6130cd\") " pod="openshift-insights/insights-runtime-extractor-76l9d" Jul 14 11:15:47.627703 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:47.627617 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-76l9d\" (UID: \"31faf0e2-46a2-4e11-a48d-ec2afc6130cd\") " pod="openshift-insights/insights-runtime-extractor-76l9d" Jul 14 11:15:47.627703 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:47.627633 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-crio-socket\") pod \"insights-runtime-extractor-76l9d\" (UID: \"31faf0e2-46a2-4e11-a48d-ec2afc6130cd\") " pod="openshift-insights/insights-runtime-extractor-76l9d" Jul 14 11:15:47.627703 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:15:47.627696 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 11:15:47.627891 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:15:47.627724 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 11:15:47.627891 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:15:47.627776 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-kube-rbac-proxy-cm podName:31faf0e2-46a2-4e11-a48d-ec2afc6130cd nodeName:}" failed. No retries permitted until 2026-07-14 11:15:48.127757616 +0000 UTC m=+264.441891136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-76l9d" (UID: "31faf0e2-46a2-4e11-a48d-ec2afc6130cd") : configmap "kube-rbac-proxy" not found Jul 14 11:15:47.627891 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:15:47.627793 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-insights-runtime-extractor-tls podName:31faf0e2-46a2-4e11-a48d-ec2afc6130cd nodeName:}" failed. No retries permitted until 2026-07-14 11:15:48.127784557 +0000 UTC m=+264.441918053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-76l9d" (UID: "31faf0e2-46a2-4e11-a48d-ec2afc6130cd") : secret "insights-runtime-extractor-tls" not found Jul 14 11:15:47.627989 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:47.627951 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-data-volume\") pod \"insights-runtime-extractor-76l9d\" (UID: \"31faf0e2-46a2-4e11-a48d-ec2afc6130cd\") " pod="openshift-insights/insights-runtime-extractor-76l9d" Jul 14 11:15:47.636636 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:47.636610 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqhfd\" (UniqueName: \"kubernetes.io/projected/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-kube-api-access-vqhfd\") pod \"insights-runtime-extractor-76l9d\" (UID: \"31faf0e2-46a2-4e11-a48d-ec2afc6130cd\") " pod="openshift-insights/insights-runtime-extractor-76l9d" Jul 14 11:15:48.130286 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:48.130245 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-76l9d\" (UID: \"31faf0e2-46a2-4e11-a48d-ec2afc6130cd\") " pod="openshift-insights/insights-runtime-extractor-76l9d" Jul 14 11:15:48.130493 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:48.130360 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-76l9d\" (UID: \"31faf0e2-46a2-4e11-a48d-ec2afc6130cd\") " pod="openshift-insights/insights-runtime-extractor-76l9d" Jul 14 11:15:48.130493 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:15:48.130379 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 11:15:48.130493 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:15:48.130439 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 11:15:48.130493 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:15:48.130454 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-insights-runtime-extractor-tls podName:31faf0e2-46a2-4e11-a48d-ec2afc6130cd nodeName:}" failed. No retries permitted until 2026-07-14 11:15:49.130438778 +0000 UTC m=+265.444572275 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-76l9d" (UID: "31faf0e2-46a2-4e11-a48d-ec2afc6130cd") : secret "insights-runtime-extractor-tls" not found Jul 14 11:15:48.130493 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:15:48.130486 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-kube-rbac-proxy-cm podName:31faf0e2-46a2-4e11-a48d-ec2afc6130cd nodeName:}" failed. No retries permitted until 2026-07-14 11:15:49.130472596 +0000 UTC m=+265.444606108 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-76l9d" (UID: "31faf0e2-46a2-4e11-a48d-ec2afc6130cd") : configmap "kube-rbac-proxy" not found Jul 14 11:15:49.138889 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:49.138856 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-76l9d\" (UID: \"31faf0e2-46a2-4e11-a48d-ec2afc6130cd\") " pod="openshift-insights/insights-runtime-extractor-76l9d" Jul 14 11:15:49.138889 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:49.138892 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-76l9d\" (UID: \"31faf0e2-46a2-4e11-a48d-ec2afc6130cd\") " pod="openshift-insights/insights-runtime-extractor-76l9d" Jul 14 11:15:49.139440 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:15:49.139006 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 11:15:49.139440 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:15:49.139092 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-kube-rbac-proxy-cm podName:31faf0e2-46a2-4e11-a48d-ec2afc6130cd nodeName:}" failed. No retries permitted until 2026-07-14 11:15:51.139070894 +0000 UTC m=+267.453204404 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-76l9d" (UID: "31faf0e2-46a2-4e11-a48d-ec2afc6130cd") : configmap "kube-rbac-proxy" not found Jul 14 11:15:49.139440 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:15:49.139015 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 11:15:49.139440 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:15:49.139144 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-insights-runtime-extractor-tls podName:31faf0e2-46a2-4e11-a48d-ec2afc6130cd nodeName:}" failed. No retries permitted until 2026-07-14 11:15:51.139133645 +0000 UTC m=+267.453267140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-76l9d" (UID: "31faf0e2-46a2-4e11-a48d-ec2afc6130cd") : secret "insights-runtime-extractor-tls" not found Jul 14 11:15:49.554505 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:49.554427 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s6hzg_e4b66bf7-506a-4e2e-bcca-3b29f9b7b5df/dns-node-resolver/0.log" Jul 14 11:15:50.153921 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:50.153893 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hvb4s_c9729993-471c-42e3-8723-7c1982f23e0a/node-ca/0.log" Jul 14 11:15:51.151118 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:51.151094 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m7wqs_b6473f89-ff70-4b55-9c7c-b19f4e27e564/serve-healthcheck-canary/0.log" Jul 14 11:15:51.152223 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:51.152193 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-76l9d\" (UID: \"31faf0e2-46a2-4e11-a48d-ec2afc6130cd\") " pod="openshift-insights/insights-runtime-extractor-76l9d" Jul 14 11:15:51.152355 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:51.152252 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-76l9d\" (UID: \"31faf0e2-46a2-4e11-a48d-ec2afc6130cd\") " pod="openshift-insights/insights-runtime-extractor-76l9d" Jul 14 11:15:51.152355 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:15:51.152293 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 11:15:51.152355 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:15:51.152348 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-kube-rbac-proxy-cm podName:31faf0e2-46a2-4e11-a48d-ec2afc6130cd nodeName:}" failed. No retries permitted until 2026-07-14 11:15:55.152335045 +0000 UTC m=+271.466468541 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-76l9d" (UID: "31faf0e2-46a2-4e11-a48d-ec2afc6130cd") : configmap "kube-rbac-proxy" not found Jul 14 11:15:51.152496 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:15:51.152373 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 11:15:51.152496 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:15:51.152425 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-insights-runtime-extractor-tls podName:31faf0e2-46a2-4e11-a48d-ec2afc6130cd nodeName:}" failed. No retries permitted until 2026-07-14 11:15:55.152409556 +0000 UTC m=+271.466543067 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-76l9d" (UID: "31faf0e2-46a2-4e11-a48d-ec2afc6130cd") : secret "insights-runtime-extractor-tls" not found Jul 14 11:15:55.187172 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:55.187128 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-76l9d\" (UID: \"31faf0e2-46a2-4e11-a48d-ec2afc6130cd\") " pod="openshift-insights/insights-runtime-extractor-76l9d" Jul 14 11:15:55.187172 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:15:55.187170 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-76l9d\" (UID: \"31faf0e2-46a2-4e11-a48d-ec2afc6130cd\") " pod="openshift-insights/insights-runtime-extractor-76l9d" Jul 14 11:15:55.187637 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:15:55.187277 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 11:15:55.187637 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:15:55.187342 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-kube-rbac-proxy-cm podName:31faf0e2-46a2-4e11-a48d-ec2afc6130cd nodeName:}" failed. No retries permitted until 2026-07-14 11:16:03.187326159 +0000 UTC m=+279.501459654 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-76l9d" (UID: "31faf0e2-46a2-4e11-a48d-ec2afc6130cd") : configmap "kube-rbac-proxy" not found Jul 14 11:15:55.187637 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:15:55.187280 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 11:15:55.187637 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:15:55.187413 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-insights-runtime-extractor-tls podName:31faf0e2-46a2-4e11-a48d-ec2afc6130cd nodeName:}" failed. No retries permitted until 2026-07-14 11:16:03.187402916 +0000 UTC m=+279.501536412 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-76l9d" (UID: "31faf0e2-46a2-4e11-a48d-ec2afc6130cd") : secret "insights-runtime-extractor-tls" not found Jul 14 11:16:03.252389 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:03.252352 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-76l9d\" (UID: \"31faf0e2-46a2-4e11-a48d-ec2afc6130cd\") " pod="openshift-insights/insights-runtime-extractor-76l9d" Jul 14 11:16:03.252389 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:03.252391 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-76l9d\" (UID: \"31faf0e2-46a2-4e11-a48d-ec2afc6130cd\") " pod="openshift-insights/insights-runtime-extractor-76l9d" Jul 14 11:16:03.253022 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:03.252995 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-76l9d\" (UID: \"31faf0e2-46a2-4e11-a48d-ec2afc6130cd\") " pod="openshift-insights/insights-runtime-extractor-76l9d" Jul 14 11:16:03.254837 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:03.254820 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31faf0e2-46a2-4e11-a48d-ec2afc6130cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-76l9d\" (UID: \"31faf0e2-46a2-4e11-a48d-ec2afc6130cd\") " pod="openshift-insights/insights-runtime-extractor-76l9d" Jul 14 11:16:03.306013 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:03.305977 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-76l9d" Jul 14 11:16:03.433866 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:03.433826 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-76l9d"] Jul 14 11:16:03.437406 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:16:03.437381 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31faf0e2_46a2_4e11_a48d_ec2afc6130cd.slice/crio-2efdb0e1de9304a6dde2b6b780c1b04c1d945b2b3881dcb22ef5a299e724e5ab WatchSource:0}: Error finding container 2efdb0e1de9304a6dde2b6b780c1b04c1d945b2b3881dcb22ef5a299e724e5ab: Status 404 returned error can't find the container with id 2efdb0e1de9304a6dde2b6b780c1b04c1d945b2b3881dcb22ef5a299e724e5ab Jul 14 11:16:04.107034 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:04.106952 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-76l9d" event={"ID":"31faf0e2-46a2-4e11-a48d-ec2afc6130cd","Type":"ContainerStarted","Data":"2efdb0e1de9304a6dde2b6b780c1b04c1d945b2b3881dcb22ef5a299e724e5ab"} Jul 14 11:16:05.754851 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:16:05.754798 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6jzwh" podUID="ff56a558-60cb-416a-b1cd-9da387c9c905" Jul 14 11:16:06.113247 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:06.113197 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6jzwh" Jul 14 11:16:08.120854 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:08.120819 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-76l9d" event={"ID":"31faf0e2-46a2-4e11-a48d-ec2afc6130cd","Type":"ContainerStarted","Data":"9db766cffcf8be2e50b7742146874b09cb106c0f816af2deada1d41e2cc1755d"} Jul 14 11:16:08.121288 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:08.120875 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-76l9d" event={"ID":"31faf0e2-46a2-4e11-a48d-ec2afc6130cd","Type":"ContainerStarted","Data":"cee1193ab8836a43fe29c24e61666f2c83059f7f6c066cf3eb5c54df00f11789"} Jul 14 11:16:08.997062 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:08.997023 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls\") pod \"dns-default-6jzwh\" (UID: \"ff56a558-60cb-416a-b1cd-9da387c9c905\") " pod="openshift-dns/dns-default-6jzwh" Jul 14 11:16:09.000027 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:08.999998 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff56a558-60cb-416a-b1cd-9da387c9c905-metrics-tls\") pod \"dns-default-6jzwh\" (UID: \"ff56a558-60cb-416a-b1cd-9da387c9c905\") " pod="openshift-dns/dns-default-6jzwh" Jul 14 11:16:09.116824 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.116791 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9dwb8\"" Jul 14 11:16:09.124954 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.124916 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6jzwh" Jul 14 11:16:09.278666 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.278543 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6jzwh"] Jul 14 11:16:09.281951 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:16:09.281918 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff56a558_60cb_416a_b1cd_9da387c9c905.slice/crio-70ca83e6f9149e68e24dabcd2074a73c7f97b2f1eacf86e6385599b8fba9bdd7 WatchSource:0}: Error finding container 70ca83e6f9149e68e24dabcd2074a73c7f97b2f1eacf86e6385599b8fba9bdd7: Status 404 returned error can't find the container with id 70ca83e6f9149e68e24dabcd2074a73c7f97b2f1eacf86e6385599b8fba9bdd7 Jul 14 11:16:09.368177 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.368145 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-2l4r2"] Jul 14 11:16:09.372688 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.372662 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-2l4r2" Jul 14 11:16:09.377171 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.377075 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-fl55v\"" Jul 14 11:16:09.377347 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.377170 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 14 11:16:09.377572 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.377551 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 14 11:16:09.390805 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.390777 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-2l4r2"] Jul 14 11:16:09.400726 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.400698 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twffj\" (UniqueName: \"kubernetes.io/projected/ffbc77d0-d4c1-4960-8f18-1ac89ceb8716-kube-api-access-twffj\") pod \"downloads-68c9cbb497-2l4r2\" (UID: \"ffbc77d0-d4c1-4960-8f18-1ac89ceb8716\") " pod="openshift-console/downloads-68c9cbb497-2l4r2" Jul 14 11:16:09.470741 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.470706 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-79c7894f4b-hcwhw"] Jul 14 11:16:09.473850 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.473827 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:09.479193 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.479170 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 14 11:16:09.479491 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.479470 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 14 11:16:09.479804 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.479787 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 14 11:16:09.481457 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.481438 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z7n4f\"" Jul 14 11:16:09.490407 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.490372 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 14 11:16:09.498652 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.498629 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79c7894f4b-hcwhw"] Jul 14 11:16:09.501802 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.501770 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s8b7\" (UniqueName: \"kubernetes.io/projected/a07dccb5-cb2d-44dc-91bf-43e0187e5fe8-kube-api-access-4s8b7\") pod \"image-registry-79c7894f4b-hcwhw\" (UID: \"a07dccb5-cb2d-44dc-91bf-43e0187e5fe8\") " pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:09.501914 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.501822 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a07dccb5-cb2d-44dc-91bf-43e0187e5fe8-bound-sa-token\") pod \"image-registry-79c7894f4b-hcwhw\" (UID: \"a07dccb5-cb2d-44dc-91bf-43e0187e5fe8\") " pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:09.501914 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.501846 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a07dccb5-cb2d-44dc-91bf-43e0187e5fe8-trusted-ca\") pod \"image-registry-79c7894f4b-hcwhw\" (UID: \"a07dccb5-cb2d-44dc-91bf-43e0187e5fe8\") " pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:09.501914 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.501872 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twffj\" (UniqueName: \"kubernetes.io/projected/ffbc77d0-d4c1-4960-8f18-1ac89ceb8716-kube-api-access-twffj\") pod \"downloads-68c9cbb497-2l4r2\" (UID: \"ffbc77d0-d4c1-4960-8f18-1ac89ceb8716\") " pod="openshift-console/downloads-68c9cbb497-2l4r2" Jul 14 11:16:09.501914 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.501891 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a07dccb5-cb2d-44dc-91bf-43e0187e5fe8-registry-tls\") pod \"image-registry-79c7894f4b-hcwhw\" (UID: \"a07dccb5-cb2d-44dc-91bf-43e0187e5fe8\") " pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:09.502094 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.501958 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a07dccb5-cb2d-44dc-91bf-43e0187e5fe8-image-registry-private-configuration\") pod \"image-registry-79c7894f4b-hcwhw\" (UID: \"a07dccb5-cb2d-44dc-91bf-43e0187e5fe8\") " pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:09.502094 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.501999 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a07dccb5-cb2d-44dc-91bf-43e0187e5fe8-registry-certificates\") pod \"image-registry-79c7894f4b-hcwhw\" (UID: \"a07dccb5-cb2d-44dc-91bf-43e0187e5fe8\") " pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:09.502094 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.502030 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a07dccb5-cb2d-44dc-91bf-43e0187e5fe8-installation-pull-secrets\") pod \"image-registry-79c7894f4b-hcwhw\" (UID: \"a07dccb5-cb2d-44dc-91bf-43e0187e5fe8\") " pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:09.502094 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.502053 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a07dccb5-cb2d-44dc-91bf-43e0187e5fe8-ca-trust-extracted\") pod \"image-registry-79c7894f4b-hcwhw\" (UID: \"a07dccb5-cb2d-44dc-91bf-43e0187e5fe8\") " pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:09.517118 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.517095 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twffj\" (UniqueName: \"kubernetes.io/projected/ffbc77d0-d4c1-4960-8f18-1ac89ceb8716-kube-api-access-twffj\") pod \"downloads-68c9cbb497-2l4r2\" (UID: \"ffbc77d0-d4c1-4960-8f18-1ac89ceb8716\") " pod="openshift-console/downloads-68c9cbb497-2l4r2" Jul 14 11:16:09.602615 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.602577 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s8b7\" (UniqueName: \"kubernetes.io/projected/a07dccb5-cb2d-44dc-91bf-43e0187e5fe8-kube-api-access-4s8b7\") pod \"image-registry-79c7894f4b-hcwhw\" (UID: \"a07dccb5-cb2d-44dc-91bf-43e0187e5fe8\") " pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:09.602787 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.602634 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a07dccb5-cb2d-44dc-91bf-43e0187e5fe8-bound-sa-token\") pod \"image-registry-79c7894f4b-hcwhw\" (UID: \"a07dccb5-cb2d-44dc-91bf-43e0187e5fe8\") " pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:09.602787 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.602653 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a07dccb5-cb2d-44dc-91bf-43e0187e5fe8-trusted-ca\") pod \"image-registry-79c7894f4b-hcwhw\" (UID: \"a07dccb5-cb2d-44dc-91bf-43e0187e5fe8\") " pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:09.602787 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.602669 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a07dccb5-cb2d-44dc-91bf-43e0187e5fe8-registry-tls\") pod \"image-registry-79c7894f4b-hcwhw\" (UID: \"a07dccb5-cb2d-44dc-91bf-43e0187e5fe8\") " pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:09.602787 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.602694 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a07dccb5-cb2d-44dc-91bf-43e0187e5fe8-image-registry-private-configuration\") pod \"image-registry-79c7894f4b-hcwhw\" (UID: \"a07dccb5-cb2d-44dc-91bf-43e0187e5fe8\") " pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:09.602787 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.602722 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a07dccb5-cb2d-44dc-91bf-43e0187e5fe8-registry-certificates\") pod \"image-registry-79c7894f4b-hcwhw\" (UID: \"a07dccb5-cb2d-44dc-91bf-43e0187e5fe8\") " pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:09.602787 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.602748 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a07dccb5-cb2d-44dc-91bf-43e0187e5fe8-installation-pull-secrets\") pod \"image-registry-79c7894f4b-hcwhw\" (UID: \"a07dccb5-cb2d-44dc-91bf-43e0187e5fe8\") " pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:09.603087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.602917 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a07dccb5-cb2d-44dc-91bf-43e0187e5fe8-ca-trust-extracted\") pod \"image-registry-79c7894f4b-hcwhw\" (UID: \"a07dccb5-cb2d-44dc-91bf-43e0187e5fe8\") " pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:09.603406 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.603358 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a07dccb5-cb2d-44dc-91bf-43e0187e5fe8-ca-trust-extracted\") pod \"image-registry-79c7894f4b-hcwhw\" (UID: \"a07dccb5-cb2d-44dc-91bf-43e0187e5fe8\") " pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:09.603773 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.603712 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a07dccb5-cb2d-44dc-91bf-43e0187e5fe8-registry-certificates\") pod \"image-registry-79c7894f4b-hcwhw\" (UID: \"a07dccb5-cb2d-44dc-91bf-43e0187e5fe8\") " pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:09.603882 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.603818 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a07dccb5-cb2d-44dc-91bf-43e0187e5fe8-trusted-ca\") pod \"image-registry-79c7894f4b-hcwhw\" (UID: \"a07dccb5-cb2d-44dc-91bf-43e0187e5fe8\") " pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:09.605948 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.605921 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a07dccb5-cb2d-44dc-91bf-43e0187e5fe8-registry-tls\") pod \"image-registry-79c7894f4b-hcwhw\" (UID: \"a07dccb5-cb2d-44dc-91bf-43e0187e5fe8\") " pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:09.606033 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.605951 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a07dccb5-cb2d-44dc-91bf-43e0187e5fe8-image-registry-private-configuration\") pod \"image-registry-79c7894f4b-hcwhw\" (UID: \"a07dccb5-cb2d-44dc-91bf-43e0187e5fe8\") " pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:09.606033 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.606003 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a07dccb5-cb2d-44dc-91bf-43e0187e5fe8-installation-pull-secrets\") pod \"image-registry-79c7894f4b-hcwhw\" (UID: \"a07dccb5-cb2d-44dc-91bf-43e0187e5fe8\") " pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:09.628186 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.628154 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a07dccb5-cb2d-44dc-91bf-43e0187e5fe8-bound-sa-token\") pod \"image-registry-79c7894f4b-hcwhw\" (UID: \"a07dccb5-cb2d-44dc-91bf-43e0187e5fe8\") " pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:09.628921 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.628890 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s8b7\" (UniqueName: \"kubernetes.io/projected/a07dccb5-cb2d-44dc-91bf-43e0187e5fe8-kube-api-access-4s8b7\") pod \"image-registry-79c7894f4b-hcwhw\" (UID: \"a07dccb5-cb2d-44dc-91bf-43e0187e5fe8\") " pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:09.684748 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.684709 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-2l4r2" Jul 14 11:16:09.785656 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:09.785612 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:10.128022 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:10.127991 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6jzwh" event={"ID":"ff56a558-60cb-416a-b1cd-9da387c9c905","Type":"ContainerStarted","Data":"70ca83e6f9149e68e24dabcd2074a73c7f97b2f1eacf86e6385599b8fba9bdd7"} Jul 14 11:16:10.528215 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:10.528186 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79c7894f4b-hcwhw"] Jul 14 11:16:10.529151 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:16:10.529119 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda07dccb5_cb2d_44dc_91bf_43e0187e5fe8.slice/crio-ba855039a02b3f33b3a5fa398c47cf934a85d15ec82cc06c8822174dec3d1b6b WatchSource:0}: Error finding container ba855039a02b3f33b3a5fa398c47cf934a85d15ec82cc06c8822174dec3d1b6b: Status 404 returned error can't find the container with id ba855039a02b3f33b3a5fa398c47cf934a85d15ec82cc06c8822174dec3d1b6b Jul 14 11:16:10.543222 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:10.543136 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-2l4r2"] Jul 14 11:16:10.547152 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:16:10.547131 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffbc77d0_d4c1_4960_8f18_1ac89ceb8716.slice/crio-fa9b860cef46c979b5a20665d7752656adc1e562f73aeb82c80328da207caf3d WatchSource:0}: Error finding container fa9b860cef46c979b5a20665d7752656adc1e562f73aeb82c80328da207caf3d: Status 404 returned error can't find the container with id fa9b860cef46c979b5a20665d7752656adc1e562f73aeb82c80328da207caf3d Jul 14 11:16:11.134522 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:11.134487 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-76l9d" event={"ID":"31faf0e2-46a2-4e11-a48d-ec2afc6130cd","Type":"ContainerStarted","Data":"d46661a946ace0b15854023e5d073a7286bf9f752f7102be6e6f7d1bc3191ccb"} Jul 14 11:16:11.135793 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:11.135762 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-2l4r2" event={"ID":"ffbc77d0-d4c1-4960-8f18-1ac89ceb8716","Type":"ContainerStarted","Data":"fa9b860cef46c979b5a20665d7752656adc1e562f73aeb82c80328da207caf3d"} Jul 14 11:16:11.137344 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:11.137317 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" event={"ID":"a07dccb5-cb2d-44dc-91bf-43e0187e5fe8","Type":"ContainerStarted","Data":"31160e0aa2e8335ab5c5f044aef3f9599ba71e0431d98235cc508fe55881fda2"} Jul 14 11:16:11.137461 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:11.137362 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" event={"ID":"a07dccb5-cb2d-44dc-91bf-43e0187e5fe8","Type":"ContainerStarted","Data":"ba855039a02b3f33b3a5fa398c47cf934a85d15ec82cc06c8822174dec3d1b6b"} Jul 14 11:16:11.137461 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:11.137452 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:11.154396 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:11.154345 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-76l9d" podStartSLOduration=17.27578428 podStartE2EDuration="24.154328339s" totalImagesPullingTime="6.878544059s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:15:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:11.154039506 +0000 UTC m=+287.468173026" watchObservedRunningTime="2026-07-14 11:16:11.154328339 +0000 UTC m=+287.468462056" Jul 14 11:16:11.178126 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:11.178062 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" podStartSLOduration=2.178047191 podStartE2EDuration="2.178047191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:16:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:11.177458866 +0000 UTC m=+287.491592398" watchObservedRunningTime="2026-07-14 11:16:11.178047191 +0000 UTC m=+287.492180693" Jul 14 11:16:12.142986 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:12.142936 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6jzwh" event={"ID":"ff56a558-60cb-416a-b1cd-9da387c9c905","Type":"ContainerStarted","Data":"d3b18462d407192a2d8f641c713ea800673cc46bf291198e62e7ba2c454389d9"} Jul 14 11:16:12.143459 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:12.143003 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6jzwh" event={"ID":"ff56a558-60cb-416a-b1cd-9da387c9c905","Type":"ContainerStarted","Data":"3a82127490c3f750cb221b6a508a3bfc6d63caca692807f738eefc87291ab0bc"} Jul 14 11:16:12.162624 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:12.162560 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6jzwh" podStartSLOduration=250.727628816 podStartE2EDuration="4m13.162537911s" totalImagesPullingTime="2.434909095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:11:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:12.162173114 +0000 UTC m=+288.476306637" watchObservedRunningTime="2026-07-14 11:16:12.162537911 +0000 UTC m=+288.476671432" Jul 14 11:16:13.147371 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:13.147341 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6jzwh" Jul 14 11:16:17.825739 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.825698 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rh482"] Jul 14 11:16:17.830010 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.829989 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:17.835655 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.835614 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 14 11:16:17.835655 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.835655 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 14 11:16:17.835866 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.835784 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 14 11:16:17.836795 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.836605 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 14 11:16:17.836795 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.836629 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 14 11:16:17.836795 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.836634 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f9kn4\"" Jul 14 11:16:17.836795 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.836613 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 14 11:16:17.869688 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.869658 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8d36b92-9484-4566-b1b5-246b9655e6de-metrics-client-ca\") pod \"node-exporter-rh482\" (UID: \"f8d36b92-9484-4566-b1b5-246b9655e6de\") " pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:17.869861 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.869730 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8d36b92-9484-4566-b1b5-246b9655e6de-root\") pod \"node-exporter-rh482\" (UID: \"f8d36b92-9484-4566-b1b5-246b9655e6de\") " pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:17.869861 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.869798 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8d36b92-9484-4566-b1b5-246b9655e6de-sys\") pod \"node-exporter-rh482\" (UID: \"f8d36b92-9484-4566-b1b5-246b9655e6de\") " pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:17.869861 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.869835 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8d36b92-9484-4566-b1b5-246b9655e6de-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rh482\" (UID: \"f8d36b92-9484-4566-b1b5-246b9655e6de\") " pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:17.870015 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.869863 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2kjk\" (UniqueName: \"kubernetes.io/projected/f8d36b92-9484-4566-b1b5-246b9655e6de-kube-api-access-z2kjk\") pod \"node-exporter-rh482\" (UID: \"f8d36b92-9484-4566-b1b5-246b9655e6de\") " pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:17.870015 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.869936 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8d36b92-9484-4566-b1b5-246b9655e6de-node-exporter-textfile\") pod \"node-exporter-rh482\" (UID: \"f8d36b92-9484-4566-b1b5-246b9655e6de\") " pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:17.870015 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.869965 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8d36b92-9484-4566-b1b5-246b9655e6de-node-exporter-tls\") pod \"node-exporter-rh482\" (UID: \"f8d36b92-9484-4566-b1b5-246b9655e6de\") " pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:17.870015 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.870000 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8d36b92-9484-4566-b1b5-246b9655e6de-node-exporter-wtmp\") pod \"node-exporter-rh482\" (UID: \"f8d36b92-9484-4566-b1b5-246b9655e6de\") " pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:17.870165 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.870046 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8d36b92-9484-4566-b1b5-246b9655e6de-node-exporter-accelerators-collector-config\") pod \"node-exporter-rh482\" (UID: \"f8d36b92-9484-4566-b1b5-246b9655e6de\") " pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:17.971763 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.971719 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8d36b92-9484-4566-b1b5-246b9655e6de-root\") pod \"node-exporter-rh482\" (UID: \"f8d36b92-9484-4566-b1b5-246b9655e6de\") " pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:17.971940 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.971779 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8d36b92-9484-4566-b1b5-246b9655e6de-sys\") pod \"node-exporter-rh482\" (UID: \"f8d36b92-9484-4566-b1b5-246b9655e6de\") " pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:17.971940 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.971817 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8d36b92-9484-4566-b1b5-246b9655e6de-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rh482\" (UID: \"f8d36b92-9484-4566-b1b5-246b9655e6de\") " pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:17.971940 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.971823 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8d36b92-9484-4566-b1b5-246b9655e6de-root\") pod \"node-exporter-rh482\" (UID: \"f8d36b92-9484-4566-b1b5-246b9655e6de\") " pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:17.971940 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.971849 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2kjk\" (UniqueName: \"kubernetes.io/projected/f8d36b92-9484-4566-b1b5-246b9655e6de-kube-api-access-z2kjk\") pod \"node-exporter-rh482\" (UID: \"f8d36b92-9484-4566-b1b5-246b9655e6de\") " pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:17.972118 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.971943 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8d36b92-9484-4566-b1b5-246b9655e6de-node-exporter-textfile\") pod \"node-exporter-rh482\" (UID: \"f8d36b92-9484-4566-b1b5-246b9655e6de\") " pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:17.972118 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.971979 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8d36b92-9484-4566-b1b5-246b9655e6de-node-exporter-tls\") pod \"node-exporter-rh482\" (UID: \"f8d36b92-9484-4566-b1b5-246b9655e6de\") " pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:17.972118 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.972020 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8d36b92-9484-4566-b1b5-246b9655e6de-node-exporter-wtmp\") pod \"node-exporter-rh482\" (UID: \"f8d36b92-9484-4566-b1b5-246b9655e6de\") " pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:17.972118 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.972068 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8d36b92-9484-4566-b1b5-246b9655e6de-node-exporter-accelerators-collector-config\") pod \"node-exporter-rh482\" (UID: \"f8d36b92-9484-4566-b1b5-246b9655e6de\") " pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:17.972118 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.972105 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8d36b92-9484-4566-b1b5-246b9655e6de-metrics-client-ca\") pod \"node-exporter-rh482\" (UID: \"f8d36b92-9484-4566-b1b5-246b9655e6de\") " pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:17.972345 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.972257 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8d36b92-9484-4566-b1b5-246b9655e6de-sys\") pod \"node-exporter-rh482\" (UID: \"f8d36b92-9484-4566-b1b5-246b9655e6de\") " pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:17.972345 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.972262 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8d36b92-9484-4566-b1b5-246b9655e6de-node-exporter-textfile\") pod \"node-exporter-rh482\" (UID: \"f8d36b92-9484-4566-b1b5-246b9655e6de\") " pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:17.972740 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.972703 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8d36b92-9484-4566-b1b5-246b9655e6de-node-exporter-wtmp\") pod \"node-exporter-rh482\" (UID: \"f8d36b92-9484-4566-b1b5-246b9655e6de\") " pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:17.974314 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.972830 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8d36b92-9484-4566-b1b5-246b9655e6de-metrics-client-ca\") pod \"node-exporter-rh482\" (UID: \"f8d36b92-9484-4566-b1b5-246b9655e6de\") " pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:17.974314 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.973147 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8d36b92-9484-4566-b1b5-246b9655e6de-node-exporter-accelerators-collector-config\") pod \"node-exporter-rh482\" (UID: \"f8d36b92-9484-4566-b1b5-246b9655e6de\") " pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:17.978521 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.978493 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8d36b92-9484-4566-b1b5-246b9655e6de-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rh482\" (UID: \"f8d36b92-9484-4566-b1b5-246b9655e6de\") " pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:17.979962 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.979939 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8d36b92-9484-4566-b1b5-246b9655e6de-node-exporter-tls\") pod \"node-exporter-rh482\" (UID: \"f8d36b92-9484-4566-b1b5-246b9655e6de\") " pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:17.982616 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:17.982594 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2kjk\" (UniqueName: \"kubernetes.io/projected/f8d36b92-9484-4566-b1b5-246b9655e6de-kube-api-access-z2kjk\") pod \"node-exporter-rh482\" (UID: \"f8d36b92-9484-4566-b1b5-246b9655e6de\") " pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:18.141160 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:18.141116 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rh482" Jul 14 11:16:18.152722 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:16:18.152682 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8d36b92_9484_4566_b1b5_246b9655e6de.slice/crio-fa7206767283418ab8a938124d4e565cfa891a9c9d3fcfa8bc047390c0321cf9 WatchSource:0}: Error finding container fa7206767283418ab8a938124d4e565cfa891a9c9d3fcfa8bc047390c0321cf9: Status 404 returned error can't find the container with id fa7206767283418ab8a938124d4e565cfa891a9c9d3fcfa8bc047390c0321cf9 Jul 14 11:16:18.167012 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:18.166937 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rh482" event={"ID":"f8d36b92-9484-4566-b1b5-246b9655e6de","Type":"ContainerStarted","Data":"fa7206767283418ab8a938124d4e565cfa891a9c9d3fcfa8bc047390c0321cf9"} Jul 14 11:16:20.176180 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:20.176138 2580 generic.go:356] "Generic (PLEG): container finished" podID="f8d36b92-9484-4566-b1b5-246b9655e6de" containerID="d4ec438fc4ccac91436622ae95f619271d6fafe50b286fd69807365a4be2a0f0" exitCode=0 Jul 14 11:16:20.176659 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:20.176245 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rh482" event={"ID":"f8d36b92-9484-4566-b1b5-246b9655e6de","Type":"ContainerDied","Data":"d4ec438fc4ccac91436622ae95f619271d6fafe50b286fd69807365a4be2a0f0"} Jul 14 11:16:20.230336 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:16:20.230281 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-q2stq" podUID="d333f07a-92a3-4c63-8f62-5a5eec2496b7" Jul 14 11:16:23.153638 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:23.153604 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6jzwh" Jul 14 11:16:27.139848 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:27.139821 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndktj_62d784b5-2a7b-4330-84a3-e8cd167dd1ce/ovn-acl-logging/0.log" Jul 14 11:16:27.140248 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:27.140042 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndktj_62d784b5-2a7b-4330-84a3-e8cd167dd1ce/ovn-acl-logging/0.log" Jul 14 11:16:27.142573 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:27.142461 2580 kubelet.go:1648] "Image garbage collection succeeded" Jul 14 11:16:28.207395 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.207361 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rh482" event={"ID":"f8d36b92-9484-4566-b1b5-246b9655e6de","Type":"ContainerStarted","Data":"e6a371fe7b06384026872b25b309a47d13368ced66918565c3b4e3cd270edd75"} Jul 14 11:16:28.207890 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.207425 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rh482" event={"ID":"f8d36b92-9484-4566-b1b5-246b9655e6de","Type":"ContainerStarted","Data":"6368710c214609b85a1ec0af839eb6a1674adcf5c8912e3320f42115b4787000"} Jul 14 11:16:28.209110 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.209069 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-2l4r2" event={"ID":"ffbc77d0-d4c1-4960-8f18-1ac89ceb8716","Type":"ContainerStarted","Data":"3391aac01ad704a3a06017d36e8bc4c8291a882aaacd6ec2044b7062cb0bc8bd"} Jul 14 11:16:28.209503 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.209480 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-2l4r2" Jul 14 11:16:28.219354 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.219328 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-2l4r2" Jul 14 11:16:28.229683 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.229633 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rh482" podStartSLOduration=10.198467487 podStartE2EDuration="11.229616416s" totalImagesPullingTime="953.306672ms" totalInitContainerRuntime="77.842257ms" isStatefulPod=true podCreationTimestamp="2026-07-14 11:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:28.229024754 +0000 UTC m=+304.543158301" watchObservedRunningTime="2026-07-14 11:16:28.229616416 +0000 UTC m=+304.543749934" Jul 14 11:16:28.252630 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.252571 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-2l4r2" podStartSLOduration=2.267598088 podStartE2EDuration="19.252552984s" totalImagesPullingTime="16.984954896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:28.251657 +0000 UTC m=+304.565790520" watchObservedRunningTime="2026-07-14 11:16:28.252552984 +0000 UTC m=+304.566686503" Jul 14 11:16:28.624893 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.624855 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86d4bdd799-vkv4f"] Jul 14 11:16:28.627713 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.627686 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:16:28.630498 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.630429 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dc9x4\"" Jul 14 11:16:28.630498 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.630464 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 14 11:16:28.630971 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.630945 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 14 11:16:28.631220 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.631199 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 14 11:16:28.631355 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.631263 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 14 11:16:28.631548 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.631528 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 14 11:16:28.637939 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.637618 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 14 11:16:28.638468 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.638442 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86d4bdd799-vkv4f"] Jul 14 11:16:28.764457 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.764411 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-trusted-ca-bundle\") pod \"console-86d4bdd799-vkv4f\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:16:28.764657 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.764475 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-service-ca\") pod \"console-86d4bdd799-vkv4f\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:16:28.764657 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.764574 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-474wk\" (UniqueName: \"kubernetes.io/projected/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-kube-api-access-474wk\") pod \"console-86d4bdd799-vkv4f\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:16:28.764657 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.764606 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-console-serving-cert\") pod \"console-86d4bdd799-vkv4f\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:16:28.764657 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.764640 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-console-config\") pod \"console-86d4bdd799-vkv4f\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:16:28.764849 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.764672 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-oauth-serving-cert\") pod \"console-86d4bdd799-vkv4f\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:16:28.764849 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.764734 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-console-oauth-config\") pod \"console-86d4bdd799-vkv4f\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:16:28.865780 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.865738 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-474wk\" (UniqueName: \"kubernetes.io/projected/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-kube-api-access-474wk\") pod \"console-86d4bdd799-vkv4f\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:16:28.865968 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.865790 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-console-serving-cert\") pod \"console-86d4bdd799-vkv4f\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:16:28.865968 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.865820 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-console-config\") pod \"console-86d4bdd799-vkv4f\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:16:28.865968 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.865842 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-oauth-serving-cert\") pod \"console-86d4bdd799-vkv4f\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:16:28.865968 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.865869 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-console-oauth-config\") pod \"console-86d4bdd799-vkv4f\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:16:28.865968 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.865904 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-trusted-ca-bundle\") pod \"console-86d4bdd799-vkv4f\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:16:28.865968 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.865945 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-service-ca\") pod \"console-86d4bdd799-vkv4f\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:16:28.867445 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.866794 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-service-ca\") pod \"console-86d4bdd799-vkv4f\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:16:28.867445 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.866798 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-console-config\") pod \"console-86d4bdd799-vkv4f\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:16:28.867445 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.867403 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-oauth-serving-cert\") pod \"console-86d4bdd799-vkv4f\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:16:28.867651 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.867468 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-trusted-ca-bundle\") pod \"console-86d4bdd799-vkv4f\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:16:28.869189 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.869168 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-console-serving-cert\") pod \"console-86d4bdd799-vkv4f\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:16:28.869332 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.869197 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-console-oauth-config\") pod \"console-86d4bdd799-vkv4f\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:16:28.874687 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.874666 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-474wk\" (UniqueName: \"kubernetes.io/projected/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-kube-api-access-474wk\") pod \"console-86d4bdd799-vkv4f\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:16:28.939954 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:28.939860 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:16:29.120349 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:29.120317 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86d4bdd799-vkv4f"] Jul 14 11:16:29.123842 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:16:29.123802 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9d395be_9586_4073_ac4b_80c1e1f8c9cf.slice/crio-134f5b777041fa239603cfda93068f3f6c870af1ca14b1cf01f6682271109271 WatchSource:0}: Error finding container 134f5b777041fa239603cfda93068f3f6c870af1ca14b1cf01f6682271109271: Status 404 returned error can't find the container with id 134f5b777041fa239603cfda93068f3f6c870af1ca14b1cf01f6682271109271 Jul 14 11:16:29.126709 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:29.126687 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 11:16:29.214812 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:29.214728 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d4bdd799-vkv4f" event={"ID":"c9d395be-9586-4073-ac4b-80c1e1f8c9cf","Type":"ContainerStarted","Data":"134f5b777041fa239603cfda93068f3f6c870af1ca14b1cf01f6682271109271"} Jul 14 11:16:29.792733 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:29.792401 2580 patch_prober.go:28] interesting pod/image-registry-79c7894f4b-hcwhw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 14 11:16:29.792733 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:29.792463 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" podUID="a07dccb5-cb2d-44dc-91bf-43e0187e5fe8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 11:16:32.149332 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:32.149226 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-79c7894f4b-hcwhw" Jul 14 11:16:33.228850 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:33.228771 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:16:33.233557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:33.233523 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d4bdd799-vkv4f" event={"ID":"c9d395be-9586-4073-ac4b-80c1e1f8c9cf","Type":"ContainerStarted","Data":"3190171b87bcaaae00f9fd63421df4da8f48b40d95c98a90d105886a2112ee89"} Jul 14 11:16:33.252164 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:33.252112 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86d4bdd799-vkv4f" podStartSLOduration=1.4334272989999999 podStartE2EDuration="5.252098224s" totalImagesPullingTime="3.818670925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:16:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:33.250567059 +0000 UTC m=+309.564700578" watchObservedRunningTime="2026-07-14 11:16:33.252098224 +0000 UTC m=+309.566231741" Jul 14 11:16:38.940344 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:38.940305 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:16:38.940841 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:38.940364 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:16:38.945035 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:38.945012 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:16:39.263851 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:39.263771 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:16:57.544807 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:16:57.544771 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" podUID="e4b72377-8f3b-4f11-9ce5-cf1e37a5f004" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 14 11:17:07.544495 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:07.544453 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" podUID="e4b72377-8f3b-4f11-9ce5-cf1e37a5f004" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 14 11:17:17.543856 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:17.543765 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" podUID="e4b72377-8f3b-4f11-9ce5-cf1e37a5f004" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 14 11:17:17.543856 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:17.543841 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" Jul 14 11:17:17.544370 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:17.544345 2580 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"02347e5f2075bdb33734b52d49f3ba19b55c26824cc4f5ad53f7e2ac89a30d10"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 14 11:17:17.544412 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:17.544393 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" podUID="e4b72377-8f3b-4f11-9ce5-cf1e37a5f004" containerName="service-proxy" containerID="cri-o://02347e5f2075bdb33734b52d49f3ba19b55c26824cc4f5ad53f7e2ac89a30d10" gracePeriod=30 Jul 14 11:17:18.388691 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:18.388657 2580 generic.go:356] "Generic (PLEG): container finished" podID="e4b72377-8f3b-4f11-9ce5-cf1e37a5f004" containerID="02347e5f2075bdb33734b52d49f3ba19b55c26824cc4f5ad53f7e2ac89a30d10" exitCode=2 Jul 14 11:17:18.388857 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:18.388729 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" event={"ID":"e4b72377-8f3b-4f11-9ce5-cf1e37a5f004","Type":"ContainerDied","Data":"02347e5f2075bdb33734b52d49f3ba19b55c26824cc4f5ad53f7e2ac89a30d10"} Jul 14 11:17:18.388857 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:18.388771 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-795546dfb5-8hm25" event={"ID":"e4b72377-8f3b-4f11-9ce5-cf1e37a5f004","Type":"ContainerStarted","Data":"877f370e67691610c67c0350f3e29e2fb13f62eb5d25b2f08588bfce5b3de027"} Jul 14 11:17:38.025091 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:38.025035 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs\") pod \"network-metrics-daemon-q2stq\" (UID: \"d333f07a-92a3-4c63-8f62-5a5eec2496b7\") " pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:17:38.027540 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:38.027519 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d333f07a-92a3-4c63-8f62-5a5eec2496b7-metrics-certs\") pod \"network-metrics-daemon-q2stq\" (UID: \"d333f07a-92a3-4c63-8f62-5a5eec2496b7\") " pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:17:38.034964 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:38.034943 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qblx9\"" Jul 14 11:17:38.040487 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:38.040471 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2stq" Jul 14 11:17:38.170598 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:38.170567 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q2stq"] Jul 14 11:17:38.174688 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:17:38.174659 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd333f07a_92a3_4c63_8f62_5a5eec2496b7.slice/crio-0ded00529e9708893135873cc924a2e54512c28c7f865b2e04d6b84e308827c8 WatchSource:0}: Error finding container 0ded00529e9708893135873cc924a2e54512c28c7f865b2e04d6b84e308827c8: Status 404 returned error can't find the container with id 0ded00529e9708893135873cc924a2e54512c28c7f865b2e04d6b84e308827c8 Jul 14 11:17:38.452468 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:38.452432 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q2stq" event={"ID":"d333f07a-92a3-4c63-8f62-5a5eec2496b7","Type":"ContainerStarted","Data":"0ded00529e9708893135873cc924a2e54512c28c7f865b2e04d6b84e308827c8"} Jul 14 11:17:39.458279 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:39.458217 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q2stq" event={"ID":"d333f07a-92a3-4c63-8f62-5a5eec2496b7","Type":"ContainerStarted","Data":"54379e45ea11d4167b57737f3d023e7595af047bfb9743148c87a436d54e9b66"} Jul 14 11:17:39.458742 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:39.458298 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q2stq" event={"ID":"d333f07a-92a3-4c63-8f62-5a5eec2496b7","Type":"ContainerStarted","Data":"066c002f4a7efd34dd707feb8eb03810925fed7d2a9b3d59c214880bcfae8c12"} Jul 14 11:17:39.487223 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:39.487172 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-q2stq" podStartSLOduration=374.678804937 podStartE2EDuration="6m15.487156318s" totalImagesPullingTime="808.351381ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:17:39.483959159 +0000 UTC m=+375.798092677" watchObservedRunningTime="2026-07-14 11:17:39.487156318 +0000 UTC m=+375.801289837" Jul 14 11:17:50.967882 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:50.967843 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67877b7499-xh6gg"] Jul 14 11:17:50.970046 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:50.970027 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:17:50.980760 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:50.980732 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67877b7499-xh6gg"] Jul 14 11:17:51.114034 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:51.113995 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-trusted-ca-bundle\") pod \"console-67877b7499-xh6gg\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:17:51.114034 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:51.114034 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-console-serving-cert\") pod \"console-67877b7499-xh6gg\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:17:51.114256 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:51.114049 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-oauth-serving-cert\") pod \"console-67877b7499-xh6gg\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:17:51.114256 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:51.114164 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-console-config\") pod \"console-67877b7499-xh6gg\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:17:51.114256 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:51.114192 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-service-ca\") pod \"console-67877b7499-xh6gg\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:17:51.114256 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:51.114208 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68hdg\" (UniqueName: \"kubernetes.io/projected/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-kube-api-access-68hdg\") pod \"console-67877b7499-xh6gg\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:17:51.114389 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:51.114288 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-console-oauth-config\") pod \"console-67877b7499-xh6gg\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:17:51.214971 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:51.214935 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-console-config\") pod \"console-67877b7499-xh6gg\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:17:51.214971 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:51.214971 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-service-ca\") pod \"console-67877b7499-xh6gg\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:17:51.215184 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:51.214988 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68hdg\" (UniqueName: \"kubernetes.io/projected/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-kube-api-access-68hdg\") pod \"console-67877b7499-xh6gg\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:17:51.215184 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:51.215024 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-console-oauth-config\") pod \"console-67877b7499-xh6gg\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:17:51.215184 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:51.215062 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-trusted-ca-bundle\") pod \"console-67877b7499-xh6gg\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:17:51.215184 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:51.215084 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-console-serving-cert\") pod \"console-67877b7499-xh6gg\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:17:51.215184 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:51.215107 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-oauth-serving-cert\") pod \"console-67877b7499-xh6gg\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:17:51.215925 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:51.215848 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-console-config\") pod \"console-67877b7499-xh6gg\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:17:51.215925 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:51.215899 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-service-ca\") pod \"console-67877b7499-xh6gg\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:17:51.215925 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:51.215899 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-oauth-serving-cert\") pod \"console-67877b7499-xh6gg\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:17:51.216210 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:51.216187 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-trusted-ca-bundle\") pod \"console-67877b7499-xh6gg\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:17:51.217731 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:51.217709 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-console-oauth-config\") pod \"console-67877b7499-xh6gg\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:17:51.218251 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:51.218175 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-console-serving-cert\") pod \"console-67877b7499-xh6gg\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:17:51.224356 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:51.224335 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68hdg\" (UniqueName: \"kubernetes.io/projected/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-kube-api-access-68hdg\") pod \"console-67877b7499-xh6gg\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:17:51.279393 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:51.279359 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:17:51.409768 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:51.409580 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67877b7499-xh6gg"] Jul 14 11:17:51.412329 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:17:51.412299 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b21fe8c_58a7_4b3c_84d8_318cc2d1da6d.slice/crio-7cf86741e3bdc1f2821024cb9c5822476f2abb1bd039ac91a1532e1eb802a261 WatchSource:0}: Error finding container 7cf86741e3bdc1f2821024cb9c5822476f2abb1bd039ac91a1532e1eb802a261: Status 404 returned error can't find the container with id 7cf86741e3bdc1f2821024cb9c5822476f2abb1bd039ac91a1532e1eb802a261 Jul 14 11:17:51.500289 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:51.500171 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67877b7499-xh6gg" event={"ID":"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d","Type":"ContainerStarted","Data":"57cd60ba3c17a580c1bb490165161a80b30e35297658be27fe39625575dec2bd"} Jul 14 11:17:51.500289 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:51.500224 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67877b7499-xh6gg" event={"ID":"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d","Type":"ContainerStarted","Data":"7cf86741e3bdc1f2821024cb9c5822476f2abb1bd039ac91a1532e1eb802a261"} Jul 14 11:17:51.519299 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:17:51.519224 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67877b7499-xh6gg" podStartSLOduration=1.519207674 podStartE2EDuration="1.519207674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:17:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:17:51.519105362 +0000 UTC m=+387.833238881" watchObservedRunningTime="2026-07-14 11:17:51.519207674 +0000 UTC m=+387.833341191" Jul 14 11:18:01.279696 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:01.279654 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:18:01.280227 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:01.279727 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:18:01.284729 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:01.284705 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:18:01.538691 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:01.538606 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:18:01.614488 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:01.614455 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86d4bdd799-vkv4f"] Jul 14 11:18:26.637952 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:26.637885 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-86d4bdd799-vkv4f" podUID="c9d395be-9586-4073-ac4b-80c1e1f8c9cf" containerName="console" containerID="cri-o://3190171b87bcaaae00f9fd63421df4da8f48b40d95c98a90d105886a2112ee89" gracePeriod=15 Jul 14 11:18:26.868345 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:26.868315 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:18:26.968018 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:26.967923 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-trusted-ca-bundle\") pod \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " Jul 14 11:18:26.968018 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:26.967969 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-console-oauth-config\") pod \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " Jul 14 11:18:26.968018 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:26.967994 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-474wk\" (UniqueName: \"kubernetes.io/projected/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-kube-api-access-474wk\") pod \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " Jul 14 11:18:26.968344 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:26.968042 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-service-ca\") pod \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " Jul 14 11:18:26.968344 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:26.968070 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-console-config\") pod \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " Jul 14 11:18:26.968344 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:26.968105 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-console-serving-cert\") pod \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " Jul 14 11:18:26.968344 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:26.968133 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-oauth-serving-cert\") pod \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\" (UID: \"c9d395be-9586-4073-ac4b-80c1e1f8c9cf\") " Jul 14 11:18:26.968569 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:26.968407 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c9d395be-9586-4073-ac4b-80c1e1f8c9cf" (UID: "c9d395be-9586-4073-ac4b-80c1e1f8c9cf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:18:26.968569 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:26.968522 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-console-config" (OuterVolumeSpecName: "console-config") pod "c9d395be-9586-4073-ac4b-80c1e1f8c9cf" (UID: "c9d395be-9586-4073-ac4b-80c1e1f8c9cf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:18:26.968642 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:26.968578 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-service-ca" (OuterVolumeSpecName: "service-ca") pod "c9d395be-9586-4073-ac4b-80c1e1f8c9cf" (UID: "c9d395be-9586-4073-ac4b-80c1e1f8c9cf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:18:26.968642 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:26.968622 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c9d395be-9586-4073-ac4b-80c1e1f8c9cf" (UID: "c9d395be-9586-4073-ac4b-80c1e1f8c9cf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:18:26.970442 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:26.970416 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-kube-api-access-474wk" (OuterVolumeSpecName: "kube-api-access-474wk") pod "c9d395be-9586-4073-ac4b-80c1e1f8c9cf" (UID: "c9d395be-9586-4073-ac4b-80c1e1f8c9cf"). InnerVolumeSpecName "kube-api-access-474wk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:18:26.970852 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:26.970829 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c9d395be-9586-4073-ac4b-80c1e1f8c9cf" (UID: "c9d395be-9586-4073-ac4b-80c1e1f8c9cf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:18:26.970935 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:26.970847 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c9d395be-9586-4073-ac4b-80c1e1f8c9cf" (UID: "c9d395be-9586-4073-ac4b-80c1e1f8c9cf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:18:27.068673 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:27.068637 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-service-ca\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:18:27.068673 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:27.068665 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-console-config\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:18:27.068673 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:27.068675 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-console-serving-cert\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:18:27.068901 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:27.068687 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-oauth-serving-cert\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:18:27.068901 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:27.068695 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-trusted-ca-bundle\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:18:27.068901 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:27.068703 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-console-oauth-config\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:18:27.068901 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:27.068710 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-474wk\" (UniqueName: \"kubernetes.io/projected/c9d395be-9586-4073-ac4b-80c1e1f8c9cf-kube-api-access-474wk\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:18:27.621760 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:27.621725 2580 generic.go:356] "Generic (PLEG): container finished" podID="c9d395be-9586-4073-ac4b-80c1e1f8c9cf" containerID="3190171b87bcaaae00f9fd63421df4da8f48b40d95c98a90d105886a2112ee89" exitCode=0 Jul 14 11:18:27.621921 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:27.621771 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d4bdd799-vkv4f" Jul 14 11:18:27.621921 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:27.621810 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d4bdd799-vkv4f" event={"ID":"c9d395be-9586-4073-ac4b-80c1e1f8c9cf","Type":"ContainerDied","Data":"3190171b87bcaaae00f9fd63421df4da8f48b40d95c98a90d105886a2112ee89"} Jul 14 11:18:27.621921 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:27.621859 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d4bdd799-vkv4f" event={"ID":"c9d395be-9586-4073-ac4b-80c1e1f8c9cf","Type":"ContainerDied","Data":"134f5b777041fa239603cfda93068f3f6c870af1ca14b1cf01f6682271109271"} Jul 14 11:18:27.621921 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:27.621882 2580 scope.go:117] "RemoveContainer" containerID="3190171b87bcaaae00f9fd63421df4da8f48b40d95c98a90d105886a2112ee89" Jul 14 11:18:27.630107 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:27.630091 2580 scope.go:117] "RemoveContainer" containerID="3190171b87bcaaae00f9fd63421df4da8f48b40d95c98a90d105886a2112ee89" Jul 14 11:18:27.630372 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:18:27.630349 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3190171b87bcaaae00f9fd63421df4da8f48b40d95c98a90d105886a2112ee89\": container with ID starting with 3190171b87bcaaae00f9fd63421df4da8f48b40d95c98a90d105886a2112ee89 not found: ID does not exist" containerID="3190171b87bcaaae00f9fd63421df4da8f48b40d95c98a90d105886a2112ee89" Jul 14 11:18:27.630450 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:27.630384 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3190171b87bcaaae00f9fd63421df4da8f48b40d95c98a90d105886a2112ee89"} err="failed to get container status \"3190171b87bcaaae00f9fd63421df4da8f48b40d95c98a90d105886a2112ee89\": rpc error: code = NotFound desc = could not find container \"3190171b87bcaaae00f9fd63421df4da8f48b40d95c98a90d105886a2112ee89\": container with ID starting with 3190171b87bcaaae00f9fd63421df4da8f48b40d95c98a90d105886a2112ee89 not found: ID does not exist" Jul 14 11:18:27.643167 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:27.643144 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86d4bdd799-vkv4f"] Jul 14 11:18:27.648576 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:27.648556 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86d4bdd799-vkv4f"] Jul 14 11:18:28.237854 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:18:28.237815 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9d395be-9586-4073-ac4b-80c1e1f8c9cf" path="/var/lib/kubelet/pods/c9d395be-9586-4073-ac4b-80c1e1f8c9cf/volumes" Jul 14 11:19:03.019657 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.019624 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64c678d565-bwvvn"] Jul 14 11:19:03.020105 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.019849 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9d395be-9586-4073-ac4b-80c1e1f8c9cf" containerName="console" Jul 14 11:19:03.020105 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.019859 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9d395be-9586-4073-ac4b-80c1e1f8c9cf" containerName="console" Jul 14 11:19:03.020105 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.019907 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9d395be-9586-4073-ac4b-80c1e1f8c9cf" containerName="console" Jul 14 11:19:03.024695 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.022548 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:19:03.040245 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.040198 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64c678d565-bwvvn"] Jul 14 11:19:03.133170 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.133125 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-trusted-ca-bundle\") pod \"console-64c678d565-bwvvn\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:19:03.133363 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.133186 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-console-config\") pod \"console-64c678d565-bwvvn\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:19:03.133363 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.133258 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-oauth-serving-cert\") pod \"console-64c678d565-bwvvn\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:19:03.133363 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.133291 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-service-ca\") pod \"console-64c678d565-bwvvn\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:19:03.133363 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.133323 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-console-oauth-config\") pod \"console-64c678d565-bwvvn\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:19:03.133363 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.133355 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wcj9\" (UniqueName: \"kubernetes.io/projected/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-kube-api-access-7wcj9\") pod \"console-64c678d565-bwvvn\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:19:03.133563 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.133379 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-console-serving-cert\") pod \"console-64c678d565-bwvvn\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:19:03.233927 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.233890 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-console-config\") pod \"console-64c678d565-bwvvn\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:19:03.233927 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.233930 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-oauth-serving-cert\") pod \"console-64c678d565-bwvvn\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:19:03.234181 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.233949 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-service-ca\") pod \"console-64c678d565-bwvvn\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:19:03.234181 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.233971 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-console-oauth-config\") pod \"console-64c678d565-bwvvn\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:19:03.234181 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.233994 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wcj9\" (UniqueName: \"kubernetes.io/projected/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-kube-api-access-7wcj9\") pod \"console-64c678d565-bwvvn\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:19:03.234181 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.234074 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-console-serving-cert\") pod \"console-64c678d565-bwvvn\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:19:03.234181 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.234134 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-trusted-ca-bundle\") pod \"console-64c678d565-bwvvn\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:19:03.234740 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.234714 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-oauth-serving-cert\") pod \"console-64c678d565-bwvvn\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:19:03.234740 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.234730 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-service-ca\") pod \"console-64c678d565-bwvvn\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:19:03.234864 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.234829 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-console-config\") pod \"console-64c678d565-bwvvn\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:19:03.234930 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.234914 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-trusted-ca-bundle\") pod \"console-64c678d565-bwvvn\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:19:03.237113 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.237087 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-console-serving-cert\") pod \"console-64c678d565-bwvvn\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:19:03.237113 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.237104 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-console-oauth-config\") pod \"console-64c678d565-bwvvn\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:19:03.242928 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.242909 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wcj9\" (UniqueName: \"kubernetes.io/projected/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-kube-api-access-7wcj9\") pod \"console-64c678d565-bwvvn\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:19:03.332112 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.332023 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:19:03.463135 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.462956 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64c678d565-bwvvn"] Jul 14 11:19:03.465635 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:19:03.465610 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod392a8e0c_d7a2_4cdf_a1d8_a458e6b8f11d.slice/crio-5e543284a8c94438c4a115c8a59aea4429ef54403ebabe4509a487272ff8651a WatchSource:0}: Error finding container 5e543284a8c94438c4a115c8a59aea4429ef54403ebabe4509a487272ff8651a: Status 404 returned error can't find the container with id 5e543284a8c94438c4a115c8a59aea4429ef54403ebabe4509a487272ff8651a Jul 14 11:19:03.742978 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.742941 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c678d565-bwvvn" event={"ID":"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d","Type":"ContainerStarted","Data":"93c92a3c8c6e33a63434c4e50b6d6e03a2e6fbc251fc565f8d8104fc50a162a2"} Jul 14 11:19:03.743173 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.742994 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c678d565-bwvvn" event={"ID":"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d","Type":"ContainerStarted","Data":"5e543284a8c94438c4a115c8a59aea4429ef54403ebabe4509a487272ff8651a"} Jul 14 11:19:03.760820 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:03.760769 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64c678d565-bwvvn" podStartSLOduration=0.760754511 podStartE2EDuration="760.754511ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:19:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:19:03.760088191 +0000 UTC m=+460.074221710" watchObservedRunningTime="2026-07-14 11:19:03.760754511 +0000 UTC m=+460.074888029" Jul 14 11:19:13.332851 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:13.332819 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:19:13.333345 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:13.332881 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:19:13.337682 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:13.337656 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:19:13.779780 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:13.779753 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:19:13.834979 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:13.834940 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67877b7499-xh6gg"] Jul 14 11:19:38.856012 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:38.855960 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-67877b7499-xh6gg" podUID="0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d" containerName="console" containerID="cri-o://57cd60ba3c17a580c1bb490165161a80b30e35297658be27fe39625575dec2bd" gracePeriod=15 Jul 14 11:19:39.118888 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.118866 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:19:39.195438 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.195403 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-console-oauth-config\") pod \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " Jul 14 11:19:39.195627 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.195448 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68hdg\" (UniqueName: \"kubernetes.io/projected/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-kube-api-access-68hdg\") pod \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " Jul 14 11:19:39.195627 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.195472 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-console-config\") pod \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " Jul 14 11:19:39.195627 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.195503 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-trusted-ca-bundle\") pod \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " Jul 14 11:19:39.195788 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.195626 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-oauth-serving-cert\") pod \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " Jul 14 11:19:39.195788 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.195663 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-service-ca\") pod \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " Jul 14 11:19:39.195788 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.195694 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-console-serving-cert\") pod \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\" (UID: \"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d\") " Jul 14 11:19:39.195986 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.195961 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-console-config" (OuterVolumeSpecName: "console-config") pod "0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d" (UID: "0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:19:39.196043 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.196008 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d" (UID: "0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:19:39.196043 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.196010 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-service-ca" (OuterVolumeSpecName: "service-ca") pod "0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d" (UID: "0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:19:39.196043 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.196036 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d" (UID: "0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:19:39.197846 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.197822 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d" (UID: "0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:19:39.197960 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.197857 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d" (UID: "0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:19:39.197960 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.197879 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-kube-api-access-68hdg" (OuterVolumeSpecName: "kube-api-access-68hdg") pod "0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d" (UID: "0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d"). InnerVolumeSpecName "kube-api-access-68hdg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:19:39.296177 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.296130 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-console-oauth-config\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:19:39.296177 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.296172 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68hdg\" (UniqueName: \"kubernetes.io/projected/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-kube-api-access-68hdg\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:19:39.296177 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.296182 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-console-config\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:19:39.296177 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.296191 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-trusted-ca-bundle\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:19:39.296177 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.296199 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-oauth-serving-cert\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:19:39.296488 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.296208 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-service-ca\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:19:39.296488 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.296216 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d-console-serving-cert\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:19:39.868757 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.868723 2580 generic.go:356] "Generic (PLEG): container finished" podID="0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d" containerID="57cd60ba3c17a580c1bb490165161a80b30e35297658be27fe39625575dec2bd" exitCode=0 Jul 14 11:19:39.869179 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.868768 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67877b7499-xh6gg" Jul 14 11:19:39.869179 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.868808 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67877b7499-xh6gg" event={"ID":"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d","Type":"ContainerDied","Data":"57cd60ba3c17a580c1bb490165161a80b30e35297658be27fe39625575dec2bd"} Jul 14 11:19:39.869179 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.868859 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67877b7499-xh6gg" event={"ID":"0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d","Type":"ContainerDied","Data":"7cf86741e3bdc1f2821024cb9c5822476f2abb1bd039ac91a1532e1eb802a261"} Jul 14 11:19:39.869179 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.868879 2580 scope.go:117] "RemoveContainer" containerID="57cd60ba3c17a580c1bb490165161a80b30e35297658be27fe39625575dec2bd" Jul 14 11:19:39.876871 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.876857 2580 scope.go:117] "RemoveContainer" containerID="57cd60ba3c17a580c1bb490165161a80b30e35297658be27fe39625575dec2bd" Jul 14 11:19:39.877103 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:19:39.877088 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57cd60ba3c17a580c1bb490165161a80b30e35297658be27fe39625575dec2bd\": container with ID starting with 57cd60ba3c17a580c1bb490165161a80b30e35297658be27fe39625575dec2bd not found: ID does not exist" containerID="57cd60ba3c17a580c1bb490165161a80b30e35297658be27fe39625575dec2bd" Jul 14 11:19:39.877166 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.877110 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57cd60ba3c17a580c1bb490165161a80b30e35297658be27fe39625575dec2bd"} err="failed to get container status \"57cd60ba3c17a580c1bb490165161a80b30e35297658be27fe39625575dec2bd\": rpc error: code = NotFound desc = could not find container \"57cd60ba3c17a580c1bb490165161a80b30e35297658be27fe39625575dec2bd\": container with ID starting with 57cd60ba3c17a580c1bb490165161a80b30e35297658be27fe39625575dec2bd not found: ID does not exist" Jul 14 11:19:39.902095 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.902069 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67877b7499-xh6gg"] Jul 14 11:19:39.907668 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:39.907644 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67877b7499-xh6gg"] Jul 14 11:19:40.232890 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:19:40.232809 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d" path="/var/lib/kubelet/pods/0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d/volumes" Jul 14 11:20:38.498337 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:38.498300 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4"] Jul 14 11:20:38.498890 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:38.498657 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d" containerName="console" Jul 14 11:20:38.498890 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:38.498673 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d" containerName="console" Jul 14 11:20:38.498890 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:38.498747 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b21fe8c-58a7-4b3c-84d8-318cc2d1da6d" containerName="console" Jul 14 11:20:38.502798 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:38.502777 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4" Jul 14 11:20:38.505593 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:38.505572 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qzfrh\"" Jul 14 11:20:38.505708 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:38.505573 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 14 11:20:38.506005 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:38.505991 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 14 11:20:38.515937 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:38.515913 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4"] Jul 14 11:20:38.606382 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:38.606347 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94da1e53-6c02-4c1a-8048-333f4de3dbda-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4\" (UID: \"94da1e53-6c02-4c1a-8048-333f4de3dbda\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4" Jul 14 11:20:38.606382 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:38.606386 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkx8k\" (UniqueName: \"kubernetes.io/projected/94da1e53-6c02-4c1a-8048-333f4de3dbda-kube-api-access-jkx8k\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4\" (UID: \"94da1e53-6c02-4c1a-8048-333f4de3dbda\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4" Jul 14 11:20:38.606608 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:38.606414 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94da1e53-6c02-4c1a-8048-333f4de3dbda-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4\" (UID: \"94da1e53-6c02-4c1a-8048-333f4de3dbda\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4" Jul 14 11:20:38.707698 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:38.707666 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94da1e53-6c02-4c1a-8048-333f4de3dbda-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4\" (UID: \"94da1e53-6c02-4c1a-8048-333f4de3dbda\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4" Jul 14 11:20:38.707853 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:38.707708 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkx8k\" (UniqueName: \"kubernetes.io/projected/94da1e53-6c02-4c1a-8048-333f4de3dbda-kube-api-access-jkx8k\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4\" (UID: \"94da1e53-6c02-4c1a-8048-333f4de3dbda\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4" Jul 14 11:20:38.707853 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:38.707737 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94da1e53-6c02-4c1a-8048-333f4de3dbda-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4\" (UID: \"94da1e53-6c02-4c1a-8048-333f4de3dbda\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4" Jul 14 11:20:38.708125 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:38.708106 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94da1e53-6c02-4c1a-8048-333f4de3dbda-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4\" (UID: \"94da1e53-6c02-4c1a-8048-333f4de3dbda\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4" Jul 14 11:20:38.708165 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:38.708123 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94da1e53-6c02-4c1a-8048-333f4de3dbda-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4\" (UID: \"94da1e53-6c02-4c1a-8048-333f4de3dbda\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4" Jul 14 11:20:38.717259 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:38.717213 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkx8k\" (UniqueName: \"kubernetes.io/projected/94da1e53-6c02-4c1a-8048-333f4de3dbda-kube-api-access-jkx8k\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4\" (UID: \"94da1e53-6c02-4c1a-8048-333f4de3dbda\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4" Jul 14 11:20:38.811404 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:38.811318 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4" Jul 14 11:20:38.940538 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:38.940509 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4"] Jul 14 11:20:38.943138 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:20:38.943115 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94da1e53_6c02_4c1a_8048_333f4de3dbda.slice/crio-97721643008f58b8de76529fb3717a4852dfb34a614fea7ef15653c019a77251 WatchSource:0}: Error finding container 97721643008f58b8de76529fb3717a4852dfb34a614fea7ef15653c019a77251: Status 404 returned error can't find the container with id 97721643008f58b8de76529fb3717a4852dfb34a614fea7ef15653c019a77251 Jul 14 11:20:39.064283 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:39.064175 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4" event={"ID":"94da1e53-6c02-4c1a-8048-333f4de3dbda","Type":"ContainerStarted","Data":"97721643008f58b8de76529fb3717a4852dfb34a614fea7ef15653c019a77251"} Jul 14 11:20:48.100160 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:48.100123 2580 generic.go:356] "Generic (PLEG): container finished" podID="94da1e53-6c02-4c1a-8048-333f4de3dbda" containerID="70cfcc4daced4e5aa7bd571d189f0c2430e9851ba0fecd2405b2b4f1ed95c6cb" exitCode=0 Jul 14 11:20:48.100604 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:48.100193 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4" event={"ID":"94da1e53-6c02-4c1a-8048-333f4de3dbda","Type":"ContainerDied","Data":"70cfcc4daced4e5aa7bd571d189f0c2430e9851ba0fecd2405b2b4f1ed95c6cb"} Jul 14 11:20:50.108948 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:50.108914 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4" event={"ID":"94da1e53-6c02-4c1a-8048-333f4de3dbda","Type":"ContainerStarted","Data":"f6393cd5c9fd7a32be39b1acdd5f2b6b1cba767bf98b5a5e99970b3c117231db"} Jul 14 11:20:51.114157 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:51.114122 2580 generic.go:356] "Generic (PLEG): container finished" podID="94da1e53-6c02-4c1a-8048-333f4de3dbda" containerID="f6393cd5c9fd7a32be39b1acdd5f2b6b1cba767bf98b5a5e99970b3c117231db" exitCode=0 Jul 14 11:20:51.114555 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:51.114210 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4" event={"ID":"94da1e53-6c02-4c1a-8048-333f4de3dbda","Type":"ContainerDied","Data":"f6393cd5c9fd7a32be39b1acdd5f2b6b1cba767bf98b5a5e99970b3c117231db"} Jul 14 11:20:59.147462 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:59.147428 2580 generic.go:356] "Generic (PLEG): container finished" podID="94da1e53-6c02-4c1a-8048-333f4de3dbda" containerID="166ddc186c4fa7763987bbe22f00e2d510ddb8c7e397651811dce1d4913e6503" exitCode=0 Jul 14 11:20:59.147865 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:20:59.147480 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4" event={"ID":"94da1e53-6c02-4c1a-8048-333f4de3dbda","Type":"ContainerDied","Data":"166ddc186c4fa7763987bbe22f00e2d510ddb8c7e397651811dce1d4913e6503"} Jul 14 11:21:00.272021 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:00.271995 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4" Jul 14 11:21:00.391412 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:00.391378 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94da1e53-6c02-4c1a-8048-333f4de3dbda-bundle\") pod \"94da1e53-6c02-4c1a-8048-333f4de3dbda\" (UID: \"94da1e53-6c02-4c1a-8048-333f4de3dbda\") " Jul 14 11:21:00.391587 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:00.391432 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkx8k\" (UniqueName: \"kubernetes.io/projected/94da1e53-6c02-4c1a-8048-333f4de3dbda-kube-api-access-jkx8k\") pod \"94da1e53-6c02-4c1a-8048-333f4de3dbda\" (UID: \"94da1e53-6c02-4c1a-8048-333f4de3dbda\") " Jul 14 11:21:00.391587 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:00.391463 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94da1e53-6c02-4c1a-8048-333f4de3dbda-util\") pod \"94da1e53-6c02-4c1a-8048-333f4de3dbda\" (UID: \"94da1e53-6c02-4c1a-8048-333f4de3dbda\") " Jul 14 11:21:00.392152 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:00.392127 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94da1e53-6c02-4c1a-8048-333f4de3dbda-bundle" (OuterVolumeSpecName: "bundle") pod "94da1e53-6c02-4c1a-8048-333f4de3dbda" (UID: "94da1e53-6c02-4c1a-8048-333f4de3dbda"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:21:00.393749 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:00.393719 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94da1e53-6c02-4c1a-8048-333f4de3dbda-kube-api-access-jkx8k" (OuterVolumeSpecName: "kube-api-access-jkx8k") pod "94da1e53-6c02-4c1a-8048-333f4de3dbda" (UID: "94da1e53-6c02-4c1a-8048-333f4de3dbda"). InnerVolumeSpecName "kube-api-access-jkx8k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:21:00.396399 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:00.396373 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94da1e53-6c02-4c1a-8048-333f4de3dbda-util" (OuterVolumeSpecName: "util") pod "94da1e53-6c02-4c1a-8048-333f4de3dbda" (UID: "94da1e53-6c02-4c1a-8048-333f4de3dbda"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:21:00.492559 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:00.492488 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94da1e53-6c02-4c1a-8048-333f4de3dbda-bundle\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:21:00.492559 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:00.492511 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkx8k\" (UniqueName: \"kubernetes.io/projected/94da1e53-6c02-4c1a-8048-333f4de3dbda-kube-api-access-jkx8k\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:21:00.492559 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:00.492521 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94da1e53-6c02-4c1a-8048-333f4de3dbda-util\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:21:01.156410 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:01.156382 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4" event={"ID":"94da1e53-6c02-4c1a-8048-333f4de3dbda","Type":"ContainerDied","Data":"97721643008f58b8de76529fb3717a4852dfb34a614fea7ef15653c019a77251"} Jul 14 11:21:01.156564 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:01.156421 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jnt4" Jul 14 11:21:01.156564 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:01.156425 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97721643008f58b8de76529fb3717a4852dfb34a614fea7ef15653c019a77251" Jul 14 11:21:12.046487 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:12.046454 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl"] Jul 14 11:21:12.046918 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:12.046682 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94da1e53-6c02-4c1a-8048-333f4de3dbda" containerName="util" Jul 14 11:21:12.046918 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:12.046692 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="94da1e53-6c02-4c1a-8048-333f4de3dbda" containerName="util" Jul 14 11:21:12.046918 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:12.046702 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94da1e53-6c02-4c1a-8048-333f4de3dbda" containerName="pull" Jul 14 11:21:12.046918 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:12.046707 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="94da1e53-6c02-4c1a-8048-333f4de3dbda" containerName="pull" Jul 14 11:21:12.046918 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:12.046713 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94da1e53-6c02-4c1a-8048-333f4de3dbda" containerName="extract" Jul 14 11:21:12.046918 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:12.046718 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="94da1e53-6c02-4c1a-8048-333f4de3dbda" containerName="extract" Jul 14 11:21:12.046918 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:12.046759 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="94da1e53-6c02-4c1a-8048-333f4de3dbda" containerName="extract" Jul 14 11:21:12.051169 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:12.051152 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl" Jul 14 11:21:12.068402 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:12.068380 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 14 11:21:12.069109 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:12.069096 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qzfrh\"" Jul 14 11:21:12.070626 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:12.070614 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 14 11:21:12.072666 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:12.072640 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fcvg\" (UniqueName: \"kubernetes.io/projected/aee418a9-34df-4567-99e5-48d616a36823-kube-api-access-8fcvg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl\" (UID: \"aee418a9-34df-4567-99e5-48d616a36823\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl" Jul 14 11:21:12.072715 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:12.072679 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aee418a9-34df-4567-99e5-48d616a36823-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl\" (UID: \"aee418a9-34df-4567-99e5-48d616a36823\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl" Jul 14 11:21:12.072748 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:12.072735 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aee418a9-34df-4567-99e5-48d616a36823-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl\" (UID: \"aee418a9-34df-4567-99e5-48d616a36823\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl" Jul 14 11:21:12.086654 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:12.086630 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl"] Jul 14 11:21:12.173491 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:12.173460 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aee418a9-34df-4567-99e5-48d616a36823-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl\" (UID: \"aee418a9-34df-4567-99e5-48d616a36823\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl" Jul 14 11:21:12.173648 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:12.173506 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aee418a9-34df-4567-99e5-48d616a36823-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl\" (UID: \"aee418a9-34df-4567-99e5-48d616a36823\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl" Jul 14 11:21:12.173648 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:12.173552 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fcvg\" (UniqueName: \"kubernetes.io/projected/aee418a9-34df-4567-99e5-48d616a36823-kube-api-access-8fcvg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl\" (UID: \"aee418a9-34df-4567-99e5-48d616a36823\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl" Jul 14 11:21:12.173808 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:12.173791 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aee418a9-34df-4567-99e5-48d616a36823-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl\" (UID: \"aee418a9-34df-4567-99e5-48d616a36823\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl" Jul 14 11:21:12.173862 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:12.173844 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aee418a9-34df-4567-99e5-48d616a36823-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl\" (UID: \"aee418a9-34df-4567-99e5-48d616a36823\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl" Jul 14 11:21:12.187851 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:12.187823 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fcvg\" (UniqueName: \"kubernetes.io/projected/aee418a9-34df-4567-99e5-48d616a36823-kube-api-access-8fcvg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl\" (UID: \"aee418a9-34df-4567-99e5-48d616a36823\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl" Jul 14 11:21:12.359896 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:12.359872 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl" Jul 14 11:21:12.487497 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:12.487469 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl"] Jul 14 11:21:12.489803 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:21:12.489772 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaee418a9_34df_4567_99e5_48d616a36823.slice/crio-1bde680e03282a92d85bc4c20f09ce684d07a8c44c6da7c2e4b8eb048ee0b5e3 WatchSource:0}: Error finding container 1bde680e03282a92d85bc4c20f09ce684d07a8c44c6da7c2e4b8eb048ee0b5e3: Status 404 returned error can't find the container with id 1bde680e03282a92d85bc4c20f09ce684d07a8c44c6da7c2e4b8eb048ee0b5e3 Jul 14 11:21:13.200703 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:13.200674 2580 generic.go:356] "Generic (PLEG): container finished" podID="aee418a9-34df-4567-99e5-48d616a36823" containerID="d734dd7a25ab59ac495a23d6273ec5b40e71694ceaa8c6fc413a39b4e0b1a960" exitCode=0 Jul 14 11:21:13.201007 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:13.200720 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl" event={"ID":"aee418a9-34df-4567-99e5-48d616a36823","Type":"ContainerDied","Data":"d734dd7a25ab59ac495a23d6273ec5b40e71694ceaa8c6fc413a39b4e0b1a960"} Jul 14 11:21:13.201007 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:13.200756 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl" event={"ID":"aee418a9-34df-4567-99e5-48d616a36823","Type":"ContainerStarted","Data":"1bde680e03282a92d85bc4c20f09ce684d07a8c44c6da7c2e4b8eb048ee0b5e3"} Jul 14 11:21:15.209593 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:15.209503 2580 generic.go:356] "Generic (PLEG): container finished" podID="aee418a9-34df-4567-99e5-48d616a36823" containerID="f557e19b28721fe214772ee5cf363397b04130859480b5eeeffc5954755cfa79" exitCode=0 Jul 14 11:21:15.209934 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:15.209590 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl" event={"ID":"aee418a9-34df-4567-99e5-48d616a36823","Type":"ContainerDied","Data":"f557e19b28721fe214772ee5cf363397b04130859480b5eeeffc5954755cfa79"} Jul 14 11:21:16.214779 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:16.214742 2580 generic.go:356] "Generic (PLEG): container finished" podID="aee418a9-34df-4567-99e5-48d616a36823" containerID="660b745431c216608f9519d9a508c02bc76187abf8bd5313a8feaad2a50f5c27" exitCode=0 Jul 14 11:21:16.215111 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:16.214831 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl" event={"ID":"aee418a9-34df-4567-99e5-48d616a36823","Type":"ContainerDied","Data":"660b745431c216608f9519d9a508c02bc76187abf8bd5313a8feaad2a50f5c27"} Jul 14 11:21:17.335160 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:17.335138 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl" Jul 14 11:21:17.414450 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:17.414414 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aee418a9-34df-4567-99e5-48d616a36823-util\") pod \"aee418a9-34df-4567-99e5-48d616a36823\" (UID: \"aee418a9-34df-4567-99e5-48d616a36823\") " Jul 14 11:21:17.414727 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:17.414473 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fcvg\" (UniqueName: \"kubernetes.io/projected/aee418a9-34df-4567-99e5-48d616a36823-kube-api-access-8fcvg\") pod \"aee418a9-34df-4567-99e5-48d616a36823\" (UID: \"aee418a9-34df-4567-99e5-48d616a36823\") " Jul 14 11:21:17.414727 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:17.414520 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aee418a9-34df-4567-99e5-48d616a36823-bundle\") pod \"aee418a9-34df-4567-99e5-48d616a36823\" (UID: \"aee418a9-34df-4567-99e5-48d616a36823\") " Jul 14 11:21:17.414973 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:17.414944 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aee418a9-34df-4567-99e5-48d616a36823-bundle" (OuterVolumeSpecName: "bundle") pod "aee418a9-34df-4567-99e5-48d616a36823" (UID: "aee418a9-34df-4567-99e5-48d616a36823"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:21:17.416779 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:17.416744 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aee418a9-34df-4567-99e5-48d616a36823-kube-api-access-8fcvg" (OuterVolumeSpecName: "kube-api-access-8fcvg") pod "aee418a9-34df-4567-99e5-48d616a36823" (UID: "aee418a9-34df-4567-99e5-48d616a36823"). InnerVolumeSpecName "kube-api-access-8fcvg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:21:17.420139 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:17.420121 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aee418a9-34df-4567-99e5-48d616a36823-util" (OuterVolumeSpecName: "util") pod "aee418a9-34df-4567-99e5-48d616a36823" (UID: "aee418a9-34df-4567-99e5-48d616a36823"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:21:17.515640 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:17.515545 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aee418a9-34df-4567-99e5-48d616a36823-bundle\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:21:17.515640 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:17.515578 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aee418a9-34df-4567-99e5-48d616a36823-util\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:21:17.515640 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:17.515589 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fcvg\" (UniqueName: \"kubernetes.io/projected/aee418a9-34df-4567-99e5-48d616a36823-kube-api-access-8fcvg\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:21:18.222988 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:18.222947 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl" event={"ID":"aee418a9-34df-4567-99e5-48d616a36823","Type":"ContainerDied","Data":"1bde680e03282a92d85bc4c20f09ce684d07a8c44c6da7c2e4b8eb048ee0b5e3"} Jul 14 11:21:18.222988 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:18.222980 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6kvl" Jul 14 11:21:18.223184 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:18.223005 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1bde680e03282a92d85bc4c20f09ce684d07a8c44c6da7c2e4b8eb048ee0b5e3" Jul 14 11:21:27.163199 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:27.163086 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndktj_62d784b5-2a7b-4330-84a3-e8cd167dd1ce/ovn-acl-logging/0.log" Jul 14 11:21:27.168320 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:27.163485 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndktj_62d784b5-2a7b-4330-84a3-e8cd167dd1ce/ovn-acl-logging/0.log" Jul 14 11:21:31.947503 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:31.947467 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj"] Jul 14 11:21:31.947860 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:31.947725 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aee418a9-34df-4567-99e5-48d616a36823" containerName="pull" Jul 14 11:21:31.947860 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:31.947736 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="aee418a9-34df-4567-99e5-48d616a36823" containerName="pull" Jul 14 11:21:31.947860 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:31.947746 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aee418a9-34df-4567-99e5-48d616a36823" containerName="extract" Jul 14 11:21:31.947860 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:31.947751 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="aee418a9-34df-4567-99e5-48d616a36823" containerName="extract" Jul 14 11:21:31.947860 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:31.947760 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aee418a9-34df-4567-99e5-48d616a36823" containerName="util" Jul 14 11:21:31.947860 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:31.947766 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="aee418a9-34df-4567-99e5-48d616a36823" containerName="util" Jul 14 11:21:31.947860 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:31.947811 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="aee418a9-34df-4567-99e5-48d616a36823" containerName="extract" Jul 14 11:21:31.965754 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:31.965726 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj"] Jul 14 11:21:31.965891 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:31.965841 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj" Jul 14 11:21:31.968427 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:31.968402 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 14 11:21:31.969477 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:31.969455 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 14 11:21:31.969570 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:31.969545 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qzfrh\"" Jul 14 11:21:32.019067 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:32.019035 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mhrw\" (UniqueName: \"kubernetes.io/projected/48b95c45-9aaa-4628-88fb-34b4cc38cfc2-kube-api-access-4mhrw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj\" (UID: \"48b95c45-9aaa-4628-88fb-34b4cc38cfc2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj" Jul 14 11:21:32.019067 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:32.019072 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48b95c45-9aaa-4628-88fb-34b4cc38cfc2-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj\" (UID: \"48b95c45-9aaa-4628-88fb-34b4cc38cfc2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj" Jul 14 11:21:32.019325 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:32.019112 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48b95c45-9aaa-4628-88fb-34b4cc38cfc2-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj\" (UID: \"48b95c45-9aaa-4628-88fb-34b4cc38cfc2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj" Jul 14 11:21:32.120119 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:32.120079 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48b95c45-9aaa-4628-88fb-34b4cc38cfc2-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj\" (UID: \"48b95c45-9aaa-4628-88fb-34b4cc38cfc2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj" Jul 14 11:21:32.120321 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:32.120131 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mhrw\" (UniqueName: \"kubernetes.io/projected/48b95c45-9aaa-4628-88fb-34b4cc38cfc2-kube-api-access-4mhrw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj\" (UID: \"48b95c45-9aaa-4628-88fb-34b4cc38cfc2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj" Jul 14 11:21:32.120321 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:32.120279 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48b95c45-9aaa-4628-88fb-34b4cc38cfc2-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj\" (UID: \"48b95c45-9aaa-4628-88fb-34b4cc38cfc2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj" Jul 14 11:21:32.120513 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:32.120495 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48b95c45-9aaa-4628-88fb-34b4cc38cfc2-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj\" (UID: \"48b95c45-9aaa-4628-88fb-34b4cc38cfc2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj" Jul 14 11:21:32.120568 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:32.120550 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48b95c45-9aaa-4628-88fb-34b4cc38cfc2-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj\" (UID: \"48b95c45-9aaa-4628-88fb-34b4cc38cfc2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj" Jul 14 11:21:32.127972 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:32.127952 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mhrw\" (UniqueName: \"kubernetes.io/projected/48b95c45-9aaa-4628-88fb-34b4cc38cfc2-kube-api-access-4mhrw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj\" (UID: \"48b95c45-9aaa-4628-88fb-34b4cc38cfc2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj" Jul 14 11:21:32.274792 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:32.274718 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj" Jul 14 11:21:32.421851 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:32.421796 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj"] Jul 14 11:21:32.424406 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:21:32.424378 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48b95c45_9aaa_4628_88fb_34b4cc38cfc2.slice/crio-a845752b8dd32b6ec83a9986f44e58a7de7b9c5d26f00f66170063d55a4306a1 WatchSource:0}: Error finding container a845752b8dd32b6ec83a9986f44e58a7de7b9c5d26f00f66170063d55a4306a1: Status 404 returned error can't find the container with id a845752b8dd32b6ec83a9986f44e58a7de7b9c5d26f00f66170063d55a4306a1 Jul 14 11:21:33.274391 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:33.274359 2580 generic.go:356] "Generic (PLEG): container finished" podID="48b95c45-9aaa-4628-88fb-34b4cc38cfc2" containerID="d01dc1869496e15f583c8ea186f54c467ddf87ea24a04adb04fa0f3d92d77845" exitCode=0 Jul 14 11:21:33.274825 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:33.274447 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj" event={"ID":"48b95c45-9aaa-4628-88fb-34b4cc38cfc2","Type":"ContainerDied","Data":"d01dc1869496e15f583c8ea186f54c467ddf87ea24a04adb04fa0f3d92d77845"} Jul 14 11:21:33.274825 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:33.274497 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj" event={"ID":"48b95c45-9aaa-4628-88fb-34b4cc38cfc2","Type":"ContainerStarted","Data":"a845752b8dd32b6ec83a9986f44e58a7de7b9c5d26f00f66170063d55a4306a1"} Jul 14 11:21:33.274895 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:33.274832 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 11:21:34.279160 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:34.279077 2580 generic.go:356] "Generic (PLEG): container finished" podID="48b95c45-9aaa-4628-88fb-34b4cc38cfc2" containerID="ec42247024560e78280b7711c3dde0f2d7899647c6505f45a070beb4c7aa53f0" exitCode=0 Jul 14 11:21:34.279527 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:34.279173 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj" event={"ID":"48b95c45-9aaa-4628-88fb-34b4cc38cfc2","Type":"ContainerDied","Data":"ec42247024560e78280b7711c3dde0f2d7899647c6505f45a070beb4c7aa53f0"} Jul 14 11:21:35.284812 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:35.284778 2580 generic.go:356] "Generic (PLEG): container finished" podID="48b95c45-9aaa-4628-88fb-34b4cc38cfc2" containerID="eccc09dc4aaa016599939cd99e0e59665a1a3e12fe5714526b2165e51cd097ed" exitCode=0 Jul 14 11:21:35.285188 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:35.284834 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj" event={"ID":"48b95c45-9aaa-4628-88fb-34b4cc38cfc2","Type":"ContainerDied","Data":"eccc09dc4aaa016599939cd99e0e59665a1a3e12fe5714526b2165e51cd097ed"} Jul 14 11:21:36.405657 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:36.405634 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj" Jul 14 11:21:36.450892 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:36.450862 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48b95c45-9aaa-4628-88fb-34b4cc38cfc2-bundle\") pod \"48b95c45-9aaa-4628-88fb-34b4cc38cfc2\" (UID: \"48b95c45-9aaa-4628-88fb-34b4cc38cfc2\") " Jul 14 11:21:36.451065 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:36.450926 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48b95c45-9aaa-4628-88fb-34b4cc38cfc2-util\") pod \"48b95c45-9aaa-4628-88fb-34b4cc38cfc2\" (UID: \"48b95c45-9aaa-4628-88fb-34b4cc38cfc2\") " Jul 14 11:21:36.451065 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:36.450960 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mhrw\" (UniqueName: \"kubernetes.io/projected/48b95c45-9aaa-4628-88fb-34b4cc38cfc2-kube-api-access-4mhrw\") pod \"48b95c45-9aaa-4628-88fb-34b4cc38cfc2\" (UID: \"48b95c45-9aaa-4628-88fb-34b4cc38cfc2\") " Jul 14 11:21:36.451628 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:36.451603 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48b95c45-9aaa-4628-88fb-34b4cc38cfc2-bundle" (OuterVolumeSpecName: "bundle") pod "48b95c45-9aaa-4628-88fb-34b4cc38cfc2" (UID: "48b95c45-9aaa-4628-88fb-34b4cc38cfc2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:21:36.453073 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:36.453051 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48b95c45-9aaa-4628-88fb-34b4cc38cfc2-kube-api-access-4mhrw" (OuterVolumeSpecName: "kube-api-access-4mhrw") pod "48b95c45-9aaa-4628-88fb-34b4cc38cfc2" (UID: "48b95c45-9aaa-4628-88fb-34b4cc38cfc2"). InnerVolumeSpecName "kube-api-access-4mhrw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:21:36.456682 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:36.456644 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48b95c45-9aaa-4628-88fb-34b4cc38cfc2-util" (OuterVolumeSpecName: "util") pod "48b95c45-9aaa-4628-88fb-34b4cc38cfc2" (UID: "48b95c45-9aaa-4628-88fb-34b4cc38cfc2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:21:36.552404 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:36.552313 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48b95c45-9aaa-4628-88fb-34b4cc38cfc2-util\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:21:36.552404 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:36.552345 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mhrw\" (UniqueName: \"kubernetes.io/projected/48b95c45-9aaa-4628-88fb-34b4cc38cfc2-kube-api-access-4mhrw\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:21:36.552404 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:36.552360 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48b95c45-9aaa-4628-88fb-34b4cc38cfc2-bundle\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:21:37.293002 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:37.292965 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj" event={"ID":"48b95c45-9aaa-4628-88fb-34b4cc38cfc2","Type":"ContainerDied","Data":"a845752b8dd32b6ec83a9986f44e58a7de7b9c5d26f00f66170063d55a4306a1"} Jul 14 11:21:37.293002 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:37.292986 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd9hqj" Jul 14 11:21:37.293216 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:37.293032 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a845752b8dd32b6ec83a9986f44e58a7de7b9c5d26f00f66170063d55a4306a1" Jul 14 11:21:40.498760 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.498730 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-749d85bc9c-lxxvx"] Jul 14 11:21:40.499206 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.499056 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48b95c45-9aaa-4628-88fb-34b4cc38cfc2" containerName="pull" Jul 14 11:21:40.499206 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.499072 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="48b95c45-9aaa-4628-88fb-34b4cc38cfc2" containerName="pull" Jul 14 11:21:40.499206 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.499087 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48b95c45-9aaa-4628-88fb-34b4cc38cfc2" containerName="util" Jul 14 11:21:40.499206 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.499094 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="48b95c45-9aaa-4628-88fb-34b4cc38cfc2" containerName="util" Jul 14 11:21:40.499206 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.499102 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48b95c45-9aaa-4628-88fb-34b4cc38cfc2" containerName="extract" Jul 14 11:21:40.499206 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.499110 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="48b95c45-9aaa-4628-88fb-34b4cc38cfc2" containerName="extract" Jul 14 11:21:40.499206 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.499192 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="48b95c45-9aaa-4628-88fb-34b4cc38cfc2" containerName="extract" Jul 14 11:21:40.501344 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.501321 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-lxxvx" Jul 14 11:21:40.505557 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.505533 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 14 11:21:40.505683 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.505561 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 14 11:21:40.505683 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.505606 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 14 11:21:40.505804 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.505676 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 14 11:21:40.505804 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.505691 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 14 11:21:40.505905 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.505834 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-w2f6l\"" Jul 14 11:21:40.522773 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.522747 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-749d85bc9c-lxxvx"] Jul 14 11:21:40.585584 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.585552 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87043478-781c-4980-8702-af33bf291180-cert\") pod \"lws-controller-manager-749d85bc9c-lxxvx\" (UID: \"87043478-781c-4980-8702-af33bf291180\") " pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-lxxvx" Jul 14 11:21:40.585584 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.585586 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/87043478-781c-4980-8702-af33bf291180-metrics-cert\") pod \"lws-controller-manager-749d85bc9c-lxxvx\" (UID: \"87043478-781c-4980-8702-af33bf291180\") " pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-lxxvx" Jul 14 11:21:40.585771 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.585605 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkl8t\" (UniqueName: \"kubernetes.io/projected/87043478-781c-4980-8702-af33bf291180-kube-api-access-mkl8t\") pod \"lws-controller-manager-749d85bc9c-lxxvx\" (UID: \"87043478-781c-4980-8702-af33bf291180\") " pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-lxxvx" Jul 14 11:21:40.585771 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.585672 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/87043478-781c-4980-8702-af33bf291180-manager-config\") pod \"lws-controller-manager-749d85bc9c-lxxvx\" (UID: \"87043478-781c-4980-8702-af33bf291180\") " pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-lxxvx" Jul 14 11:21:40.686170 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.686136 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87043478-781c-4980-8702-af33bf291180-cert\") pod \"lws-controller-manager-749d85bc9c-lxxvx\" (UID: \"87043478-781c-4980-8702-af33bf291180\") " pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-lxxvx" Jul 14 11:21:40.686170 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.686170 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/87043478-781c-4980-8702-af33bf291180-metrics-cert\") pod \"lws-controller-manager-749d85bc9c-lxxvx\" (UID: \"87043478-781c-4980-8702-af33bf291180\") " pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-lxxvx" Jul 14 11:21:40.686451 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.686197 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkl8t\" (UniqueName: \"kubernetes.io/projected/87043478-781c-4980-8702-af33bf291180-kube-api-access-mkl8t\") pod \"lws-controller-manager-749d85bc9c-lxxvx\" (UID: \"87043478-781c-4980-8702-af33bf291180\") " pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-lxxvx" Jul 14 11:21:40.686451 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.686256 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/87043478-781c-4980-8702-af33bf291180-manager-config\") pod \"lws-controller-manager-749d85bc9c-lxxvx\" (UID: \"87043478-781c-4980-8702-af33bf291180\") " pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-lxxvx" Jul 14 11:21:40.686981 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.686913 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/87043478-781c-4980-8702-af33bf291180-manager-config\") pod \"lws-controller-manager-749d85bc9c-lxxvx\" (UID: \"87043478-781c-4980-8702-af33bf291180\") " pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-lxxvx" Jul 14 11:21:40.688648 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.688622 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87043478-781c-4980-8702-af33bf291180-cert\") pod \"lws-controller-manager-749d85bc9c-lxxvx\" (UID: \"87043478-781c-4980-8702-af33bf291180\") " pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-lxxvx" Jul 14 11:21:40.688733 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.688695 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/87043478-781c-4980-8702-af33bf291180-metrics-cert\") pod \"lws-controller-manager-749d85bc9c-lxxvx\" (UID: \"87043478-781c-4980-8702-af33bf291180\") " pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-lxxvx" Jul 14 11:21:40.702297 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.702276 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkl8t\" (UniqueName: \"kubernetes.io/projected/87043478-781c-4980-8702-af33bf291180-kube-api-access-mkl8t\") pod \"lws-controller-manager-749d85bc9c-lxxvx\" (UID: \"87043478-781c-4980-8702-af33bf291180\") " pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-lxxvx" Jul 14 11:21:40.810226 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.810136 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-lxxvx" Jul 14 11:21:40.946638 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:40.946610 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-749d85bc9c-lxxvx"] Jul 14 11:21:40.948954 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:21:40.948915 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87043478_781c_4980_8702_af33bf291180.slice/crio-a667fc59bcb2c5db06fffc55e021bd502478592e1efb19e18ad688b06f2074a0 WatchSource:0}: Error finding container a667fc59bcb2c5db06fffc55e021bd502478592e1efb19e18ad688b06f2074a0: Status 404 returned error can't find the container with id a667fc59bcb2c5db06fffc55e021bd502478592e1efb19e18ad688b06f2074a0 Jul 14 11:21:41.309735 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:41.309700 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-lxxvx" event={"ID":"87043478-781c-4980-8702-af33bf291180","Type":"ContainerStarted","Data":"a667fc59bcb2c5db06fffc55e021bd502478592e1efb19e18ad688b06f2074a0"} Jul 14 11:21:43.319214 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:43.319181 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-lxxvx" event={"ID":"87043478-781c-4980-8702-af33bf291180","Type":"ContainerStarted","Data":"ad68d1130880c524d9df4ee2ce6d79078a4681154ed4043c14c18b2c94aed862"} Jul 14 11:21:43.319602 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:43.319311 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-lxxvx" Jul 14 11:21:43.351294 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:43.351251 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-lxxvx" podStartSLOduration=1.794628887 podStartE2EDuration="3.351220116s" totalImagesPullingTime="1.556591229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:21:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:21:43.348066125 +0000 UTC m=+619.662199645" watchObservedRunningTime="2026-07-14 11:21:43.351220116 +0000 UTC m=+619.665353635" Jul 14 11:21:45.330924 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:45.330851 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bf58df976-fpg6h"] Jul 14 11:21:45.333091 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:45.333073 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-fpg6h" Jul 14 11:21:45.339815 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:45.339794 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 14 11:21:45.339815 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:45.339795 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-j5tr7\"" Jul 14 11:21:45.340005 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:45.339931 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 14 11:21:45.340005 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:45.339935 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 14 11:21:45.342701 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:45.342681 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 14 11:21:45.424559 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:45.424520 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fj4z\" (UniqueName: \"kubernetes.io/projected/c4093ae8-8fd7-474d-a5b7-626a6f494217-kube-api-access-4fj4z\") pod \"opendatahub-operator-controller-manager-5bf58df976-fpg6h\" (UID: \"c4093ae8-8fd7-474d-a5b7-626a6f494217\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-fpg6h" Jul 14 11:21:45.424728 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:45.424587 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c4093ae8-8fd7-474d-a5b7-626a6f494217-manifests\") pod \"opendatahub-operator-controller-manager-5bf58df976-fpg6h\" (UID: \"c4093ae8-8fd7-474d-a5b7-626a6f494217\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-fpg6h" Jul 14 11:21:45.424728 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:45.424616 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4093ae8-8fd7-474d-a5b7-626a6f494217-tmp\") pod \"opendatahub-operator-controller-manager-5bf58df976-fpg6h\" (UID: \"c4093ae8-8fd7-474d-a5b7-626a6f494217\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-fpg6h" Jul 14 11:21:45.424728 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:45.424632 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c4093ae8-8fd7-474d-a5b7-626a6f494217-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bf58df976-fpg6h\" (UID: \"c4093ae8-8fd7-474d-a5b7-626a6f494217\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-fpg6h" Jul 14 11:21:45.424728 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:45.424650 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4093ae8-8fd7-474d-a5b7-626a6f494217-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bf58df976-fpg6h\" (UID: \"c4093ae8-8fd7-474d-a5b7-626a6f494217\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-fpg6h" Jul 14 11:21:45.450461 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:45.450435 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bf58df976-fpg6h"] Jul 14 11:21:45.525382 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:45.525347 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c4093ae8-8fd7-474d-a5b7-626a6f494217-manifests\") pod \"opendatahub-operator-controller-manager-5bf58df976-fpg6h\" (UID: \"c4093ae8-8fd7-474d-a5b7-626a6f494217\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-fpg6h" Jul 14 11:21:45.525563 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:45.525390 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4093ae8-8fd7-474d-a5b7-626a6f494217-tmp\") pod \"opendatahub-operator-controller-manager-5bf58df976-fpg6h\" (UID: \"c4093ae8-8fd7-474d-a5b7-626a6f494217\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-fpg6h" Jul 14 11:21:45.525563 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:45.525409 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c4093ae8-8fd7-474d-a5b7-626a6f494217-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bf58df976-fpg6h\" (UID: \"c4093ae8-8fd7-474d-a5b7-626a6f494217\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-fpg6h" Jul 14 11:21:45.525563 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:45.525429 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4093ae8-8fd7-474d-a5b7-626a6f494217-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bf58df976-fpg6h\" (UID: \"c4093ae8-8fd7-474d-a5b7-626a6f494217\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-fpg6h" Jul 14 11:21:45.525563 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:45.525491 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fj4z\" (UniqueName: \"kubernetes.io/projected/c4093ae8-8fd7-474d-a5b7-626a6f494217-kube-api-access-4fj4z\") pod \"opendatahub-operator-controller-manager-5bf58df976-fpg6h\" (UID: \"c4093ae8-8fd7-474d-a5b7-626a6f494217\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-fpg6h" Jul 14 11:21:45.525848 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:45.525827 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c4093ae8-8fd7-474d-a5b7-626a6f494217-manifests\") pod \"opendatahub-operator-controller-manager-5bf58df976-fpg6h\" (UID: \"c4093ae8-8fd7-474d-a5b7-626a6f494217\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-fpg6h" Jul 14 11:21:45.527643 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:45.527615 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4093ae8-8fd7-474d-a5b7-626a6f494217-tmp\") pod \"opendatahub-operator-controller-manager-5bf58df976-fpg6h\" (UID: \"c4093ae8-8fd7-474d-a5b7-626a6f494217\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-fpg6h" Jul 14 11:21:45.527835 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:45.527818 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4093ae8-8fd7-474d-a5b7-626a6f494217-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bf58df976-fpg6h\" (UID: \"c4093ae8-8fd7-474d-a5b7-626a6f494217\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-fpg6h" Jul 14 11:21:45.527878 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:45.527849 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c4093ae8-8fd7-474d-a5b7-626a6f494217-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bf58df976-fpg6h\" (UID: \"c4093ae8-8fd7-474d-a5b7-626a6f494217\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-fpg6h" Jul 14 11:21:45.540396 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:45.540374 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fj4z\" (UniqueName: \"kubernetes.io/projected/c4093ae8-8fd7-474d-a5b7-626a6f494217-kube-api-access-4fj4z\") pod \"opendatahub-operator-controller-manager-5bf58df976-fpg6h\" (UID: \"c4093ae8-8fd7-474d-a5b7-626a6f494217\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-fpg6h" Jul 14 11:21:45.643374 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:45.643331 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-fpg6h" Jul 14 11:21:45.797988 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:45.797955 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bf58df976-fpg6h"] Jul 14 11:21:45.800618 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:21:45.800593 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4093ae8_8fd7_474d_a5b7_626a6f494217.slice/crio-f6f946d0d593f1376971d6e2e3c41c211f7e9b3dc7cad8d4932d0048c8d3eb6d WatchSource:0}: Error finding container f6f946d0d593f1376971d6e2e3c41c211f7e9b3dc7cad8d4932d0048c8d3eb6d: Status 404 returned error can't find the container with id f6f946d0d593f1376971d6e2e3c41c211f7e9b3dc7cad8d4932d0048c8d3eb6d Jul 14 11:21:46.331668 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:46.331634 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-fpg6h" event={"ID":"c4093ae8-8fd7-474d-a5b7-626a6f494217","Type":"ContainerStarted","Data":"f6f946d0d593f1376971d6e2e3c41c211f7e9b3dc7cad8d4932d0048c8d3eb6d"} Jul 14 11:21:49.346632 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:49.346547 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-fpg6h" event={"ID":"c4093ae8-8fd7-474d-a5b7-626a6f494217","Type":"ContainerStarted","Data":"1da8c264eabbe7938834bc92b22fe932378882d441c8e8c83a91287a3f88fb12"} Jul 14 11:21:50.352031 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:50.352001 2580 generic.go:356] "Generic (PLEG): container finished" podID="c4093ae8-8fd7-474d-a5b7-626a6f494217" containerID="1da8c264eabbe7938834bc92b22fe932378882d441c8e8c83a91287a3f88fb12" exitCode=0 Jul 14 11:21:50.352411 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:50.352093 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-fpg6h" event={"ID":"c4093ae8-8fd7-474d-a5b7-626a6f494217","Type":"ContainerDied","Data":"1da8c264eabbe7938834bc92b22fe932378882d441c8e8c83a91287a3f88fb12"} Jul 14 11:21:51.359100 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:51.359062 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-fpg6h" event={"ID":"c4093ae8-8fd7-474d-a5b7-626a6f494217","Type":"ContainerStarted","Data":"f9684be9e4b3b5ed63c710d57fe17a287ea7d9065c809ff0ed7dd5fa85aaa848"} Jul 14 11:21:51.359489 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:51.359220 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-fpg6h" Jul 14 11:21:51.410160 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:51.410111 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-fpg6h" podStartSLOduration=1.916202582 podStartE2EDuration="6.410093777s" totalImagesPullingTime="3.403919361s" totalInitContainerRuntime="1.089971834s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:21:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:21:51.409773345 +0000 UTC m=+627.723906869" watchObservedRunningTime="2026-07-14 11:21:51.410093777 +0000 UTC m=+627.724227295" Jul 14 11:21:54.324762 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:21:54.324734 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-lxxvx" Jul 14 11:22:02.366408 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:02.366378 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-fpg6h" Jul 14 11:22:16.121005 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.120966 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf"] Jul 14 11:22:16.126351 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.126328 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" Jul 14 11:22:16.131041 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.131017 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 14 11:22:16.131195 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.131181 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 14 11:22:16.131466 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.131448 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 14 11:22:16.131699 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.131684 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 14 11:22:16.131756 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.131691 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 14 11:22:16.131954 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.131936 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-98q88\"" Jul 14 11:22:16.132171 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.132157 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 14 11:22:16.150128 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.150098 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf"] Jul 14 11:22:16.162135 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.162107 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac9ad772-d85f-476c-8f57-1209c56e960f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-44kkf\" (UID: \"ac9ad772-d85f-476c-8f57-1209c56e960f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" Jul 14 11:22:16.162280 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.162156 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ac9ad772-d85f-476c-8f57-1209c56e960f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-44kkf\" (UID: \"ac9ad772-d85f-476c-8f57-1209c56e960f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" Jul 14 11:22:16.162280 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.162200 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac9ad772-d85f-476c-8f57-1209c56e960f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-44kkf\" (UID: \"ac9ad772-d85f-476c-8f57-1209c56e960f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" Jul 14 11:22:16.162280 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.162225 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl6bh\" (UniqueName: \"kubernetes.io/projected/ac9ad772-d85f-476c-8f57-1209c56e960f-kube-api-access-cl6bh\") pod \"istiod-openshift-gateway-94bb8fbfd-44kkf\" (UID: \"ac9ad772-d85f-476c-8f57-1209c56e960f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" Jul 14 11:22:16.162280 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.162257 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ac9ad772-d85f-476c-8f57-1209c56e960f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-44kkf\" (UID: \"ac9ad772-d85f-476c-8f57-1209c56e960f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" Jul 14 11:22:16.162418 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.162324 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ac9ad772-d85f-476c-8f57-1209c56e960f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-44kkf\" (UID: \"ac9ad772-d85f-476c-8f57-1209c56e960f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" Jul 14 11:22:16.162418 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.162355 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac9ad772-d85f-476c-8f57-1209c56e960f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-44kkf\" (UID: \"ac9ad772-d85f-476c-8f57-1209c56e960f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" Jul 14 11:22:16.263154 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.263116 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ac9ad772-d85f-476c-8f57-1209c56e960f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-44kkf\" (UID: \"ac9ad772-d85f-476c-8f57-1209c56e960f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" Jul 14 11:22:16.263154 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.263159 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac9ad772-d85f-476c-8f57-1209c56e960f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-44kkf\" (UID: \"ac9ad772-d85f-476c-8f57-1209c56e960f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" Jul 14 11:22:16.263552 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.263189 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac9ad772-d85f-476c-8f57-1209c56e960f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-44kkf\" (UID: \"ac9ad772-d85f-476c-8f57-1209c56e960f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" Jul 14 11:22:16.263552 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.263467 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ac9ad772-d85f-476c-8f57-1209c56e960f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-44kkf\" (UID: \"ac9ad772-d85f-476c-8f57-1209c56e960f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" Jul 14 11:22:16.263663 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.263592 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac9ad772-d85f-476c-8f57-1209c56e960f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-44kkf\" (UID: \"ac9ad772-d85f-476c-8f57-1209c56e960f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" Jul 14 11:22:16.263663 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.263655 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl6bh\" (UniqueName: \"kubernetes.io/projected/ac9ad772-d85f-476c-8f57-1209c56e960f-kube-api-access-cl6bh\") pod \"istiod-openshift-gateway-94bb8fbfd-44kkf\" (UID: \"ac9ad772-d85f-476c-8f57-1209c56e960f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" Jul 14 11:22:16.263774 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.263686 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ac9ad772-d85f-476c-8f57-1209c56e960f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-44kkf\" (UID: \"ac9ad772-d85f-476c-8f57-1209c56e960f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" Jul 14 11:22:16.263824 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.263801 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ac9ad772-d85f-476c-8f57-1209c56e960f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-44kkf\" (UID: \"ac9ad772-d85f-476c-8f57-1209c56e960f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" Jul 14 11:22:16.265874 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.265843 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac9ad772-d85f-476c-8f57-1209c56e960f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-44kkf\" (UID: \"ac9ad772-d85f-476c-8f57-1209c56e960f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" Jul 14 11:22:16.266029 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.266004 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ac9ad772-d85f-476c-8f57-1209c56e960f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-44kkf\" (UID: \"ac9ad772-d85f-476c-8f57-1209c56e960f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" Jul 14 11:22:16.266106 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.266054 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac9ad772-d85f-476c-8f57-1209c56e960f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-44kkf\" (UID: \"ac9ad772-d85f-476c-8f57-1209c56e960f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" Jul 14 11:22:16.266106 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.266094 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ac9ad772-d85f-476c-8f57-1209c56e960f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-44kkf\" (UID: \"ac9ad772-d85f-476c-8f57-1209c56e960f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" Jul 14 11:22:16.271630 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.271610 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl6bh\" (UniqueName: \"kubernetes.io/projected/ac9ad772-d85f-476c-8f57-1209c56e960f-kube-api-access-cl6bh\") pod \"istiod-openshift-gateway-94bb8fbfd-44kkf\" (UID: \"ac9ad772-d85f-476c-8f57-1209c56e960f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" Jul 14 11:22:16.271904 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.271871 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac9ad772-d85f-476c-8f57-1209c56e960f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-44kkf\" (UID: \"ac9ad772-d85f-476c-8f57-1209c56e960f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" Jul 14 11:22:16.435624 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.435528 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" Jul 14 11:22:16.581971 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:16.581949 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf"] Jul 14 11:22:16.584363 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:22:16.584331 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac9ad772_d85f_476c_8f57_1209c56e960f.slice/crio-90da5ab35fae58d270201bb9440c83add34e0c93e06ddf2bcc5bdcceef4fea17 WatchSource:0}: Error finding container 90da5ab35fae58d270201bb9440c83add34e0c93e06ddf2bcc5bdcceef4fea17: Status 404 returned error can't find the container with id 90da5ab35fae58d270201bb9440c83add34e0c93e06ddf2bcc5bdcceef4fea17 Jul 14 11:22:17.477779 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:17.477716 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" event={"ID":"ac9ad772-d85f-476c-8f57-1209c56e960f","Type":"ContainerStarted","Data":"90da5ab35fae58d270201bb9440c83add34e0c93e06ddf2bcc5bdcceef4fea17"} Jul 14 11:22:18.910123 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:18.910081 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 11:22:18.910509 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:18.910164 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 11:22:19.489994 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:19.489957 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" event={"ID":"ac9ad772-d85f-476c-8f57-1209c56e960f","Type":"ContainerStarted","Data":"03ac5bc98f0b9b27bd281d2668ed06c6f11f90164d98f40978fe32c36e014cb1"} Jul 14 11:22:19.490183 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:19.490106 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" Jul 14 11:22:19.491698 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:19.491678 2580 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-44kkf container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 11:22:19.491784 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:19.491722 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" podUID="ac9ad772-d85f-476c-8f57-1209c56e960f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 11:22:19.563603 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:19.563554 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" podStartSLOduration=1.240304272 podStartE2EDuration="3.563538234s" totalImagesPullingTime="2.323233962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:22:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:22:19.562470687 +0000 UTC m=+655.876604208" watchObservedRunningTime="2026-07-14 11:22:19.563538234 +0000 UTC m=+655.877671752" Jul 14 11:22:20.494521 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:22:20.494492 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-44kkf" Jul 14 11:23:19.842086 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:19.842008 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64c678d565-bwvvn"] Jul 14 11:23:22.472006 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:22.471971 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx"] Jul 14 11:23:22.474876 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:22.474859 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx" Jul 14 11:23:22.477561 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:22.477541 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 11:23:22.477671 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:22.477614 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 11:23:22.478469 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:22.478456 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2ztm4\"" Jul 14 11:23:22.485130 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:22.485101 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx"] Jul 14 11:23:22.591385 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:22.591347 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/583c83c1-b347-4c5e-ac0a-a5de9836f4e8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx\" (UID: \"583c83c1-b347-4c5e-ac0a-a5de9836f4e8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx" Jul 14 11:23:22.591385 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:22.591381 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/583c83c1-b347-4c5e-ac0a-a5de9836f4e8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx\" (UID: \"583c83c1-b347-4c5e-ac0a-a5de9836f4e8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx" Jul 14 11:23:22.591576 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:22.591467 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjb8s\" (UniqueName: \"kubernetes.io/projected/583c83c1-b347-4c5e-ac0a-a5de9836f4e8-kube-api-access-xjb8s\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx\" (UID: \"583c83c1-b347-4c5e-ac0a-a5de9836f4e8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx" Jul 14 11:23:22.692612 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:22.692575 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjb8s\" (UniqueName: \"kubernetes.io/projected/583c83c1-b347-4c5e-ac0a-a5de9836f4e8-kube-api-access-xjb8s\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx\" (UID: \"583c83c1-b347-4c5e-ac0a-a5de9836f4e8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx" Jul 14 11:23:22.692763 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:22.692620 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/583c83c1-b347-4c5e-ac0a-a5de9836f4e8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx\" (UID: \"583c83c1-b347-4c5e-ac0a-a5de9836f4e8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx" Jul 14 11:23:22.692763 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:22.692647 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/583c83c1-b347-4c5e-ac0a-a5de9836f4e8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx\" (UID: \"583c83c1-b347-4c5e-ac0a-a5de9836f4e8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx" Jul 14 11:23:22.692975 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:22.692943 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/583c83c1-b347-4c5e-ac0a-a5de9836f4e8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx\" (UID: \"583c83c1-b347-4c5e-ac0a-a5de9836f4e8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx" Jul 14 11:23:22.693026 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:22.693010 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/583c83c1-b347-4c5e-ac0a-a5de9836f4e8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx\" (UID: \"583c83c1-b347-4c5e-ac0a-a5de9836f4e8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx" Jul 14 11:23:22.701101 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:22.701072 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjb8s\" (UniqueName: \"kubernetes.io/projected/583c83c1-b347-4c5e-ac0a-a5de9836f4e8-kube-api-access-xjb8s\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx\" (UID: \"583c83c1-b347-4c5e-ac0a-a5de9836f4e8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx" Jul 14 11:23:22.783972 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:22.783890 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx" Jul 14 11:23:22.870083 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:22.870054 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz"] Jul 14 11:23:22.873160 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:22.873138 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz" Jul 14 11:23:22.883681 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:22.883616 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz"] Jul 14 11:23:22.914772 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:22.914698 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx"] Jul 14 11:23:22.916967 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:23:22.916942 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod583c83c1_b347_4c5e_ac0a_a5de9836f4e8.slice/crio-c3954293bbd6a3d3d9dcdb3652c72c9b6414169fb55ed75c01b5a3d37a96a0eb WatchSource:0}: Error finding container c3954293bbd6a3d3d9dcdb3652c72c9b6414169fb55ed75c01b5a3d37a96a0eb: Status 404 returned error can't find the container with id c3954293bbd6a3d3d9dcdb3652c72c9b6414169fb55ed75c01b5a3d37a96a0eb Jul 14 11:23:22.995090 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:22.995047 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpw25\" (UniqueName: \"kubernetes.io/projected/0187b017-3e8c-48c2-aa0d-625650500073-kube-api-access-mpw25\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz\" (UID: \"0187b017-3e8c-48c2-aa0d-625650500073\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz" Jul 14 11:23:22.995247 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:22.995161 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0187b017-3e8c-48c2-aa0d-625650500073-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz\" (UID: \"0187b017-3e8c-48c2-aa0d-625650500073\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz" Jul 14 11:23:22.995247 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:22.995199 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0187b017-3e8c-48c2-aa0d-625650500073-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz\" (UID: \"0187b017-3e8c-48c2-aa0d-625650500073\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz" Jul 14 11:23:23.095622 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.095525 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpw25\" (UniqueName: \"kubernetes.io/projected/0187b017-3e8c-48c2-aa0d-625650500073-kube-api-access-mpw25\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz\" (UID: \"0187b017-3e8c-48c2-aa0d-625650500073\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz" Jul 14 11:23:23.095622 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.095591 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0187b017-3e8c-48c2-aa0d-625650500073-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz\" (UID: \"0187b017-3e8c-48c2-aa0d-625650500073\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz" Jul 14 11:23:23.095622 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.095609 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0187b017-3e8c-48c2-aa0d-625650500073-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz\" (UID: \"0187b017-3e8c-48c2-aa0d-625650500073\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz" Jul 14 11:23:23.095917 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.095900 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0187b017-3e8c-48c2-aa0d-625650500073-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz\" (UID: \"0187b017-3e8c-48c2-aa0d-625650500073\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz" Jul 14 11:23:23.095961 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.095942 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0187b017-3e8c-48c2-aa0d-625650500073-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz\" (UID: \"0187b017-3e8c-48c2-aa0d-625650500073\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz" Jul 14 11:23:23.105753 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.105730 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpw25\" (UniqueName: \"kubernetes.io/projected/0187b017-3e8c-48c2-aa0d-625650500073-kube-api-access-mpw25\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz\" (UID: \"0187b017-3e8c-48c2-aa0d-625650500073\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz" Jul 14 11:23:23.184698 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.184667 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz" Jul 14 11:23:23.285204 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.285050 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74"] Jul 14 11:23:23.289745 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.289720 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74" Jul 14 11:23:23.297918 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.297891 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74"] Jul 14 11:23:23.318790 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.318768 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz"] Jul 14 11:23:23.321079 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:23:23.321054 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0187b017_3e8c_48c2_aa0d_625650500073.slice/crio-4aa4db7534edbf9135500d93c00c37640455a09a921f61724f955ee0cbce7a53 WatchSource:0}: Error finding container 4aa4db7534edbf9135500d93c00c37640455a09a921f61724f955ee0cbce7a53: Status 404 returned error can't find the container with id 4aa4db7534edbf9135500d93c00c37640455a09a921f61724f955ee0cbce7a53 Jul 14 11:23:23.398192 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.398145 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7bbac94-c7cf-4e20-a5d7-d30deae3e132-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74\" (UID: \"d7bbac94-c7cf-4e20-a5d7-d30deae3e132\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74" Jul 14 11:23:23.398440 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.398324 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcklx\" (UniqueName: \"kubernetes.io/projected/d7bbac94-c7cf-4e20-a5d7-d30deae3e132-kube-api-access-tcklx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74\" (UID: \"d7bbac94-c7cf-4e20-a5d7-d30deae3e132\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74" Jul 14 11:23:23.398487 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.398453 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7bbac94-c7cf-4e20-a5d7-d30deae3e132-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74\" (UID: \"d7bbac94-c7cf-4e20-a5d7-d30deae3e132\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74" Jul 14 11:23:23.499561 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.499525 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7bbac94-c7cf-4e20-a5d7-d30deae3e132-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74\" (UID: \"d7bbac94-c7cf-4e20-a5d7-d30deae3e132\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74" Jul 14 11:23:23.499561 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.499562 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7bbac94-c7cf-4e20-a5d7-d30deae3e132-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74\" (UID: \"d7bbac94-c7cf-4e20-a5d7-d30deae3e132\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74" Jul 14 11:23:23.500067 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.499594 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcklx\" (UniqueName: \"kubernetes.io/projected/d7bbac94-c7cf-4e20-a5d7-d30deae3e132-kube-api-access-tcklx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74\" (UID: \"d7bbac94-c7cf-4e20-a5d7-d30deae3e132\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74" Jul 14 11:23:23.500067 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.499979 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7bbac94-c7cf-4e20-a5d7-d30deae3e132-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74\" (UID: \"d7bbac94-c7cf-4e20-a5d7-d30deae3e132\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74" Jul 14 11:23:23.500067 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.499987 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7bbac94-c7cf-4e20-a5d7-d30deae3e132-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74\" (UID: \"d7bbac94-c7cf-4e20-a5d7-d30deae3e132\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74" Jul 14 11:23:23.508966 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.508941 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcklx\" (UniqueName: \"kubernetes.io/projected/d7bbac94-c7cf-4e20-a5d7-d30deae3e132-kube-api-access-tcklx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74\" (UID: \"d7bbac94-c7cf-4e20-a5d7-d30deae3e132\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74" Jul 14 11:23:23.602130 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.602096 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74" Jul 14 11:23:23.747826 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.747803 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74"] Jul 14 11:23:23.750337 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:23:23.750308 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7bbac94_c7cf_4e20_a5d7_d30deae3e132.slice/crio-8cdcbce25c6e18208bdb671efcee103e640666995019525cd020865f07a01c0e WatchSource:0}: Error finding container 8cdcbce25c6e18208bdb671efcee103e640666995019525cd020865f07a01c0e: Status 404 returned error can't find the container with id 8cdcbce25c6e18208bdb671efcee103e640666995019525cd020865f07a01c0e Jul 14 11:23:23.755080 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.755060 2580 generic.go:356] "Generic (PLEG): container finished" podID="583c83c1-b347-4c5e-ac0a-a5de9836f4e8" containerID="bbf0b18065ad97e9e62693b3bdff6c128fba34c6a7e310020f7982597b38be1e" exitCode=0 Jul 14 11:23:23.755166 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.755131 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx" event={"ID":"583c83c1-b347-4c5e-ac0a-a5de9836f4e8","Type":"ContainerDied","Data":"bbf0b18065ad97e9e62693b3bdff6c128fba34c6a7e310020f7982597b38be1e"} Jul 14 11:23:23.755212 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.755170 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx" event={"ID":"583c83c1-b347-4c5e-ac0a-a5de9836f4e8","Type":"ContainerStarted","Data":"c3954293bbd6a3d3d9dcdb3652c72c9b6414169fb55ed75c01b5a3d37a96a0eb"} Jul 14 11:23:23.757098 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.757073 2580 generic.go:356] "Generic (PLEG): container finished" podID="0187b017-3e8c-48c2-aa0d-625650500073" containerID="da62bb8917ce1f535f2ee8e05cc23c5b9535b59a6b255f8b66057ac7d382c000" exitCode=0 Jul 14 11:23:23.757205 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.757169 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz" event={"ID":"0187b017-3e8c-48c2-aa0d-625650500073","Type":"ContainerDied","Data":"da62bb8917ce1f535f2ee8e05cc23c5b9535b59a6b255f8b66057ac7d382c000"} Jul 14 11:23:23.757354 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.757261 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz" event={"ID":"0187b017-3e8c-48c2-aa0d-625650500073","Type":"ContainerStarted","Data":"4aa4db7534edbf9135500d93c00c37640455a09a921f61724f955ee0cbce7a53"} Jul 14 11:23:23.900446 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.900386 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp"] Jul 14 11:23:23.903519 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.903503 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp" Jul 14 11:23:23.921775 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:23.921752 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp"] Jul 14 11:23:24.003639 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:24.003603 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9tzl\" (UniqueName: \"kubernetes.io/projected/594121d4-f6dc-4aaa-93f6-5bb7d582922a-kube-api-access-k9tzl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp\" (UID: \"594121d4-f6dc-4aaa-93f6-5bb7d582922a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp" Jul 14 11:23:24.003805 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:24.003649 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/594121d4-f6dc-4aaa-93f6-5bb7d582922a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp\" (UID: \"594121d4-f6dc-4aaa-93f6-5bb7d582922a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp" Jul 14 11:23:24.003805 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:24.003721 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/594121d4-f6dc-4aaa-93f6-5bb7d582922a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp\" (UID: \"594121d4-f6dc-4aaa-93f6-5bb7d582922a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp" Jul 14 11:23:24.104629 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:24.104599 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/594121d4-f6dc-4aaa-93f6-5bb7d582922a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp\" (UID: \"594121d4-f6dc-4aaa-93f6-5bb7d582922a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp" Jul 14 11:23:24.104794 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:24.104665 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/594121d4-f6dc-4aaa-93f6-5bb7d582922a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp\" (UID: \"594121d4-f6dc-4aaa-93f6-5bb7d582922a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp" Jul 14 11:23:24.104794 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:24.104709 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9tzl\" (UniqueName: \"kubernetes.io/projected/594121d4-f6dc-4aaa-93f6-5bb7d582922a-kube-api-access-k9tzl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp\" (UID: \"594121d4-f6dc-4aaa-93f6-5bb7d582922a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp" Jul 14 11:23:24.104929 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:24.104911 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/594121d4-f6dc-4aaa-93f6-5bb7d582922a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp\" (UID: \"594121d4-f6dc-4aaa-93f6-5bb7d582922a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp" Jul 14 11:23:24.105002 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:24.104940 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/594121d4-f6dc-4aaa-93f6-5bb7d582922a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp\" (UID: \"594121d4-f6dc-4aaa-93f6-5bb7d582922a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp" Jul 14 11:23:24.114147 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:24.114114 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9tzl\" (UniqueName: \"kubernetes.io/projected/594121d4-f6dc-4aaa-93f6-5bb7d582922a-kube-api-access-k9tzl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp\" (UID: \"594121d4-f6dc-4aaa-93f6-5bb7d582922a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp" Jul 14 11:23:24.213737 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:24.213664 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp" Jul 14 11:23:24.351747 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:24.351720 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp"] Jul 14 11:23:24.352982 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:23:24.352952 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod594121d4_f6dc_4aaa_93f6_5bb7d582922a.slice/crio-c7f94a20674aa44acc9659f97c08237a3701c21fc9aa7a6a0699ce798cedb2c8 WatchSource:0}: Error finding container c7f94a20674aa44acc9659f97c08237a3701c21fc9aa7a6a0699ce798cedb2c8: Status 404 returned error can't find the container with id c7f94a20674aa44acc9659f97c08237a3701c21fc9aa7a6a0699ce798cedb2c8 Jul 14 11:23:24.762941 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:24.762900 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx" event={"ID":"583c83c1-b347-4c5e-ac0a-a5de9836f4e8","Type":"ContainerStarted","Data":"da20afd0fa0e169a73ebc09a594d501b1948138a5457654364ae412ef91fc16a"} Jul 14 11:23:24.764411 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:24.764383 2580 generic.go:356] "Generic (PLEG): container finished" podID="594121d4-f6dc-4aaa-93f6-5bb7d582922a" containerID="afe9d89be521e5df4f75a3efdc3a0a206b05742f8f22ac2f6a32a15f42679fd0" exitCode=0 Jul 14 11:23:24.764512 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:24.764456 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp" event={"ID":"594121d4-f6dc-4aaa-93f6-5bb7d582922a","Type":"ContainerDied","Data":"afe9d89be521e5df4f75a3efdc3a0a206b05742f8f22ac2f6a32a15f42679fd0"} Jul 14 11:23:24.764512 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:24.764499 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp" event={"ID":"594121d4-f6dc-4aaa-93f6-5bb7d582922a","Type":"ContainerStarted","Data":"c7f94a20674aa44acc9659f97c08237a3701c21fc9aa7a6a0699ce798cedb2c8"} Jul 14 11:23:24.766020 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:24.766001 2580 generic.go:356] "Generic (PLEG): container finished" podID="d7bbac94-c7cf-4e20-a5d7-d30deae3e132" containerID="893f02a9da7fc9301a86d33c1c65e418ff96f64f604a66307c87be1754ee2fa7" exitCode=0 Jul 14 11:23:24.766113 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:24.766027 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74" event={"ID":"d7bbac94-c7cf-4e20-a5d7-d30deae3e132","Type":"ContainerDied","Data":"893f02a9da7fc9301a86d33c1c65e418ff96f64f604a66307c87be1754ee2fa7"} Jul 14 11:23:24.766113 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:24.766057 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74" event={"ID":"d7bbac94-c7cf-4e20-a5d7-d30deae3e132","Type":"ContainerStarted","Data":"8cdcbce25c6e18208bdb671efcee103e640666995019525cd020865f07a01c0e"} Jul 14 11:23:25.773628 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:25.773601 2580 generic.go:356] "Generic (PLEG): container finished" podID="594121d4-f6dc-4aaa-93f6-5bb7d582922a" containerID="df8141d3ba323fae28751d59f9d3222ec21d5db449ced99e26ed01fc10189824" exitCode=0 Jul 14 11:23:25.773974 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:25.773670 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp" event={"ID":"594121d4-f6dc-4aaa-93f6-5bb7d582922a","Type":"ContainerDied","Data":"df8141d3ba323fae28751d59f9d3222ec21d5db449ced99e26ed01fc10189824"} Jul 14 11:23:25.775460 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:25.775440 2580 generic.go:356] "Generic (PLEG): container finished" podID="d7bbac94-c7cf-4e20-a5d7-d30deae3e132" containerID="5fc6e4645829521bbd3eab857bd8c4d7d512aa6a3c85b9a6e8ae2c6ffbcdf9c5" exitCode=0 Jul 14 11:23:25.775554 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:25.775518 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74" event={"ID":"d7bbac94-c7cf-4e20-a5d7-d30deae3e132","Type":"ContainerDied","Data":"5fc6e4645829521bbd3eab857bd8c4d7d512aa6a3c85b9a6e8ae2c6ffbcdf9c5"} Jul 14 11:23:25.777330 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:25.777306 2580 generic.go:356] "Generic (PLEG): container finished" podID="583c83c1-b347-4c5e-ac0a-a5de9836f4e8" containerID="da20afd0fa0e169a73ebc09a594d501b1948138a5457654364ae412ef91fc16a" exitCode=0 Jul 14 11:23:25.777404 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:25.777348 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx" event={"ID":"583c83c1-b347-4c5e-ac0a-a5de9836f4e8","Type":"ContainerDied","Data":"da20afd0fa0e169a73ebc09a594d501b1948138a5457654364ae412ef91fc16a"} Jul 14 11:23:25.779161 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:25.779139 2580 generic.go:356] "Generic (PLEG): container finished" podID="0187b017-3e8c-48c2-aa0d-625650500073" containerID="bacae52e52df6699c2b5077209e0f5fc1ce4577e2de45b7f6eaae97f4d5f3937" exitCode=0 Jul 14 11:23:25.779307 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:25.779166 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz" event={"ID":"0187b017-3e8c-48c2-aa0d-625650500073","Type":"ContainerDied","Data":"bacae52e52df6699c2b5077209e0f5fc1ce4577e2de45b7f6eaae97f4d5f3937"} Jul 14 11:23:26.786040 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:26.786003 2580 generic.go:356] "Generic (PLEG): container finished" podID="0187b017-3e8c-48c2-aa0d-625650500073" containerID="3da163636828dbfdeb65906e92eb24027e7f69959f7e5cc94718911f219b5c60" exitCode=0 Jul 14 11:23:26.786454 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:26.786081 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz" event={"ID":"0187b017-3e8c-48c2-aa0d-625650500073","Type":"ContainerDied","Data":"3da163636828dbfdeb65906e92eb24027e7f69959f7e5cc94718911f219b5c60"} Jul 14 11:23:26.788046 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:26.788020 2580 generic.go:356] "Generic (PLEG): container finished" podID="594121d4-f6dc-4aaa-93f6-5bb7d582922a" containerID="6051978137aa6361fd2298fe3809c9548f0d09feb44fba8bb153275a1043ac83" exitCode=0 Jul 14 11:23:26.788141 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:26.788103 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp" event={"ID":"594121d4-f6dc-4aaa-93f6-5bb7d582922a","Type":"ContainerDied","Data":"6051978137aa6361fd2298fe3809c9548f0d09feb44fba8bb153275a1043ac83"} Jul 14 11:23:26.790128 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:26.790111 2580 generic.go:356] "Generic (PLEG): container finished" podID="d7bbac94-c7cf-4e20-a5d7-d30deae3e132" containerID="cac778db81c8b1a1156efdbde931c4ed637b35da9e39fc8b9a352e4ba3264450" exitCode=0 Jul 14 11:23:26.790186 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:26.790136 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74" event={"ID":"d7bbac94-c7cf-4e20-a5d7-d30deae3e132","Type":"ContainerDied","Data":"cac778db81c8b1a1156efdbde931c4ed637b35da9e39fc8b9a352e4ba3264450"} Jul 14 11:23:26.792045 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:26.792027 2580 generic.go:356] "Generic (PLEG): container finished" podID="583c83c1-b347-4c5e-ac0a-a5de9836f4e8" containerID="159ddff0a05095ce41322ee119d7d54d0f8026f6a4c9d264cd5870c7c4bbf626" exitCode=0 Jul 14 11:23:26.792141 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:26.792055 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx" event={"ID":"583c83c1-b347-4c5e-ac0a-a5de9836f4e8","Type":"ContainerDied","Data":"159ddff0a05095ce41322ee119d7d54d0f8026f6a4c9d264cd5870c7c4bbf626"} Jul 14 11:23:27.959493 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:27.959465 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz" Jul 14 11:23:27.977373 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:27.977314 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx" Jul 14 11:23:28.006874 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.006851 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp" Jul 14 11:23:28.016539 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.016519 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74" Jul 14 11:23:28.039189 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.039165 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0187b017-3e8c-48c2-aa0d-625650500073-bundle\") pod \"0187b017-3e8c-48c2-aa0d-625650500073\" (UID: \"0187b017-3e8c-48c2-aa0d-625650500073\") " Jul 14 11:23:28.039318 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.039215 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpw25\" (UniqueName: \"kubernetes.io/projected/0187b017-3e8c-48c2-aa0d-625650500073-kube-api-access-mpw25\") pod \"0187b017-3e8c-48c2-aa0d-625650500073\" (UID: \"0187b017-3e8c-48c2-aa0d-625650500073\") " Jul 14 11:23:28.039318 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.039270 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/583c83c1-b347-4c5e-ac0a-a5de9836f4e8-util\") pod \"583c83c1-b347-4c5e-ac0a-a5de9836f4e8\" (UID: \"583c83c1-b347-4c5e-ac0a-a5de9836f4e8\") " Jul 14 11:23:28.039318 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.039292 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0187b017-3e8c-48c2-aa0d-625650500073-util\") pod \"0187b017-3e8c-48c2-aa0d-625650500073\" (UID: \"0187b017-3e8c-48c2-aa0d-625650500073\") " Jul 14 11:23:28.039318 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.039311 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/583c83c1-b347-4c5e-ac0a-a5de9836f4e8-bundle\") pod \"583c83c1-b347-4c5e-ac0a-a5de9836f4e8\" (UID: \"583c83c1-b347-4c5e-ac0a-a5de9836f4e8\") " Jul 14 11:23:28.039531 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.039344 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjb8s\" (UniqueName: \"kubernetes.io/projected/583c83c1-b347-4c5e-ac0a-a5de9836f4e8-kube-api-access-xjb8s\") pod \"583c83c1-b347-4c5e-ac0a-a5de9836f4e8\" (UID: \"583c83c1-b347-4c5e-ac0a-a5de9836f4e8\") " Jul 14 11:23:28.040413 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.040370 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0187b017-3e8c-48c2-aa0d-625650500073-bundle" (OuterVolumeSpecName: "bundle") pod "0187b017-3e8c-48c2-aa0d-625650500073" (UID: "0187b017-3e8c-48c2-aa0d-625650500073"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:23:28.040665 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.040534 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/583c83c1-b347-4c5e-ac0a-a5de9836f4e8-bundle" (OuterVolumeSpecName: "bundle") pod "583c83c1-b347-4c5e-ac0a-a5de9836f4e8" (UID: "583c83c1-b347-4c5e-ac0a-a5de9836f4e8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:23:28.042178 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.042146 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0187b017-3e8c-48c2-aa0d-625650500073-kube-api-access-mpw25" (OuterVolumeSpecName: "kube-api-access-mpw25") pod "0187b017-3e8c-48c2-aa0d-625650500073" (UID: "0187b017-3e8c-48c2-aa0d-625650500073"). InnerVolumeSpecName "kube-api-access-mpw25". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:23:28.044430 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.044397 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/583c83c1-b347-4c5e-ac0a-a5de9836f4e8-kube-api-access-xjb8s" (OuterVolumeSpecName: "kube-api-access-xjb8s") pod "583c83c1-b347-4c5e-ac0a-a5de9836f4e8" (UID: "583c83c1-b347-4c5e-ac0a-a5de9836f4e8"). InnerVolumeSpecName "kube-api-access-xjb8s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:23:28.047024 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.046991 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0187b017-3e8c-48c2-aa0d-625650500073-util" (OuterVolumeSpecName: "util") pod "0187b017-3e8c-48c2-aa0d-625650500073" (UID: "0187b017-3e8c-48c2-aa0d-625650500073"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:23:28.050189 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.050135 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/583c83c1-b347-4c5e-ac0a-a5de9836f4e8-util" (OuterVolumeSpecName: "util") pod "583c83c1-b347-4c5e-ac0a-a5de9836f4e8" (UID: "583c83c1-b347-4c5e-ac0a-a5de9836f4e8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:23:28.140363 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.140329 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/594121d4-f6dc-4aaa-93f6-5bb7d582922a-util\") pod \"594121d4-f6dc-4aaa-93f6-5bb7d582922a\" (UID: \"594121d4-f6dc-4aaa-93f6-5bb7d582922a\") " Jul 14 11:23:28.140501 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.140398 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcklx\" (UniqueName: \"kubernetes.io/projected/d7bbac94-c7cf-4e20-a5d7-d30deae3e132-kube-api-access-tcklx\") pod \"d7bbac94-c7cf-4e20-a5d7-d30deae3e132\" (UID: \"d7bbac94-c7cf-4e20-a5d7-d30deae3e132\") " Jul 14 11:23:28.140501 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.140421 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9tzl\" (UniqueName: \"kubernetes.io/projected/594121d4-f6dc-4aaa-93f6-5bb7d582922a-kube-api-access-k9tzl\") pod \"594121d4-f6dc-4aaa-93f6-5bb7d582922a\" (UID: \"594121d4-f6dc-4aaa-93f6-5bb7d582922a\") " Jul 14 11:23:28.140501 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.140469 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/594121d4-f6dc-4aaa-93f6-5bb7d582922a-bundle\") pod \"594121d4-f6dc-4aaa-93f6-5bb7d582922a\" (UID: \"594121d4-f6dc-4aaa-93f6-5bb7d582922a\") " Jul 14 11:23:28.140652 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.140630 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7bbac94-c7cf-4e20-a5d7-d30deae3e132-util\") pod \"d7bbac94-c7cf-4e20-a5d7-d30deae3e132\" (UID: \"d7bbac94-c7cf-4e20-a5d7-d30deae3e132\") " Jul 14 11:23:28.140726 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.140713 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7bbac94-c7cf-4e20-a5d7-d30deae3e132-bundle\") pod \"d7bbac94-c7cf-4e20-a5d7-d30deae3e132\" (UID: \"d7bbac94-c7cf-4e20-a5d7-d30deae3e132\") " Jul 14 11:23:28.140943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.140919 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0187b017-3e8c-48c2-aa0d-625650500073-bundle\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:23:28.140943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.140945 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpw25\" (UniqueName: \"kubernetes.io/projected/0187b017-3e8c-48c2-aa0d-625650500073-kube-api-access-mpw25\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:23:28.141110 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.140974 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/583c83c1-b347-4c5e-ac0a-a5de9836f4e8-util\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:23:28.141110 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.140986 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0187b017-3e8c-48c2-aa0d-625650500073-util\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:23:28.141110 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.141000 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/583c83c1-b347-4c5e-ac0a-a5de9836f4e8-bundle\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:23:28.141110 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.141012 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjb8s\" (UniqueName: \"kubernetes.io/projected/583c83c1-b347-4c5e-ac0a-a5de9836f4e8-kube-api-access-xjb8s\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:23:28.141329 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.141206 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/594121d4-f6dc-4aaa-93f6-5bb7d582922a-bundle" (OuterVolumeSpecName: "bundle") pod "594121d4-f6dc-4aaa-93f6-5bb7d582922a" (UID: "594121d4-f6dc-4aaa-93f6-5bb7d582922a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:23:28.141456 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.141433 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7bbac94-c7cf-4e20-a5d7-d30deae3e132-bundle" (OuterVolumeSpecName: "bundle") pod "d7bbac94-c7cf-4e20-a5d7-d30deae3e132" (UID: "d7bbac94-c7cf-4e20-a5d7-d30deae3e132"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:23:28.142688 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.142660 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7bbac94-c7cf-4e20-a5d7-d30deae3e132-kube-api-access-tcklx" (OuterVolumeSpecName: "kube-api-access-tcklx") pod "d7bbac94-c7cf-4e20-a5d7-d30deae3e132" (UID: "d7bbac94-c7cf-4e20-a5d7-d30deae3e132"). InnerVolumeSpecName "kube-api-access-tcklx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:23:28.143009 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.142991 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/594121d4-f6dc-4aaa-93f6-5bb7d582922a-kube-api-access-k9tzl" (OuterVolumeSpecName: "kube-api-access-k9tzl") pod "594121d4-f6dc-4aaa-93f6-5bb7d582922a" (UID: "594121d4-f6dc-4aaa-93f6-5bb7d582922a"). InnerVolumeSpecName "kube-api-access-k9tzl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:23:28.146582 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.146564 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7bbac94-c7cf-4e20-a5d7-d30deae3e132-util" (OuterVolumeSpecName: "util") pod "d7bbac94-c7cf-4e20-a5d7-d30deae3e132" (UID: "d7bbac94-c7cf-4e20-a5d7-d30deae3e132"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:23:28.146924 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.146905 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/594121d4-f6dc-4aaa-93f6-5bb7d582922a-util" (OuterVolumeSpecName: "util") pod "594121d4-f6dc-4aaa-93f6-5bb7d582922a" (UID: "594121d4-f6dc-4aaa-93f6-5bb7d582922a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:23:28.242123 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.242094 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcklx\" (UniqueName: \"kubernetes.io/projected/d7bbac94-c7cf-4e20-a5d7-d30deae3e132-kube-api-access-tcklx\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:23:28.242283 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.242126 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9tzl\" (UniqueName: \"kubernetes.io/projected/594121d4-f6dc-4aaa-93f6-5bb7d582922a-kube-api-access-k9tzl\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:23:28.242283 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.242140 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/594121d4-f6dc-4aaa-93f6-5bb7d582922a-bundle\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:23:28.242283 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.242151 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7bbac94-c7cf-4e20-a5d7-d30deae3e132-util\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:23:28.242283 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.242161 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7bbac94-c7cf-4e20-a5d7-d30deae3e132-bundle\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:23:28.242283 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.242173 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/594121d4-f6dc-4aaa-93f6-5bb7d582922a-util\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:23:28.803356 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.803325 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp" Jul 14 11:23:28.803558 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.803326 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp" event={"ID":"594121d4-f6dc-4aaa-93f6-5bb7d582922a","Type":"ContainerDied","Data":"c7f94a20674aa44acc9659f97c08237a3701c21fc9aa7a6a0699ce798cedb2c8"} Jul 14 11:23:28.803558 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.803457 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7f94a20674aa44acc9659f97c08237a3701c21fc9aa7a6a0699ce798cedb2c8" Jul 14 11:23:28.805349 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.805268 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74" event={"ID":"d7bbac94-c7cf-4e20-a5d7-d30deae3e132","Type":"ContainerDied","Data":"8cdcbce25c6e18208bdb671efcee103e640666995019525cd020865f07a01c0e"} Jul 14 11:23:28.805349 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.805323 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8cdcbce25c6e18208bdb671efcee103e640666995019525cd020865f07a01c0e" Jul 14 11:23:28.805349 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.805281 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74" Jul 14 11:23:28.807860 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.807832 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx" event={"ID":"583c83c1-b347-4c5e-ac0a-a5de9836f4e8","Type":"ContainerDied","Data":"c3954293bbd6a3d3d9dcdb3652c72c9b6414169fb55ed75c01b5a3d37a96a0eb"} Jul 14 11:23:28.807962 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.807871 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx" Jul 14 11:23:28.807962 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.807919 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c3954293bbd6a3d3d9dcdb3652c72c9b6414169fb55ed75c01b5a3d37a96a0eb" Jul 14 11:23:28.811174 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.810315 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz" event={"ID":"0187b017-3e8c-48c2-aa0d-625650500073","Type":"ContainerDied","Data":"4aa4db7534edbf9135500d93c00c37640455a09a921f61724f955ee0cbce7a53"} Jul 14 11:23:28.811174 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.810363 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4aa4db7534edbf9135500d93c00c37640455a09a921f61724f955ee0cbce7a53" Jul 14 11:23:28.811174 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:28.810496 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz" Jul 14 11:23:44.862502 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:44.862462 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-64c678d565-bwvvn" podUID="392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d" containerName="console" containerID="cri-o://93c92a3c8c6e33a63434c4e50b6d6e03a2e6fbc251fc565f8d8104fc50a162a2" gracePeriod=15 Jul 14 11:23:45.103550 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.103523 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:23:45.179208 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.179126 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-oauth-serving-cert\") pod \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " Jul 14 11:23:45.179208 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.179174 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wcj9\" (UniqueName: \"kubernetes.io/projected/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-kube-api-access-7wcj9\") pod \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " Jul 14 11:23:45.179416 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.179223 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-trusted-ca-bundle\") pod \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " Jul 14 11:23:45.179416 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.179299 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-console-oauth-config\") pod \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " Jul 14 11:23:45.179416 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.179351 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-console-serving-cert\") pod \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " Jul 14 11:23:45.179416 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.179395 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-console-config\") pod \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " Jul 14 11:23:45.179611 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.179426 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-service-ca\") pod \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\" (UID: \"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d\") " Jul 14 11:23:45.179731 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.179703 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d" (UID: "392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:23:45.179731 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.179585 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d" (UID: "392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:23:45.179853 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.179808 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-console-config" (OuterVolumeSpecName: "console-config") pod "392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d" (UID: "392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:23:45.179904 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.179876 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-service-ca" (OuterVolumeSpecName: "service-ca") pod "392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d" (UID: "392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:23:45.181668 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.181643 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-kube-api-access-7wcj9" (OuterVolumeSpecName: "kube-api-access-7wcj9") pod "392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d" (UID: "392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d"). InnerVolumeSpecName "kube-api-access-7wcj9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:23:45.182024 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.181995 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d" (UID: "392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:23:45.182024 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.182007 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d" (UID: "392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:23:45.280008 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.279974 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-console-config\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:23:45.280008 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.280004 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-service-ca\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:23:45.280210 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.280018 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-oauth-serving-cert\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:23:45.280210 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.280031 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wcj9\" (UniqueName: \"kubernetes.io/projected/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-kube-api-access-7wcj9\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:23:45.280210 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.280042 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-trusted-ca-bundle\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:23:45.280210 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.280054 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-console-oauth-config\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:23:45.280210 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.280066 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d-console-serving-cert\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:23:45.886358 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.886321 2580 generic.go:356] "Generic (PLEG): container finished" podID="392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d" containerID="93c92a3c8c6e33a63434c4e50b6d6e03a2e6fbc251fc565f8d8104fc50a162a2" exitCode=0 Jul 14 11:23:45.886750 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.886363 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c678d565-bwvvn" Jul 14 11:23:45.886750 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.886404 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c678d565-bwvvn" event={"ID":"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d","Type":"ContainerDied","Data":"93c92a3c8c6e33a63434c4e50b6d6e03a2e6fbc251fc565f8d8104fc50a162a2"} Jul 14 11:23:45.886750 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.886445 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c678d565-bwvvn" event={"ID":"392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d","Type":"ContainerDied","Data":"5e543284a8c94438c4a115c8a59aea4429ef54403ebabe4509a487272ff8651a"} Jul 14 11:23:45.886750 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.886470 2580 scope.go:117] "RemoveContainer" containerID="93c92a3c8c6e33a63434c4e50b6d6e03a2e6fbc251fc565f8d8104fc50a162a2" Jul 14 11:23:45.895990 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.895972 2580 scope.go:117] "RemoveContainer" containerID="93c92a3c8c6e33a63434c4e50b6d6e03a2e6fbc251fc565f8d8104fc50a162a2" Jul 14 11:23:45.896342 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:23:45.896313 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93c92a3c8c6e33a63434c4e50b6d6e03a2e6fbc251fc565f8d8104fc50a162a2\": container with ID starting with 93c92a3c8c6e33a63434c4e50b6d6e03a2e6fbc251fc565f8d8104fc50a162a2 not found: ID does not exist" containerID="93c92a3c8c6e33a63434c4e50b6d6e03a2e6fbc251fc565f8d8104fc50a162a2" Jul 14 11:23:45.896427 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.896351 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93c92a3c8c6e33a63434c4e50b6d6e03a2e6fbc251fc565f8d8104fc50a162a2"} err="failed to get container status \"93c92a3c8c6e33a63434c4e50b6d6e03a2e6fbc251fc565f8d8104fc50a162a2\": rpc error: code = NotFound desc = could not find container \"93c92a3c8c6e33a63434c4e50b6d6e03a2e6fbc251fc565f8d8104fc50a162a2\": container with ID starting with 93c92a3c8c6e33a63434c4e50b6d6e03a2e6fbc251fc565f8d8104fc50a162a2 not found: ID does not exist" Jul 14 11:23:45.926177 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.926155 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64c678d565-bwvvn"] Jul 14 11:23:45.929868 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:45.929849 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64c678d565-bwvvn"] Jul 14 11:23:46.233536 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:23:46.233459 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d" path="/var/lib/kubelet/pods/392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d/volumes" Jul 14 11:24:38.765646 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.765608 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2qmgv"] Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.765891 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="583c83c1-b347-4c5e-ac0a-a5de9836f4e8" containerName="util" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.765902 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="583c83c1-b347-4c5e-ac0a-a5de9836f4e8" containerName="util" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.765910 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7bbac94-c7cf-4e20-a5d7-d30deae3e132" containerName="util" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.765917 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7bbac94-c7cf-4e20-a5d7-d30deae3e132" containerName="util" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.765924 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7bbac94-c7cf-4e20-a5d7-d30deae3e132" containerName="pull" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.765929 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7bbac94-c7cf-4e20-a5d7-d30deae3e132" containerName="pull" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.765935 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7bbac94-c7cf-4e20-a5d7-d30deae3e132" containerName="extract" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.765939 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7bbac94-c7cf-4e20-a5d7-d30deae3e132" containerName="extract" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.765950 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0187b017-3e8c-48c2-aa0d-625650500073" containerName="pull" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.765955 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0187b017-3e8c-48c2-aa0d-625650500073" containerName="pull" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.765963 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0187b017-3e8c-48c2-aa0d-625650500073" containerName="util" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.765968 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0187b017-3e8c-48c2-aa0d-625650500073" containerName="util" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.765974 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="594121d4-f6dc-4aaa-93f6-5bb7d582922a" containerName="pull" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.765979 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="594121d4-f6dc-4aaa-93f6-5bb7d582922a" containerName="pull" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.765987 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d" containerName="console" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.765994 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d" containerName="console" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.765999 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="594121d4-f6dc-4aaa-93f6-5bb7d582922a" containerName="util" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.766006 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="594121d4-f6dc-4aaa-93f6-5bb7d582922a" containerName="util" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.766012 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="583c83c1-b347-4c5e-ac0a-a5de9836f4e8" containerName="extract" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.766017 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="583c83c1-b347-4c5e-ac0a-a5de9836f4e8" containerName="extract" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.766022 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0187b017-3e8c-48c2-aa0d-625650500073" containerName="extract" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.766026 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0187b017-3e8c-48c2-aa0d-625650500073" containerName="extract" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.766035 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="583c83c1-b347-4c5e-ac0a-a5de9836f4e8" containerName="pull" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.766040 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="583c83c1-b347-4c5e-ac0a-a5de9836f4e8" containerName="pull" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.766046 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="594121d4-f6dc-4aaa-93f6-5bb7d582922a" containerName="extract" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.766050 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="594121d4-f6dc-4aaa-93f6-5bb7d582922a" containerName="extract" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.766091 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="583c83c1-b347-4c5e-ac0a-a5de9836f4e8" containerName="extract" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.766099 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0187b017-3e8c-48c2-aa0d-625650500073" containerName="extract" Jul 14 11:24:38.766087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.766104 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="594121d4-f6dc-4aaa-93f6-5bb7d582922a" containerName="extract" Jul 14 11:24:38.766962 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.766110 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7bbac94-c7cf-4e20-a5d7-d30deae3e132" containerName="extract" Jul 14 11:24:38.766962 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.766117 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="392a8e0c-d7a2-4cdf-a1d8-a458e6b8f11d" containerName="console" Jul 14 11:24:38.770102 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.770086 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2qmgv" Jul 14 11:24:38.777792 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.777772 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2ztm4\"" Jul 14 11:24:38.777966 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.777910 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 11:24:38.778888 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.778873 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 11:24:38.780338 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.780321 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 14 11:24:38.785051 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.785033 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2qmgv"] Jul 14 11:24:38.833498 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.833463 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2qmgv"] Jul 14 11:24:38.881799 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.881768 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5ab293b-05df-46d6-9449-c430a6d757ba-config-file\") pod \"limitador-limitador-64c94fd64f-2qmgv\" (UID: \"e5ab293b-05df-46d6-9449-c430a6d757ba\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2qmgv" Jul 14 11:24:38.881968 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.881844 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rghq\" (UniqueName: \"kubernetes.io/projected/e5ab293b-05df-46d6-9449-c430a6d757ba-kube-api-access-7rghq\") pod \"limitador-limitador-64c94fd64f-2qmgv\" (UID: \"e5ab293b-05df-46d6-9449-c430a6d757ba\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2qmgv" Jul 14 11:24:38.983168 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.983133 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rghq\" (UniqueName: \"kubernetes.io/projected/e5ab293b-05df-46d6-9449-c430a6d757ba-kube-api-access-7rghq\") pod \"limitador-limitador-64c94fd64f-2qmgv\" (UID: \"e5ab293b-05df-46d6-9449-c430a6d757ba\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2qmgv" Jul 14 11:24:38.983168 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.983171 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5ab293b-05df-46d6-9449-c430a6d757ba-config-file\") pod \"limitador-limitador-64c94fd64f-2qmgv\" (UID: \"e5ab293b-05df-46d6-9449-c430a6d757ba\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2qmgv" Jul 14 11:24:38.983742 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.983723 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5ab293b-05df-46d6-9449-c430a6d757ba-config-file\") pod \"limitador-limitador-64c94fd64f-2qmgv\" (UID: \"e5ab293b-05df-46d6-9449-c430a6d757ba\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2qmgv" Jul 14 11:24:38.993519 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:38.993498 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rghq\" (UniqueName: \"kubernetes.io/projected/e5ab293b-05df-46d6-9449-c430a6d757ba-kube-api-access-7rghq\") pod \"limitador-limitador-64c94fd64f-2qmgv\" (UID: \"e5ab293b-05df-46d6-9449-c430a6d757ba\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2qmgv" Jul 14 11:24:39.080258 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:39.080161 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2qmgv" Jul 14 11:24:39.219125 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:39.219092 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2qmgv"] Jul 14 11:24:39.222179 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:24:39.222150 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5ab293b_05df_46d6_9449_c430a6d757ba.slice/crio-f0b625969b3852e3bae0770d9602a5af122d0f4cfd85c47a2a8afe7590495911 WatchSource:0}: Error finding container f0b625969b3852e3bae0770d9602a5af122d0f4cfd85c47a2a8afe7590495911: Status 404 returned error can't find the container with id f0b625969b3852e3bae0770d9602a5af122d0f4cfd85c47a2a8afe7590495911 Jul 14 11:24:40.126447 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:40.126366 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2qmgv" event={"ID":"e5ab293b-05df-46d6-9449-c430a6d757ba","Type":"ContainerStarted","Data":"f0b625969b3852e3bae0770d9602a5af122d0f4cfd85c47a2a8afe7590495911"} Jul 14 11:24:42.138025 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:42.137985 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2qmgv" event={"ID":"e5ab293b-05df-46d6-9449-c430a6d757ba","Type":"ContainerStarted","Data":"b57c39c7a496352f69e0b78d1fac76f3f884b77b59872167b82cad1156724c17"} Jul 14 11:24:42.138468 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:42.138099 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-2qmgv" Jul 14 11:24:42.164616 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:42.164338 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-2qmgv" podStartSLOduration=1.434180996 podStartE2EDuration="4.164317061s" totalImagesPullingTime="2.730136065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:24:42.163809641 +0000 UTC m=+798.477943162" watchObservedRunningTime="2026-07-14 11:24:42.164317061 +0000 UTC m=+798.478450584" Jul 14 11:24:53.143389 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:53.143310 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-2qmgv" Jul 14 11:24:55.334206 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:55.334167 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2qmgv"] Jul 14 11:24:55.334623 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:55.334398 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-2qmgv" podUID="e5ab293b-05df-46d6-9449-c430a6d757ba" containerName="limitador" containerID="cri-o://b57c39c7a496352f69e0b78d1fac76f3f884b77b59872167b82cad1156724c17" gracePeriod=30 Jul 14 11:24:55.665165 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:24:55.665130 2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5ab293b_05df_46d6_9449_c430a6d757ba.slice/crio-b57c39c7a496352f69e0b78d1fac76f3f884b77b59872167b82cad1156724c17.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5ab293b_05df_46d6_9449_c430a6d757ba.slice/crio-conmon-b57c39c7a496352f69e0b78d1fac76f3f884b77b59872167b82cad1156724c17.scope\": RecentStats: unable to find data in memory cache]" Jul 14 11:24:55.880878 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:55.880852 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2qmgv" Jul 14 11:24:56.029340 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:56.029250 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rghq\" (UniqueName: \"kubernetes.io/projected/e5ab293b-05df-46d6-9449-c430a6d757ba-kube-api-access-7rghq\") pod \"e5ab293b-05df-46d6-9449-c430a6d757ba\" (UID: \"e5ab293b-05df-46d6-9449-c430a6d757ba\") " Jul 14 11:24:56.029340 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:56.029312 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5ab293b-05df-46d6-9449-c430a6d757ba-config-file\") pod \"e5ab293b-05df-46d6-9449-c430a6d757ba\" (UID: \"e5ab293b-05df-46d6-9449-c430a6d757ba\") " Jul 14 11:24:56.029707 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:56.029684 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5ab293b-05df-46d6-9449-c430a6d757ba-config-file" (OuterVolumeSpecName: "config-file") pod "e5ab293b-05df-46d6-9449-c430a6d757ba" (UID: "e5ab293b-05df-46d6-9449-c430a6d757ba"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:24:56.031518 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:56.031491 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5ab293b-05df-46d6-9449-c430a6d757ba-kube-api-access-7rghq" (OuterVolumeSpecName: "kube-api-access-7rghq") pod "e5ab293b-05df-46d6-9449-c430a6d757ba" (UID: "e5ab293b-05df-46d6-9449-c430a6d757ba"). InnerVolumeSpecName "kube-api-access-7rghq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:24:56.130717 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:56.130678 2580 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5ab293b-05df-46d6-9449-c430a6d757ba-config-file\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:24:56.130717 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:56.130708 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rghq\" (UniqueName: \"kubernetes.io/projected/e5ab293b-05df-46d6-9449-c430a6d757ba-kube-api-access-7rghq\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:24:56.197964 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:56.197928 2580 generic.go:356] "Generic (PLEG): container finished" podID="e5ab293b-05df-46d6-9449-c430a6d757ba" containerID="b57c39c7a496352f69e0b78d1fac76f3f884b77b59872167b82cad1156724c17" exitCode=0 Jul 14 11:24:56.198144 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:56.197976 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2qmgv" Jul 14 11:24:56.198144 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:56.198013 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2qmgv" event={"ID":"e5ab293b-05df-46d6-9449-c430a6d757ba","Type":"ContainerDied","Data":"b57c39c7a496352f69e0b78d1fac76f3f884b77b59872167b82cad1156724c17"} Jul 14 11:24:56.198144 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:56.198053 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2qmgv" event={"ID":"e5ab293b-05df-46d6-9449-c430a6d757ba","Type":"ContainerDied","Data":"f0b625969b3852e3bae0770d9602a5af122d0f4cfd85c47a2a8afe7590495911"} Jul 14 11:24:56.198144 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:56.198074 2580 scope.go:117] "RemoveContainer" containerID="b57c39c7a496352f69e0b78d1fac76f3f884b77b59872167b82cad1156724c17" Jul 14 11:24:56.206869 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:56.206847 2580 scope.go:117] "RemoveContainer" containerID="b57c39c7a496352f69e0b78d1fac76f3f884b77b59872167b82cad1156724c17" Jul 14 11:24:56.207099 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:24:56.207075 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b57c39c7a496352f69e0b78d1fac76f3f884b77b59872167b82cad1156724c17\": container with ID starting with b57c39c7a496352f69e0b78d1fac76f3f884b77b59872167b82cad1156724c17 not found: ID does not exist" containerID="b57c39c7a496352f69e0b78d1fac76f3f884b77b59872167b82cad1156724c17" Jul 14 11:24:56.207144 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:56.207105 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b57c39c7a496352f69e0b78d1fac76f3f884b77b59872167b82cad1156724c17"} err="failed to get container status \"b57c39c7a496352f69e0b78d1fac76f3f884b77b59872167b82cad1156724c17\": rpc error: code = NotFound desc = could not find container \"b57c39c7a496352f69e0b78d1fac76f3f884b77b59872167b82cad1156724c17\": container with ID starting with b57c39c7a496352f69e0b78d1fac76f3f884b77b59872167b82cad1156724c17 not found: ID does not exist" Jul 14 11:24:56.220589 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:56.220567 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2qmgv"] Jul 14 11:24:56.222447 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:56.222426 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2qmgv"] Jul 14 11:24:56.233005 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:24:56.232982 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5ab293b-05df-46d6-9449-c430a6d757ba" path="/var/lib/kubelet/pods/e5ab293b-05df-46d6-9449-c430a6d757ba/volumes" Jul 14 11:25:00.204987 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:00.204950 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-cl29x"] Jul 14 11:25:00.205783 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:00.205765 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5ab293b-05df-46d6-9449-c430a6d757ba" containerName="limitador" Jul 14 11:25:00.205852 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:00.205786 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5ab293b-05df-46d6-9449-c430a6d757ba" containerName="limitador" Jul 14 11:25:00.205852 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:00.205846 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5ab293b-05df-46d6-9449-c430a6d757ba" containerName="limitador" Jul 14 11:25:00.210447 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:00.210425 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cl29x" Jul 14 11:25:00.213327 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:00.213303 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 14 11:25:00.213327 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:00.213319 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 14 11:25:00.213530 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:00.213389 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-2h75w\"" Jul 14 11:25:00.214474 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:00.214453 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 14 11:25:00.218876 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:00.218854 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-cl29x"] Jul 14 11:25:00.363647 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:00.363606 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a2157a69-9585-4a87-b0e5-c17232e46529-data\") pod \"postgres-69fb4594cf-cl29x\" (UID: \"a2157a69-9585-4a87-b0e5-c17232e46529\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cl29x" Jul 14 11:25:00.363813 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:00.363653 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvh8w\" (UniqueName: \"kubernetes.io/projected/a2157a69-9585-4a87-b0e5-c17232e46529-kube-api-access-pvh8w\") pod \"postgres-69fb4594cf-cl29x\" (UID: \"a2157a69-9585-4a87-b0e5-c17232e46529\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cl29x" Jul 14 11:25:00.464556 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:00.464482 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvh8w\" (UniqueName: \"kubernetes.io/projected/a2157a69-9585-4a87-b0e5-c17232e46529-kube-api-access-pvh8w\") pod \"postgres-69fb4594cf-cl29x\" (UID: \"a2157a69-9585-4a87-b0e5-c17232e46529\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cl29x" Jul 14 11:25:00.464724 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:00.464565 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a2157a69-9585-4a87-b0e5-c17232e46529-data\") pod \"postgres-69fb4594cf-cl29x\" (UID: \"a2157a69-9585-4a87-b0e5-c17232e46529\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cl29x" Jul 14 11:25:00.464938 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:00.464919 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a2157a69-9585-4a87-b0e5-c17232e46529-data\") pod \"postgres-69fb4594cf-cl29x\" (UID: \"a2157a69-9585-4a87-b0e5-c17232e46529\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cl29x" Jul 14 11:25:00.474526 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:00.474497 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvh8w\" (UniqueName: \"kubernetes.io/projected/a2157a69-9585-4a87-b0e5-c17232e46529-kube-api-access-pvh8w\") pod \"postgres-69fb4594cf-cl29x\" (UID: \"a2157a69-9585-4a87-b0e5-c17232e46529\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cl29x" Jul 14 11:25:00.522765 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:00.522734 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cl29x" Jul 14 11:25:00.656427 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:00.656399 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-cl29x"] Jul 14 11:25:00.659177 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:25:00.659151 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2157a69_9585_4a87_b0e5_c17232e46529.slice/crio-657a0ace0f81410bd83faa167d7a91df7c97bfdd1a7ef4a88f75383f6b6e83b5 WatchSource:0}: Error finding container 657a0ace0f81410bd83faa167d7a91df7c97bfdd1a7ef4a88f75383f6b6e83b5: Status 404 returned error can't find the container with id 657a0ace0f81410bd83faa167d7a91df7c97bfdd1a7ef4a88f75383f6b6e83b5 Jul 14 11:25:01.223254 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:01.223199 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cl29x" event={"ID":"a2157a69-9585-4a87-b0e5-c17232e46529","Type":"ContainerStarted","Data":"657a0ace0f81410bd83faa167d7a91df7c97bfdd1a7ef4a88f75383f6b6e83b5"} Jul 14 11:25:06.249381 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:06.249342 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cl29x" event={"ID":"a2157a69-9585-4a87-b0e5-c17232e46529","Type":"ContainerStarted","Data":"7135650b99204f01bb1f69b9960cd51a2b48087ed7ffcb37fd5abc4ec94a4ae5"} Jul 14 11:25:06.249762 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:06.249409 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cl29x" Jul 14 11:25:06.272141 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:06.272037 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cl29x" podStartSLOduration=1.1113765899999999 podStartE2EDuration="6.272017102s" totalImagesPullingTime="5.160640512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:25:06.271431531 +0000 UTC m=+822.585565049" watchObservedRunningTime="2026-07-14 11:25:06.272017102 +0000 UTC m=+822.586150622" Jul 14 11:25:12.284540 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:12.284507 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cl29x" Jul 14 11:25:19.358435 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:19.358395 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9884b8b4c-6fwp6"] Jul 14 11:25:19.432955 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:19.432917 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9884b8b4c-6fwp6"] Jul 14 11:25:19.433122 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:19.433013 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9884b8b4c-6fwp6" Jul 14 11:25:19.435887 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:19.435861 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 14 11:25:19.436174 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:19.436156 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 14 11:25:19.437218 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:19.437199 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xx425\"" Jul 14 11:25:19.517908 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:19.517866 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpz4r\" (UniqueName: \"kubernetes.io/projected/bfe25647-c84b-4c83-85a4-3e8815ea6a0b-kube-api-access-tpz4r\") pod \"maas-controller-9884b8b4c-6fwp6\" (UID: \"bfe25647-c84b-4c83-85a4-3e8815ea6a0b\") " pod="opendatahub/maas-controller-9884b8b4c-6fwp6" Jul 14 11:25:19.518082 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:19.517919 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfe25647-c84b-4c83-85a4-3e8815ea6a0b-webhook-cert\") pod \"maas-controller-9884b8b4c-6fwp6\" (UID: \"bfe25647-c84b-4c83-85a4-3e8815ea6a0b\") " pod="opendatahub/maas-controller-9884b8b4c-6fwp6" Jul 14 11:25:19.539911 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:19.539876 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-686f4d7c89-b4p4r"] Jul 14 11:25:19.573623 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:19.573581 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-686f4d7c89-b4p4r"] Jul 14 11:25:19.573792 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:19.573716 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-686f4d7c89-b4p4r" Jul 14 11:25:19.618989 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:19.618919 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/960917b1-4adc-414b-b7f4-bea1c2a3582f-webhook-cert\") pod \"maas-controller-686f4d7c89-b4p4r\" (UID: \"960917b1-4adc-414b-b7f4-bea1c2a3582f\") " pod="opendatahub/maas-controller-686f4d7c89-b4p4r" Jul 14 11:25:19.619115 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:19.618992 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpz4r\" (UniqueName: \"kubernetes.io/projected/bfe25647-c84b-4c83-85a4-3e8815ea6a0b-kube-api-access-tpz4r\") pod \"maas-controller-9884b8b4c-6fwp6\" (UID: \"bfe25647-c84b-4c83-85a4-3e8815ea6a0b\") " pod="opendatahub/maas-controller-9884b8b4c-6fwp6" Jul 14 11:25:19.619115 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:19.619020 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfe25647-c84b-4c83-85a4-3e8815ea6a0b-webhook-cert\") pod \"maas-controller-9884b8b4c-6fwp6\" (UID: \"bfe25647-c84b-4c83-85a4-3e8815ea6a0b\") " pod="opendatahub/maas-controller-9884b8b4c-6fwp6" Jul 14 11:25:19.619115 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:19.619036 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm5pw\" (UniqueName: \"kubernetes.io/projected/960917b1-4adc-414b-b7f4-bea1c2a3582f-kube-api-access-fm5pw\") pod \"maas-controller-686f4d7c89-b4p4r\" (UID: \"960917b1-4adc-414b-b7f4-bea1c2a3582f\") " pod="opendatahub/maas-controller-686f4d7c89-b4p4r" Jul 14 11:25:19.621563 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:19.621545 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfe25647-c84b-4c83-85a4-3e8815ea6a0b-webhook-cert\") pod \"maas-controller-9884b8b4c-6fwp6\" (UID: \"bfe25647-c84b-4c83-85a4-3e8815ea6a0b\") " pod="opendatahub/maas-controller-9884b8b4c-6fwp6" Jul 14 11:25:19.628784 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:19.628761 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpz4r\" (UniqueName: \"kubernetes.io/projected/bfe25647-c84b-4c83-85a4-3e8815ea6a0b-kube-api-access-tpz4r\") pod \"maas-controller-9884b8b4c-6fwp6\" (UID: \"bfe25647-c84b-4c83-85a4-3e8815ea6a0b\") " pod="opendatahub/maas-controller-9884b8b4c-6fwp6" Jul 14 11:25:19.720190 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:19.720147 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/960917b1-4adc-414b-b7f4-bea1c2a3582f-webhook-cert\") pod \"maas-controller-686f4d7c89-b4p4r\" (UID: \"960917b1-4adc-414b-b7f4-bea1c2a3582f\") " pod="opendatahub/maas-controller-686f4d7c89-b4p4r" Jul 14 11:25:19.720404 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:19.720206 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm5pw\" (UniqueName: \"kubernetes.io/projected/960917b1-4adc-414b-b7f4-bea1c2a3582f-kube-api-access-fm5pw\") pod \"maas-controller-686f4d7c89-b4p4r\" (UID: \"960917b1-4adc-414b-b7f4-bea1c2a3582f\") " pod="opendatahub/maas-controller-686f4d7c89-b4p4r" Jul 14 11:25:19.722770 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:19.722745 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/960917b1-4adc-414b-b7f4-bea1c2a3582f-webhook-cert\") pod \"maas-controller-686f4d7c89-b4p4r\" (UID: \"960917b1-4adc-414b-b7f4-bea1c2a3582f\") " pod="opendatahub/maas-controller-686f4d7c89-b4p4r" Jul 14 11:25:19.729781 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:19.729752 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm5pw\" (UniqueName: \"kubernetes.io/projected/960917b1-4adc-414b-b7f4-bea1c2a3582f-kube-api-access-fm5pw\") pod \"maas-controller-686f4d7c89-b4p4r\" (UID: \"960917b1-4adc-414b-b7f4-bea1c2a3582f\") " pod="opendatahub/maas-controller-686f4d7c89-b4p4r" Jul 14 11:25:19.742610 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:19.742588 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9884b8b4c-6fwp6" Jul 14 11:25:19.883690 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:19.883654 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-686f4d7c89-b4p4r" Jul 14 11:25:19.919759 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:19.919731 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9884b8b4c-6fwp6"] Jul 14 11:25:19.922332 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:25:19.922304 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfe25647_c84b_4c83_85a4_3e8815ea6a0b.slice/crio-38c17820192ff1c5f1d12af7cb54185ee17c36ffbf855ed1c1866738cc3821b9 WatchSource:0}: Error finding container 38c17820192ff1c5f1d12af7cb54185ee17c36ffbf855ed1c1866738cc3821b9: Status 404 returned error can't find the container with id 38c17820192ff1c5f1d12af7cb54185ee17c36ffbf855ed1c1866738cc3821b9 Jul 14 11:25:20.043856 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:20.043830 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-686f4d7c89-b4p4r"] Jul 14 11:25:20.046076 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:25:20.046049 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod960917b1_4adc_414b_b7f4_bea1c2a3582f.slice/crio-b843c4935300e7a1d351ece38eeee2a8dfbf2f3556630c1198be79221f7db1a1 WatchSource:0}: Error finding container b843c4935300e7a1d351ece38eeee2a8dfbf2f3556630c1198be79221f7db1a1: Status 404 returned error can't find the container with id b843c4935300e7a1d351ece38eeee2a8dfbf2f3556630c1198be79221f7db1a1 Jul 14 11:25:20.315916 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:20.315827 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-686f4d7c89-b4p4r" event={"ID":"960917b1-4adc-414b-b7f4-bea1c2a3582f","Type":"ContainerStarted","Data":"b843c4935300e7a1d351ece38eeee2a8dfbf2f3556630c1198be79221f7db1a1"} Jul 14 11:25:20.316894 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:20.316868 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9884b8b4c-6fwp6" event={"ID":"bfe25647-c84b-4c83-85a4-3e8815ea6a0b","Type":"ContainerStarted","Data":"38c17820192ff1c5f1d12af7cb54185ee17c36ffbf855ed1c1866738cc3821b9"} Jul 14 11:25:23.335949 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:23.335900 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-686f4d7c89-b4p4r" event={"ID":"960917b1-4adc-414b-b7f4-bea1c2a3582f","Type":"ContainerStarted","Data":"8d491737633d50f78f48cdb13a20a86b74cb02572f8753d6429a2f9313985282"} Jul 14 11:25:23.336370 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:23.336002 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-686f4d7c89-b4p4r" Jul 14 11:25:23.337316 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:23.337298 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9884b8b4c-6fwp6" event={"ID":"bfe25647-c84b-4c83-85a4-3e8815ea6a0b","Type":"ContainerStarted","Data":"af9dc08422e3a25d930a64d64480c0b6f0e5abfbceae715593c3bdfc9fef89a8"} Jul 14 11:25:23.337450 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:23.337434 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9884b8b4c-6fwp6" Jul 14 11:25:23.376759 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:23.376701 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-686f4d7c89-b4p4r" podStartSLOduration=2.145208608 podStartE2EDuration="4.37668441s" totalImagesPullingTime="2.231475802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:25:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:25:23.37529489 +0000 UTC m=+839.689428409" watchObservedRunningTime="2026-07-14 11:25:23.37668441 +0000 UTC m=+839.690817906" Jul 14 11:25:23.433536 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:23.433477 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9884b8b4c-6fwp6" podStartSLOduration=2.066558585 podStartE2EDuration="4.433457726s" totalImagesPullingTime="2.366899141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:25:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:25:23.431882028 +0000 UTC m=+839.746015546" watchObservedRunningTime="2026-07-14 11:25:23.433457726 +0000 UTC m=+839.747591244" Jul 14 11:25:34.342875 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:34.342844 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9884b8b4c-6fwp6" Jul 14 11:25:34.343302 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:34.342911 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-686f4d7c89-b4p4r" Jul 14 11:25:34.415272 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:34.415220 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9884b8b4c-6fwp6"] Jul 14 11:25:34.415452 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:34.415427 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-9884b8b4c-6fwp6" podUID="bfe25647-c84b-4c83-85a4-3e8815ea6a0b" containerName="manager" containerID="cri-o://af9dc08422e3a25d930a64d64480c0b6f0e5abfbceae715593c3bdfc9fef89a8" gracePeriod=30 Jul 14 11:25:34.660608 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:34.660582 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9884b8b4c-6fwp6" Jul 14 11:25:34.743065 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:34.743034 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfe25647-c84b-4c83-85a4-3e8815ea6a0b-webhook-cert\") pod \"bfe25647-c84b-4c83-85a4-3e8815ea6a0b\" (UID: \"bfe25647-c84b-4c83-85a4-3e8815ea6a0b\") " Jul 14 11:25:34.743219 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:34.743152 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpz4r\" (UniqueName: \"kubernetes.io/projected/bfe25647-c84b-4c83-85a4-3e8815ea6a0b-kube-api-access-tpz4r\") pod \"bfe25647-c84b-4c83-85a4-3e8815ea6a0b\" (UID: \"bfe25647-c84b-4c83-85a4-3e8815ea6a0b\") " Jul 14 11:25:34.745505 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:34.745470 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfe25647-c84b-4c83-85a4-3e8815ea6a0b-kube-api-access-tpz4r" (OuterVolumeSpecName: "kube-api-access-tpz4r") pod "bfe25647-c84b-4c83-85a4-3e8815ea6a0b" (UID: "bfe25647-c84b-4c83-85a4-3e8815ea6a0b"). InnerVolumeSpecName "kube-api-access-tpz4r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:25:34.745648 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:34.745518 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfe25647-c84b-4c83-85a4-3e8815ea6a0b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "bfe25647-c84b-4c83-85a4-3e8815ea6a0b" (UID: "bfe25647-c84b-4c83-85a4-3e8815ea6a0b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:25:34.843832 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:34.843786 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpz4r\" (UniqueName: \"kubernetes.io/projected/bfe25647-c84b-4c83-85a4-3e8815ea6a0b-kube-api-access-tpz4r\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:25:34.843832 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:34.843832 2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfe25647-c84b-4c83-85a4-3e8815ea6a0b-webhook-cert\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:25:35.393064 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:35.393030 2580 generic.go:356] "Generic (PLEG): container finished" podID="bfe25647-c84b-4c83-85a4-3e8815ea6a0b" containerID="af9dc08422e3a25d930a64d64480c0b6f0e5abfbceae715593c3bdfc9fef89a8" exitCode=0 Jul 14 11:25:35.393064 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:35.393065 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9884b8b4c-6fwp6" Jul 14 11:25:35.393560 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:35.393126 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9884b8b4c-6fwp6" event={"ID":"bfe25647-c84b-4c83-85a4-3e8815ea6a0b","Type":"ContainerDied","Data":"af9dc08422e3a25d930a64d64480c0b6f0e5abfbceae715593c3bdfc9fef89a8"} Jul 14 11:25:35.393560 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:35.393171 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9884b8b4c-6fwp6" event={"ID":"bfe25647-c84b-4c83-85a4-3e8815ea6a0b","Type":"ContainerDied","Data":"38c17820192ff1c5f1d12af7cb54185ee17c36ffbf855ed1c1866738cc3821b9"} Jul 14 11:25:35.393560 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:35.393195 2580 scope.go:117] "RemoveContainer" containerID="af9dc08422e3a25d930a64d64480c0b6f0e5abfbceae715593c3bdfc9fef89a8" Jul 14 11:25:35.403534 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:35.403517 2580 scope.go:117] "RemoveContainer" containerID="af9dc08422e3a25d930a64d64480c0b6f0e5abfbceae715593c3bdfc9fef89a8" Jul 14 11:25:35.403784 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:25:35.403763 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af9dc08422e3a25d930a64d64480c0b6f0e5abfbceae715593c3bdfc9fef89a8\": container with ID starting with af9dc08422e3a25d930a64d64480c0b6f0e5abfbceae715593c3bdfc9fef89a8 not found: ID does not exist" containerID="af9dc08422e3a25d930a64d64480c0b6f0e5abfbceae715593c3bdfc9fef89a8" Jul 14 11:25:35.403838 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:35.403794 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af9dc08422e3a25d930a64d64480c0b6f0e5abfbceae715593c3bdfc9fef89a8"} err="failed to get container status \"af9dc08422e3a25d930a64d64480c0b6f0e5abfbceae715593c3bdfc9fef89a8\": rpc error: code = NotFound desc = could not find container \"af9dc08422e3a25d930a64d64480c0b6f0e5abfbceae715593c3bdfc9fef89a8\": container with ID starting with af9dc08422e3a25d930a64d64480c0b6f0e5abfbceae715593c3bdfc9fef89a8 not found: ID does not exist" Jul 14 11:25:35.418402 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:35.418374 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9884b8b4c-6fwp6"] Jul 14 11:25:35.425029 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:35.425001 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-9884b8b4c-6fwp6"] Jul 14 11:25:36.233810 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:36.233773 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfe25647-c84b-4c83-85a4-3e8815ea6a0b" path="/var/lib/kubelet/pods/bfe25647-c84b-4c83-85a4-3e8815ea6a0b/volumes" Jul 14 11:25:55.655920 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:55.655884 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7869cfc4f6-b6rnw"] Jul 14 11:25:55.656379 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:55.656140 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfe25647-c84b-4c83-85a4-3e8815ea6a0b" containerName="manager" Jul 14 11:25:55.656379 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:55.656151 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfe25647-c84b-4c83-85a4-3e8815ea6a0b" containerName="manager" Jul 14 11:25:55.656379 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:55.656208 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfe25647-c84b-4c83-85a4-3e8815ea6a0b" containerName="manager" Jul 14 11:25:55.658509 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:55.658484 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7869cfc4f6-b6rnw" Jul 14 11:25:55.661265 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:55.661220 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fzlsv\"" Jul 14 11:25:55.662275 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:55.662260 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 14 11:25:55.671282 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:55.671256 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7869cfc4f6-b6rnw"] Jul 14 11:25:55.814120 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:55.814086 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40ded95c-3c11-4267-b41e-b46e8ce5e0ee-openshift-service-ca\") pod \"maas-api-7869cfc4f6-b6rnw\" (UID: \"40ded95c-3c11-4267-b41e-b46e8ce5e0ee\") " pod="odh-ai-gateway-infra/maas-api-7869cfc4f6-b6rnw" Jul 14 11:25:55.814120 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:55.814131 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40ded95c-3c11-4267-b41e-b46e8ce5e0ee-maas-api-tls\") pod \"maas-api-7869cfc4f6-b6rnw\" (UID: \"40ded95c-3c11-4267-b41e-b46e8ce5e0ee\") " pod="odh-ai-gateway-infra/maas-api-7869cfc4f6-b6rnw" Jul 14 11:25:55.814365 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:55.814151 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sjvf\" (UniqueName: \"kubernetes.io/projected/40ded95c-3c11-4267-b41e-b46e8ce5e0ee-kube-api-access-5sjvf\") pod \"maas-api-7869cfc4f6-b6rnw\" (UID: \"40ded95c-3c11-4267-b41e-b46e8ce5e0ee\") " pod="odh-ai-gateway-infra/maas-api-7869cfc4f6-b6rnw" Jul 14 11:25:55.914687 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:55.914614 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40ded95c-3c11-4267-b41e-b46e8ce5e0ee-maas-api-tls\") pod \"maas-api-7869cfc4f6-b6rnw\" (UID: \"40ded95c-3c11-4267-b41e-b46e8ce5e0ee\") " pod="odh-ai-gateway-infra/maas-api-7869cfc4f6-b6rnw" Jul 14 11:25:55.914687 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:55.914649 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sjvf\" (UniqueName: \"kubernetes.io/projected/40ded95c-3c11-4267-b41e-b46e8ce5e0ee-kube-api-access-5sjvf\") pod \"maas-api-7869cfc4f6-b6rnw\" (UID: \"40ded95c-3c11-4267-b41e-b46e8ce5e0ee\") " pod="odh-ai-gateway-infra/maas-api-7869cfc4f6-b6rnw" Jul 14 11:25:55.914915 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:55.914705 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40ded95c-3c11-4267-b41e-b46e8ce5e0ee-openshift-service-ca\") pod \"maas-api-7869cfc4f6-b6rnw\" (UID: \"40ded95c-3c11-4267-b41e-b46e8ce5e0ee\") " pod="odh-ai-gateway-infra/maas-api-7869cfc4f6-b6rnw" Jul 14 11:25:55.915365 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:55.915346 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40ded95c-3c11-4267-b41e-b46e8ce5e0ee-openshift-service-ca\") pod \"maas-api-7869cfc4f6-b6rnw\" (UID: \"40ded95c-3c11-4267-b41e-b46e8ce5e0ee\") " pod="odh-ai-gateway-infra/maas-api-7869cfc4f6-b6rnw" Jul 14 11:25:55.917125 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:55.917093 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40ded95c-3c11-4267-b41e-b46e8ce5e0ee-maas-api-tls\") pod \"maas-api-7869cfc4f6-b6rnw\" (UID: \"40ded95c-3c11-4267-b41e-b46e8ce5e0ee\") " pod="odh-ai-gateway-infra/maas-api-7869cfc4f6-b6rnw" Jul 14 11:25:55.932333 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:55.932305 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sjvf\" (UniqueName: \"kubernetes.io/projected/40ded95c-3c11-4267-b41e-b46e8ce5e0ee-kube-api-access-5sjvf\") pod \"maas-api-7869cfc4f6-b6rnw\" (UID: \"40ded95c-3c11-4267-b41e-b46e8ce5e0ee\") " pod="odh-ai-gateway-infra/maas-api-7869cfc4f6-b6rnw" Jul 14 11:25:55.969694 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:55.969659 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7869cfc4f6-b6rnw" Jul 14 11:25:56.104146 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:56.104122 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7869cfc4f6-b6rnw"] Jul 14 11:25:56.106328 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:25:56.106301 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ded95c_3c11_4267_b41e_b46e8ce5e0ee.slice/crio-7cd78ce7326dc86201eea22b6478d3091fe73c9908ea8a43a5bde0fe7dd1c48b WatchSource:0}: Error finding container 7cd78ce7326dc86201eea22b6478d3091fe73c9908ea8a43a5bde0fe7dd1c48b: Status 404 returned error can't find the container with id 7cd78ce7326dc86201eea22b6478d3091fe73c9908ea8a43a5bde0fe7dd1c48b Jul 14 11:25:56.152674 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:56.152644 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-bc5dh"] Jul 14 11:25:56.155331 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:56.155315 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-bc5dh" Jul 14 11:25:56.157860 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:56.157837 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 14 11:25:56.157983 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:56.157911 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-k76l8\"" Jul 14 11:25:56.165817 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:56.165769 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-bc5dh"] Jul 14 11:25:56.168771 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:56.168748 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-csbtc"] Jul 14 11:25:56.170797 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:56.170780 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-csbtc" Jul 14 11:25:56.182676 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:56.182652 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-csbtc"] Jul 14 11:25:56.318435 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:56.318405 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gq4t\" (UniqueName: \"kubernetes.io/projected/f90ea259-c602-49b1-97a3-9d0d9c44b3f8-kube-api-access-6gq4t\") pod \"payload-processing-f9b8d9b9b-csbtc\" (UID: \"f90ea259-c602-49b1-97a3-9d0d9c44b3f8\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-csbtc" Jul 14 11:25:56.318608 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:56.318442 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f90ea259-c602-49b1-97a3-9d0d9c44b3f8-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-csbtc\" (UID: \"f90ea259-c602-49b1-97a3-9d0d9c44b3f8\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-csbtc" Jul 14 11:25:56.318608 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:56.318475 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpngt\" (UniqueName: \"kubernetes.io/projected/81fb40fe-f6ba-423c-9146-768e653e7167-kube-api-access-wpngt\") pod \"payload-pre-processing-74584bb9f8-bc5dh\" (UID: \"81fb40fe-f6ba-423c-9146-768e653e7167\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-bc5dh" Jul 14 11:25:56.318608 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:56.318585 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81fb40fe-f6ba-423c-9146-768e653e7167-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-bc5dh\" (UID: \"81fb40fe-f6ba-423c-9146-768e653e7167\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-bc5dh" Jul 14 11:25:56.419386 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:56.419304 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpngt\" (UniqueName: \"kubernetes.io/projected/81fb40fe-f6ba-423c-9146-768e653e7167-kube-api-access-wpngt\") pod \"payload-pre-processing-74584bb9f8-bc5dh\" (UID: \"81fb40fe-f6ba-423c-9146-768e653e7167\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-bc5dh" Jul 14 11:25:56.419386 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:56.419358 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81fb40fe-f6ba-423c-9146-768e653e7167-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-bc5dh\" (UID: \"81fb40fe-f6ba-423c-9146-768e653e7167\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-bc5dh" Jul 14 11:25:56.419587 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:56.419400 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gq4t\" (UniqueName: \"kubernetes.io/projected/f90ea259-c602-49b1-97a3-9d0d9c44b3f8-kube-api-access-6gq4t\") pod \"payload-processing-f9b8d9b9b-csbtc\" (UID: \"f90ea259-c602-49b1-97a3-9d0d9c44b3f8\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-csbtc" Jul 14 11:25:56.419587 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:56.419419 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f90ea259-c602-49b1-97a3-9d0d9c44b3f8-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-csbtc\" (UID: \"f90ea259-c602-49b1-97a3-9d0d9c44b3f8\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-csbtc" Jul 14 11:25:56.420061 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:56.420043 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81fb40fe-f6ba-423c-9146-768e653e7167-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-bc5dh\" (UID: \"81fb40fe-f6ba-423c-9146-768e653e7167\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-bc5dh" Jul 14 11:25:56.420147 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:56.420130 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f90ea259-c602-49b1-97a3-9d0d9c44b3f8-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-csbtc\" (UID: \"f90ea259-c602-49b1-97a3-9d0d9c44b3f8\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-csbtc" Jul 14 11:25:56.429102 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:56.429079 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gq4t\" (UniqueName: \"kubernetes.io/projected/f90ea259-c602-49b1-97a3-9d0d9c44b3f8-kube-api-access-6gq4t\") pod \"payload-processing-f9b8d9b9b-csbtc\" (UID: \"f90ea259-c602-49b1-97a3-9d0d9c44b3f8\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-csbtc" Jul 14 11:25:56.432031 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:56.432013 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpngt\" (UniqueName: \"kubernetes.io/projected/81fb40fe-f6ba-423c-9146-768e653e7167-kube-api-access-wpngt\") pod \"payload-pre-processing-74584bb9f8-bc5dh\" (UID: \"81fb40fe-f6ba-423c-9146-768e653e7167\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-bc5dh" Jul 14 11:25:56.466710 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:56.466682 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-bc5dh" Jul 14 11:25:56.479679 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:56.479652 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-csbtc" Jul 14 11:25:56.487395 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:56.487363 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7869cfc4f6-b6rnw" event={"ID":"40ded95c-3c11-4267-b41e-b46e8ce5e0ee","Type":"ContainerStarted","Data":"7cd78ce7326dc86201eea22b6478d3091fe73c9908ea8a43a5bde0fe7dd1c48b"} Jul 14 11:25:56.609938 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:56.609908 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-bc5dh"] Jul 14 11:25:56.611863 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:25:56.611832 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81fb40fe_f6ba_423c_9146_768e653e7167.slice/crio-d366cb8255ee2bb53f9b4c5e0a18f27e4e38f039f241e8871137cef3339d223c WatchSource:0}: Error finding container d366cb8255ee2bb53f9b4c5e0a18f27e4e38f039f241e8871137cef3339d223c: Status 404 returned error can't find the container with id d366cb8255ee2bb53f9b4c5e0a18f27e4e38f039f241e8871137cef3339d223c Jul 14 11:25:56.636594 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:56.636470 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-csbtc"] Jul 14 11:25:56.638937 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:25:56.638911 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf90ea259_c602_49b1_97a3_9d0d9c44b3f8.slice/crio-ca49453c2c488bd45864f341e66bd473fe7541ed4b0e82f34c2bb43878597b4b WatchSource:0}: Error finding container ca49453c2c488bd45864f341e66bd473fe7541ed4b0e82f34c2bb43878597b4b: Status 404 returned error can't find the container with id ca49453c2c488bd45864f341e66bd473fe7541ed4b0e82f34c2bb43878597b4b Jul 14 11:25:57.495856 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:57.495182 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-bc5dh" event={"ID":"81fb40fe-f6ba-423c-9146-768e653e7167","Type":"ContainerStarted","Data":"d366cb8255ee2bb53f9b4c5e0a18f27e4e38f039f241e8871137cef3339d223c"} Jul 14 11:25:57.496993 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:57.496928 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-csbtc" event={"ID":"f90ea259-c602-49b1-97a3-9d0d9c44b3f8","Type":"ContainerStarted","Data":"ca49453c2c488bd45864f341e66bd473fe7541ed4b0e82f34c2bb43878597b4b"} Jul 14 11:25:58.502751 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:58.502665 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7869cfc4f6-b6rnw" event={"ID":"40ded95c-3c11-4267-b41e-b46e8ce5e0ee","Type":"ContainerStarted","Data":"48c91f8f912e8739bca0d54a7ec100b28ea9dc3342d8e03df009c51ffc54707f"} Jul 14 11:25:58.503157 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:58.502823 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7869cfc4f6-b6rnw" Jul 14 11:25:58.504217 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:58.504176 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-bc5dh" event={"ID":"81fb40fe-f6ba-423c-9146-768e653e7167","Type":"ContainerStarted","Data":"eafa1b0d94913c8c15ae7ad5c675660631cb4e129f49a30a24e148cdb06b3547"} Jul 14 11:25:58.504375 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:58.504251 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-bc5dh" Jul 14 11:25:58.505649 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:58.505629 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-csbtc" event={"ID":"f90ea259-c602-49b1-97a3-9d0d9c44b3f8","Type":"ContainerStarted","Data":"4afd1e35e0d2a53f752a89bdb2d32056e63bc37250aede88459126d6d929e3a6"} Jul 14 11:25:58.505728 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:58.505671 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-csbtc" Jul 14 11:25:58.527281 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:58.527215 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7869cfc4f6-b6rnw" podStartSLOduration=1.448465659 podStartE2EDuration="3.527195543s" totalImagesPullingTime="2.078729884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:25:58.524006744 +0000 UTC m=+874.838140265" watchObservedRunningTime="2026-07-14 11:25:58.527195543 +0000 UTC m=+874.841329062" Jul 14 11:25:58.547380 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:58.547329 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-csbtc" podStartSLOduration=0.999449482 podStartE2EDuration="2.547309481s" totalImagesPullingTime="1.547859999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:25:58.545037644 +0000 UTC m=+874.859171167" watchObservedRunningTime="2026-07-14 11:25:58.547309481 +0000 UTC m=+874.861443001" Jul 14 11:25:58.567122 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:25:58.567074 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-bc5dh" podStartSLOduration=0.995227995 podStartE2EDuration="2.567059314s" totalImagesPullingTime="1.571831319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:25:58.56477446 +0000 UTC m=+874.878907957" watchObservedRunningTime="2026-07-14 11:25:58.567059314 +0000 UTC m=+874.881192832" Jul 14 11:26:04.516374 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:04.516343 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7869cfc4f6-b6rnw" Jul 14 11:26:09.512971 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:09.512941 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-csbtc" Jul 14 11:26:09.513427 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:09.513170 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-bc5dh" Jul 14 11:26:27.194517 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:27.194408 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndktj_62d784b5-2a7b-4330-84a3-e8cd167dd1ce/ovn-acl-logging/0.log" Jul 14 11:26:27.198931 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:27.195671 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndktj_62d784b5-2a7b-4330-84a3-e8cd167dd1ce/ovn-acl-logging/0.log" Jul 14 11:26:49.005942 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.005908 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv"] Jul 14 11:26:49.008112 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.008091 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv" Jul 14 11:26:49.014839 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.014706 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 14 11:26:49.014839 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.014741 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 14 11:26:49.014839 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.014762 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 14 11:26:49.015057 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.014979 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nlg7b\"" Jul 14 11:26:49.026168 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.026144 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv"] Jul 14 11:26:49.115641 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.115603 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ce41775-0716-4cc1-b36d-d35fbcb480d4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bd5hv\" (UID: \"5ce41775-0716-4cc1-b36d-d35fbcb480d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv" Jul 14 11:26:49.115641 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.115642 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ce41775-0716-4cc1-b36d-d35fbcb480d4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bd5hv\" (UID: \"5ce41775-0716-4cc1-b36d-d35fbcb480d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv" Jul 14 11:26:49.115866 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.115700 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ce41775-0716-4cc1-b36d-d35fbcb480d4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bd5hv\" (UID: \"5ce41775-0716-4cc1-b36d-d35fbcb480d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv" Jul 14 11:26:49.115866 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.115728 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ce41775-0716-4cc1-b36d-d35fbcb480d4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bd5hv\" (UID: \"5ce41775-0716-4cc1-b36d-d35fbcb480d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv" Jul 14 11:26:49.115866 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.115766 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ce41775-0716-4cc1-b36d-d35fbcb480d4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bd5hv\" (UID: \"5ce41775-0716-4cc1-b36d-d35fbcb480d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv" Jul 14 11:26:49.115866 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.115816 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6hgn\" (UniqueName: \"kubernetes.io/projected/5ce41775-0716-4cc1-b36d-d35fbcb480d4-kube-api-access-f6hgn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bd5hv\" (UID: \"5ce41775-0716-4cc1-b36d-d35fbcb480d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv" Jul 14 11:26:49.217242 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.217200 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ce41775-0716-4cc1-b36d-d35fbcb480d4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bd5hv\" (UID: \"5ce41775-0716-4cc1-b36d-d35fbcb480d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv" Jul 14 11:26:49.217436 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.217266 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ce41775-0716-4cc1-b36d-d35fbcb480d4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bd5hv\" (UID: \"5ce41775-0716-4cc1-b36d-d35fbcb480d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv" Jul 14 11:26:49.217436 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.217326 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ce41775-0716-4cc1-b36d-d35fbcb480d4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bd5hv\" (UID: \"5ce41775-0716-4cc1-b36d-d35fbcb480d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv" Jul 14 11:26:49.217436 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.217347 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ce41775-0716-4cc1-b36d-d35fbcb480d4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bd5hv\" (UID: \"5ce41775-0716-4cc1-b36d-d35fbcb480d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv" Jul 14 11:26:49.217436 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.217380 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ce41775-0716-4cc1-b36d-d35fbcb480d4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bd5hv\" (UID: \"5ce41775-0716-4cc1-b36d-d35fbcb480d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv" Jul 14 11:26:49.217667 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.217429 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6hgn\" (UniqueName: \"kubernetes.io/projected/5ce41775-0716-4cc1-b36d-d35fbcb480d4-kube-api-access-f6hgn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bd5hv\" (UID: \"5ce41775-0716-4cc1-b36d-d35fbcb480d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv" Jul 14 11:26:49.217724 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.217683 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ce41775-0716-4cc1-b36d-d35fbcb480d4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bd5hv\" (UID: \"5ce41775-0716-4cc1-b36d-d35fbcb480d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv" Jul 14 11:26:49.217778 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.217754 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ce41775-0716-4cc1-b36d-d35fbcb480d4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bd5hv\" (UID: \"5ce41775-0716-4cc1-b36d-d35fbcb480d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv" Jul 14 11:26:49.217815 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.217775 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ce41775-0716-4cc1-b36d-d35fbcb480d4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bd5hv\" (UID: \"5ce41775-0716-4cc1-b36d-d35fbcb480d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv" Jul 14 11:26:49.219785 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.219766 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ce41775-0716-4cc1-b36d-d35fbcb480d4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bd5hv\" (UID: \"5ce41775-0716-4cc1-b36d-d35fbcb480d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv" Jul 14 11:26:49.220132 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.220113 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ce41775-0716-4cc1-b36d-d35fbcb480d4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bd5hv\" (UID: \"5ce41775-0716-4cc1-b36d-d35fbcb480d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv" Jul 14 11:26:49.227120 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.227097 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6hgn\" (UniqueName: \"kubernetes.io/projected/5ce41775-0716-4cc1-b36d-d35fbcb480d4-kube-api-access-f6hgn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bd5hv\" (UID: \"5ce41775-0716-4cc1-b36d-d35fbcb480d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv" Jul 14 11:26:49.318167 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.318056 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv" Jul 14 11:26:49.453780 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.453750 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv"] Jul 14 11:26:49.457069 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:26:49.457029 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ce41775_0716_4cc1_b36d_d35fbcb480d4.slice/crio-cc64d85febfed07bdd98a20625b708d3b9ed8dcf39b96a2484427489e77397ea WatchSource:0}: Error finding container cc64d85febfed07bdd98a20625b708d3b9ed8dcf39b96a2484427489e77397ea: Status 404 returned error can't find the container with id cc64d85febfed07bdd98a20625b708d3b9ed8dcf39b96a2484427489e77397ea Jul 14 11:26:49.458392 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.458375 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 11:26:49.742176 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:49.742135 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv" event={"ID":"5ce41775-0716-4cc1-b36d-d35fbcb480d4","Type":"ContainerStarted","Data":"cc64d85febfed07bdd98a20625b708d3b9ed8dcf39b96a2484427489e77397ea"} Jul 14 11:26:50.748015 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:50.747980 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv" event={"ID":"5ce41775-0716-4cc1-b36d-d35fbcb480d4","Type":"ContainerStarted","Data":"b6624f8fbcc7f55fdf715439d000af09fd68167ade2ba57f33220499a10b83e4"} Jul 14 11:26:50.772860 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:50.772764 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv" podStartSLOduration=1.719883775 podStartE2EDuration="2.77274625s" totalImagesPullingTime="1.052862475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:26:50.770456316 +0000 UTC m=+927.084589832" watchObservedRunningTime="2026-07-14 11:26:50.77274625 +0000 UTC m=+927.086879817" Jul 14 11:26:59.318597 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:59.318559 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv" Jul 14 11:26:59.319028 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:59.318819 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv" Jul 14 11:26:59.331254 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:59.331213 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv" Jul 14 11:26:59.799210 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:26:59.799182 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bd5hv" Jul 14 11:27:04.783533 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:04.783498 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw"] Jul 14 11:27:04.788086 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:04.788063 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw" Jul 14 11:27:04.790578 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:04.790559 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 14 11:27:04.797158 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:04.797133 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw"] Jul 14 11:27:04.948680 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:04.948640 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae49b722-f47f-4f53-aeaa-d350db9c0e15-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw\" (UID: \"ae49b722-f47f-4f53-aeaa-d350db9c0e15\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw" Jul 14 11:27:04.948680 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:04.948684 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae49b722-f47f-4f53-aeaa-d350db9c0e15-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw\" (UID: \"ae49b722-f47f-4f53-aeaa-d350db9c0e15\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw" Jul 14 11:27:04.948909 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:04.948708 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae49b722-f47f-4f53-aeaa-d350db9c0e15-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw\" (UID: \"ae49b722-f47f-4f53-aeaa-d350db9c0e15\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw" Jul 14 11:27:04.948909 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:04.948725 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae49b722-f47f-4f53-aeaa-d350db9c0e15-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw\" (UID: \"ae49b722-f47f-4f53-aeaa-d350db9c0e15\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw" Jul 14 11:27:04.948909 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:04.948816 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx54w\" (UniqueName: \"kubernetes.io/projected/ae49b722-f47f-4f53-aeaa-d350db9c0e15-kube-api-access-sx54w\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw\" (UID: \"ae49b722-f47f-4f53-aeaa-d350db9c0e15\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw" Jul 14 11:27:04.948909 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:04.948848 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae49b722-f47f-4f53-aeaa-d350db9c0e15-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw\" (UID: \"ae49b722-f47f-4f53-aeaa-d350db9c0e15\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw" Jul 14 11:27:05.050399 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:05.050295 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx54w\" (UniqueName: \"kubernetes.io/projected/ae49b722-f47f-4f53-aeaa-d350db9c0e15-kube-api-access-sx54w\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw\" (UID: \"ae49b722-f47f-4f53-aeaa-d350db9c0e15\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw" Jul 14 11:27:05.050399 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:05.050348 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae49b722-f47f-4f53-aeaa-d350db9c0e15-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw\" (UID: \"ae49b722-f47f-4f53-aeaa-d350db9c0e15\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw" Jul 14 11:27:05.050399 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:05.050399 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae49b722-f47f-4f53-aeaa-d350db9c0e15-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw\" (UID: \"ae49b722-f47f-4f53-aeaa-d350db9c0e15\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw" Jul 14 11:27:05.050682 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:05.050420 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae49b722-f47f-4f53-aeaa-d350db9c0e15-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw\" (UID: \"ae49b722-f47f-4f53-aeaa-d350db9c0e15\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw" Jul 14 11:27:05.050682 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:05.050441 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae49b722-f47f-4f53-aeaa-d350db9c0e15-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw\" (UID: \"ae49b722-f47f-4f53-aeaa-d350db9c0e15\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw" Jul 14 11:27:05.050682 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:05.050456 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae49b722-f47f-4f53-aeaa-d350db9c0e15-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw\" (UID: \"ae49b722-f47f-4f53-aeaa-d350db9c0e15\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw" Jul 14 11:27:05.050895 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:05.050860 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae49b722-f47f-4f53-aeaa-d350db9c0e15-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw\" (UID: \"ae49b722-f47f-4f53-aeaa-d350db9c0e15\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw" Jul 14 11:27:05.050963 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:05.050875 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae49b722-f47f-4f53-aeaa-d350db9c0e15-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw\" (UID: \"ae49b722-f47f-4f53-aeaa-d350db9c0e15\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw" Jul 14 11:27:05.050963 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:05.050909 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae49b722-f47f-4f53-aeaa-d350db9c0e15-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw\" (UID: \"ae49b722-f47f-4f53-aeaa-d350db9c0e15\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw" Jul 14 11:27:05.052789 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:05.052771 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae49b722-f47f-4f53-aeaa-d350db9c0e15-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw\" (UID: \"ae49b722-f47f-4f53-aeaa-d350db9c0e15\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw" Jul 14 11:27:05.052966 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:05.052951 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae49b722-f47f-4f53-aeaa-d350db9c0e15-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw\" (UID: \"ae49b722-f47f-4f53-aeaa-d350db9c0e15\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw" Jul 14 11:27:05.060946 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:05.060923 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx54w\" (UniqueName: \"kubernetes.io/projected/ae49b722-f47f-4f53-aeaa-d350db9c0e15-kube-api-access-sx54w\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw\" (UID: \"ae49b722-f47f-4f53-aeaa-d350db9c0e15\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw" Jul 14 11:27:05.098925 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:05.098890 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw" Jul 14 11:27:05.227868 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:05.227841 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw"] Jul 14 11:27:05.229698 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:27:05.229673 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae49b722_f47f_4f53_aeaa_d350db9c0e15.slice/crio-9af76f2207eea1671760524f6b50c199a2213e2d63c3d3cf2695b7b4e4bad541 WatchSource:0}: Error finding container 9af76f2207eea1671760524f6b50c199a2213e2d63c3d3cf2695b7b4e4bad541: Status 404 returned error can't find the container with id 9af76f2207eea1671760524f6b50c199a2213e2d63c3d3cf2695b7b4e4bad541 Jul 14 11:27:05.816362 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:05.816263 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw" event={"ID":"ae49b722-f47f-4f53-aeaa-d350db9c0e15","Type":"ContainerStarted","Data":"6030c1af5b8fba6969d624d83f92790e36a65fe6576a77c8c915d5a30df46b09"} Jul 14 11:27:05.816362 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:05.816324 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw" event={"ID":"ae49b722-f47f-4f53-aeaa-d350db9c0e15","Type":"ContainerStarted","Data":"9af76f2207eea1671760524f6b50c199a2213e2d63c3d3cf2695b7b4e4bad541"} Jul 14 11:27:05.839087 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:05.839033 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw" podStartSLOduration=1.661637527 podStartE2EDuration="1.839015652s" totalImagesPullingTime="177.378125ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:27:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:27:05.83652829 +0000 UTC m=+942.150661808" watchObservedRunningTime="2026-07-14 11:27:05.839015652 +0000 UTC m=+942.153149169" Jul 14 11:27:15.099279 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:15.099223 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw" Jul 14 11:27:15.099671 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:15.099305 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw" Jul 14 11:27:15.112104 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:15.112075 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw" Jul 14 11:27:15.870879 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:27:15.870852 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw" Jul 14 11:31:27.222806 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:31:27.222693 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndktj_62d784b5-2a7b-4330-84a3-e8cd167dd1ce/ovn-acl-logging/0.log" Jul 14 11:31:27.226074 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:31:27.225023 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndktj_62d784b5-2a7b-4330-84a3-e8cd167dd1ce/ovn-acl-logging/0.log" Jul 14 11:32:25.317862 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:25.317762 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-686f4d7c89-b4p4r"] Jul 14 11:32:25.318477 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:25.317985 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-686f4d7c89-b4p4r" podUID="960917b1-4adc-414b-b7f4-bea1c2a3582f" containerName="manager" containerID="cri-o://8d491737633d50f78f48cdb13a20a86b74cb02572f8753d6429a2f9313985282" gracePeriod=30 Jul 14 11:32:25.564088 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:25.564064 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-686f4d7c89-b4p4r" Jul 14 11:32:25.647364 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:25.647331 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/960917b1-4adc-414b-b7f4-bea1c2a3582f-webhook-cert\") pod \"960917b1-4adc-414b-b7f4-bea1c2a3582f\" (UID: \"960917b1-4adc-414b-b7f4-bea1c2a3582f\") " Jul 14 11:32:25.647550 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:25.647377 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fm5pw\" (UniqueName: \"kubernetes.io/projected/960917b1-4adc-414b-b7f4-bea1c2a3582f-kube-api-access-fm5pw\") pod \"960917b1-4adc-414b-b7f4-bea1c2a3582f\" (UID: \"960917b1-4adc-414b-b7f4-bea1c2a3582f\") " Jul 14 11:32:25.649470 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:25.649441 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/960917b1-4adc-414b-b7f4-bea1c2a3582f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "960917b1-4adc-414b-b7f4-bea1c2a3582f" (UID: "960917b1-4adc-414b-b7f4-bea1c2a3582f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:32:25.649650 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:25.649627 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/960917b1-4adc-414b-b7f4-bea1c2a3582f-kube-api-access-fm5pw" (OuterVolumeSpecName: "kube-api-access-fm5pw") pod "960917b1-4adc-414b-b7f4-bea1c2a3582f" (UID: "960917b1-4adc-414b-b7f4-bea1c2a3582f"). InnerVolumeSpecName "kube-api-access-fm5pw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:32:25.748554 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:25.748516 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fm5pw\" (UniqueName: \"kubernetes.io/projected/960917b1-4adc-414b-b7f4-bea1c2a3582f-kube-api-access-fm5pw\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:32:25.748554 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:25.748544 2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/960917b1-4adc-414b-b7f4-bea1c2a3582f-webhook-cert\") on node \"ip-10-0-141-138.ec2.internal\" DevicePath \"\"" Jul 14 11:32:26.279421 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:26.279386 2580 generic.go:356] "Generic (PLEG): container finished" podID="960917b1-4adc-414b-b7f4-bea1c2a3582f" containerID="8d491737633d50f78f48cdb13a20a86b74cb02572f8753d6429a2f9313985282" exitCode=0 Jul 14 11:32:26.279587 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:26.279433 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-686f4d7c89-b4p4r" Jul 14 11:32:26.279587 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:26.279437 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-686f4d7c89-b4p4r" event={"ID":"960917b1-4adc-414b-b7f4-bea1c2a3582f","Type":"ContainerDied","Data":"8d491737633d50f78f48cdb13a20a86b74cb02572f8753d6429a2f9313985282"} Jul 14 11:32:26.279587 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:26.279486 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-686f4d7c89-b4p4r" event={"ID":"960917b1-4adc-414b-b7f4-bea1c2a3582f","Type":"ContainerDied","Data":"b843c4935300e7a1d351ece38eeee2a8dfbf2f3556630c1198be79221f7db1a1"} Jul 14 11:32:26.279587 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:26.279517 2580 scope.go:117] "RemoveContainer" containerID="8d491737633d50f78f48cdb13a20a86b74cb02572f8753d6429a2f9313985282" Jul 14 11:32:26.289628 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:26.289608 2580 scope.go:117] "RemoveContainer" containerID="8d491737633d50f78f48cdb13a20a86b74cb02572f8753d6429a2f9313985282" Jul 14 11:32:26.289914 ip-10-0-141-138 kubenswrapper[2580]: E0714 11:32:26.289893 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d491737633d50f78f48cdb13a20a86b74cb02572f8753d6429a2f9313985282\": container with ID starting with 8d491737633d50f78f48cdb13a20a86b74cb02572f8753d6429a2f9313985282 not found: ID does not exist" containerID="8d491737633d50f78f48cdb13a20a86b74cb02572f8753d6429a2f9313985282" Jul 14 11:32:26.289984 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:26.289922 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d491737633d50f78f48cdb13a20a86b74cb02572f8753d6429a2f9313985282"} err="failed to get container status \"8d491737633d50f78f48cdb13a20a86b74cb02572f8753d6429a2f9313985282\": rpc error: code = NotFound desc = could not find container \"8d491737633d50f78f48cdb13a20a86b74cb02572f8753d6429a2f9313985282\": container with ID starting with 8d491737633d50f78f48cdb13a20a86b74cb02572f8753d6429a2f9313985282 not found: ID does not exist" Jul 14 11:32:26.304404 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:26.304375 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-686f4d7c89-b4p4r"] Jul 14 11:32:26.307051 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:26.307020 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-686f4d7c89-b4p4r"] Jul 14 11:32:27.128664 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:27.128625 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-686f4d7c89-28r76"] Jul 14 11:32:27.129047 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:27.128938 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="960917b1-4adc-414b-b7f4-bea1c2a3582f" containerName="manager" Jul 14 11:32:27.129047 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:27.128949 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="960917b1-4adc-414b-b7f4-bea1c2a3582f" containerName="manager" Jul 14 11:32:27.129047 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:27.129020 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="960917b1-4adc-414b-b7f4-bea1c2a3582f" containerName="manager" Jul 14 11:32:27.133437 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:27.133412 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-686f4d7c89-28r76" Jul 14 11:32:27.136249 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:27.136211 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xx425\"" Jul 14 11:32:27.137356 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:27.137335 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 14 11:32:27.137463 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:27.137336 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 14 11:32:27.144022 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:27.143997 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-686f4d7c89-28r76"] Jul 14 11:32:27.162122 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:27.161902 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c892cfc8-bd35-40c7-a560-d399f6e5ac43-webhook-cert\") pod \"maas-controller-686f4d7c89-28r76\" (UID: \"c892cfc8-bd35-40c7-a560-d399f6e5ac43\") " pod="opendatahub/maas-controller-686f4d7c89-28r76" Jul 14 11:32:27.162122 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:27.162005 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c94dt\" (UniqueName: \"kubernetes.io/projected/c892cfc8-bd35-40c7-a560-d399f6e5ac43-kube-api-access-c94dt\") pod \"maas-controller-686f4d7c89-28r76\" (UID: \"c892cfc8-bd35-40c7-a560-d399f6e5ac43\") " pod="opendatahub/maas-controller-686f4d7c89-28r76" Jul 14 11:32:27.262998 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:27.262958 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c94dt\" (UniqueName: \"kubernetes.io/projected/c892cfc8-bd35-40c7-a560-d399f6e5ac43-kube-api-access-c94dt\") pod \"maas-controller-686f4d7c89-28r76\" (UID: \"c892cfc8-bd35-40c7-a560-d399f6e5ac43\") " pod="opendatahub/maas-controller-686f4d7c89-28r76" Jul 14 11:32:27.263158 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:27.263030 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c892cfc8-bd35-40c7-a560-d399f6e5ac43-webhook-cert\") pod \"maas-controller-686f4d7c89-28r76\" (UID: \"c892cfc8-bd35-40c7-a560-d399f6e5ac43\") " pod="opendatahub/maas-controller-686f4d7c89-28r76" Jul 14 11:32:27.265460 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:27.265435 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c892cfc8-bd35-40c7-a560-d399f6e5ac43-webhook-cert\") pod \"maas-controller-686f4d7c89-28r76\" (UID: \"c892cfc8-bd35-40c7-a560-d399f6e5ac43\") " pod="opendatahub/maas-controller-686f4d7c89-28r76" Jul 14 11:32:27.272220 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:27.272195 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c94dt\" (UniqueName: \"kubernetes.io/projected/c892cfc8-bd35-40c7-a560-d399f6e5ac43-kube-api-access-c94dt\") pod \"maas-controller-686f4d7c89-28r76\" (UID: \"c892cfc8-bd35-40c7-a560-d399f6e5ac43\") " pod="opendatahub/maas-controller-686f4d7c89-28r76" Jul 14 11:32:27.444519 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:27.444427 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-686f4d7c89-28r76" Jul 14 11:32:27.581670 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:27.581646 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-686f4d7c89-28r76"] Jul 14 11:32:27.583697 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:32:27.583670 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc892cfc8_bd35_40c7_a560_d399f6e5ac43.slice/crio-c6d40031c942e6cac3a1c5904a13234ff8441f0b6d826a48965173ab52e4f57f WatchSource:0}: Error finding container c6d40031c942e6cac3a1c5904a13234ff8441f0b6d826a48965173ab52e4f57f: Status 404 returned error can't find the container with id c6d40031c942e6cac3a1c5904a13234ff8441f0b6d826a48965173ab52e4f57f Jul 14 11:32:27.585019 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:27.584999 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 11:32:28.234195 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:28.234160 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="960917b1-4adc-414b-b7f4-bea1c2a3582f" path="/var/lib/kubelet/pods/960917b1-4adc-414b-b7f4-bea1c2a3582f/volumes" Jul 14 11:32:28.290969 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:28.290875 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-686f4d7c89-28r76" event={"ID":"c892cfc8-bd35-40c7-a560-d399f6e5ac43","Type":"ContainerStarted","Data":"49dafb3b2212817e5241d9ac8841fd1b5880fcfcdcdfe49f5a4e8b6687164bdf"} Jul 14 11:32:28.290969 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:28.290926 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-686f4d7c89-28r76" event={"ID":"c892cfc8-bd35-40c7-a560-d399f6e5ac43","Type":"ContainerStarted","Data":"c6d40031c942e6cac3a1c5904a13234ff8441f0b6d826a48965173ab52e4f57f"} Jul 14 11:32:28.291197 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:28.290980 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-686f4d7c89-28r76" Jul 14 11:32:39.298314 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:39.298282 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-686f4d7c89-28r76" Jul 14 11:32:39.334511 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:32:39.334459 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-686f4d7c89-28r76" podStartSLOduration=11.88179197 podStartE2EDuration="12.334442278s" totalImagesPullingTime="452.650308ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:32:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:32:28.33013774 +0000 UTC m=+1264.644271260" watchObservedRunningTime="2026-07-14 11:32:39.334442278 +0000 UTC m=+1275.648575795" Jul 14 11:33:43.655158 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:33:43.655126 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-686f4d7c89-28r76_c892cfc8-bd35-40c7-a560-d399f6e5ac43/manager/0.log" Jul 14 11:33:44.167049 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:33:44.167019 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bf58df976-fpg6h_c4093ae8-8fd7-474d-a5b7-626a6f494217/copy-manifests/0.log" Jul 14 11:33:44.180209 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:33:44.180135 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bf58df976-fpg6h_c4093ae8-8fd7-474d-a5b7-626a6f494217/manager/0.log" Jul 14 11:33:44.661517 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:33:44.661484 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7869cfc4f6-b6rnw_40ded95c-3c11-4267-b41e-b46e8ce5e0ee/maas-api/0.log" Jul 14 11:33:44.928773 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:33:44.928697 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-cl29x_a2157a69-9585-4a87-b0e5-c17232e46529/postgres/0.log" Jul 14 11:33:45.707952 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:33:45.707924 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx_583c83c1-b347-4c5e-ac0a-a5de9836f4e8/util/0.log" Jul 14 11:33:45.713845 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:33:45.713826 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx_583c83c1-b347-4c5e-ac0a-a5de9836f4e8/pull/0.log" Jul 14 11:33:45.720182 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:33:45.720160 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx_583c83c1-b347-4c5e-ac0a-a5de9836f4e8/extract/0.log" Jul 14 11:33:45.831856 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:33:45.831828 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz_0187b017-3e8c-48c2-aa0d-625650500073/util/0.log" Jul 14 11:33:45.840419 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:33:45.840396 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz_0187b017-3e8c-48c2-aa0d-625650500073/pull/0.log" Jul 14 11:33:45.846572 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:33:45.846555 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz_0187b017-3e8c-48c2-aa0d-625650500073/extract/0.log" Jul 14 11:33:45.957101 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:33:45.957076 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74_d7bbac94-c7cf-4e20-a5d7-d30deae3e132/util/0.log" Jul 14 11:33:45.963684 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:33:45.963624 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74_d7bbac94-c7cf-4e20-a5d7-d30deae3e132/pull/0.log" Jul 14 11:33:45.970113 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:33:45.970091 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74_d7bbac94-c7cf-4e20-a5d7-d30deae3e132/extract/0.log" Jul 14 11:33:46.079793 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:33:46.079767 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp_594121d4-f6dc-4aaa-93f6-5bb7d582922a/extract/0.log" Jul 14 11:33:46.086078 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:33:46.086048 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp_594121d4-f6dc-4aaa-93f6-5bb7d582922a/util/0.log" Jul 14 11:33:46.093026 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:33:46.093006 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp_594121d4-f6dc-4aaa-93f6-5bb7d582922a/pull/0.log" Jul 14 11:33:47.580355 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:33:47.580324 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-44kkf_ac9ad772-d85f-476c-8f57-1209c56e960f/discovery/0.log" Jul 14 11:33:48.038939 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:33:48.038906 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-bc5dh_81fb40fe-f6ba-423c-9146-768e653e7167/payload-pre-processing/0.log" Jul 14 11:33:48.147628 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:33:48.147603 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-csbtc_f90ea259-c602-49b1-97a3-9d0d9c44b3f8/payload-processing/0.log" Jul 14 11:33:48.853539 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:33:48.853511 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-bd5hv_5ce41775-0716-4cc1-b36d-d35fbcb480d4/main/0.log" Jul 14 11:33:48.963504 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:33:48.963479 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8ccdw_ae49b722-f47f-4f53-aeaa-d350db9c0e15/main/0.log" Jul 14 11:33:56.467747 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:33:56.467716 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lzzhb_4432fb72-2ee9-49e5-bc93-73462d52ed6e/global-pull-secret-syncer/0.log" Jul 14 11:33:56.676339 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:33:56.676307 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qjq7w_a8dc1f8e-58c9-4aac-994a-95422c85bad5/konnectivity-agent/0.log" Jul 14 11:33:56.752860 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:33:56.752772 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-138.ec2.internal_3b34c804ba21769735646d070057ea2e/haproxy/0.log" Jul 14 11:34:01.887065 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:01.887013 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx_583c83c1-b347-4c5e-ac0a-a5de9836f4e8/extract/0.log" Jul 14 11:34:01.912070 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:01.912038 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx_583c83c1-b347-4c5e-ac0a-a5de9836f4e8/util/0.log" Jul 14 11:34:01.935225 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:01.935198 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d54nx_583c83c1-b347-4c5e-ac0a-a5de9836f4e8/pull/0.log" Jul 14 11:34:01.972806 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:01.968200 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz_0187b017-3e8c-48c2-aa0d-625650500073/extract/0.log" Jul 14 11:34:01.990028 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:01.989996 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz_0187b017-3e8c-48c2-aa0d-625650500073/util/0.log" Jul 14 11:34:02.020061 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:02.020011 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p7zrz_0187b017-3e8c-48c2-aa0d-625650500073/pull/0.log" Jul 14 11:34:02.053520 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:02.053489 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74_d7bbac94-c7cf-4e20-a5d7-d30deae3e132/extract/0.log" Jul 14 11:34:02.081300 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:02.081267 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74_d7bbac94-c7cf-4e20-a5d7-d30deae3e132/util/0.log" Jul 14 11:34:02.104669 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:02.104643 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rwj74_d7bbac94-c7cf-4e20-a5d7-d30deae3e132/pull/0.log" Jul 14 11:34:02.132606 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:02.132578 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp_594121d4-f6dc-4aaa-93f6-5bb7d582922a/extract/0.log" Jul 14 11:34:02.156531 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:02.156443 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp_594121d4-f6dc-4aaa-93f6-5bb7d582922a/util/0.log" Jul 14 11:34:02.179564 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:02.179532 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n6snp_594121d4-f6dc-4aaa-93f6-5bb7d582922a/pull/0.log" Jul 14 11:34:05.091642 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:05.091612 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rh482_f8d36b92-9484-4566-b1b5-246b9655e6de/node-exporter/0.log" Jul 14 11:34:05.116570 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:05.116500 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rh482_f8d36b92-9484-4566-b1b5-246b9655e6de/kube-rbac-proxy/0.log" Jul 14 11:34:05.147421 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:05.147399 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rh482_f8d36b92-9484-4566-b1b5-246b9655e6de/init-textfile/0.log" Jul 14 11:34:06.463866 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:06.463827 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-82fbt/perf-node-gather-daemonset-88hjh"] Jul 14 11:34:06.467351 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:06.467328 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-88hjh" Jul 14 11:34:06.469789 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:06.469761 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-82fbt\"/\"kube-root-ca.crt\"" Jul 14 11:34:06.469943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:06.469853 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-82fbt\"/\"openshift-service-ca.crt\"" Jul 14 11:34:06.469943 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:06.469886 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-82fbt\"/\"default-dockercfg-qbkjj\"" Jul 14 11:34:06.478066 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:06.478044 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-82fbt/perf-node-gather-daemonset-88hjh"] Jul 14 11:34:06.600662 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:06.600625 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/937a2d20-9dbc-4762-9540-122a018f54a7-podres\") pod \"perf-node-gather-daemonset-88hjh\" (UID: \"937a2d20-9dbc-4762-9540-122a018f54a7\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-88hjh" Jul 14 11:34:06.600834 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:06.600673 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzzdm\" (UniqueName: \"kubernetes.io/projected/937a2d20-9dbc-4762-9540-122a018f54a7-kube-api-access-lzzdm\") pod \"perf-node-gather-daemonset-88hjh\" (UID: \"937a2d20-9dbc-4762-9540-122a018f54a7\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-88hjh" Jul 14 11:34:06.600834 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:06.600703 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/937a2d20-9dbc-4762-9540-122a018f54a7-proc\") pod \"perf-node-gather-daemonset-88hjh\" (UID: \"937a2d20-9dbc-4762-9540-122a018f54a7\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-88hjh" Jul 14 11:34:06.600834 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:06.600788 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/937a2d20-9dbc-4762-9540-122a018f54a7-sys\") pod \"perf-node-gather-daemonset-88hjh\" (UID: \"937a2d20-9dbc-4762-9540-122a018f54a7\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-88hjh" Jul 14 11:34:06.600834 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:06.600817 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/937a2d20-9dbc-4762-9540-122a018f54a7-lib-modules\") pod \"perf-node-gather-daemonset-88hjh\" (UID: \"937a2d20-9dbc-4762-9540-122a018f54a7\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-88hjh" Jul 14 11:34:06.701979 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:06.701938 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/937a2d20-9dbc-4762-9540-122a018f54a7-podres\") pod \"perf-node-gather-daemonset-88hjh\" (UID: \"937a2d20-9dbc-4762-9540-122a018f54a7\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-88hjh" Jul 14 11:34:06.702150 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:06.701987 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzzdm\" (UniqueName: \"kubernetes.io/projected/937a2d20-9dbc-4762-9540-122a018f54a7-kube-api-access-lzzdm\") pod \"perf-node-gather-daemonset-88hjh\" (UID: \"937a2d20-9dbc-4762-9540-122a018f54a7\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-88hjh" Jul 14 11:34:06.702150 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:06.702015 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/937a2d20-9dbc-4762-9540-122a018f54a7-proc\") pod \"perf-node-gather-daemonset-88hjh\" (UID: \"937a2d20-9dbc-4762-9540-122a018f54a7\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-88hjh" Jul 14 11:34:06.702150 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:06.702067 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/937a2d20-9dbc-4762-9540-122a018f54a7-sys\") pod \"perf-node-gather-daemonset-88hjh\" (UID: \"937a2d20-9dbc-4762-9540-122a018f54a7\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-88hjh" Jul 14 11:34:06.702150 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:06.702087 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/937a2d20-9dbc-4762-9540-122a018f54a7-lib-modules\") pod \"perf-node-gather-daemonset-88hjh\" (UID: \"937a2d20-9dbc-4762-9540-122a018f54a7\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-88hjh" Jul 14 11:34:06.702150 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:06.702142 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/937a2d20-9dbc-4762-9540-122a018f54a7-podres\") pod \"perf-node-gather-daemonset-88hjh\" (UID: \"937a2d20-9dbc-4762-9540-122a018f54a7\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-88hjh" Jul 14 11:34:06.702426 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:06.702162 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/937a2d20-9dbc-4762-9540-122a018f54a7-proc\") pod \"perf-node-gather-daemonset-88hjh\" (UID: \"937a2d20-9dbc-4762-9540-122a018f54a7\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-88hjh" Jul 14 11:34:06.702426 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:06.702168 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/937a2d20-9dbc-4762-9540-122a018f54a7-sys\") pod \"perf-node-gather-daemonset-88hjh\" (UID: \"937a2d20-9dbc-4762-9540-122a018f54a7\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-88hjh" Jul 14 11:34:06.702426 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:06.702308 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/937a2d20-9dbc-4762-9540-122a018f54a7-lib-modules\") pod \"perf-node-gather-daemonset-88hjh\" (UID: \"937a2d20-9dbc-4762-9540-122a018f54a7\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-88hjh" Jul 14 11:34:06.711019 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:06.710993 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzzdm\" (UniqueName: \"kubernetes.io/projected/937a2d20-9dbc-4762-9540-122a018f54a7-kube-api-access-lzzdm\") pod \"perf-node-gather-daemonset-88hjh\" (UID: \"937a2d20-9dbc-4762-9540-122a018f54a7\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-88hjh" Jul 14 11:34:06.777148 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:06.777061 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-88hjh" Jul 14 11:34:06.925712 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:06.925686 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-82fbt/perf-node-gather-daemonset-88hjh"] Jul 14 11:34:06.927519 ip-10-0-141-138 kubenswrapper[2580]: W0714 11:34:06.927488 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod937a2d20_9dbc_4762_9540_122a018f54a7.slice/crio-7ff5036bede986576087e6146d681e8391e8c911223610402b11be23d3036e91 WatchSource:0}: Error finding container 7ff5036bede986576087e6146d681e8391e8c911223610402b11be23d3036e91: Status 404 returned error can't find the container with id 7ff5036bede986576087e6146d681e8391e8c911223610402b11be23d3036e91 Jul 14 11:34:07.754979 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:07.754944 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-88hjh" event={"ID":"937a2d20-9dbc-4762-9540-122a018f54a7","Type":"ContainerStarted","Data":"e4f7557cfc4fd96f700b8e896cf577f68ff9f2184678ae3390fac6cec8e141d6"} Jul 14 11:34:07.755403 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:07.755027 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-88hjh" event={"ID":"937a2d20-9dbc-4762-9540-122a018f54a7","Type":"ContainerStarted","Data":"7ff5036bede986576087e6146d681e8391e8c911223610402b11be23d3036e91"} Jul 14 11:34:07.755403 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:07.755051 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-88hjh" Jul 14 11:34:07.771603 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:07.771547 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-88hjh" podStartSLOduration=1.7715332190000002 podStartE2EDuration="1.771533219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:34:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:34:07.770966133 +0000 UTC m=+1364.085099670" watchObservedRunningTime="2026-07-14 11:34:07.771533219 +0000 UTC m=+1364.085666738" Jul 14 11:34:08.424831 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:08.424796 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-2l4r2_ffbc77d0-d4c1-4960-8f18-1ac89ceb8716/download-server/0.log" Jul 14 11:34:10.258165 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:10.258130 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6jzwh_ff56a558-60cb-416a-b1cd-9da387c9c905/dns/0.log" Jul 14 11:34:10.288926 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:10.288896 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6jzwh_ff56a558-60cb-416a-b1cd-9da387c9c905/kube-rbac-proxy/0.log" Jul 14 11:34:10.566574 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:10.566502 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s6hzg_e4b66bf7-506a-4e2e-bcca-3b29f9b7b5df/dns-node-resolver/0.log" Jul 14 11:34:11.304487 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:11.304459 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-79c7894f4b-hcwhw_a07dccb5-cb2d-44dc-91bf-43e0187e5fe8/registry/0.log" Jul 14 11:34:11.348596 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:11.348567 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hvb4s_c9729993-471c-42e3-8723-7c1982f23e0a/node-ca/0.log" Jul 14 11:34:12.583852 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:12.583822 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-44kkf_ac9ad772-d85f-476c-8f57-1209c56e960f/discovery/0.log" Jul 14 11:34:12.715283 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:12.715252 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-bc5dh_81fb40fe-f6ba-423c-9146-768e653e7167/payload-pre-processing/0.log" Jul 14 11:34:12.741168 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:12.741135 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-csbtc_f90ea259-c602-49b1-97a3-9d0d9c44b3f8/payload-processing/0.log" Jul 14 11:34:13.485517 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:13.485480 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m7wqs_b6473f89-ff70-4b55-9c7c-b19f4e27e564/serve-healthcheck-canary/0.log" Jul 14 11:34:13.770156 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:13.770080 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-88hjh" Jul 14 11:34:14.103192 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:14.103165 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-76l9d_31faf0e2-46a2-4e11-a48d-ec2afc6130cd/kube-rbac-proxy/0.log" Jul 14 11:34:14.127093 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:14.127070 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-76l9d_31faf0e2-46a2-4e11-a48d-ec2afc6130cd/exporter/0.log" Jul 14 11:34:14.149892 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:14.149869 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-76l9d_31faf0e2-46a2-4e11-a48d-ec2afc6130cd/extractor/0.log" Jul 14 11:34:17.338872 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:17.338845 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-686f4d7c89-28r76_c892cfc8-bd35-40c7-a560-d399f6e5ac43/manager/0.log" Jul 14 11:34:17.637084 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:17.637054 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bf58df976-fpg6h_c4093ae8-8fd7-474d-a5b7-626a6f494217/manager/0.log" Jul 14 11:34:17.663321 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:17.663301 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bf58df976-fpg6h_c4093ae8-8fd7-474d-a5b7-626a6f494217/copy-manifests/0.log" Jul 14 11:34:17.791964 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:17.791918 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-44kkf_ac9ad772-d85f-476c-8f57-1209c56e960f/discovery/0.log" Jul 14 11:34:17.881717 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:17.881690 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-bc5dh_81fb40fe-f6ba-423c-9146-768e653e7167/payload-pre-processing/0.log" Jul 14 11:34:17.902530 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:17.902459 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-csbtc_f90ea259-c602-49b1-97a3-9d0d9c44b3f8/payload-processing/0.log" Jul 14 11:34:19.088121 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:19.088087 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-749d85bc9c-lxxvx_87043478-781c-4980-8702-af33bf291180/manager/0.log" Jul 14 11:34:19.105206 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:19.105179 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-44kkf_ac9ad772-d85f-476c-8f57-1209c56e960f/discovery/0.log" Jul 14 11:34:19.193064 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:19.193035 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-bc5dh_81fb40fe-f6ba-423c-9146-768e653e7167/payload-pre-processing/0.log" Jul 14 11:34:19.210073 ip-10-0-141-138 kubenswrapper[2580]: I0714 11:34:19.210048 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-csbtc_f90ea259-c602-49b1-97a3-9d0d9c44b3f8/payload-processing/0.log"