Jul 27 20:34:22.134864 ip-10-0-130-119 systemd[1]: Starting Kubernetes Kubelet... Jul 27 20:34:22.497583 ip-10-0-130-119 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 20:34:22.497583 ip-10-0-130-119 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 27 20:34:22.497583 ip-10-0-130-119 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 20:34:22.497583 ip-10-0-130-119 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 27 20:34:22.497583 ip-10-0-130-119 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 20:34:22.502599 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.502483 2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 27 20:34:22.506589 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506572 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 20:34:22.506589 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506590 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 20:34:22.506661 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506594 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 20:34:22.506661 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506598 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 20:34:22.506661 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506601 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 20:34:22.506661 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506609 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 20:34:22.506661 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506614 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 20:34:22.506661 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506617 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 20:34:22.506661 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506620 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 20:34:22.506661 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506623 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 20:34:22.506661 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506626 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 20:34:22.506661 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506628 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 20:34:22.506661 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506631 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 20:34:22.506661 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506634 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 20:34:22.506661 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506636 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 20:34:22.506661 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506639 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 20:34:22.506661 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506644 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 20:34:22.506661 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506647 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 27 20:34:22.506661 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506650 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 20:34:22.506661 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506652 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 20:34:22.506661 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506655 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 20:34:22.507110 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506657 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 20:34:22.507110 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506660 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 20:34:22.507110 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506663 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 20:34:22.507110 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506665 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 20:34:22.507110 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506668 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 20:34:22.507110 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506671 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 20:34:22.507110 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506673 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 20:34:22.507110 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506676 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 20:34:22.507110 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506678 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 20:34:22.507110 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506681 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 20:34:22.507110 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506683 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 20:34:22.507110 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506686 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 20:34:22.507110 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506689 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 20:34:22.507110 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506691 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 20:34:22.507110 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506693 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 20:34:22.507110 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506696 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 20:34:22.507110 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506698 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 20:34:22.507110 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506701 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 20:34:22.507110 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506703 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 20:34:22.507110 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506705 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 20:34:22.507717 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506709 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 20:34:22.507717 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506713 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 20:34:22.507717 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506717 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 20:34:22.507717 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506720 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 20:34:22.507717 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506723 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 20:34:22.507717 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506727 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 20:34:22.507717 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506730 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 20:34:22.507717 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506733 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 20:34:22.507717 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506735 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 20:34:22.507717 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506738 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 20:34:22.507717 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506740 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 20:34:22.507717 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506743 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 20:34:22.507717 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506746 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 20:34:22.507717 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506750 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 20:34:22.507717 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506752 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 20:34:22.507717 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506755 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 20:34:22.507717 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506757 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 20:34:22.507717 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506760 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 20:34:22.507717 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506763 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 20:34:22.508198 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506765 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 20:34:22.508198 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506767 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 20:34:22.508198 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506770 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 20:34:22.508198 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506773 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 20:34:22.508198 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506775 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 20:34:22.508198 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506778 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 20:34:22.508198 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506781 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 20:34:22.508198 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506783 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 20:34:22.508198 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506786 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 20:34:22.508198 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506788 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 20:34:22.508198 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506791 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 20:34:22.508198 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506793 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 20:34:22.508198 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506796 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 20:34:22.508198 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506798 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 20:34:22.508198 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506801 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 20:34:22.508198 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506803 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 20:34:22.508198 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506805 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 20:34:22.508198 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506808 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 20:34:22.508198 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506810 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 20:34:22.508198 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506812 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 20:34:22.508688 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506816 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 20:34:22.508688 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506819 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 20:34:22.508688 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506821 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 20:34:22.508688 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506824 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 20:34:22.508688 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506826 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 20:34:22.508688 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506829 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 20:34:22.508688 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506833 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 20:34:22.508688 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506835 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 20:34:22.508688 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506838 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 20:34:22.508688 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506840 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 20:34:22.508688 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506843 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 20:34:22.508688 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506845 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 20:34:22.508688 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506847 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 20:34:22.508688 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506850 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 20:34:22.508688 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506852 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 20:34:22.508688 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506854 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 20:34:22.508688 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506857 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 20:34:22.508688 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506860 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 20:34:22.508688 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.506862 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 20:34:22.508688 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507587 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 20:34:22.509179 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507595 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 20:34:22.509179 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507599 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 20:34:22.509179 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507602 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 20:34:22.509179 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507604 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 20:34:22.509179 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507607 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 20:34:22.509179 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507609 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 20:34:22.509179 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507612 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 20:34:22.509179 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507614 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 20:34:22.509179 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507617 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 20:34:22.509179 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507620 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 20:34:22.509179 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507622 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 20:34:22.509179 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507625 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 20:34:22.509179 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507628 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 20:34:22.509179 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507631 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 20:34:22.509179 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507633 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 20:34:22.509179 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507636 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 20:34:22.509179 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507639 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 20:34:22.509179 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507644 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 20:34:22.509179 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507648 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 20:34:22.509179 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507652 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 20:34:22.509703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507654 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 20:34:22.509703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507657 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 20:34:22.509703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507660 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 20:34:22.509703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507663 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 20:34:22.509703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507665 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 20:34:22.509703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507668 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 20:34:22.509703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507671 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 20:34:22.509703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507673 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 20:34:22.509703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507676 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 20:34:22.509703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507679 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 20:34:22.509703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507681 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 27 20:34:22.509703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507684 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 20:34:22.509703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507686 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 20:34:22.509703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507689 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 20:34:22.509703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507691 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 20:34:22.509703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507694 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 20:34:22.509703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507696 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 20:34:22.509703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507699 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 20:34:22.509703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507701 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 20:34:22.509703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507703 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 20:34:22.510193 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507707 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 20:34:22.510193 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507710 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 20:34:22.510193 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507712 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 20:34:22.510193 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507715 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 20:34:22.510193 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507718 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 20:34:22.510193 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507720 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 20:34:22.510193 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507724 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 20:34:22.510193 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507726 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 20:34:22.510193 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507729 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 20:34:22.510193 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507732 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 20:34:22.510193 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507735 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 20:34:22.510193 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507738 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 20:34:22.510193 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507741 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 20:34:22.510193 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507743 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 20:34:22.510193 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507746 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 20:34:22.510193 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507748 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 20:34:22.510193 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507751 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 20:34:22.510193 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507753 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 20:34:22.510193 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507755 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 20:34:22.510193 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507758 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 20:34:22.510713 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507761 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 20:34:22.510713 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507764 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 20:34:22.510713 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507768 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 20:34:22.510713 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507771 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 20:34:22.510713 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507774 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 20:34:22.510713 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507776 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 20:34:22.510713 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507779 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 20:34:22.510713 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507781 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 20:34:22.510713 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507784 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 20:34:22.510713 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507786 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 20:34:22.510713 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507790 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 20:34:22.510713 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507793 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 20:34:22.510713 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507795 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 20:34:22.510713 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507798 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 20:34:22.510713 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507800 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 20:34:22.510713 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507803 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 20:34:22.510713 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507805 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 20:34:22.510713 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507808 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 20:34:22.510713 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507810 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 20:34:22.511173 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507817 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 20:34:22.511173 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507820 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 20:34:22.511173 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507824 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 20:34:22.511173 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507826 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 20:34:22.511173 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507829 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 20:34:22.511173 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507831 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 20:34:22.511173 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507834 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 20:34:22.511173 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507836 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 20:34:22.511173 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507839 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 20:34:22.511173 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507841 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 20:34:22.511173 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507844 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 20:34:22.511173 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507846 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 20:34:22.511173 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507848 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 20:34:22.511173 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507851 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 20:34:22.511173 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507853 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 20:34:22.511173 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507856 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 20:34:22.511173 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507858 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 20:34:22.511173 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507861 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 20:34:22.511173 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.507863 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 20:34:22.511173 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508247 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 20:34:22.511708 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508252 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 20:34:22.511708 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508255 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 20:34:22.511708 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508258 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 20:34:22.511708 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508261 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 20:34:22.511708 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508263 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 20:34:22.511708 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508266 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 20:34:22.511708 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508268 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 20:34:22.511708 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508271 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 20:34:22.511708 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508273 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 20:34:22.511708 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508276 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 20:34:22.511708 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508279 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 20:34:22.511708 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508281 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 20:34:22.511708 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508284 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 20:34:22.511708 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508287 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 20:34:22.511708 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508290 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 20:34:22.511708 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508292 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 20:34:22.511708 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508295 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 20:34:22.511708 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508298 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 20:34:22.511708 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508300 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 20:34:22.512169 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508303 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 20:34:22.512169 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508306 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 20:34:22.512169 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508308 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 20:34:22.512169 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508312 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 20:34:22.512169 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508316 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 20:34:22.512169 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508319 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 20:34:22.512169 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508322 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 20:34:22.512169 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508324 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 20:34:22.512169 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508327 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 20:34:22.512169 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508330 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 20:34:22.512169 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508333 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 20:34:22.512169 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508335 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 20:34:22.512169 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508338 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 20:34:22.512169 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508340 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 20:34:22.512169 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508343 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 20:34:22.512169 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508347 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 20:34:22.512169 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508350 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 20:34:22.512169 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508353 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 20:34:22.512169 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508356 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 20:34:22.512647 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508358 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 20:34:22.512647 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508360 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 20:34:22.512647 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508363 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 20:34:22.512647 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508365 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 20:34:22.512647 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508367 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 20:34:22.512647 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508370 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 20:34:22.512647 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508372 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 20:34:22.512647 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508378 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 20:34:22.512647 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508381 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 20:34:22.512647 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508383 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 20:34:22.512647 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508386 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 20:34:22.512647 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508388 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 20:34:22.512647 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508391 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 20:34:22.512647 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508394 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 20:34:22.512647 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508396 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 20:34:22.512647 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508399 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 20:34:22.512647 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508401 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 20:34:22.512647 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508403 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 20:34:22.512647 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508406 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 20:34:22.512647 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508408 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 20:34:22.513163 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508411 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 20:34:22.513163 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508414 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 20:34:22.513163 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508417 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 20:34:22.513163 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508420 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 20:34:22.513163 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508422 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 20:34:22.513163 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508425 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 20:34:22.513163 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508427 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 20:34:22.513163 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508430 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 20:34:22.513163 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508432 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 20:34:22.513163 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508435 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 20:34:22.513163 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508437 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 20:34:22.513163 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508440 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 20:34:22.513163 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508442 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 20:34:22.513163 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508444 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 20:34:22.513163 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508447 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 20:34:22.513163 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508449 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 20:34:22.513163 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508452 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 20:34:22.513163 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508454 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 20:34:22.513163 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508458 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 20:34:22.513163 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508462 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 20:34:22.513670 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508466 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 20:34:22.513670 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508469 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 20:34:22.513670 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508471 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 20:34:22.513670 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508474 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 20:34:22.513670 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508477 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 20:34:22.513670 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508480 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 27 20:34:22.513670 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508482 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 20:34:22.513670 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508485 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 20:34:22.513670 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508487 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 20:34:22.513670 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508490 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 20:34:22.513670 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508492 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 20:34:22.513670 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508494 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 20:34:22.513670 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508497 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 20:34:22.513670 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508499 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 20:34:22.513670 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508502 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 20:34:22.513670 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508504 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 20:34:22.513670 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508507 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 20:34:22.513670 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508509 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 20:34:22.513670 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508512 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 20:34:22.513670 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.508514 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 20:34:22.514162 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508605 2554 flags.go:64] FLAG: --address="0.0.0.0" Jul 27 20:34:22.514162 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508621 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 27 20:34:22.514162 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508627 2554 flags.go:64] FLAG: --anonymous-auth="true" Jul 27 20:34:22.514162 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508632 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 27 20:34:22.514162 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508636 2554 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 27 20:34:22.514162 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508640 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 27 20:34:22.514162 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508644 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 27 20:34:22.514162 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508648 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 27 20:34:22.514162 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508651 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 27 20:34:22.514162 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508655 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 27 20:34:22.514162 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508658 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 27 20:34:22.514162 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508662 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 27 20:34:22.514162 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508666 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 27 20:34:22.514162 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508669 2554 flags.go:64] FLAG: --cgroup-root="" Jul 27 20:34:22.514162 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508672 2554 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 27 20:34:22.514162 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508675 2554 flags.go:64] FLAG: --client-ca-file="" Jul 27 20:34:22.514162 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508678 2554 flags.go:64] FLAG: --cloud-provider="external" Jul 27 20:34:22.514162 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508681 2554 flags.go:64] FLAG: --cluster-dns="[]" Jul 27 20:34:22.514162 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508685 2554 flags.go:64] FLAG: --cluster-domain="" Jul 27 20:34:22.514162 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508688 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 27 20:34:22.514162 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508691 2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 27 20:34:22.514162 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508694 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 27 20:34:22.514162 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508698 2554 flags.go:64] FLAG: --container-log-max-files="5" Jul 27 20:34:22.514162 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508720 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 27 20:34:22.514785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508723 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 27 20:34:22.514785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508726 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 27 20:34:22.514785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508729 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 27 20:34:22.514785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508732 2554 flags.go:64] FLAG: --contention-profiling="false" Jul 27 20:34:22.514785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508735 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 27 20:34:22.514785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508737 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 27 20:34:22.514785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508740 2554 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 27 20:34:22.514785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508743 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 27 20:34:22.514785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508747 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 27 20:34:22.514785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508750 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 27 20:34:22.514785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508753 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 27 20:34:22.514785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508755 2554 flags.go:64] FLAG: --enable-load-reader="false" Jul 27 20:34:22.514785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508758 2554 flags.go:64] FLAG: --enable-server="true" Jul 27 20:34:22.514785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508761 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 27 20:34:22.514785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508765 2554 flags.go:64] FLAG: --event-burst="100" Jul 27 20:34:22.514785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508768 2554 flags.go:64] FLAG: --event-qps="50" Jul 27 20:34:22.514785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508771 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 27 20:34:22.514785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508774 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 27 20:34:22.514785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508776 2554 flags.go:64] FLAG: --eviction-hard="" Jul 27 20:34:22.514785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508781 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 27 20:34:22.514785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508785 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 27 20:34:22.514785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508788 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 27 20:34:22.514785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508792 2554 flags.go:64] FLAG: --eviction-soft="" Jul 27 20:34:22.514785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508795 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 27 20:34:22.514785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508798 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 27 20:34:22.515445 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508801 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 27 20:34:22.515445 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508803 2554 flags.go:64] FLAG: --experimental-mounter-path="" Jul 27 20:34:22.515445 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508806 2554 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 27 20:34:22.515445 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508809 2554 flags.go:64] FLAG: --fail-swap-on="true" Jul 27 20:34:22.515445 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508811 2554 flags.go:64] FLAG: --feature-gates="" Jul 27 20:34:22.515445 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508815 2554 flags.go:64] FLAG: --file-check-frequency="20s" Jul 27 20:34:22.515445 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508818 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 27 20:34:22.515445 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508820 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 27 20:34:22.515445 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508823 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 27 20:34:22.515445 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508826 2554 flags.go:64] FLAG: --healthz-port="10248" Jul 27 20:34:22.515445 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508829 2554 flags.go:64] FLAG: --help="false" Jul 27 20:34:22.515445 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508831 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-130-119.ec2.internal" Jul 27 20:34:22.515445 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508834 2554 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 27 20:34:22.515445 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508837 2554 flags.go:64] FLAG: --http-check-frequency="20s" Jul 27 20:34:22.515445 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508840 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 27 20:34:22.515445 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508843 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 27 20:34:22.515445 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508846 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 27 20:34:22.515445 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508848 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 27 20:34:22.515445 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508851 2554 flags.go:64] FLAG: --image-service-endpoint="" Jul 27 20:34:22.515445 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508853 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 27 20:34:22.515445 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508856 2554 flags.go:64] FLAG: --kube-api-burst="100" Jul 27 20:34:22.515445 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508859 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 27 20:34:22.515445 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508862 2554 flags.go:64] FLAG: --kube-api-qps="50" Jul 27 20:34:22.515445 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508864 2554 flags.go:64] FLAG: --kube-reserved="" Jul 27 20:34:22.516059 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508867 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 27 20:34:22.516059 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508870 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 27 20:34:22.516059 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508873 2554 flags.go:64] FLAG: --kubelet-cgroups="" Jul 27 20:34:22.516059 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508877 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 27 20:34:22.516059 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508880 2554 flags.go:64] FLAG: --lock-file="" Jul 27 20:34:22.516059 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508883 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 27 20:34:22.516059 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508886 2554 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 27 20:34:22.516059 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508889 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 27 20:34:22.516059 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508894 2554 flags.go:64] FLAG: --log-json-split-stream="false" Jul 27 20:34:22.516059 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508897 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 27 20:34:22.516059 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508900 2554 flags.go:64] FLAG: --log-text-split-stream="false" Jul 27 20:34:22.516059 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508903 2554 flags.go:64] FLAG: --logging-format="text" Jul 27 20:34:22.516059 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508905 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 27 20:34:22.516059 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508909 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 27 20:34:22.516059 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508911 2554 flags.go:64] FLAG: --manifest-url="" Jul 27 20:34:22.516059 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508914 2554 flags.go:64] FLAG: --manifest-url-header="" Jul 27 20:34:22.516059 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508919 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 27 20:34:22.516059 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508922 2554 flags.go:64] FLAG: --max-open-files="1000000" Jul 27 20:34:22.516059 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508925 2554 flags.go:64] FLAG: --max-pods="110" Jul 27 20:34:22.516059 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508928 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 27 20:34:22.516059 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508931 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 27 20:34:22.516059 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508934 2554 flags.go:64] FLAG: --memory-manager-policy="None" Jul 27 20:34:22.516059 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508937 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 27 20:34:22.516059 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508939 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 27 20:34:22.516059 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508942 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 27 20:34:22.516681 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508945 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 27 20:34:22.516681 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508953 2554 flags.go:64] FLAG: --node-status-max-images="50" Jul 27 20:34:22.516681 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508956 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 27 20:34:22.516681 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508959 2554 flags.go:64] FLAG: --oom-score-adj="-999" Jul 27 20:34:22.516681 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508962 2554 flags.go:64] FLAG: --pod-cidr="" Jul 27 20:34:22.516681 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508964 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 27 20:34:22.516681 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508971 2554 flags.go:64] FLAG: --pod-manifest-path="" Jul 27 20:34:22.516681 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508973 2554 flags.go:64] FLAG: --pod-max-pids="-1" Jul 27 20:34:22.516681 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508977 2554 flags.go:64] FLAG: --pods-per-core="0" Jul 27 20:34:22.516681 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508979 2554 flags.go:64] FLAG: --port="10250" Jul 27 20:34:22.516681 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508984 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 27 20:34:22.516681 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508987 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02c5b0559dd365ac5" Jul 27 20:34:22.516681 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508990 2554 flags.go:64] FLAG: --qos-reserved="" Jul 27 20:34:22.516681 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508993 2554 flags.go:64] FLAG: --read-only-port="10255" Jul 27 20:34:22.516681 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508997 2554 flags.go:64] FLAG: --register-node="true" Jul 27 20:34:22.516681 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.508999 2554 flags.go:64] FLAG: --register-with-taints="" Jul 27 20:34:22.516681 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509003 2554 flags.go:64] FLAG: --registry-burst="10" Jul 27 20:34:22.516681 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509006 2554 flags.go:64] FLAG: --registry-qps="5" Jul 27 20:34:22.516681 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509008 2554 flags.go:64] FLAG: --reserved-cpus="" Jul 27 20:34:22.516681 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509011 2554 flags.go:64] FLAG: --reserved-memory="" Jul 27 20:34:22.516681 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509014 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 27 20:34:22.516681 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509017 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 27 20:34:22.516681 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509020 2554 flags.go:64] FLAG: --rotate-certificates="false" Jul 27 20:34:22.516681 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509023 2554 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 27 20:34:22.516681 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509025 2554 flags.go:64] FLAG: --runonce="false" Jul 27 20:34:22.517293 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509028 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 27 20:34:22.517293 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509031 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 27 20:34:22.517293 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509034 2554 flags.go:64] FLAG: --seccomp-default="false" Jul 27 20:34:22.517293 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509036 2554 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 27 20:34:22.517293 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509040 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 27 20:34:22.517293 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509042 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 27 20:34:22.517293 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509045 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 27 20:34:22.517293 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509048 2554 flags.go:64] FLAG: --storage-driver-password="root" Jul 27 20:34:22.517293 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509051 2554 flags.go:64] FLAG: --storage-driver-secure="false" Jul 27 20:34:22.517293 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509054 2554 flags.go:64] FLAG: --storage-driver-table="stats" Jul 27 20:34:22.517293 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509056 2554 flags.go:64] FLAG: --storage-driver-user="root" Jul 27 20:34:22.517293 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509059 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 27 20:34:22.517293 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509062 2554 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 27 20:34:22.517293 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509064 2554 flags.go:64] FLAG: --system-cgroups="" Jul 27 20:34:22.517293 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509067 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 27 20:34:22.517293 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509072 2554 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 27 20:34:22.517293 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509075 2554 flags.go:64] FLAG: --tls-cert-file="" Jul 27 20:34:22.517293 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509079 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 27 20:34:22.517293 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509083 2554 flags.go:64] FLAG: --tls-min-version="" Jul 27 20:34:22.517293 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509086 2554 flags.go:64] FLAG: --tls-private-key-file="" Jul 27 20:34:22.517293 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509088 2554 flags.go:64] FLAG: --topology-manager-policy="none" Jul 27 20:34:22.517293 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509091 2554 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 27 20:34:22.517293 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509094 2554 flags.go:64] FLAG: --topology-manager-scope="container" Jul 27 20:34:22.517293 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509097 2554 flags.go:64] FLAG: --v="2" Jul 27 20:34:22.517293 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509101 2554 flags.go:64] FLAG: --version="false" Jul 27 20:34:22.517988 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509105 2554 flags.go:64] FLAG: --vmodule="" Jul 27 20:34:22.517988 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509108 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 27 20:34:22.517988 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509111 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 27 20:34:22.517988 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509227 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 27 20:34:22.517988 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509231 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 20:34:22.517988 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509235 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 20:34:22.517988 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509238 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 20:34:22.517988 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509241 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 20:34:22.517988 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509244 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 20:34:22.517988 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509246 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 20:34:22.517988 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509249 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 20:34:22.517988 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509251 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 20:34:22.517988 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509254 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 20:34:22.517988 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509256 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 20:34:22.517988 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509259 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 20:34:22.517988 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509261 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 20:34:22.517988 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509264 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 20:34:22.517988 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509266 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 20:34:22.517988 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509269 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 20:34:22.517988 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509271 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 20:34:22.518542 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509273 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 20:34:22.518542 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509276 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 20:34:22.518542 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509278 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 20:34:22.518542 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509280 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 20:34:22.518542 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509286 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 20:34:22.518542 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509289 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 20:34:22.518542 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509292 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 20:34:22.518542 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509294 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 20:34:22.518542 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509297 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 20:34:22.518542 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509299 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 20:34:22.518542 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509302 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 20:34:22.518542 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509305 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 20:34:22.518542 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509308 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 20:34:22.518542 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509310 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 20:34:22.518542 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509313 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 20:34:22.518542 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509315 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 20:34:22.518542 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509318 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 20:34:22.518542 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509320 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 20:34:22.518542 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509324 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 20:34:22.519024 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509328 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 20:34:22.519024 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509330 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 20:34:22.519024 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509333 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 20:34:22.519024 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509336 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 20:34:22.519024 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509339 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 20:34:22.519024 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509341 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 20:34:22.519024 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509344 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 20:34:22.519024 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509346 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 20:34:22.519024 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509349 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 20:34:22.519024 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509351 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 20:34:22.519024 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509355 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 20:34:22.519024 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509358 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 20:34:22.519024 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509361 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 20:34:22.519024 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509363 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 20:34:22.519024 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509366 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 20:34:22.519024 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509368 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 20:34:22.519024 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509371 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 20:34:22.519024 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509377 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 20:34:22.519024 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509380 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 20:34:22.519024 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509383 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 20:34:22.519592 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509386 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 20:34:22.519592 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509388 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 20:34:22.519592 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509391 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 20:34:22.519592 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509393 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 20:34:22.519592 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509397 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 20:34:22.519592 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509399 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 20:34:22.519592 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509402 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 20:34:22.519592 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509404 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 20:34:22.519592 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509406 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 20:34:22.519592 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509409 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 20:34:22.519592 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509411 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 20:34:22.519592 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509415 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 20:34:22.519592 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509417 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 20:34:22.519592 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509420 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 20:34:22.519592 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509422 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 20:34:22.519592 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509424 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 20:34:22.519592 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509427 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 20:34:22.519592 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509430 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 20:34:22.519592 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509432 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 20:34:22.519592 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509435 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 20:34:22.520097 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509437 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 20:34:22.520097 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509440 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 20:34:22.520097 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509443 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 20:34:22.520097 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509445 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 20:34:22.520097 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509447 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 20:34:22.520097 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509451 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 20:34:22.520097 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509454 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 20:34:22.520097 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509457 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 20:34:22.520097 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509460 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 20:34:22.520097 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509464 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 20:34:22.520097 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509467 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 20:34:22.520097 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509469 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 20:34:22.520097 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509472 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 20:34:22.520097 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509474 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 20:34:22.520097 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509477 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 20:34:22.520097 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509480 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 20:34:22.520097 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509482 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 20:34:22.520097 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509485 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 20:34:22.520097 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509487 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 20:34:22.520683 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509490 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 20:34:22.520683 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509492 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 20:34:22.520683 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509495 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 20:34:22.520683 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.509497 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 20:34:22.520683 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.509503 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 20:34:22.520683 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.516322 2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 27 20:34:22.520683 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.516338 2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 27 20:34:22.520683 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.516356 2554 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 27 20:34:22.520683 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.516366 2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 27 20:34:22.520683 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516422 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 20:34:22.520683 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516428 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 20:34:22.520683 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516431 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 20:34:22.520683 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516434 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 20:34:22.520683 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516437 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 20:34:22.521096 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516439 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 20:34:22.521096 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516442 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 20:34:22.521096 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516445 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 20:34:22.521096 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516449 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 20:34:22.521096 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516451 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 20:34:22.521096 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516454 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 20:34:22.521096 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516456 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 20:34:22.521096 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516459 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 20:34:22.521096 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516462 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 20:34:22.521096 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516464 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 20:34:22.521096 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516468 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 20:34:22.521096 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516472 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 20:34:22.521096 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516475 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 20:34:22.521096 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516478 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 20:34:22.521096 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516480 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 20:34:22.521096 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516483 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 20:34:22.521096 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516485 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 20:34:22.521096 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516488 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 20:34:22.521096 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516490 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 20:34:22.521719 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516493 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 20:34:22.521719 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516495 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 20:34:22.521719 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516498 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 20:34:22.521719 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516500 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 20:34:22.521719 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516503 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 20:34:22.521719 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516507 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 20:34:22.521719 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516510 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 20:34:22.521719 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516513 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 20:34:22.521719 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516515 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 20:34:22.521719 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516533 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 20:34:22.521719 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516536 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 20:34:22.521719 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516538 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 20:34:22.521719 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516541 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 20:34:22.521719 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516544 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 20:34:22.521719 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516546 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 20:34:22.521719 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516549 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 20:34:22.521719 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516553 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 20:34:22.521719 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516557 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 20:34:22.521719 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516560 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 20:34:22.522630 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516563 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 20:34:22.522630 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516566 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 20:34:22.522630 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516569 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 20:34:22.522630 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516572 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 20:34:22.522630 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516575 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 20:34:22.522630 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516577 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 20:34:22.522630 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516580 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 20:34:22.522630 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516582 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 20:34:22.522630 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516584 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 20:34:22.522630 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516587 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 20:34:22.522630 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516589 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 20:34:22.522630 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516592 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 20:34:22.522630 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516594 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 20:34:22.522630 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516597 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 20:34:22.522630 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516599 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 20:34:22.522630 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516602 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 20:34:22.522630 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516604 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 20:34:22.522630 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516607 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 20:34:22.522630 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516609 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 20:34:22.522630 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516612 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 20:34:22.523178 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516615 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 20:34:22.523178 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516617 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 20:34:22.523178 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516620 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 20:34:22.523178 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516622 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 20:34:22.523178 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516625 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 20:34:22.523178 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516627 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 20:34:22.523178 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516630 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 20:34:22.523178 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516634 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 20:34:22.523178 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516637 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 20:34:22.523178 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516639 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 20:34:22.523178 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516642 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 20:34:22.523178 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516645 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 20:34:22.523178 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516647 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 20:34:22.523178 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516650 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 20:34:22.523178 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516652 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 20:34:22.523178 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516655 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 20:34:22.523178 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516657 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 20:34:22.523178 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516660 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 20:34:22.523178 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516662 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 20:34:22.523776 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516664 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 20:34:22.523776 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516667 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 20:34:22.523776 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516669 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 20:34:22.523776 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516672 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 20:34:22.523776 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516674 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 20:34:22.523776 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516677 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 20:34:22.523776 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516679 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 27 20:34:22.523776 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516682 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 20:34:22.523776 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516685 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 20:34:22.523776 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516688 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 20:34:22.523776 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516690 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 20:34:22.523776 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516693 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 20:34:22.523776 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516696 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 20:34:22.523776 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516699 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 20:34:22.523776 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516702 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 20:34:22.523776 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516705 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 20:34:22.523776 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516707 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 20:34:22.524341 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.516712 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 20:34:22.524341 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516831 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 20:34:22.524341 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516836 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 20:34:22.524341 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516839 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 20:34:22.524341 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516842 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 20:34:22.524341 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516845 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 20:34:22.524341 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516848 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 20:34:22.524341 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516851 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 20:34:22.524341 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516853 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 20:34:22.524341 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516856 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 20:34:22.524341 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516858 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 20:34:22.524341 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516861 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 20:34:22.524341 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516864 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 20:34:22.524341 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516867 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 20:34:22.524341 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516869 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 20:34:22.524752 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516872 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 20:34:22.524752 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516874 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 20:34:22.524752 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516877 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 20:34:22.524752 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516879 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 20:34:22.524752 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516882 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 20:34:22.524752 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516884 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 20:34:22.524752 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516888 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 20:34:22.524752 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516892 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 20:34:22.524752 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516894 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 20:34:22.524752 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516897 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 20:34:22.524752 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516899 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 20:34:22.524752 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516902 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 20:34:22.524752 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516905 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 20:34:22.524752 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516907 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 20:34:22.524752 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516910 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 20:34:22.524752 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516913 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 20:34:22.524752 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516916 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 20:34:22.524752 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516919 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 20:34:22.524752 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516921 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 20:34:22.524752 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516923 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 20:34:22.525256 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516926 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 20:34:22.525256 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516930 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 20:34:22.525256 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516933 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 20:34:22.525256 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516936 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 20:34:22.525256 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516939 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 20:34:22.525256 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516942 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 20:34:22.525256 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516945 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 20:34:22.525256 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516949 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 20:34:22.525256 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516952 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 20:34:22.525256 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516954 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 20:34:22.525256 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516957 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 20:34:22.525256 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516960 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 20:34:22.525256 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516962 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 20:34:22.525256 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516964 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 20:34:22.525256 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516967 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 20:34:22.525256 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516969 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 20:34:22.525256 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516972 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 20:34:22.525256 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516974 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 20:34:22.525703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516976 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 20:34:22.525703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516979 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 20:34:22.525703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516981 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 20:34:22.525703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516983 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 20:34:22.525703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516987 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 20:34:22.525703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516989 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 20:34:22.525703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516992 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 20:34:22.525703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516994 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 20:34:22.525703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.516996 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 20:34:22.525703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517000 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 20:34:22.525703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517002 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 20:34:22.525703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517004 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 20:34:22.525703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517006 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 20:34:22.525703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517009 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 20:34:22.525703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517011 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 20:34:22.525703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517014 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 20:34:22.525703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517016 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 20:34:22.525703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517018 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 20:34:22.525703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517021 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 20:34:22.525703 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517023 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 20:34:22.526254 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517025 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 20:34:22.526254 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517028 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 20:34:22.526254 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517030 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 20:34:22.526254 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517032 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 20:34:22.526254 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517034 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 20:34:22.526254 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517037 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 20:34:22.526254 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517039 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 20:34:22.526254 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517042 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 20:34:22.526254 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517044 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 20:34:22.526254 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517047 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 20:34:22.526254 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517049 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 20:34:22.526254 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517051 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 20:34:22.526254 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517054 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 20:34:22.526254 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517056 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 27 20:34:22.526254 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517059 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 20:34:22.526254 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517061 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 20:34:22.526254 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517068 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 20:34:22.526254 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517070 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 20:34:22.526254 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517073 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 20:34:22.526254 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517075 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 20:34:22.526836 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517078 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 20:34:22.526836 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517080 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 20:34:22.526836 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517083 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 20:34:22.526836 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517086 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 20:34:22.526836 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517088 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 20:34:22.526836 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517090 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 20:34:22.526836 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:22.517094 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 20:34:22.526836 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.517098 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 20:34:22.526836 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.517220 2554 server.go:962] "Client rotation is on, will bootstrap in background" Jul 27 20:34:22.526836 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.519141 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 27 20:34:22.526836 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.520352 2554 server.go:1019] "Starting client certificate rotation" Jul 27 20:34:22.526836 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.520469 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 20:34:22.526836 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.520535 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 20:34:22.526836 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.522404 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 20:34:22.527215 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.523552 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 20:34:22.533144 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.533121 2554 log.go:25] "Validated CRI v1 runtime API" Jul 27 20:34:22.535098 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.535080 2554 log.go:25] "Validated CRI v1 image API" Jul 27 20:34:22.538548 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.538528 2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 27 20:34:22.540958 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.540931 2554 fs.go:135] Filesystem UUIDs: map[1dcc85df-9926-4d01-88cb-9450863145b3:/dev/nvme0n1p4 5db76e64-83f0-4426-a03a-4af5d21f85e9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 27 20:34:22.541005 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.540959 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 27 20:34:22.546871 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.546762 2554 manager.go:216] Machine: {Timestamp:2026-07-27 20:34:22.545330439 +0000 UTC m=+0.298574762 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099839 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2828e62935014daee01d10668e5a38 SystemUUID:ec2828e6-2935-014d-aee0-1d10668e5a38 BootID:31d1b645-7431-4c55-8baa-52a1dcaef0c2 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ca:d8:c6:7e:db Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ca:d8:c6:7e:db Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:ec:42:b7:5c:ad Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 27 20:34:22.546871 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.546870 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 27 20:34:22.546978 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.546958 2554 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 27 20:34:22.550845 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.550811 2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 27 20:34:22.550996 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.550848 2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-119.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 27 20:34:22.552041 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.552026 2554 topology_manager.go:138] "Creating topology manager with none policy" Jul 27 20:34:22.552080 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.552044 2554 container_manager_linux.go:309] "Creating device plugin manager" Jul 27 20:34:22.552080 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.552057 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 20:34:22.552675 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.552661 2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 20:34:22.553426 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.553415 2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 27 20:34:22.554548 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.554510 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 20:34:22.556060 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.556048 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 27 20:34:22.556188 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.556178 2554 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 27 20:34:22.556225 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.556210 2554 kubelet.go:486] "Attempting to sync node with API server" Jul 27 20:34:22.556253 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.556225 2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 27 20:34:22.556253 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.556251 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 27 20:34:22.556304 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.556265 2554 kubelet.go:398] "Adding apiserver pod source" Jul 27 20:34:22.556304 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.556286 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 27 20:34:22.556752 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.556739 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 20:34:22.556797 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.556758 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 20:34:22.559943 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.559927 2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 27 20:34:22.561630 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.561617 2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 27 20:34:22.561676 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.561648 2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 27 20:34:22.562991 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.562979 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 27 20:34:22.563026 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.562997 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 27 20:34:22.563026 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.563004 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 27 20:34:22.563026 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.563012 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 27 20:34:22.563103 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.563035 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 27 20:34:22.563103 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.563042 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 27 20:34:22.563103 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.563050 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 27 20:34:22.563103 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.563055 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 27 20:34:22.563103 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.563061 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 27 20:34:22.563103 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.563067 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 27 20:34:22.563103 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.563076 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 27 20:34:22.563103 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.563081 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 27 20:34:22.563724 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.563712 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 27 20:34:22.563761 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.563726 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 27 20:34:22.567114 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.567088 2554 server.go:1268] "Started kubelet" Jul 27 20:34:22.567219 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.567183 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 27 20:34:22.567366 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.567319 2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 27 20:34:22.567458 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.567387 2554 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 27 20:34:22.568408 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.568390 2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-119.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 27 20:34:22.568642 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:22.568615 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-119.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 27 20:34:22.568642 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:22.568646 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 27 20:34:22.568896 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.568877 2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 27 20:34:22.568894 ip-10-0-130-119 systemd[1]: Started Kubernetes Kubelet. Jul 27 20:34:22.569683 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.569669 2554 server.go:310] "Adding debug handlers to kubelet server" Jul 27 20:34:22.572732 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:22.572713 2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 27 20:34:22.575076 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.575060 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 27 20:34:22.575147 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.575061 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 27 20:34:22.578219 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:22.574712 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-119.ec2.internal.18c63fcf75db275b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-119.ec2.internal,UID:ip-10-0-130-119.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-119.ec2.internal,},FirstTimestamp:2026-07-27 20:34:22.567057243 +0000 UTC m=+0.320301564,LastTimestamp:2026-07-27 20:34:22.567057243 +0000 UTC m=+0.320301564,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-119.ec2.internal,}" Jul 27 20:34:22.578777 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:22.578748 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-119.ec2.internal\" not found" Jul 27 20:34:22.579584 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.579565 2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 27 20:34:22.579957 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.579939 2554 factory.go:153] Registering CRI-O factory Jul 27 20:34:22.580022 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.579963 2554 factory.go:223] Registration of the crio container factory successfully Jul 27 20:34:22.580022 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.580012 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 27 20:34:22.580022 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.580014 2554 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 27 20:34:22.580022 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.580020 2554 factory.go:55] Registering systemd factory Jul 27 20:34:22.580188 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.580028 2554 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 27 20:34:22.580188 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.580034 2554 factory.go:223] Registration of the systemd container factory successfully Jul 27 20:34:22.580188 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.580061 2554 factory.go:103] Registering Raw factory Jul 27 20:34:22.580188 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.580076 2554 manager.go:1196] Started watching for new ooms in manager Jul 27 20:34:22.580367 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.580230 2554 reconstruct.go:97] "Volume reconstruction finished" Jul 27 20:34:22.580367 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.580239 2554 reconciler.go:29] "Reconciler: start to sync state" Jul 27 20:34:22.580804 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.580786 2554 manager.go:349] Starting recovery of all containers Jul 27 20:34:22.586060 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:22.586030 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 27 20:34:22.586060 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:22.586012 2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-119.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 27 20:34:22.591146 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.590967 2554 manager.go:354] Recovery completed Jul 27 20:34:22.596464 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.596449 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 20:34:22.598549 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.598499 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientMemory" Jul 27 20:34:22.598649 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.598565 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 20:34:22.598649 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.598578 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientPID" Jul 27 20:34:22.599192 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.599176 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 27 20:34:22.599192 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.599188 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 27 20:34:22.599309 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.599204 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 27 20:34:22.599309 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.599191 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 20:34:22.600363 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.600344 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientMemory" Jul 27 20:34:22.600406 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.600379 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 20:34:22.600406 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.600394 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientPID" Jul 27 20:34:22.600824 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:22.600756 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-119.ec2.internal.18c63fcf77bbae61 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-119.ec2.internal,UID:ip-10-0-130-119.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-119.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-119.ec2.internal,},FirstTimestamp:2026-07-27 20:34:22.598549089 +0000 UTC m=+0.351793414,LastTimestamp:2026-07-27 20:34:22.598549089 +0000 UTC m=+0.351793414,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-119.ec2.internal,}" Jul 27 20:34:22.601806 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.601793 2554 policy_none.go:49] "None policy: Start" Jul 27 20:34:22.601857 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.601812 2554 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 27 20:34:22.601857 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.601826 2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 27 20:34:22.603778 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.603767 2554 policy_none.go:47] "Start" Jul 27 20:34:22.610873 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.610853 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zmsxv" Jul 27 20:34:22.610873 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:22.610817 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-119.ec2.internal.18c63fcf77bc05a8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-119.ec2.internal,UID:ip-10-0-130-119.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-119.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-119.ec2.internal,},FirstTimestamp:2026-07-27 20:34:22.598571432 +0000 UTC m=+0.351815755,LastTimestamp:2026-07-27 20:34:22.598571432 +0000 UTC m=+0.351815755,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-119.ec2.internal,}" Jul 27 20:34:22.620642 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.620618 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zmsxv" Jul 27 20:34:22.621342 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:22.621260 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-119.ec2.internal.18c63fcf77bc2d53 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-119.ec2.internal,UID:ip-10-0-130-119.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-130-119.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-130-119.ec2.internal,},FirstTimestamp:2026-07-27 20:34:22.598581587 +0000 UTC m=+0.351825908,LastTimestamp:2026-07-27 20:34:22.598581587 +0000 UTC m=+0.351825908,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-119.ec2.internal,}" Jul 27 20:34:22.646106 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.646089 2554 manager.go:337] "Starting Device Plugin manager" Jul 27 20:34:22.646222 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:22.646124 2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 27 20:34:22.646222 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.646138 2554 server.go:87] "Starting device plugin registration server" Jul 27 20:34:22.646613 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.646598 2554 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 27 20:34:22.646727 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.646612 2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 27 20:34:22.646784 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.646729 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 27 20:34:22.646840 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.646806 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 27 20:34:22.646840 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.646815 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 27 20:34:22.647394 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:22.647376 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 27 20:34:22.647459 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:22.647419 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-119.ec2.internal\" not found" Jul 27 20:34:22.710242 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.710200 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 27 20:34:22.712247 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.711570 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 27 20:34:22.712247 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.711603 2554 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 27 20:34:22.712247 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.711630 2554 kubelet.go:2448] "Starting kubelet main sync loop" Jul 27 20:34:22.712247 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:22.711663 2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 27 20:34:22.714565 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.714546 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 20:34:22.746888 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.746849 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 20:34:22.747894 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.747829 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientMemory" Jul 27 20:34:22.747894 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.747867 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 20:34:22.747894 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.747876 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientPID" Jul 27 20:34:22.748057 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.747900 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-119.ec2.internal" Jul 27 20:34:22.759112 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.759092 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-119.ec2.internal" Jul 27 20:34:22.759216 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:22.759119 2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-119.ec2.internal\": node \"ip-10-0-130-119.ec2.internal\" not found" Jul 27 20:34:22.812345 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.811777 2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-119.ec2.internal"] Jul 27 20:34:22.812534 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.812386 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 20:34:22.813367 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.813346 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientMemory" Jul 27 20:34:22.813477 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.813378 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 20:34:22.813477 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.813389 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientPID" Jul 27 20:34:22.814781 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:22.814764 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-119.ec2.internal\" not found" Jul 27 20:34:22.815499 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.815487 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 20:34:22.815641 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.815628 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal" Jul 27 20:34:22.815686 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.815658 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 20:34:22.816235 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.816219 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientMemory" Jul 27 20:34:22.816235 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.816245 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 20:34:22.816323 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.816258 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientPID" Jul 27 20:34:22.816323 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.816316 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientMemory" Jul 27 20:34:22.816389 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.816345 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 20:34:22.816389 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.816357 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientPID" Jul 27 20:34:22.818416 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.818402 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-119.ec2.internal" Jul 27 20:34:22.818509 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.818425 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 20:34:22.819076 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.819061 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientMemory" Jul 27 20:34:22.819152 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.819089 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 20:34:22.819152 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.819103 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientPID" Jul 27 20:34:22.844376 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:22.844344 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-119.ec2.internal\" not found" node="ip-10-0-130-119.ec2.internal" Jul 27 20:34:22.848680 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:22.848659 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-119.ec2.internal\" not found" node="ip-10-0-130-119.ec2.internal" Jul 27 20:34:22.882387 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.882351 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7cd07560a4c9074965365583990e4d9f-config\") pod \"kube-apiserver-proxy-ip-10-0-130-119.ec2.internal\" (UID: \"7cd07560a4c9074965365583990e4d9f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-119.ec2.internal" Jul 27 20:34:22.882387 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.882382 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8ea1d8fb0907f36088eebfaff978f333-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal\" (UID: \"8ea1d8fb0907f36088eebfaff978f333\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal" Jul 27 20:34:22.882657 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.882399 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ea1d8fb0907f36088eebfaff978f333-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal\" (UID: \"8ea1d8fb0907f36088eebfaff978f333\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal" Jul 27 20:34:22.915478 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:22.915444 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-119.ec2.internal\" not found" Jul 27 20:34:22.983507 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.983469 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8ea1d8fb0907f36088eebfaff978f333-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal\" (UID: \"8ea1d8fb0907f36088eebfaff978f333\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal" Jul 27 20:34:22.983507 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.983509 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ea1d8fb0907f36088eebfaff978f333-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal\" (UID: \"8ea1d8fb0907f36088eebfaff978f333\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal" Jul 27 20:34:22.983753 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.983559 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7cd07560a4c9074965365583990e4d9f-config\") pod \"kube-apiserver-proxy-ip-10-0-130-119.ec2.internal\" (UID: \"7cd07560a4c9074965365583990e4d9f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-119.ec2.internal" Jul 27 20:34:22.983753 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.983582 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8ea1d8fb0907f36088eebfaff978f333-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal\" (UID: \"8ea1d8fb0907f36088eebfaff978f333\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal" Jul 27 20:34:22.983753 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.983605 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7cd07560a4c9074965365583990e4d9f-config\") pod \"kube-apiserver-proxy-ip-10-0-130-119.ec2.internal\" (UID: \"7cd07560a4c9074965365583990e4d9f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-119.ec2.internal" Jul 27 20:34:22.983753 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:22.983658 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ea1d8fb0907f36088eebfaff978f333-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal\" (UID: \"8ea1d8fb0907f36088eebfaff978f333\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal" Jul 27 20:34:23.016047 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:23.015980 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-119.ec2.internal\" not found" Jul 27 20:34:23.116819 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:23.116792 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-119.ec2.internal\" not found" Jul 27 20:34:23.147006 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.146977 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal" Jul 27 20:34:23.151914 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.151652 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-119.ec2.internal" Jul 27 20:34:23.217895 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:23.217862 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-119.ec2.internal\" not found" Jul 27 20:34:23.318482 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:23.318405 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-119.ec2.internal\" not found" Jul 27 20:34:23.418934 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:23.418903 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-119.ec2.internal\" not found" Jul 27 20:34:23.482491 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.482455 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 20:34:23.519251 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:23.519207 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-119.ec2.internal\" not found" Jul 27 20:34:23.520400 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.520381 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 27 20:34:23.520612 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.520581 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 27 20:34:23.520612 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.520578 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 27 20:34:23.534625 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.534585 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 20:34:23.557289 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.557262 2554 apiserver.go:52] "Watching apiserver" Jul 27 20:34:23.566008 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.565980 2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 27 20:34:23.567868 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.567845 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-72nxw","kube-system/konnectivity-agent-mvmqf","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj","openshift-dns/node-resolver-q55tf","openshift-multus/multus-j4lwg","openshift-multus/network-metrics-daemon-zh9q6","openshift-network-operator/iptables-alerter-6ph7w","openshift-ovn-kubernetes/ovnkube-node-c9d44","openshift-cluster-node-tuning-operator/tuned-vffbm","openshift-image-registry/node-ca-l6kb4","openshift-multus/multus-additional-cni-plugins-lkv46","openshift-network-diagnostics/network-check-target-qm26m"] Jul 27 20:34:23.570532 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.570475 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:23.570654 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:23.570565 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72nxw" podUID="f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f" Jul 27 20:34:23.572715 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.572693 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mvmqf" Jul 27 20:34:23.574760 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.574741 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 27 20:34:23.575330 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.575315 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 27 20:34:23.575572 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.575554 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9w6bg\"" Jul 27 20:34:23.575870 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.575854 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" Jul 27 20:34:23.577820 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.577775 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wmhvr\"" Jul 27 20:34:23.577926 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.577907 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 27 20:34:23.578093 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.578064 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q55tf" Jul 27 20:34:23.578158 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.578111 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 27 20:34:23.578209 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.578189 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 27 20:34:23.578281 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.578236 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 27 20:34:23.578772 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.578755 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal" Jul 27 20:34:23.580334 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.580316 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.581367 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.581206 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 27 20:34:23.581453 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.581429 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xhggx\"" Jul 27 20:34:23.581759 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.581735 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 27 20:34:23.584290 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.584261 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 27 20:34:23.584290 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.584273 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-znbkx\"" Jul 27 20:34:23.584437 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.584274 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 27 20:34:23.584437 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.584313 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 27 20:34:23.584437 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.584319 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 27 20:34:23.585035 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585014 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:23.585123 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585050 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/166099a0-d343-4494-a962-5ad47838e44f-cni-binary-copy\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.585123 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585077 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-host-var-lib-cni-bin\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.585123 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:23.585083 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh9q6" podUID="a8904ad3-db74-4e35-8ca0-1374ae5af9ec" Jul 27 20:34:23.585123 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585101 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-host-run-multus-certs\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.585329 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585159 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-original-pull-secret\") pod \"global-pull-secret-syncer-72nxw\" (UID: \"f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f\") " pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:23.585329 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585176 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bd649c67-6e7d-4723-89de-68f0f5ad3877-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c5jmj\" (UID: \"bd649c67-6e7d-4723-89de-68f0f5ad3877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" Jul 27 20:34:23.585329 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585192 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c504af2f-31d3-47cc-a8f2-bf1562671e1c-konnectivity-ca\") pod \"konnectivity-agent-mvmqf\" (UID: \"c504af2f-31d3-47cc-a8f2-bf1562671e1c\") " pod="kube-system/konnectivity-agent-mvmqf" Jul 27 20:34:23.585329 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585215 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-host-run-netns\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.585329 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585266 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kkht\" (UniqueName: \"kubernetes.io/projected/5dccd741-555f-4715-89bc-dd6df8888a9d-kube-api-access-8kkht\") pod \"node-resolver-q55tf\" (UID: \"5dccd741-555f-4715-89bc-dd6df8888a9d\") " pod="openshift-dns/node-resolver-q55tf" Jul 27 20:34:23.585329 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585292 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-host-var-lib-kubelet\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.585329 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585315 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-hostroot\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.585329 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585335 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-etc-kubernetes\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.585746 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585358 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-cnibin\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.585746 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585376 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/166099a0-d343-4494-a962-5ad47838e44f-multus-daemon-config\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.585746 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585396 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gfpb\" (UniqueName: \"kubernetes.io/projected/166099a0-d343-4494-a962-5ad47838e44f-kube-api-access-6gfpb\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.585746 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585410 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c504af2f-31d3-47cc-a8f2-bf1562671e1c-agent-certs\") pod \"konnectivity-agent-mvmqf\" (UID: \"c504af2f-31d3-47cc-a8f2-bf1562671e1c\") " pod="kube-system/konnectivity-agent-mvmqf" Jul 27 20:34:23.585746 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585426 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bd649c67-6e7d-4723-89de-68f0f5ad3877-device-dir\") pod \"aws-ebs-csi-driver-node-c5jmj\" (UID: \"bd649c67-6e7d-4723-89de-68f0f5ad3877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" Jul 27 20:34:23.585746 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585449 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5krf2\" (UniqueName: \"kubernetes.io/projected/bd649c67-6e7d-4723-89de-68f0f5ad3877-kube-api-access-5krf2\") pod \"aws-ebs-csi-driver-node-c5jmj\" (UID: \"bd649c67-6e7d-4723-89de-68f0f5ad3877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" Jul 27 20:34:23.585746 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585476 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-multus-cni-dir\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.585746 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585500 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bd649c67-6e7d-4723-89de-68f0f5ad3877-etc-selinux\") pod \"aws-ebs-csi-driver-node-c5jmj\" (UID: \"bd649c67-6e7d-4723-89de-68f0f5ad3877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" Jul 27 20:34:23.585746 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585520 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dccd741-555f-4715-89bc-dd6df8888a9d-tmp-dir\") pod \"node-resolver-q55tf\" (UID: \"5dccd741-555f-4715-89bc-dd6df8888a9d\") " pod="openshift-dns/node-resolver-q55tf" Jul 27 20:34:23.585746 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585557 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-host-run-k8s-cni-cncf-io\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.585746 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585575 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-multus-socket-dir-parent\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.585746 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585591 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-host-var-lib-cni-multus\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.585746 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585615 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-dbus\") pod \"global-pull-secret-syncer-72nxw\" (UID: \"f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f\") " pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:23.585746 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585638 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bd649c67-6e7d-4723-89de-68f0f5ad3877-socket-dir\") pod \"aws-ebs-csi-driver-node-c5jmj\" (UID: \"bd649c67-6e7d-4723-89de-68f0f5ad3877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" Jul 27 20:34:23.585746 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585670 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bd649c67-6e7d-4723-89de-68f0f5ad3877-sys-fs\") pod \"aws-ebs-csi-driver-node-c5jmj\" (UID: \"bd649c67-6e7d-4723-89de-68f0f5ad3877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" Jul 27 20:34:23.585746 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585695 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5dccd741-555f-4715-89bc-dd6df8888a9d-hosts-file\") pod \"node-resolver-q55tf\" (UID: \"5dccd741-555f-4715-89bc-dd6df8888a9d\") " pod="openshift-dns/node-resolver-q55tf" Jul 27 20:34:23.585746 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585713 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-os-release\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.586527 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585738 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-multus-conf-dir\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.586527 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585762 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-kubelet-config\") pod \"global-pull-secret-syncer-72nxw\" (UID: \"f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f\") " pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:23.586527 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585800 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bd649c67-6e7d-4723-89de-68f0f5ad3877-registration-dir\") pod \"aws-ebs-csi-driver-node-c5jmj\" (UID: \"bd649c67-6e7d-4723-89de-68f0f5ad3877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" Jul 27 20:34:23.586527 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.585816 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-system-cni-dir\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.587925 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.587900 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6ph7w" Jul 27 20:34:23.590488 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.589790 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t9pwp\"" Jul 27 20:34:23.590488 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.589816 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 27 20:34:23.590488 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.590055 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 27 20:34:23.590691 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.590656 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.590749 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.590726 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 27 20:34:23.592674 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.592655 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 27 20:34:23.593089 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.593072 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 27 20:34:23.593184 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.593160 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.593184 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.593174 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 27 20:34:23.593405 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.593382 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 27 20:34:23.593518 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.593390 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 27 20:34:23.593815 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.593799 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 27 20:34:23.593815 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.593806 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lf8k4\"" Jul 27 20:34:23.594071 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.594055 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 20:34:23.596231 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.596213 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 27 20:34:23.596332 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.596290 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l6kb4" Jul 27 20:34:23.596705 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.596687 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xxwlh\"" Jul 27 20:34:23.596801 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.596788 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 27 20:34:23.598783 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.598765 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lkv46" Jul 27 20:34:23.599092 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.599076 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 20:34:23.599167 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.599148 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-119.ec2.internal" Jul 27 20:34:23.599227 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.599177 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 27 20:34:23.599456 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.599437 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 27 20:34:23.599985 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.599969 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 27 20:34:23.600458 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.600444 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-66gc5\"" Jul 27 20:34:23.601153 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.601134 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 27 20:34:23.601220 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.601193 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal"] Jul 27 20:34:23.601297 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.601283 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:23.601363 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:23.601346 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm26m" podUID="aab3ef63-f667-4177-bb17-b5284f37f7a9" Jul 27 20:34:23.601576 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.601562 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 27 20:34:23.601856 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.601836 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gt42k\"" Jul 27 20:34:23.611041 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.611025 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-119.ec2.internal"] Jul 27 20:34:23.611364 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.611351 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 20:34:23.625573 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.625513 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 20:29:23 +0000 UTC" deadline="2028-01-01 09:34:52.294785676 +0000 UTC" Jul 27 20:34:23.625573 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.625572 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12541h0m28.669217018s" Jul 27 20:34:23.631688 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.631668 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-954vd" Jul 27 20:34:23.643963 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.643944 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-954vd" Jul 27 20:34:23.680915 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.680894 2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 27 20:34:23.686231 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.686197 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-etc-systemd\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.686365 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.686248 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-cnibin\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.686365 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.686282 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c504af2f-31d3-47cc-a8f2-bf1562671e1c-agent-certs\") pod \"konnectivity-agent-mvmqf\" (UID: \"c504af2f-31d3-47cc-a8f2-bf1562671e1c\") " pod="kube-system/konnectivity-agent-mvmqf" Jul 27 20:34:23.686365 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.686310 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bd649c67-6e7d-4723-89de-68f0f5ad3877-device-dir\") pod \"aws-ebs-csi-driver-node-c5jmj\" (UID: \"bd649c67-6e7d-4723-89de-68f0f5ad3877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" Jul 27 20:34:23.686365 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.686339 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5krf2\" (UniqueName: \"kubernetes.io/projected/bd649c67-6e7d-4723-89de-68f0f5ad3877-kube-api-access-5krf2\") pod \"aws-ebs-csi-driver-node-c5jmj\" (UID: \"bd649c67-6e7d-4723-89de-68f0f5ad3877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" Jul 27 20:34:23.686365 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.686344 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-cnibin\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.686643 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.686368 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-host-cni-bin\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.686643 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.686395 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-host-cni-netd\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.686643 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.686413 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bd649c67-6e7d-4723-89de-68f0f5ad3877-device-dir\") pod \"aws-ebs-csi-driver-node-c5jmj\" (UID: \"bd649c67-6e7d-4723-89de-68f0f5ad3877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" Jul 27 20:34:23.686643 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.686424 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.686643 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.686460 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5f4g\" (UniqueName: \"kubernetes.io/projected/aafbdcb1-b199-4dc8-aa92-7366acb4b04e-kube-api-access-w5f4g\") pod \"multus-additional-cni-plugins-lkv46\" (UID: \"aafbdcb1-b199-4dc8-aa92-7366acb4b04e\") " pod="openshift-multus/multus-additional-cni-plugins-lkv46" Jul 27 20:34:23.686643 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.686487 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/45f5ad83-4b09-4ba3-9c4b-ba2bdf24f303-iptables-alerter-script\") pod \"iptables-alerter-6ph7w\" (UID: \"45f5ad83-4b09-4ba3-9c4b-ba2bdf24f303\") " pod="openshift-network-operator/iptables-alerter-6ph7w" Jul 27 20:34:23.686643 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.686511 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-lib-modules\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.686643 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.686535 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-host-slash\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.686643 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.686562 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-run-ovn\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.687073 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.686659 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d695dc18-1a3e-464a-abac-c615738700ad-ovnkube-config\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.687073 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.686698 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dccd741-555f-4715-89bc-dd6df8888a9d-tmp-dir\") pod \"node-resolver-q55tf\" (UID: \"5dccd741-555f-4715-89bc-dd6df8888a9d\") " pod="openshift-dns/node-resolver-q55tf" Jul 27 20:34:23.687073 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.686682 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 27 20:34:23.687073 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.686746 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45f5ad83-4b09-4ba3-9c4b-ba2bdf24f303-host-slash\") pod \"iptables-alerter-6ph7w\" (UID: \"45f5ad83-4b09-4ba3-9c4b-ba2bdf24f303\") " pod="openshift-network-operator/iptables-alerter-6ph7w" Jul 27 20:34:23.687073 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.686779 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-etc-modprobe-d\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.687073 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.686805 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-etc-openvswitch\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.687073 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.686841 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-log-socket\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.687073 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.686874 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aafbdcb1-b199-4dc8-aa92-7366acb4b04e-cnibin\") pod \"multus-additional-cni-plugins-lkv46\" (UID: \"aafbdcb1-b199-4dc8-aa92-7366acb4b04e\") " pod="openshift-multus/multus-additional-cni-plugins-lkv46" Jul 27 20:34:23.687073 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.686925 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-host-run-k8s-cni-cncf-io\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.687073 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.686960 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-multus-socket-dir-parent\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.687073 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.686986 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ccbf7d58-4b22-4192-8b66-be1dd1f18309-host\") pod \"node-ca-l6kb4\" (UID: \"ccbf7d58-4b22-4192-8b66-be1dd1f18309\") " pod="openshift-image-registry/node-ca-l6kb4" Jul 27 20:34:23.687073 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.686996 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-host-run-k8s-cni-cncf-io\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.687073 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687011 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-node-log\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.687073 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687012 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dccd741-555f-4715-89bc-dd6df8888a9d-tmp-dir\") pod \"node-resolver-q55tf\" (UID: \"5dccd741-555f-4715-89bc-dd6df8888a9d\") " pod="openshift-dns/node-resolver-q55tf" Jul 27 20:34:23.687073 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687049 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g295f\" (UniqueName: \"kubernetes.io/projected/d695dc18-1a3e-464a-abac-c615738700ad-kube-api-access-g295f\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.687073 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687076 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-host-var-lib-cni-multus\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.687943 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687084 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-multus-socket-dir-parent\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.687943 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687118 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-host-var-lib-cni-multus\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.687943 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687127 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bd649c67-6e7d-4723-89de-68f0f5ad3877-socket-dir\") pod \"aws-ebs-csi-driver-node-c5jmj\" (UID: \"bd649c67-6e7d-4723-89de-68f0f5ad3877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" Jul 27 20:34:23.687943 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687153 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-host-kubelet\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.687943 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687170 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aafbdcb1-b199-4dc8-aa92-7366acb4b04e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lkv46\" (UID: \"aafbdcb1-b199-4dc8-aa92-7366acb4b04e\") " pod="openshift-multus/multus-additional-cni-plugins-lkv46" Jul 27 20:34:23.687943 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687194 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aafbdcb1-b199-4dc8-aa92-7366acb4b04e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lkv46\" (UID: \"aafbdcb1-b199-4dc8-aa92-7366acb4b04e\") " pod="openshift-multus/multus-additional-cni-plugins-lkv46" Jul 27 20:34:23.687943 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687210 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ccbf7d58-4b22-4192-8b66-be1dd1f18309-serviceca\") pod \"node-ca-l6kb4\" (UID: \"ccbf7d58-4b22-4192-8b66-be1dd1f18309\") " pod="openshift-image-registry/node-ca-l6kb4" Jul 27 20:34:23.687943 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687244 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlnrf\" (UniqueName: \"kubernetes.io/projected/ccbf7d58-4b22-4192-8b66-be1dd1f18309-kube-api-access-hlnrf\") pod \"node-ca-l6kb4\" (UID: \"ccbf7d58-4b22-4192-8b66-be1dd1f18309\") " pod="openshift-image-registry/node-ca-l6kb4" Jul 27 20:34:23.687943 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687285 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bd649c67-6e7d-4723-89de-68f0f5ad3877-socket-dir\") pod \"aws-ebs-csi-driver-node-c5jmj\" (UID: \"bd649c67-6e7d-4723-89de-68f0f5ad3877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" Jul 27 20:34:23.687943 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687297 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5dccd741-555f-4715-89bc-dd6df8888a9d-hosts-file\") pod \"node-resolver-q55tf\" (UID: \"5dccd741-555f-4715-89bc-dd6df8888a9d\") " pod="openshift-dns/node-resolver-q55tf" Jul 27 20:34:23.687943 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687336 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5dccd741-555f-4715-89bc-dd6df8888a9d-hosts-file\") pod \"node-resolver-q55tf\" (UID: \"5dccd741-555f-4715-89bc-dd6df8888a9d\") " pod="openshift-dns/node-resolver-q55tf" Jul 27 20:34:23.687943 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687339 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-os-release\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.687943 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687367 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-multus-conf-dir\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.687943 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687387 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-os-release\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.687943 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687403 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bd649c67-6e7d-4723-89de-68f0f5ad3877-registration-dir\") pod \"aws-ebs-csi-driver-node-c5jmj\" (UID: \"bd649c67-6e7d-4723-89de-68f0f5ad3877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" Jul 27 20:34:23.687943 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687412 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-multus-conf-dir\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.687943 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687432 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-etc-sysctl-conf\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.688845 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687451 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bd649c67-6e7d-4723-89de-68f0f5ad3877-registration-dir\") pod \"aws-ebs-csi-driver-node-c5jmj\" (UID: \"bd649c67-6e7d-4723-89de-68f0f5ad3877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" Jul 27 20:34:23.688845 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687478 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-system-cni-dir\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.688845 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687505 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-host-run-multus-certs\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.688845 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687530 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-original-pull-secret\") pod \"global-pull-secret-syncer-72nxw\" (UID: \"f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f\") " pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:23.688845 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687571 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-host-run-multus-certs\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.688845 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687580 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-host-run-netns\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.688845 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687587 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-system-cni-dir\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.688845 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687610 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-run-openvswitch\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.688845 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687637 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4xg8\" (UniqueName: \"kubernetes.io/projected/aab3ef63-f667-4177-bb17-b5284f37f7a9-kube-api-access-x4xg8\") pod \"network-check-target-qm26m\" (UID: \"aab3ef63-f667-4177-bb17-b5284f37f7a9\") " pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:23.688845 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:23.687660 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 20:34:23.688845 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687667 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-etc-kubernetes\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.688845 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687692 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-etc-sysconfig\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.688845 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687726 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-etc-kubernetes\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.688845 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:23.687741 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-original-pull-secret podName:f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f nodeName:}" failed. No retries permitted until 2026-07-27 20:34:24.18771812 +0000 UTC m=+1.940962459 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-original-pull-secret") pod "global-pull-secret-syncer-72nxw" (UID: "f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f") : object "kube-system"/"original-pull-secret" not registered Jul 27 20:34:23.688845 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687752 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-etc-kubernetes\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.688845 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687781 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-etc-sysctl-d\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.688845 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687812 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8qq8\" (UniqueName: \"kubernetes.io/projected/357848c8-04fa-4781-bf7b-14c15c51d192-kube-api-access-q8qq8\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.689568 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687834 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-run-systemd\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.689568 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687861 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/166099a0-d343-4494-a962-5ad47838e44f-multus-daemon-config\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.689568 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687884 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8904ad3-db74-4e35-8ca0-1374ae5af9ec-metrics-certs\") pod \"network-metrics-daemon-zh9q6\" (UID: \"a8904ad3-db74-4e35-8ca0-1374ae5af9ec\") " pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:23.689568 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687914 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-multus-cni-dir\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.689568 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687940 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bd649c67-6e7d-4723-89de-68f0f5ad3877-etc-selinux\") pod \"aws-ebs-csi-driver-node-c5jmj\" (UID: \"bd649c67-6e7d-4723-89de-68f0f5ad3877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" Jul 27 20:34:23.689568 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687962 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-sys\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.689568 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.687984 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtbkl\" (UniqueName: \"kubernetes.io/projected/45f5ad83-4b09-4ba3-9c4b-ba2bdf24f303-kube-api-access-mtbkl\") pod \"iptables-alerter-6ph7w\" (UID: \"45f5ad83-4b09-4ba3-9c4b-ba2bdf24f303\") " pod="openshift-network-operator/iptables-alerter-6ph7w" Jul 27 20:34:23.689568 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688004 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-var-lib-kubelet\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.689568 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688023 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-host\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.689568 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688049 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbct2\" (UniqueName: \"kubernetes.io/projected/a8904ad3-db74-4e35-8ca0-1374ae5af9ec-kube-api-access-mbct2\") pod \"network-metrics-daemon-zh9q6\" (UID: \"a8904ad3-db74-4e35-8ca0-1374ae5af9ec\") " pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:23.689568 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688065 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-multus-cni-dir\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.689568 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688072 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d695dc18-1a3e-464a-abac-c615738700ad-env-overrides\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.689568 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688099 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aafbdcb1-b199-4dc8-aa92-7366acb4b04e-system-cni-dir\") pod \"multus-additional-cni-plugins-lkv46\" (UID: \"aafbdcb1-b199-4dc8-aa92-7366acb4b04e\") " pod="openshift-multus/multus-additional-cni-plugins-lkv46" Jul 27 20:34:23.689568 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688112 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bd649c67-6e7d-4723-89de-68f0f5ad3877-etc-selinux\") pod \"aws-ebs-csi-driver-node-c5jmj\" (UID: \"bd649c67-6e7d-4723-89de-68f0f5ad3877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" Jul 27 20:34:23.689568 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688142 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-host-run-ovn-kubernetes\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.689568 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688182 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d695dc18-1a3e-464a-abac-c615738700ad-ovnkube-script-lib\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.689568 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688209 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-dbus\") pod \"global-pull-secret-syncer-72nxw\" (UID: \"f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f\") " pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:23.690315 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688235 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bd649c67-6e7d-4723-89de-68f0f5ad3877-sys-fs\") pod \"aws-ebs-csi-driver-node-c5jmj\" (UID: \"bd649c67-6e7d-4723-89de-68f0f5ad3877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" Jul 27 20:34:23.690315 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688260 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/357848c8-04fa-4781-bf7b-14c15c51d192-etc-tuned\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.690315 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688284 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-var-lib-openvswitch\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.690315 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688309 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d695dc18-1a3e-464a-abac-c615738700ad-ovn-node-metrics-cert\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.690315 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688314 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-dbus\") pod \"global-pull-secret-syncer-72nxw\" (UID: \"f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f\") " pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:23.690315 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688328 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bd649c67-6e7d-4723-89de-68f0f5ad3877-sys-fs\") pod \"aws-ebs-csi-driver-node-c5jmj\" (UID: \"bd649c67-6e7d-4723-89de-68f0f5ad3877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" Jul 27 20:34:23.690315 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688335 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aafbdcb1-b199-4dc8-aa92-7366acb4b04e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lkv46\" (UID: \"aafbdcb1-b199-4dc8-aa92-7366acb4b04e\") " pod="openshift-multus/multus-additional-cni-plugins-lkv46" Jul 27 20:34:23.690315 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688362 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-kubelet-config\") pod \"global-pull-secret-syncer-72nxw\" (UID: \"f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f\") " pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:23.690315 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688382 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/357848c8-04fa-4781-bf7b-14c15c51d192-tmp\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.690315 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688401 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-systemd-units\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.690315 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688405 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-kubelet-config\") pod \"global-pull-secret-syncer-72nxw\" (UID: \"f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f\") " pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:23.690315 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688422 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aafbdcb1-b199-4dc8-aa92-7366acb4b04e-os-release\") pod \"multus-additional-cni-plugins-lkv46\" (UID: \"aafbdcb1-b199-4dc8-aa92-7366acb4b04e\") " pod="openshift-multus/multus-additional-cni-plugins-lkv46" Jul 27 20:34:23.690315 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688458 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aafbdcb1-b199-4dc8-aa92-7366acb4b04e-cni-binary-copy\") pod \"multus-additional-cni-plugins-lkv46\" (UID: \"aafbdcb1-b199-4dc8-aa92-7366acb4b04e\") " pod="openshift-multus/multus-additional-cni-plugins-lkv46" Jul 27 20:34:23.690315 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688473 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/166099a0-d343-4494-a962-5ad47838e44f-multus-daemon-config\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.690315 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688491 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/166099a0-d343-4494-a962-5ad47838e44f-cni-binary-copy\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.690315 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688550 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-host-var-lib-cni-bin\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.690315 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688579 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bd649c67-6e7d-4723-89de-68f0f5ad3877-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c5jmj\" (UID: \"bd649c67-6e7d-4723-89de-68f0f5ad3877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" Jul 27 20:34:23.691066 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688602 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-run\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.691066 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688629 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c504af2f-31d3-47cc-a8f2-bf1562671e1c-konnectivity-ca\") pod \"konnectivity-agent-mvmqf\" (UID: \"c504af2f-31d3-47cc-a8f2-bf1562671e1c\") " pod="kube-system/konnectivity-agent-mvmqf" Jul 27 20:34:23.691066 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688655 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-host-run-netns\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.691066 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688682 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kkht\" (UniqueName: \"kubernetes.io/projected/5dccd741-555f-4715-89bc-dd6df8888a9d-kube-api-access-8kkht\") pod \"node-resolver-q55tf\" (UID: \"5dccd741-555f-4715-89bc-dd6df8888a9d\") " pod="openshift-dns/node-resolver-q55tf" Jul 27 20:34:23.691066 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688656 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-host-var-lib-cni-bin\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.691066 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688706 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-host-var-lib-kubelet\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.691066 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688738 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-host-run-netns\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.691066 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688778 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-hostroot\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.691066 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688806 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gfpb\" (UniqueName: \"kubernetes.io/projected/166099a0-d343-4494-a962-5ad47838e44f-kube-api-access-6gfpb\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.691066 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688998 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/166099a0-d343-4494-a962-5ad47838e44f-cni-binary-copy\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.691066 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.689014 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-host-var-lib-kubelet\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.691066 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.688678 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bd649c67-6e7d-4723-89de-68f0f5ad3877-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c5jmj\" (UID: \"bd649c67-6e7d-4723-89de-68f0f5ad3877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" Jul 27 20:34:23.691066 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.689062 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/166099a0-d343-4494-a962-5ad47838e44f-hostroot\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.691066 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.689110 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c504af2f-31d3-47cc-a8f2-bf1562671e1c-konnectivity-ca\") pod \"konnectivity-agent-mvmqf\" (UID: \"c504af2f-31d3-47cc-a8f2-bf1562671e1c\") " pod="kube-system/konnectivity-agent-mvmqf" Jul 27 20:34:23.691066 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.690888 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c504af2f-31d3-47cc-a8f2-bf1562671e1c-agent-certs\") pod \"konnectivity-agent-mvmqf\" (UID: \"c504af2f-31d3-47cc-a8f2-bf1562671e1c\") " pod="kube-system/konnectivity-agent-mvmqf" Jul 27 20:34:23.695627 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.695587 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5krf2\" (UniqueName: \"kubernetes.io/projected/bd649c67-6e7d-4723-89de-68f0f5ad3877-kube-api-access-5krf2\") pod \"aws-ebs-csi-driver-node-c5jmj\" (UID: \"bd649c67-6e7d-4723-89de-68f0f5ad3877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" Jul 27 20:34:23.698226 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.698201 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gfpb\" (UniqueName: \"kubernetes.io/projected/166099a0-d343-4494-a962-5ad47838e44f-kube-api-access-6gfpb\") pod \"multus-j4lwg\" (UID: \"166099a0-d343-4494-a962-5ad47838e44f\") " pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.698819 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.698794 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kkht\" (UniqueName: \"kubernetes.io/projected/5dccd741-555f-4715-89bc-dd6df8888a9d-kube-api-access-8kkht\") pod \"node-resolver-q55tf\" (UID: \"5dccd741-555f-4715-89bc-dd6df8888a9d\") " pod="openshift-dns/node-resolver-q55tf" Jul 27 20:34:23.788198 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:23.788159 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ea1d8fb0907f36088eebfaff978f333.slice/crio-951e1c9bbd2c5f55a393bd1cefd7b0924ce51d0ecaa5d6cf86cb50bafc9bfece WatchSource:0}: Error finding container 951e1c9bbd2c5f55a393bd1cefd7b0924ce51d0ecaa5d6cf86cb50bafc9bfece: Status 404 returned error can't find the container with id 951e1c9bbd2c5f55a393bd1cefd7b0924ce51d0ecaa5d6cf86cb50bafc9bfece Jul 27 20:34:23.789408 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.789391 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ccbf7d58-4b22-4192-8b66-be1dd1f18309-serviceca\") pod \"node-ca-l6kb4\" (UID: \"ccbf7d58-4b22-4192-8b66-be1dd1f18309\") " pod="openshift-image-registry/node-ca-l6kb4" Jul 27 20:34:23.789479 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.789420 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlnrf\" (UniqueName: \"kubernetes.io/projected/ccbf7d58-4b22-4192-8b66-be1dd1f18309-kube-api-access-hlnrf\") pod \"node-ca-l6kb4\" (UID: \"ccbf7d58-4b22-4192-8b66-be1dd1f18309\") " pod="openshift-image-registry/node-ca-l6kb4" Jul 27 20:34:23.789479 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.789446 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-etc-sysctl-conf\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.789599 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.789487 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-host-run-netns\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.789599 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.789511 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-run-openvswitch\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.789599 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.789536 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4xg8\" (UniqueName: \"kubernetes.io/projected/aab3ef63-f667-4177-bb17-b5284f37f7a9-kube-api-access-x4xg8\") pod \"network-check-target-qm26m\" (UID: \"aab3ef63-f667-4177-bb17-b5284f37f7a9\") " pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:23.789599 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.789584 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-etc-sysconfig\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.789804 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.789658 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-run-openvswitch\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.789804 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.789687 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-etc-kubernetes\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.789804 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.789694 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-etc-sysctl-conf\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.789804 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.789718 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-etc-sysctl-d\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.789804 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.789754 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8qq8\" (UniqueName: \"kubernetes.io/projected/357848c8-04fa-4781-bf7b-14c15c51d192-kube-api-access-q8qq8\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.789804 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.789785 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-run-systemd\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.790124 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.789811 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8904ad3-db74-4e35-8ca0-1374ae5af9ec-metrics-certs\") pod \"network-metrics-daemon-zh9q6\" (UID: \"a8904ad3-db74-4e35-8ca0-1374ae5af9ec\") " pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:23.790124 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.789840 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-sys\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.790124 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.789843 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-etc-sysctl-d\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.790124 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.789876 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtbkl\" (UniqueName: \"kubernetes.io/projected/45f5ad83-4b09-4ba3-9c4b-ba2bdf24f303-kube-api-access-mtbkl\") pod \"iptables-alerter-6ph7w\" (UID: \"45f5ad83-4b09-4ba3-9c4b-ba2bdf24f303\") " pod="openshift-network-operator/iptables-alerter-6ph7w" Jul 27 20:34:23.790124 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.789904 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-etc-kubernetes\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.790124 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.789905 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-var-lib-kubelet\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.790124 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.789658 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-host-run-netns\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.790124 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.789957 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-run-systemd\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.790124 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.789980 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-etc-sysconfig\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.790124 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:23.790001 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:34:23.790124 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790009 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-var-lib-kubelet\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.790124 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790003 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ccbf7d58-4b22-4192-8b66-be1dd1f18309-serviceca\") pod \"node-ca-l6kb4\" (UID: \"ccbf7d58-4b22-4192-8b66-be1dd1f18309\") " pod="openshift-image-registry/node-ca-l6kb4" Jul 27 20:34:23.790124 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790053 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-sys\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.790124 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:23.790050 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8904ad3-db74-4e35-8ca0-1374ae5af9ec-metrics-certs podName:a8904ad3-db74-4e35-8ca0-1374ae5af9ec nodeName:}" failed. No retries permitted until 2026-07-27 20:34:24.290037048 +0000 UTC m=+2.043281363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8904ad3-db74-4e35-8ca0-1374ae5af9ec-metrics-certs") pod "network-metrics-daemon-zh9q6" (UID: "a8904ad3-db74-4e35-8ca0-1374ae5af9ec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:34:23.790124 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790103 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-host\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.790124 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790121 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-host\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.790124 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790125 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbct2\" (UniqueName: \"kubernetes.io/projected/a8904ad3-db74-4e35-8ca0-1374ae5af9ec-kube-api-access-mbct2\") pod \"network-metrics-daemon-zh9q6\" (UID: \"a8904ad3-db74-4e35-8ca0-1374ae5af9ec\") " pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:23.790939 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790152 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d695dc18-1a3e-464a-abac-c615738700ad-env-overrides\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.790939 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790170 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aafbdcb1-b199-4dc8-aa92-7366acb4b04e-system-cni-dir\") pod \"multus-additional-cni-plugins-lkv46\" (UID: \"aafbdcb1-b199-4dc8-aa92-7366acb4b04e\") " pod="openshift-multus/multus-additional-cni-plugins-lkv46" Jul 27 20:34:23.790939 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790204 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aafbdcb1-b199-4dc8-aa92-7366acb4b04e-system-cni-dir\") pod \"multus-additional-cni-plugins-lkv46\" (UID: \"aafbdcb1-b199-4dc8-aa92-7366acb4b04e\") " pod="openshift-multus/multus-additional-cni-plugins-lkv46" Jul 27 20:34:23.790939 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790234 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-host-run-ovn-kubernetes\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.790939 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790283 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d695dc18-1a3e-464a-abac-c615738700ad-ovnkube-script-lib\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.790939 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790302 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/357848c8-04fa-4781-bf7b-14c15c51d192-etc-tuned\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.790939 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790325 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-var-lib-openvswitch\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.790939 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790336 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-host-run-ovn-kubernetes\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.790939 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790348 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d695dc18-1a3e-464a-abac-c615738700ad-ovn-node-metrics-cert\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.790939 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790381 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aafbdcb1-b199-4dc8-aa92-7366acb4b04e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lkv46\" (UID: \"aafbdcb1-b199-4dc8-aa92-7366acb4b04e\") " pod="openshift-multus/multus-additional-cni-plugins-lkv46" Jul 27 20:34:23.790939 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790409 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/357848c8-04fa-4781-bf7b-14c15c51d192-tmp\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.790939 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790435 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-systemd-units\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.790939 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790461 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aafbdcb1-b199-4dc8-aa92-7366acb4b04e-os-release\") pod \"multus-additional-cni-plugins-lkv46\" (UID: \"aafbdcb1-b199-4dc8-aa92-7366acb4b04e\") " pod="openshift-multus/multus-additional-cni-plugins-lkv46" Jul 27 20:34:23.790939 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790468 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-var-lib-openvswitch\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.790939 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790511 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aafbdcb1-b199-4dc8-aa92-7366acb4b04e-cni-binary-copy\") pod \"multus-additional-cni-plugins-lkv46\" (UID: \"aafbdcb1-b199-4dc8-aa92-7366acb4b04e\") " pod="openshift-multus/multus-additional-cni-plugins-lkv46" Jul 27 20:34:23.790939 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790541 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-run\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.790939 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790614 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-etc-systemd\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.792071 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790651 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-host-cni-bin\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.792071 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790668 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d695dc18-1a3e-464a-abac-c615738700ad-env-overrides\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.792071 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790676 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-host-cni-netd\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.792071 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790704 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.792071 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790738 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5f4g\" (UniqueName: \"kubernetes.io/projected/aafbdcb1-b199-4dc8-aa92-7366acb4b04e-kube-api-access-w5f4g\") pod \"multus-additional-cni-plugins-lkv46\" (UID: \"aafbdcb1-b199-4dc8-aa92-7366acb4b04e\") " pod="openshift-multus/multus-additional-cni-plugins-lkv46" Jul 27 20:34:23.792071 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790767 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/45f5ad83-4b09-4ba3-9c4b-ba2bdf24f303-iptables-alerter-script\") pod \"iptables-alerter-6ph7w\" (UID: \"45f5ad83-4b09-4ba3-9c4b-ba2bdf24f303\") " pod="openshift-network-operator/iptables-alerter-6ph7w" Jul 27 20:34:23.792071 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790793 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-lib-modules\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.792071 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790819 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-host-slash\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.792071 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790844 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-run-ovn\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.792071 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790869 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d695dc18-1a3e-464a-abac-c615738700ad-ovnkube-config\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.792071 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790890 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d695dc18-1a3e-464a-abac-c615738700ad-ovnkube-script-lib\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.792071 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790895 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45f5ad83-4b09-4ba3-9c4b-ba2bdf24f303-host-slash\") pod \"iptables-alerter-6ph7w\" (UID: \"45f5ad83-4b09-4ba3-9c4b-ba2bdf24f303\") " pod="openshift-network-operator/iptables-alerter-6ph7w" Jul 27 20:34:23.792071 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790920 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-etc-modprobe-d\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.792071 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790948 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-etc-openvswitch\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.792071 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790973 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-log-socket\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.792071 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.790998 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aafbdcb1-b199-4dc8-aa92-7366acb4b04e-cnibin\") pod \"multus-additional-cni-plugins-lkv46\" (UID: \"aafbdcb1-b199-4dc8-aa92-7366acb4b04e\") " pod="openshift-multus/multus-additional-cni-plugins-lkv46" Jul 27 20:34:23.792071 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791026 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ccbf7d58-4b22-4192-8b66-be1dd1f18309-host\") pod \"node-ca-l6kb4\" (UID: \"ccbf7d58-4b22-4192-8b66-be1dd1f18309\") " pod="openshift-image-registry/node-ca-l6kb4" Jul 27 20:34:23.793010 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791049 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-node-log\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.793010 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791074 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g295f\" (UniqueName: \"kubernetes.io/projected/d695dc18-1a3e-464a-abac-c615738700ad-kube-api-access-g295f\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.793010 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791108 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-host-kubelet\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.793010 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791136 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aafbdcb1-b199-4dc8-aa92-7366acb4b04e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lkv46\" (UID: \"aafbdcb1-b199-4dc8-aa92-7366acb4b04e\") " pod="openshift-multus/multus-additional-cni-plugins-lkv46" Jul 27 20:34:23.793010 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791166 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aafbdcb1-b199-4dc8-aa92-7366acb4b04e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lkv46\" (UID: \"aafbdcb1-b199-4dc8-aa92-7366acb4b04e\") " pod="openshift-multus/multus-additional-cni-plugins-lkv46" Jul 27 20:34:23.793010 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791219 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aafbdcb1-b199-4dc8-aa92-7366acb4b04e-cni-binary-copy\") pod \"multus-additional-cni-plugins-lkv46\" (UID: \"aafbdcb1-b199-4dc8-aa92-7366acb4b04e\") " pod="openshift-multus/multus-additional-cni-plugins-lkv46" Jul 27 20:34:23.793010 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791285 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-systemd-units\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.793010 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791347 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aafbdcb1-b199-4dc8-aa92-7366acb4b04e-os-release\") pod \"multus-additional-cni-plugins-lkv46\" (UID: \"aafbdcb1-b199-4dc8-aa92-7366acb4b04e\") " pod="openshift-multus/multus-additional-cni-plugins-lkv46" Jul 27 20:34:23.793010 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791350 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aafbdcb1-b199-4dc8-aa92-7366acb4b04e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lkv46\" (UID: \"aafbdcb1-b199-4dc8-aa92-7366acb4b04e\") " pod="openshift-multus/multus-additional-cni-plugins-lkv46" Jul 27 20:34:23.793010 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791406 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aafbdcb1-b199-4dc8-aa92-7366acb4b04e-cnibin\") pod \"multus-additional-cni-plugins-lkv46\" (UID: \"aafbdcb1-b199-4dc8-aa92-7366acb4b04e\") " pod="openshift-multus/multus-additional-cni-plugins-lkv46" Jul 27 20:34:23.793010 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791447 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45f5ad83-4b09-4ba3-9c4b-ba2bdf24f303-host-slash\") pod \"iptables-alerter-6ph7w\" (UID: \"45f5ad83-4b09-4ba3-9c4b-ba2bdf24f303\") " pod="openshift-network-operator/iptables-alerter-6ph7w" Jul 27 20:34:23.793010 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791489 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-etc-openvswitch\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.793010 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791532 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-log-socket\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.793010 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791692 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aafbdcb1-b199-4dc8-aa92-7366acb4b04e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lkv46\" (UID: \"aafbdcb1-b199-4dc8-aa92-7366acb4b04e\") " pod="openshift-multus/multus-additional-cni-plugins-lkv46" Jul 27 20:34:23.793010 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791698 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.793010 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791706 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ccbf7d58-4b22-4192-8b66-be1dd1f18309-host\") pod \"node-ca-l6kb4\" (UID: \"ccbf7d58-4b22-4192-8b66-be1dd1f18309\") " pod="openshift-image-registry/node-ca-l6kb4" Jul 27 20:34:23.793010 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791753 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-host-kubelet\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.793812 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791765 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-host-cni-bin\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.793812 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791773 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-etc-systemd\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.793812 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791841 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-etc-modprobe-d\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.793812 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791866 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aafbdcb1-b199-4dc8-aa92-7366acb4b04e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lkv46\" (UID: \"aafbdcb1-b199-4dc8-aa92-7366acb4b04e\") " pod="openshift-multus/multus-additional-cni-plugins-lkv46" Jul 27 20:34:23.793812 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791873 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-lib-modules\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.793812 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791883 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-host-cni-netd\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.793812 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791912 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-node-log\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.793812 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791926 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-host-slash\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.793812 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791955 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/357848c8-04fa-4781-bf7b-14c15c51d192-run\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.793812 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.791967 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d695dc18-1a3e-464a-abac-c615738700ad-run-ovn\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.793812 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.792305 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/45f5ad83-4b09-4ba3-9c4b-ba2bdf24f303-iptables-alerter-script\") pod \"iptables-alerter-6ph7w\" (UID: \"45f5ad83-4b09-4ba3-9c4b-ba2bdf24f303\") " pod="openshift-network-operator/iptables-alerter-6ph7w" Jul 27 20:34:23.793812 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.792660 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d695dc18-1a3e-464a-abac-c615738700ad-ovnkube-config\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.794912 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.794875 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/357848c8-04fa-4781-bf7b-14c15c51d192-tmp\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.795050 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.794909 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/357848c8-04fa-4781-bf7b-14c15c51d192-etc-tuned\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.795050 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.794912 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d695dc18-1a3e-464a-abac-c615738700ad-ovn-node-metrics-cert\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.795949 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.795929 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 20:34:23.801971 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:23.801944 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cd07560a4c9074965365583990e4d9f.slice/crio-41ec047b67acb4bb069dba844896a54385d0dcb035c65909d41e0cef94482d98 WatchSource:0}: Error finding container 41ec047b67acb4bb069dba844896a54385d0dcb035c65909d41e0cef94482d98: Status 404 returned error can't find the container with id 41ec047b67acb4bb069dba844896a54385d0dcb035c65909d41e0cef94482d98 Jul 27 20:34:23.839386 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.839310 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlnrf\" (UniqueName: \"kubernetes.io/projected/ccbf7d58-4b22-4192-8b66-be1dd1f18309-kube-api-access-hlnrf\") pod \"node-ca-l6kb4\" (UID: \"ccbf7d58-4b22-4192-8b66-be1dd1f18309\") " pod="openshift-image-registry/node-ca-l6kb4" Jul 27 20:34:23.839530 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.839405 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g295f\" (UniqueName: \"kubernetes.io/projected/d695dc18-1a3e-464a-abac-c615738700ad-kube-api-access-g295f\") pod \"ovnkube-node-c9d44\" (UID: \"d695dc18-1a3e-464a-abac-c615738700ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.839530 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.839427 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtbkl\" (UniqueName: \"kubernetes.io/projected/45f5ad83-4b09-4ba3-9c4b-ba2bdf24f303-kube-api-access-mtbkl\") pod \"iptables-alerter-6ph7w\" (UID: \"45f5ad83-4b09-4ba3-9c4b-ba2bdf24f303\") " pod="openshift-network-operator/iptables-alerter-6ph7w" Jul 27 20:34:23.841068 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.841050 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbct2\" (UniqueName: \"kubernetes.io/projected/a8904ad3-db74-4e35-8ca0-1374ae5af9ec-kube-api-access-mbct2\") pod \"network-metrics-daemon-zh9q6\" (UID: \"a8904ad3-db74-4e35-8ca0-1374ae5af9ec\") " pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:23.843245 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:23.843226 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 20:34:23.843245 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:23.843248 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 20:34:23.843373 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:23.843259 2554 projected.go:196] Error preparing data for projected volume kube-api-access-x4xg8 for pod openshift-network-diagnostics/network-check-target-qm26m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:34:23.843373 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:23.843350 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aab3ef63-f667-4177-bb17-b5284f37f7a9-kube-api-access-x4xg8 podName:aab3ef63-f667-4177-bb17-b5284f37f7a9 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:24.343335036 +0000 UTC m=+2.096579348 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-x4xg8" (UniqueName: "kubernetes.io/projected/aab3ef63-f667-4177-bb17-b5284f37f7a9-kube-api-access-x4xg8") pod "network-check-target-qm26m" (UID: "aab3ef63-f667-4177-bb17-b5284f37f7a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:34:23.844833 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.844807 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8qq8\" (UniqueName: \"kubernetes.io/projected/357848c8-04fa-4781-bf7b-14c15c51d192-kube-api-access-q8qq8\") pod \"tuned-vffbm\" (UID: \"357848c8-04fa-4781-bf7b-14c15c51d192\") " pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:23.853039 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.853019 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5f4g\" (UniqueName: \"kubernetes.io/projected/aafbdcb1-b199-4dc8-aa92-7366acb4b04e-kube-api-access-w5f4g\") pod \"multus-additional-cni-plugins-lkv46\" (UID: \"aafbdcb1-b199-4dc8-aa92-7366acb4b04e\") " pod="openshift-multus/multus-additional-cni-plugins-lkv46" Jul 27 20:34:23.894927 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.894895 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mvmqf" Jul 27 20:34:23.905255 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:23.905230 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc504af2f_31d3_47cc_a8f2_bf1562671e1c.slice/crio-bc511f100697b5f3451bee9733ee726df5a1299e8dce32521dbfff258a674f61 WatchSource:0}: Error finding container bc511f100697b5f3451bee9733ee726df5a1299e8dce32521dbfff258a674f61: Status 404 returned error can't find the container with id bc511f100697b5f3451bee9733ee726df5a1299e8dce32521dbfff258a674f61 Jul 27 20:34:23.924377 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.924349 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" Jul 27 20:34:23.934129 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:23.934096 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd649c67_6e7d_4723_89de_68f0f5ad3877.slice/crio-0be701fd47d737f917cd37933c9e7be3497b16da3542a521261f03a0c0586657 WatchSource:0}: Error finding container 0be701fd47d737f917cd37933c9e7be3497b16da3542a521261f03a0c0586657: Status 404 returned error can't find the container with id 0be701fd47d737f917cd37933c9e7be3497b16da3542a521261f03a0c0586657 Jul 27 20:34:23.941709 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.941667 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q55tf" Jul 27 20:34:23.951532 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:23.951500 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dccd741_555f_4715_89bc_dd6df8888a9d.slice/crio-ad7647ce2b3879c2682408a6b1fe948f8709fb0159e146b0e9ef4e11c7c117c4 WatchSource:0}: Error finding container ad7647ce2b3879c2682408a6b1fe948f8709fb0159e146b0e9ef4e11c7c117c4: Status 404 returned error can't find the container with id ad7647ce2b3879c2682408a6b1fe948f8709fb0159e146b0e9ef4e11c7c117c4 Jul 27 20:34:23.952375 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.952355 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j4lwg" Jul 27 20:34:23.961897 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:23.961872 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod166099a0_d343_4494_a962_5ad47838e44f.slice/crio-72c0f0fe98dba6990cc1bb661b248753b6487b1445faa9efbc4220fdfe80c166 WatchSource:0}: Error finding container 72c0f0fe98dba6990cc1bb661b248753b6487b1445faa9efbc4220fdfe80c166: Status 404 returned error can't find the container with id 72c0f0fe98dba6990cc1bb661b248753b6487b1445faa9efbc4220fdfe80c166 Jul 27 20:34:23.973677 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.973657 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6ph7w" Jul 27 20:34:23.982843 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:23.982818 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45f5ad83_4b09_4ba3_9c4b_ba2bdf24f303.slice/crio-34cc7797485d565bde6c825cf716bf78be43e7c7d04a99a6746ad9108322b0da WatchSource:0}: Error finding container 34cc7797485d565bde6c825cf716bf78be43e7c7d04a99a6746ad9108322b0da: Status 404 returned error can't find the container with id 34cc7797485d565bde6c825cf716bf78be43e7c7d04a99a6746ad9108322b0da Jul 27 20:34:23.988302 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:23.988281 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:23.997320 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:23.997296 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd695dc18_1a3e_464a_abac_c615738700ad.slice/crio-a5f43bc4baca4f87bc392713c98c0a11a67b0a58ff0d5b3fad380ac68c9c6be4 WatchSource:0}: Error finding container a5f43bc4baca4f87bc392713c98c0a11a67b0a58ff0d5b3fad380ac68c9c6be4: Status 404 returned error can't find the container with id a5f43bc4baca4f87bc392713c98c0a11a67b0a58ff0d5b3fad380ac68c9c6be4 Jul 27 20:34:24.010709 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:24.010692 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vffbm" Jul 27 20:34:24.019618 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:24.019591 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod357848c8_04fa_4781_bf7b_14c15c51d192.slice/crio-ef45c11faec579215abac966f62e1abbbf95c2596f9c27b712f95ff6752bd70b WatchSource:0}: Error finding container ef45c11faec579215abac966f62e1abbbf95c2596f9c27b712f95ff6752bd70b: Status 404 returned error can't find the container with id ef45c11faec579215abac966f62e1abbbf95c2596f9c27b712f95ff6752bd70b Jul 27 20:34:24.025190 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:24.025172 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l6kb4" Jul 27 20:34:24.029259 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:24.029239 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lkv46" Jul 27 20:34:24.035742 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:24.035713 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccbf7d58_4b22_4192_8b66_be1dd1f18309.slice/crio-9c5dd9d4973392c924ac558b9440ac83ed1fff6b170a88dbcf089cd91ea76a9f WatchSource:0}: Error finding container 9c5dd9d4973392c924ac558b9440ac83ed1fff6b170a88dbcf089cd91ea76a9f: Status 404 returned error can't find the container with id 9c5dd9d4973392c924ac558b9440ac83ed1fff6b170a88dbcf089cd91ea76a9f Jul 27 20:34:24.039015 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:24.038991 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaafbdcb1_b199_4dc8_aa92_7366acb4b04e.slice/crio-6b047a20537f5dc184573b7d09a95c7cc3164a8e7b322a04b32d9f6b2d9f2ced WatchSource:0}: Error finding container 6b047a20537f5dc184573b7d09a95c7cc3164a8e7b322a04b32d9f6b2d9f2ced: Status 404 returned error can't find the container with id 6b047a20537f5dc184573b7d09a95c7cc3164a8e7b322a04b32d9f6b2d9f2ced Jul 27 20:34:24.138825 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:24.138741 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 20:34:24.194154 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:24.194118 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-original-pull-secret\") pod \"global-pull-secret-syncer-72nxw\" (UID: \"f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f\") " pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:24.194342 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:24.194263 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 20:34:24.194391 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:24.194342 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-original-pull-secret podName:f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f nodeName:}" failed. No retries permitted until 2026-07-27 20:34:25.194320379 +0000 UTC m=+2.947564712 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-original-pull-secret") pod "global-pull-secret-syncer-72nxw" (UID: "f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f") : object "kube-system"/"original-pull-secret" not registered Jul 27 20:34:24.295162 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:24.295073 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8904ad3-db74-4e35-8ca0-1374ae5af9ec-metrics-certs\") pod \"network-metrics-daemon-zh9q6\" (UID: \"a8904ad3-db74-4e35-8ca0-1374ae5af9ec\") " pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:24.295349 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:24.295220 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:34:24.295349 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:24.295292 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8904ad3-db74-4e35-8ca0-1374ae5af9ec-metrics-certs podName:a8904ad3-db74-4e35-8ca0-1374ae5af9ec nodeName:}" failed. No retries permitted until 2026-07-27 20:34:25.295269794 +0000 UTC m=+3.048514109 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8904ad3-db74-4e35-8ca0-1374ae5af9ec-metrics-certs") pod "network-metrics-daemon-zh9q6" (UID: "a8904ad3-db74-4e35-8ca0-1374ae5af9ec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:34:24.396096 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:24.395949 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4xg8\" (UniqueName: \"kubernetes.io/projected/aab3ef63-f667-4177-bb17-b5284f37f7a9-kube-api-access-x4xg8\") pod \"network-check-target-qm26m\" (UID: \"aab3ef63-f667-4177-bb17-b5284f37f7a9\") " pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:24.396270 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:24.396147 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 20:34:24.396270 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:24.396172 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 20:34:24.396270 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:24.396186 2554 projected.go:196] Error preparing data for projected volume kube-api-access-x4xg8 for pod openshift-network-diagnostics/network-check-target-qm26m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:34:24.396270 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:24.396250 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aab3ef63-f667-4177-bb17-b5284f37f7a9-kube-api-access-x4xg8 podName:aab3ef63-f667-4177-bb17-b5284f37f7a9 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:25.396230217 +0000 UTC m=+3.149474533 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-x4xg8" (UniqueName: "kubernetes.io/projected/aab3ef63-f667-4177-bb17-b5284f37f7a9-kube-api-access-x4xg8") pod "network-check-target-qm26m" (UID: "aab3ef63-f667-4177-bb17-b5284f37f7a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:34:24.648138 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:24.648010 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 20:29:24 +0000 UTC" deadline="2027-12-25 16:03:35.240521783 +0000 UTC" Jul 27 20:34:24.648138 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:24.648077 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12379h29m10.592449447s" Jul 27 20:34:24.686084 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:24.686050 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 20:34:24.715384 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:24.715328 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:24.715573 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:24.715470 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72nxw" podUID="f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f" Jul 27 20:34:24.750399 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:24.750311 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vffbm" event={"ID":"357848c8-04fa-4781-bf7b-14c15c51d192","Type":"ContainerStarted","Data":"ef45c11faec579215abac966f62e1abbbf95c2596f9c27b712f95ff6752bd70b"} Jul 27 20:34:24.770118 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:24.770072 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" event={"ID":"d695dc18-1a3e-464a-abac-c615738700ad","Type":"ContainerStarted","Data":"a5f43bc4baca4f87bc392713c98c0a11a67b0a58ff0d5b3fad380ac68c9c6be4"} Jul 27 20:34:24.777305 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:24.777260 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q55tf" event={"ID":"5dccd741-555f-4715-89bc-dd6df8888a9d","Type":"ContainerStarted","Data":"ad7647ce2b3879c2682408a6b1fe948f8709fb0159e146b0e9ef4e11c7c117c4"} Jul 27 20:34:24.814796 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:24.814742 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" event={"ID":"bd649c67-6e7d-4723-89de-68f0f5ad3877","Type":"ContainerStarted","Data":"0be701fd47d737f917cd37933c9e7be3497b16da3542a521261f03a0c0586657"} Jul 27 20:34:24.816712 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:24.816675 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mvmqf" event={"ID":"c504af2f-31d3-47cc-a8f2-bf1562671e1c","Type":"ContainerStarted","Data":"bc511f100697b5f3451bee9733ee726df5a1299e8dce32521dbfff258a674f61"} Jul 27 20:34:24.818857 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:24.818827 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lkv46" event={"ID":"aafbdcb1-b199-4dc8-aa92-7366acb4b04e","Type":"ContainerStarted","Data":"6b047a20537f5dc184573b7d09a95c7cc3164a8e7b322a04b32d9f6b2d9f2ced"} Jul 27 20:34:24.821629 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:24.821595 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l6kb4" event={"ID":"ccbf7d58-4b22-4192-8b66-be1dd1f18309","Type":"ContainerStarted","Data":"9c5dd9d4973392c924ac558b9440ac83ed1fff6b170a88dbcf089cd91ea76a9f"} Jul 27 20:34:24.828970 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:24.828920 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6ph7w" event={"ID":"45f5ad83-4b09-4ba3-9c4b-ba2bdf24f303","Type":"ContainerStarted","Data":"34cc7797485d565bde6c825cf716bf78be43e7c7d04a99a6746ad9108322b0da"} Jul 27 20:34:24.839002 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:24.838815 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j4lwg" event={"ID":"166099a0-d343-4494-a962-5ad47838e44f","Type":"ContainerStarted","Data":"72c0f0fe98dba6990cc1bb661b248753b6487b1445faa9efbc4220fdfe80c166"} Jul 27 20:34:24.844177 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:24.842271 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-119.ec2.internal" event={"ID":"7cd07560a4c9074965365583990e4d9f","Type":"ContainerStarted","Data":"41ec047b67acb4bb069dba844896a54385d0dcb035c65909d41e0cef94482d98"} Jul 27 20:34:24.844177 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:24.844021 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal" event={"ID":"8ea1d8fb0907f36088eebfaff978f333","Type":"ContainerStarted","Data":"951e1c9bbd2c5f55a393bd1cefd7b0924ce51d0ecaa5d6cf86cb50bafc9bfece"} Jul 27 20:34:25.203558 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:25.202956 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-original-pull-secret\") pod \"global-pull-secret-syncer-72nxw\" (UID: \"f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f\") " pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:25.203558 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:25.203130 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 20:34:25.203558 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:25.203198 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-original-pull-secret podName:f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f nodeName:}" failed. No retries permitted until 2026-07-27 20:34:27.203178766 +0000 UTC m=+4.956423091 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-original-pull-secret") pod "global-pull-secret-syncer-72nxw" (UID: "f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f") : object "kube-system"/"original-pull-secret" not registered Jul 27 20:34:25.303452 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:25.303407 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8904ad3-db74-4e35-8ca0-1374ae5af9ec-metrics-certs\") pod \"network-metrics-daemon-zh9q6\" (UID: \"a8904ad3-db74-4e35-8ca0-1374ae5af9ec\") " pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:25.303675 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:25.303603 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:34:25.303675 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:25.303671 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8904ad3-db74-4e35-8ca0-1374ae5af9ec-metrics-certs podName:a8904ad3-db74-4e35-8ca0-1374ae5af9ec nodeName:}" failed. No retries permitted until 2026-07-27 20:34:27.303652221 +0000 UTC m=+5.056896531 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8904ad3-db74-4e35-8ca0-1374ae5af9ec-metrics-certs") pod "network-metrics-daemon-zh9q6" (UID: "a8904ad3-db74-4e35-8ca0-1374ae5af9ec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:34:25.404087 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:25.404000 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4xg8\" (UniqueName: \"kubernetes.io/projected/aab3ef63-f667-4177-bb17-b5284f37f7a9-kube-api-access-x4xg8\") pod \"network-check-target-qm26m\" (UID: \"aab3ef63-f667-4177-bb17-b5284f37f7a9\") " pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:25.404269 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:25.404235 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 20:34:25.404269 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:25.404263 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 20:34:25.404408 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:25.404277 2554 projected.go:196] Error preparing data for projected volume kube-api-access-x4xg8 for pod openshift-network-diagnostics/network-check-target-qm26m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:34:25.404408 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:25.404341 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aab3ef63-f667-4177-bb17-b5284f37f7a9-kube-api-access-x4xg8 podName:aab3ef63-f667-4177-bb17-b5284f37f7a9 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:27.404322516 +0000 UTC m=+5.157566849 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-x4xg8" (UniqueName: "kubernetes.io/projected/aab3ef63-f667-4177-bb17-b5284f37f7a9-kube-api-access-x4xg8") pod "network-check-target-qm26m" (UID: "aab3ef63-f667-4177-bb17-b5284f37f7a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:34:25.648657 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:25.648588 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 20:29:24 +0000 UTC" deadline="2028-02-29 20:20:18.868014443 +0000 UTC" Jul 27 20:34:25.648657 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:25.648631 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13967h45m53.219388934s" Jul 27 20:34:25.712986 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:25.712092 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:25.712986 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:25.712232 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm26m" podUID="aab3ef63-f667-4177-bb17-b5284f37f7a9" Jul 27 20:34:25.712986 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:25.712465 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:25.712986 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:25.712590 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh9q6" podUID="a8904ad3-db74-4e35-8ca0-1374ae5af9ec" Jul 27 20:34:26.652759 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:26.652724 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 20:34:26.715400 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:26.715268 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:26.726751 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:26.716064 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72nxw" podUID="f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f" Jul 27 20:34:27.229421 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:27.229382 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-original-pull-secret\") pod \"global-pull-secret-syncer-72nxw\" (UID: \"f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f\") " pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:27.229652 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:27.229615 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 20:34:27.229728 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:27.229686 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-original-pull-secret podName:f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f nodeName:}" failed. No retries permitted until 2026-07-27 20:34:31.229663729 +0000 UTC m=+8.982908058 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-original-pull-secret") pod "global-pull-secret-syncer-72nxw" (UID: "f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f") : object "kube-system"/"original-pull-secret" not registered Jul 27 20:34:27.330470 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:27.330435 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8904ad3-db74-4e35-8ca0-1374ae5af9ec-metrics-certs\") pod \"network-metrics-daemon-zh9q6\" (UID: \"a8904ad3-db74-4e35-8ca0-1374ae5af9ec\") " pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:27.330652 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:27.330607 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:34:27.330734 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:27.330671 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8904ad3-db74-4e35-8ca0-1374ae5af9ec-metrics-certs podName:a8904ad3-db74-4e35-8ca0-1374ae5af9ec nodeName:}" failed. No retries permitted until 2026-07-27 20:34:31.330649991 +0000 UTC m=+9.083894301 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8904ad3-db74-4e35-8ca0-1374ae5af9ec-metrics-certs") pod "network-metrics-daemon-zh9q6" (UID: "a8904ad3-db74-4e35-8ca0-1374ae5af9ec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:34:27.430962 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:27.430921 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4xg8\" (UniqueName: \"kubernetes.io/projected/aab3ef63-f667-4177-bb17-b5284f37f7a9-kube-api-access-x4xg8\") pod \"network-check-target-qm26m\" (UID: \"aab3ef63-f667-4177-bb17-b5284f37f7a9\") " pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:27.431150 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:27.431102 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 20:34:27.431150 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:27.431123 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 20:34:27.431150 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:27.431137 2554 projected.go:196] Error preparing data for projected volume kube-api-access-x4xg8 for pod openshift-network-diagnostics/network-check-target-qm26m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:34:27.431344 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:27.431198 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aab3ef63-f667-4177-bb17-b5284f37f7a9-kube-api-access-x4xg8 podName:aab3ef63-f667-4177-bb17-b5284f37f7a9 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:31.431177018 +0000 UTC m=+9.184421354 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-x4xg8" (UniqueName: "kubernetes.io/projected/aab3ef63-f667-4177-bb17-b5284f37f7a9-kube-api-access-x4xg8") pod "network-check-target-qm26m" (UID: "aab3ef63-f667-4177-bb17-b5284f37f7a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:34:27.712851 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:27.712803 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:27.713317 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:27.712936 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm26m" podUID="aab3ef63-f667-4177-bb17-b5284f37f7a9" Jul 27 20:34:27.713317 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:27.712998 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:27.713317 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:27.713104 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh9q6" podUID="a8904ad3-db74-4e35-8ca0-1374ae5af9ec" Jul 27 20:34:28.713318 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:28.712784 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:28.713318 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:28.712933 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72nxw" podUID="f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f" Jul 27 20:34:29.712277 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:29.712238 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:29.712501 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:29.712370 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm26m" podUID="aab3ef63-f667-4177-bb17-b5284f37f7a9" Jul 27 20:34:29.712501 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:29.712427 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:29.712501 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:29.712481 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh9q6" podUID="a8904ad3-db74-4e35-8ca0-1374ae5af9ec" Jul 27 20:34:30.712267 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:30.712230 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:30.712779 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:30.712367 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72nxw" podUID="f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f" Jul 27 20:34:31.267085 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:31.266994 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-original-pull-secret\") pod \"global-pull-secret-syncer-72nxw\" (UID: \"f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f\") " pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:31.267277 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:31.267185 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 20:34:31.267277 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:31.267271 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-original-pull-secret podName:f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f nodeName:}" failed. No retries permitted until 2026-07-27 20:34:39.267249899 +0000 UTC m=+17.020494225 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-original-pull-secret") pod "global-pull-secret-syncer-72nxw" (UID: "f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f") : object "kube-system"/"original-pull-secret" not registered Jul 27 20:34:31.368288 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:31.368246 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8904ad3-db74-4e35-8ca0-1374ae5af9ec-metrics-certs\") pod \"network-metrics-daemon-zh9q6\" (UID: \"a8904ad3-db74-4e35-8ca0-1374ae5af9ec\") " pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:31.368486 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:31.368429 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:34:31.368555 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:31.368500 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8904ad3-db74-4e35-8ca0-1374ae5af9ec-metrics-certs podName:a8904ad3-db74-4e35-8ca0-1374ae5af9ec nodeName:}" failed. No retries permitted until 2026-07-27 20:34:39.368479628 +0000 UTC m=+17.121723957 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8904ad3-db74-4e35-8ca0-1374ae5af9ec-metrics-certs") pod "network-metrics-daemon-zh9q6" (UID: "a8904ad3-db74-4e35-8ca0-1374ae5af9ec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:34:31.469167 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:31.469127 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4xg8\" (UniqueName: \"kubernetes.io/projected/aab3ef63-f667-4177-bb17-b5284f37f7a9-kube-api-access-x4xg8\") pod \"network-check-target-qm26m\" (UID: \"aab3ef63-f667-4177-bb17-b5284f37f7a9\") " pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:31.469354 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:31.469336 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 20:34:31.469354 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:31.469356 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 20:34:31.469480 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:31.469366 2554 projected.go:196] Error preparing data for projected volume kube-api-access-x4xg8 for pod openshift-network-diagnostics/network-check-target-qm26m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:34:31.469480 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:31.469428 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aab3ef63-f667-4177-bb17-b5284f37f7a9-kube-api-access-x4xg8 podName:aab3ef63-f667-4177-bb17-b5284f37f7a9 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:39.469406365 +0000 UTC m=+17.222650698 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-x4xg8" (UniqueName: "kubernetes.io/projected/aab3ef63-f667-4177-bb17-b5284f37f7a9-kube-api-access-x4xg8") pod "network-check-target-qm26m" (UID: "aab3ef63-f667-4177-bb17-b5284f37f7a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:34:31.711952 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:31.711869 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:31.712097 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:31.712031 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm26m" podUID="aab3ef63-f667-4177-bb17-b5284f37f7a9" Jul 27 20:34:31.712097 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:31.712064 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:31.712178 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:31.712125 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh9q6" podUID="a8904ad3-db74-4e35-8ca0-1374ae5af9ec" Jul 27 20:34:32.713118 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:32.713072 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:32.713648 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:32.713220 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72nxw" podUID="f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f" Jul 27 20:34:33.712032 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:33.711997 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:33.712229 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:33.712130 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm26m" podUID="aab3ef63-f667-4177-bb17-b5284f37f7a9" Jul 27 20:34:33.712573 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:33.712544 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:33.712701 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:33.712670 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh9q6" podUID="a8904ad3-db74-4e35-8ca0-1374ae5af9ec" Jul 27 20:34:34.712955 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:34.712643 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:34.713397 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:34.713018 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72nxw" podUID="f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f" Jul 27 20:34:35.712816 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:35.712785 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:35.712957 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:35.712785 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:35.712957 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:35.712914 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh9q6" podUID="a8904ad3-db74-4e35-8ca0-1374ae5af9ec" Jul 27 20:34:35.713296 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:35.713027 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm26m" podUID="aab3ef63-f667-4177-bb17-b5284f37f7a9" Jul 27 20:34:36.712852 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:36.712810 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:36.712996 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:36.712950 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72nxw" podUID="f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f" Jul 27 20:34:37.712136 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:37.712099 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:37.712619 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:37.712099 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:37.712619 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:37.712223 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm26m" podUID="aab3ef63-f667-4177-bb17-b5284f37f7a9" Jul 27 20:34:37.712619 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:37.712326 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh9q6" podUID="a8904ad3-db74-4e35-8ca0-1374ae5af9ec" Jul 27 20:34:38.712774 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:38.712741 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:38.713201 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:38.712855 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72nxw" podUID="f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f" Jul 27 20:34:39.335693 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:39.335656 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-original-pull-secret\") pod \"global-pull-secret-syncer-72nxw\" (UID: \"f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f\") " pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:39.335872 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:39.335819 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 20:34:39.335951 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:39.335903 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-original-pull-secret podName:f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f nodeName:}" failed. No retries permitted until 2026-07-27 20:34:55.33588668 +0000 UTC m=+33.089131000 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-original-pull-secret") pod "global-pull-secret-syncer-72nxw" (UID: "f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f") : object "kube-system"/"original-pull-secret" not registered Jul 27 20:34:39.437077 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:39.437033 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8904ad3-db74-4e35-8ca0-1374ae5af9ec-metrics-certs\") pod \"network-metrics-daemon-zh9q6\" (UID: \"a8904ad3-db74-4e35-8ca0-1374ae5af9ec\") " pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:39.437299 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:39.437180 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:34:39.437299 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:39.437266 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8904ad3-db74-4e35-8ca0-1374ae5af9ec-metrics-certs podName:a8904ad3-db74-4e35-8ca0-1374ae5af9ec nodeName:}" failed. No retries permitted until 2026-07-27 20:34:55.437236509 +0000 UTC m=+33.190480837 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8904ad3-db74-4e35-8ca0-1374ae5af9ec-metrics-certs") pod "network-metrics-daemon-zh9q6" (UID: "a8904ad3-db74-4e35-8ca0-1374ae5af9ec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:34:39.538168 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:39.538129 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4xg8\" (UniqueName: \"kubernetes.io/projected/aab3ef63-f667-4177-bb17-b5284f37f7a9-kube-api-access-x4xg8\") pod \"network-check-target-qm26m\" (UID: \"aab3ef63-f667-4177-bb17-b5284f37f7a9\") " pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:39.538374 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:39.538319 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 20:34:39.538374 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:39.538340 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 20:34:39.538374 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:39.538350 2554 projected.go:196] Error preparing data for projected volume kube-api-access-x4xg8 for pod openshift-network-diagnostics/network-check-target-qm26m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:34:39.538615 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:39.538405 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aab3ef63-f667-4177-bb17-b5284f37f7a9-kube-api-access-x4xg8 podName:aab3ef63-f667-4177-bb17-b5284f37f7a9 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:55.538389462 +0000 UTC m=+33.291633775 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-x4xg8" (UniqueName: "kubernetes.io/projected/aab3ef63-f667-4177-bb17-b5284f37f7a9-kube-api-access-x4xg8") pod "network-check-target-qm26m" (UID: "aab3ef63-f667-4177-bb17-b5284f37f7a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:34:39.712747 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:39.712668 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:39.712747 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:39.712718 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:39.713183 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:39.712832 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh9q6" podUID="a8904ad3-db74-4e35-8ca0-1374ae5af9ec" Jul 27 20:34:39.713183 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:39.712963 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm26m" podUID="aab3ef63-f667-4177-bb17-b5284f37f7a9" Jul 27 20:34:40.712844 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:40.712812 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:40.713138 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:40.712944 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72nxw" podUID="f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f" Jul 27 20:34:41.712339 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:41.712306 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:41.712513 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:41.712438 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm26m" podUID="aab3ef63-f667-4177-bb17-b5284f37f7a9" Jul 27 20:34:41.712513 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:41.712486 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:41.712640 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:41.712619 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh9q6" podUID="a8904ad3-db74-4e35-8ca0-1374ae5af9ec" Jul 27 20:34:42.713961 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:42.713803 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:42.714495 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:42.713920 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72nxw" podUID="f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f" Jul 27 20:34:43.712694 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:43.712650 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:43.712914 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:43.712710 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:43.712914 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:43.712774 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh9q6" podUID="a8904ad3-db74-4e35-8ca0-1374ae5af9ec" Jul 27 20:34:43.712914 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:43.712856 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm26m" podUID="aab3ef63-f667-4177-bb17-b5284f37f7a9" Jul 27 20:34:44.712348 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:44.712308 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:44.712864 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:44.712455 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72nxw" podUID="f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f" Jul 27 20:34:45.712824 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:45.712802 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:45.713412 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:45.712807 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:45.713412 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:45.712895 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm26m" podUID="aab3ef63-f667-4177-bb17-b5284f37f7a9" Jul 27 20:34:45.713412 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:45.712980 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh9q6" podUID="a8904ad3-db74-4e35-8ca0-1374ae5af9ec" Jul 27 20:34:45.908101 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:45.908062 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vffbm" event={"ID":"357848c8-04fa-4781-bf7b-14c15c51d192","Type":"ContainerStarted","Data":"46fd922674db1b5124ce494608832ae40622ad5aa172b8513e9e35561f9c05f9"} Jul 27 20:34:45.911042 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:45.911009 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" event={"ID":"d695dc18-1a3e-464a-abac-c615738700ad","Type":"ContainerStarted","Data":"e5f2eea3faa2b8bfb1e4cfeb1efa576341c8e187210c9686a41af7075078f645"} Jul 27 20:34:45.911198 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:45.911077 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" event={"ID":"d695dc18-1a3e-464a-abac-c615738700ad","Type":"ContainerStarted","Data":"84d35f2eb40fa7e81b9d62bb47a9c8ed2b780920b7285a814c96f45c37a879b2"} Jul 27 20:34:45.911198 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:45.911125 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" event={"ID":"d695dc18-1a3e-464a-abac-c615738700ad","Type":"ContainerStarted","Data":"5b2259f7c4afab695573955d9a5d531a64d956c7b0498b8be0fba6cc3f7598cf"} Jul 27 20:34:45.911198 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:45.911159 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" event={"ID":"d695dc18-1a3e-464a-abac-c615738700ad","Type":"ContainerStarted","Data":"c88f5e55bf09f6073b39c2a21e7589953c94b5734bdbf776ce651d6fa24f2520"} Jul 27 20:34:45.911198 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:45.911195 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" event={"ID":"d695dc18-1a3e-464a-abac-c615738700ad","Type":"ContainerStarted","Data":"4a412063107121ddb36e84d5258c3023dd4d6d76440231ff66110aa562322f49"} Jul 27 20:34:45.911380 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:45.911239 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" event={"ID":"d695dc18-1a3e-464a-abac-c615738700ad","Type":"ContainerStarted","Data":"c69b8b8b9c8f6aa013f449a30815d9c94fc7d866ec56f38e406441df0c0c126f"} Jul 27 20:34:45.912389 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:45.912367 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q55tf" event={"ID":"5dccd741-555f-4715-89bc-dd6df8888a9d","Type":"ContainerStarted","Data":"02da6c099e5a19514fbe96fc19532dfca13c7c45bf682dad777c355cde9a198c"} Jul 27 20:34:45.913739 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:45.913718 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" event={"ID":"bd649c67-6e7d-4723-89de-68f0f5ad3877","Type":"ContainerStarted","Data":"95af9882772e9372cc94c695cee827067fa635fe00b28bd766f931a0e3b24099"} Jul 27 20:34:45.915053 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:45.915031 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mvmqf" event={"ID":"c504af2f-31d3-47cc-a8f2-bf1562671e1c","Type":"ContainerStarted","Data":"4bb17b43fff5293ab30da9933b4b15bdfeafe29a344dc0fa6803a8285e8c9481"} Jul 27 20:34:45.916480 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:45.916460 2554 generic.go:356] "Generic (PLEG): container finished" podID="aafbdcb1-b199-4dc8-aa92-7366acb4b04e" containerID="b228337e522c306930fe0b500a4342d1fca8408916ba5e4862eb205fa8d11de7" exitCode=0 Jul 27 20:34:45.916588 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:45.916501 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lkv46" event={"ID":"aafbdcb1-b199-4dc8-aa92-7366acb4b04e","Type":"ContainerDied","Data":"b228337e522c306930fe0b500a4342d1fca8408916ba5e4862eb205fa8d11de7"} Jul 27 20:34:45.917973 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:45.917947 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l6kb4" event={"ID":"ccbf7d58-4b22-4192-8b66-be1dd1f18309","Type":"ContainerStarted","Data":"b6ebec7ba98cdc4efcf62558ea4e5401900435593a25a055c4f93281079429c6"} Jul 27 20:34:45.923869 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:45.923849 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j4lwg" event={"ID":"166099a0-d343-4494-a962-5ad47838e44f","Type":"ContainerStarted","Data":"8f25ad16714759be012ff769ac5461dc87d5706d3306287f20a58da1e0df9333"} Jul 27 20:34:45.925245 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:45.925226 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-119.ec2.internal" event={"ID":"7cd07560a4c9074965365583990e4d9f","Type":"ContainerStarted","Data":"f0f08eaaffbded03445902616e7f3cda70d5470dc6e837898099d4946752939b"} Jul 27 20:34:45.925493 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:45.925447 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vffbm" podStartSLOduration=1.9720510199999999 podStartE2EDuration="22.925430162s" totalImagesPullingTime="20.953379142s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:45.92469788 +0000 UTC m=+23.677942211" watchObservedRunningTime="2026-07-27 20:34:45.925430162 +0000 UTC m=+23.678674493" Jul 27 20:34:45.926724 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:45.926704 2554 generic.go:356] "Generic (PLEG): container finished" podID="8ea1d8fb0907f36088eebfaff978f333" containerID="087baf26870b0d81dfddb09ac20f6d23c9237d53bd8865e73f7c805d60d04c93" exitCode=0 Jul 27 20:34:45.926805 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:45.926732 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal" event={"ID":"8ea1d8fb0907f36088eebfaff978f333","Type":"ContainerDied","Data":"087baf26870b0d81dfddb09ac20f6d23c9237d53bd8865e73f7c805d60d04c93"} Jul 27 20:34:45.937212 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:45.937174 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-l6kb4" podStartSLOduration=2.021648335 podStartE2EDuration="22.937162001s" totalImagesPullingTime="20.915513666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:45.936757022 +0000 UTC m=+23.690001353" watchObservedRunningTime="2026-07-27 20:34:45.937162001 +0000 UTC m=+23.690406331" Jul 27 20:34:45.949460 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:45.949415 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mvmqf" podStartSLOduration=1.925649665 podStartE2EDuration="22.949403669s" totalImagesPullingTime="21.023754004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:45.949058186 +0000 UTC m=+23.702302537" watchObservedRunningTime="2026-07-27 20:34:45.949403669 +0000 UTC m=+23.702648001" Jul 27 20:34:45.969337 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:45.969294 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-j4lwg" podStartSLOduration=1.7524203520000001 podStartE2EDuration="22.969285571s" totalImagesPullingTime="21.216865219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:45.96901622 +0000 UTC m=+23.722260550" watchObservedRunningTime="2026-07-27 20:34:45.969285571 +0000 UTC m=+23.722529902" Jul 27 20:34:46.024544 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:46.024321 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-119.ec2.internal" podStartSLOduration=22.024305009 podStartE2EDuration="22.024305009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:46.024028882 +0000 UTC m=+23.777273213" watchObservedRunningTime="2026-07-27 20:34:46.024305009 +0000 UTC m=+23.777549340" Jul 27 20:34:46.024708 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:46.024672 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-q55tf" podStartSLOduration=2.047436928 podStartE2EDuration="23.024663541s" totalImagesPullingTime="20.977226613s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:46.010116663 +0000 UTC m=+23.763360996" watchObservedRunningTime="2026-07-27 20:34:46.024663541 +0000 UTC m=+23.777907872" Jul 27 20:34:46.174700 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:46.174662 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mvmqf" Jul 27 20:34:46.175337 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:46.175316 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mvmqf" Jul 27 20:34:46.712596 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:46.712566 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:46.712759 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:46.712678 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72nxw" podUID="f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f" Jul 27 20:34:46.930662 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:46.930618 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6ph7w" event={"ID":"45f5ad83-4b09-4ba3-9c4b-ba2bdf24f303","Type":"ContainerStarted","Data":"fdb17350b642bbb8d51164ce6719132f87b11ad6f6111b5a4bcbcc3b1ca2f492"} Jul 27 20:34:46.931848 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:46.931413 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mvmqf" Jul 27 20:34:46.931848 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:46.931466 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mvmqf" Jul 27 20:34:46.946490 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:46.946377 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6ph7w" podStartSLOduration=2.9569984590000002 podStartE2EDuration="23.946356444s" totalImagesPullingTime="20.989357985s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:46.946318352 +0000 UTC m=+24.699562752" watchObservedRunningTime="2026-07-27 20:34:46.946356444 +0000 UTC m=+24.699600775" Jul 27 20:34:46.950577 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:46.950552 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 27 20:34:47.658595 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:47.658449 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T20:34:46.950572873Z","UUID":"1fecad19-e1a9-4554-a439-d2a652b6e65a","Handler":null,"Name":"","Endpoint":""} Jul 27 20:34:47.660304 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:47.660283 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 27 20:34:47.660430 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:47.660323 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 27 20:34:47.712644 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:47.712614 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:47.712806 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:47.712734 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh9q6" podUID="a8904ad3-db74-4e35-8ca0-1374ae5af9ec" Jul 27 20:34:47.712806 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:47.712783 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:47.712899 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:47.712878 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm26m" podUID="aab3ef63-f667-4177-bb17-b5284f37f7a9" Jul 27 20:34:47.935494 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:47.935411 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal" event={"ID":"8ea1d8fb0907f36088eebfaff978f333","Type":"ContainerStarted","Data":"a7030cbebd40e3bed88e638590aa945bb851cd83fed171b0e026e36aa17822f0"} Jul 27 20:34:47.937705 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:47.937665 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" event={"ID":"bd649c67-6e7d-4723-89de-68f0f5ad3877","Type":"ContainerStarted","Data":"902434b3eea1952da56d348870c04466e874358f3d33b8fbf440548b1277ba35"} Jul 27 20:34:47.949435 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:47.949373 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal" podStartSLOduration=23.949353159 podStartE2EDuration="23.949353159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:47.949120799 +0000 UTC m=+25.702365130" watchObservedRunningTime="2026-07-27 20:34:47.949353159 +0000 UTC m=+25.702597491" Jul 27 20:34:48.712309 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:48.712226 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:48.712465 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:48.712369 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72nxw" podUID="f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f" Jul 27 20:34:48.942906 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:48.942870 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" event={"ID":"d695dc18-1a3e-464a-abac-c615738700ad","Type":"ContainerStarted","Data":"bf5d2dc948bad6bc14dfb426b6d10110d25509de08b82e62c971b283a96efb46"} Jul 27 20:34:48.944946 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:48.944909 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" event={"ID":"bd649c67-6e7d-4723-89de-68f0f5ad3877","Type":"ContainerStarted","Data":"67e8b66ec06ca8f68aa5152c76934f69716a43fdf7e08eb56358de165c2765a7"} Jul 27 20:34:49.712754 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:49.712717 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:49.712937 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:49.712720 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:49.712937 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:49.712838 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm26m" podUID="aab3ef63-f667-4177-bb17-b5284f37f7a9" Jul 27 20:34:49.713052 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:49.712947 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh9q6" podUID="a8904ad3-db74-4e35-8ca0-1374ae5af9ec" Jul 27 20:34:50.711990 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:50.711827 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:50.712607 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:50.712120 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72nxw" podUID="f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f" Jul 27 20:34:50.951240 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:50.951209 2554 generic.go:356] "Generic (PLEG): container finished" podID="aafbdcb1-b199-4dc8-aa92-7366acb4b04e" containerID="28e60737b33e87f97bc4353712d882796f3af8e312182cb58b828b85130e5cb3" exitCode=0 Jul 27 20:34:50.951417 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:50.951301 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lkv46" event={"ID":"aafbdcb1-b199-4dc8-aa92-7366acb4b04e","Type":"ContainerDied","Data":"28e60737b33e87f97bc4353712d882796f3af8e312182cb58b828b85130e5cb3"} Jul 27 20:34:50.955560 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:50.955539 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" event={"ID":"d695dc18-1a3e-464a-abac-c615738700ad","Type":"ContainerStarted","Data":"5baac90ca3f74ed05f9440ec1a677af297ca8c2dc70baa3d4a20ff2c08e4da47"} Jul 27 20:34:50.955816 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:50.955803 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:50.971304 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:50.971258 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5jmj" podStartSLOduration=4.282958014 podStartE2EDuration="27.971242667s" totalImagesPullingTime="23.688284653s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:48.962774867 +0000 UTC m=+26.716019198" watchObservedRunningTime="2026-07-27 20:34:50.971242667 +0000 UTC m=+28.724486998" Jul 27 20:34:50.971496 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:50.971480 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:50.994840 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:50.994789 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" podStartSLOduration=6.982666677 podStartE2EDuration="27.994775388s" totalImagesPullingTime="21.012108711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:50.994068941 +0000 UTC m=+28.747313271" watchObservedRunningTime="2026-07-27 20:34:50.994775388 +0000 UTC m=+28.748019719" Jul 27 20:34:51.712454 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:51.712424 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:51.712928 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:51.712462 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:51.712928 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:51.712548 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm26m" podUID="aab3ef63-f667-4177-bb17-b5284f37f7a9" Jul 27 20:34:51.712928 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:51.712628 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh9q6" podUID="a8904ad3-db74-4e35-8ca0-1374ae5af9ec" Jul 27 20:34:51.958641 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:51.958552 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:51.958641 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:51.958649 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:51.973749 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:51.973689 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:34:52.477911 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:52.477709 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-72nxw"] Jul 27 20:34:52.478130 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:52.478007 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:52.478203 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:52.478144 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72nxw" podUID="f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f" Jul 27 20:34:52.480932 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:52.480901 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qm26m"] Jul 27 20:34:52.481060 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:52.481003 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:52.481129 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:52.481103 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm26m" podUID="aab3ef63-f667-4177-bb17-b5284f37f7a9" Jul 27 20:34:52.481514 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:52.481494 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zh9q6"] Jul 27 20:34:52.481609 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:52.481597 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:52.481703 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:52.481683 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh9q6" podUID="a8904ad3-db74-4e35-8ca0-1374ae5af9ec" Jul 27 20:34:52.962639 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:52.962601 2554 generic.go:356] "Generic (PLEG): container finished" podID="aafbdcb1-b199-4dc8-aa92-7366acb4b04e" containerID="fb61437ec96b2928b68c71379e5910db7a8a040d73a3c29ca4e730650f4c2a35" exitCode=0 Jul 27 20:34:52.963074 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:52.962686 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lkv46" event={"ID":"aafbdcb1-b199-4dc8-aa92-7366acb4b04e","Type":"ContainerDied","Data":"fb61437ec96b2928b68c71379e5910db7a8a040d73a3c29ca4e730650f4c2a35"} Jul 27 20:34:53.712191 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:53.712159 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:53.712394 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:53.712159 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:53.712394 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:53.712257 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72nxw" podUID="f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f" Jul 27 20:34:53.712394 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:53.712333 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm26m" podUID="aab3ef63-f667-4177-bb17-b5284f37f7a9" Jul 27 20:34:54.711915 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:54.711885 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:54.712457 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:54.712029 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh9q6" podUID="a8904ad3-db74-4e35-8ca0-1374ae5af9ec" Jul 27 20:34:54.969534 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:54.969433 2554 generic.go:356] "Generic (PLEG): container finished" podID="aafbdcb1-b199-4dc8-aa92-7366acb4b04e" containerID="da9889b9aa0fbba90b87ffcf8a4cc68039aaa1042ed49308955a940235e45046" exitCode=0 Jul 27 20:34:54.969534 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:54.969504 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lkv46" event={"ID":"aafbdcb1-b199-4dc8-aa92-7366acb4b04e","Type":"ContainerDied","Data":"da9889b9aa0fbba90b87ffcf8a4cc68039aaa1042ed49308955a940235e45046"} Jul 27 20:34:55.357753 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:55.357723 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-original-pull-secret\") pod \"global-pull-secret-syncer-72nxw\" (UID: \"f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f\") " pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:55.357922 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:55.357880 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 20:34:55.357965 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:55.357951 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-original-pull-secret podName:f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f nodeName:}" failed. No retries permitted until 2026-07-27 20:35:27.357935094 +0000 UTC m=+65.111179405 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-original-pull-secret") pod "global-pull-secret-syncer-72nxw" (UID: "f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f") : object "kube-system"/"original-pull-secret" not registered Jul 27 20:34:55.458811 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:55.458780 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8904ad3-db74-4e35-8ca0-1374ae5af9ec-metrics-certs\") pod \"network-metrics-daemon-zh9q6\" (UID: \"a8904ad3-db74-4e35-8ca0-1374ae5af9ec\") " pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:55.458972 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:55.458890 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:34:55.458972 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:55.458940 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8904ad3-db74-4e35-8ca0-1374ae5af9ec-metrics-certs podName:a8904ad3-db74-4e35-8ca0-1374ae5af9ec nodeName:}" failed. No retries permitted until 2026-07-27 20:35:27.458927014 +0000 UTC m=+65.212171322 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8904ad3-db74-4e35-8ca0-1374ae5af9ec-metrics-certs") pod "network-metrics-daemon-zh9q6" (UID: "a8904ad3-db74-4e35-8ca0-1374ae5af9ec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:34:55.559813 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:55.559773 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4xg8\" (UniqueName: \"kubernetes.io/projected/aab3ef63-f667-4177-bb17-b5284f37f7a9-kube-api-access-x4xg8\") pod \"network-check-target-qm26m\" (UID: \"aab3ef63-f667-4177-bb17-b5284f37f7a9\") " pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:55.559969 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:55.559938 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 20:34:55.559969 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:55.559959 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 20:34:55.559969 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:55.559969 2554 projected.go:196] Error preparing data for projected volume kube-api-access-x4xg8 for pod openshift-network-diagnostics/network-check-target-qm26m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:34:55.560067 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:55.560024 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aab3ef63-f667-4177-bb17-b5284f37f7a9-kube-api-access-x4xg8 podName:aab3ef63-f667-4177-bb17-b5284f37f7a9 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:27.56000803 +0000 UTC m=+65.313252339 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-x4xg8" (UniqueName: "kubernetes.io/projected/aab3ef63-f667-4177-bb17-b5284f37f7a9-kube-api-access-x4xg8") pod "network-check-target-qm26m" (UID: "aab3ef63-f667-4177-bb17-b5284f37f7a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:34:55.712723 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:55.712642 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:55.713171 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:55.712766 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm26m" podUID="aab3ef63-f667-4177-bb17-b5284f37f7a9" Jul 27 20:34:55.713171 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:55.712642 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:55.713171 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:55.712908 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72nxw" podUID="f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f" Jul 27 20:34:56.712424 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:56.712341 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:56.712601 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:56.712495 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh9q6" podUID="a8904ad3-db74-4e35-8ca0-1374ae5af9ec" Jul 27 20:34:57.712803 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:57.712765 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:57.713241 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:57.712909 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72nxw" podUID="f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f" Jul 27 20:34:57.713241 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:57.712965 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:57.713241 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:57.713091 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm26m" podUID="aab3ef63-f667-4177-bb17-b5284f37f7a9" Jul 27 20:34:58.067191 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.067161 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeReady" Jul 27 20:34:58.067370 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.067309 2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 27 20:34:58.103988 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.103890 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f9c674658-hrc5h"] Jul 27 20:34:58.109533 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.109492 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn"] Jul 27 20:34:58.109718 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.109627 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:34:58.112749 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.112727 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9gqn4"] Jul 27 20:34:58.112899 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.112856 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn" Jul 27 20:34:58.113723 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.113703 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 27 20:34:58.116055 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.116035 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-jncsv"] Jul 27 20:34:58.116175 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.116099 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hj2k5\"" Jul 27 20:34:58.116175 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.116146 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9gqn4" Jul 27 20:34:58.116863 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.116840 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 27 20:34:58.116991 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.116935 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 27 20:34:58.117563 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.117546 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 27 20:34:58.117860 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.117833 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-92s7j\"" Jul 27 20:34:58.117968 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.117877 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 27 20:34:58.119402 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.119384 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-zk5pq"] Jul 27 20:34:58.119502 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.119492 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-jncsv" Jul 27 20:34:58.122733 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.122710 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-zk5pq" Jul 27 20:34:58.125289 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.125271 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 27 20:34:58.125373 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.125328 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 27 20:34:58.125583 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.125563 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 27 20:34:58.125583 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.125575 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 27 20:34:58.125748 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.125702 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 27 20:34:58.125748 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.125716 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 27 20:34:58.129612 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.129593 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 27 20:34:58.129947 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.129930 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 20:34:58.130065 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.130050 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 27 20:34:58.130171 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.130157 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-gpxvh\"" Jul 27 20:34:58.130398 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.130369 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 20:34:58.130482 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.130376 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tnxv4\"" Jul 27 20:34:58.130482 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.130431 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-9jwlw\"" Jul 27 20:34:58.138851 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.138799 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-zk5pq"] Jul 27 20:34:58.140971 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.140947 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qfczc"] Jul 27 20:34:58.144490 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.144467 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f9c674658-hrc5h"] Jul 27 20:34:58.144612 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.144507 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-jncsv"] Jul 27 20:34:58.144675 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.144625 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qfczc" Jul 27 20:34:58.157630 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.157606 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn"] Jul 27 20:34:58.160332 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.160312 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-89mzs\"" Jul 27 20:34:58.163952 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.163930 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 27 20:34:58.167860 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.167841 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 27 20:34:58.169774 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.169750 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8n4dm"] Jul 27 20:34:58.170550 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.170512 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 27 20:34:58.173111 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.173092 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qfczc"] Jul 27 20:34:58.173200 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.173181 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8n4dm" Jul 27 20:34:58.176154 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.176134 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 27 20:34:58.176253 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.176181 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pmzfn\"" Jul 27 20:34:58.176253 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.176142 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 27 20:34:58.176482 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.176468 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 27 20:34:58.184163 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.184143 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9gqn4"] Jul 27 20:34:58.184409 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.184394 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8n4dm"] Jul 27 20:34:58.280307 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.280274 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/43074e6a-caf7-4f21-95eb-9df294467f17-config-volume\") pod \"dns-default-qfczc\" (UID: \"43074e6a-caf7-4f21-95eb-9df294467f17\") " pod="openshift-dns/dns-default-qfczc" Jul 27 20:34:58.280487 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.280323 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-certificates\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:34:58.280487 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.280347 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/44beca5c-6e02-4013-9941-62fd7ee205dc-trusted-ca\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:34:58.280487 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.280374 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6htxw\" (UniqueName: \"kubernetes.io/projected/07514f38-661f-48c6-b1ef-7b96f23194cc-kube-api-access-6htxw\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn\" (UID: \"07514f38-661f-48c6-b1ef-7b96f23194cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn" Jul 27 20:34:58.280487 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.280399 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43074e6a-caf7-4f21-95eb-9df294467f17-tmp-dir\") pod \"dns-default-qfczc\" (UID: \"43074e6a-caf7-4f21-95eb-9df294467f17\") " pod="openshift-dns/dns-default-qfczc" Jul 27 20:34:58.280487 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.280416 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j5ts\" (UniqueName: \"kubernetes.io/projected/43074e6a-caf7-4f21-95eb-9df294467f17-kube-api-access-9j5ts\") pod \"dns-default-qfczc\" (UID: \"43074e6a-caf7-4f21-95eb-9df294467f17\") " pod="openshift-dns/dns-default-qfczc" Jul 27 20:34:58.280487 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.280461 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/025bed99-b1ce-4015-a0b6-cb53a49942c3-cert\") pod \"ingress-canary-8n4dm\" (UID: \"025bed99-b1ce-4015-a0b6-cb53a49942c3\") " pod="openshift-ingress-canary/ingress-canary-8n4dm" Jul 27 20:34:58.280762 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.280584 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txcfq\" (UniqueName: \"kubernetes.io/projected/3dfcc64a-c1c8-45b1-aa8a-5ba64a1df28c-kube-api-access-txcfq\") pod \"network-check-source-7d88cb55d8-zk5pq\" (UID: \"3dfcc64a-c1c8-45b1-aa8a-5ba64a1df28c\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-zk5pq" Jul 27 20:34:58.280762 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.280613 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43074e6a-caf7-4f21-95eb-9df294467f17-metrics-tls\") pod \"dns-default-qfczc\" (UID: \"43074e6a-caf7-4f21-95eb-9df294467f17\") " pod="openshift-dns/dns-default-qfczc" Jul 27 20:34:58.280762 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.280638 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/44beca5c-6e02-4013-9941-62fd7ee205dc-installation-pull-secrets\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:34:58.280762 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.280659 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8b97\" (UniqueName: \"kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-kube-api-access-l8b97\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:34:58.280762 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.280700 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/739a7fa3-aa14-4e4d-958e-f16b7c81fd5a-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-jncsv\" (UID: \"739a7fa3-aa14-4e4d-958e-f16b7c81fd5a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-jncsv" Jul 27 20:34:58.280762 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.280717 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-tls\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:34:58.281001 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.280774 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/44beca5c-6e02-4013-9941-62fd7ee205dc-ca-trust-extracted\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:34:58.281001 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.280790 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-bound-sa-token\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:34:58.281001 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.280837 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90a58abb-4c3b-4fe3-a65c-d942e5df5fe2-config\") pod \"service-ca-operator-5d6c75f84f-9gqn4\" (UID: \"90a58abb-4c3b-4fe3-a65c-d942e5df5fe2\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9gqn4" Jul 27 20:34:58.281001 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.280872 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/739a7fa3-aa14-4e4d-958e-f16b7c81fd5a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-jncsv\" (UID: \"739a7fa3-aa14-4e4d-958e-f16b7c81fd5a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-jncsv" Jul 27 20:34:58.281001 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.280900 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/07514f38-661f-48c6-b1ef-7b96f23194cc-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn\" (UID: \"07514f38-661f-48c6-b1ef-7b96f23194cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn" Jul 27 20:34:58.281001 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.280917 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwwk7\" (UniqueName: \"kubernetes.io/projected/025bed99-b1ce-4015-a0b6-cb53a49942c3-kube-api-access-gwwk7\") pod \"ingress-canary-8n4dm\" (UID: \"025bed99-b1ce-4015-a0b6-cb53a49942c3\") " pod="openshift-ingress-canary/ingress-canary-8n4dm" Jul 27 20:34:58.281001 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.280936 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp48m\" (UniqueName: \"kubernetes.io/projected/90a58abb-4c3b-4fe3-a65c-d942e5df5fe2-kube-api-access-cp48m\") pod \"service-ca-operator-5d6c75f84f-9gqn4\" (UID: \"90a58abb-4c3b-4fe3-a65c-d942e5df5fe2\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9gqn4" Jul 27 20:34:58.281001 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.280957 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07514f38-661f-48c6-b1ef-7b96f23194cc-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn\" (UID: \"07514f38-661f-48c6-b1ef-7b96f23194cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn" Jul 27 20:34:58.281001 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.280982 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/44beca5c-6e02-4013-9941-62fd7ee205dc-image-registry-private-configuration\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:34:58.281325 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.281012 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90a58abb-4c3b-4fe3-a65c-d942e5df5fe2-serving-cert\") pod \"service-ca-operator-5d6c75f84f-9gqn4\" (UID: \"90a58abb-4c3b-4fe3-a65c-d942e5df5fe2\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9gqn4" Jul 27 20:34:58.381781 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.381685 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/07514f38-661f-48c6-b1ef-7b96f23194cc-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn\" (UID: \"07514f38-661f-48c6-b1ef-7b96f23194cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn" Jul 27 20:34:58.381781 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.381740 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwwk7\" (UniqueName: \"kubernetes.io/projected/025bed99-b1ce-4015-a0b6-cb53a49942c3-kube-api-access-gwwk7\") pod \"ingress-canary-8n4dm\" (UID: \"025bed99-b1ce-4015-a0b6-cb53a49942c3\") " pod="openshift-ingress-canary/ingress-canary-8n4dm" Jul 27 20:34:58.381781 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.381777 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp48m\" (UniqueName: \"kubernetes.io/projected/90a58abb-4c3b-4fe3-a65c-d942e5df5fe2-kube-api-access-cp48m\") pod \"service-ca-operator-5d6c75f84f-9gqn4\" (UID: \"90a58abb-4c3b-4fe3-a65c-d942e5df5fe2\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9gqn4" Jul 27 20:34:58.382054 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.381803 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07514f38-661f-48c6-b1ef-7b96f23194cc-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn\" (UID: \"07514f38-661f-48c6-b1ef-7b96f23194cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn" Jul 27 20:34:58.382054 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.381829 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/44beca5c-6e02-4013-9941-62fd7ee205dc-image-registry-private-configuration\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:34:58.382054 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.381858 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90a58abb-4c3b-4fe3-a65c-d942e5df5fe2-serving-cert\") pod \"service-ca-operator-5d6c75f84f-9gqn4\" (UID: \"90a58abb-4c3b-4fe3-a65c-d942e5df5fe2\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9gqn4" Jul 27 20:34:58.382054 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.381911 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/43074e6a-caf7-4f21-95eb-9df294467f17-config-volume\") pod \"dns-default-qfczc\" (UID: \"43074e6a-caf7-4f21-95eb-9df294467f17\") " pod="openshift-dns/dns-default-qfczc" Jul 27 20:34:58.382054 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.381953 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-certificates\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:34:58.382054 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.381979 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/44beca5c-6e02-4013-9941-62fd7ee205dc-trusted-ca\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:34:58.382054 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.382009 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6htxw\" (UniqueName: \"kubernetes.io/projected/07514f38-661f-48c6-b1ef-7b96f23194cc-kube-api-access-6htxw\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn\" (UID: \"07514f38-661f-48c6-b1ef-7b96f23194cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn" Jul 27 20:34:58.382054 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.382038 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43074e6a-caf7-4f21-95eb-9df294467f17-tmp-dir\") pod \"dns-default-qfczc\" (UID: \"43074e6a-caf7-4f21-95eb-9df294467f17\") " pod="openshift-dns/dns-default-qfczc" Jul 27 20:34:58.382442 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.382065 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j5ts\" (UniqueName: \"kubernetes.io/projected/43074e6a-caf7-4f21-95eb-9df294467f17-kube-api-access-9j5ts\") pod \"dns-default-qfczc\" (UID: \"43074e6a-caf7-4f21-95eb-9df294467f17\") " pod="openshift-dns/dns-default-qfczc" Jul 27 20:34:58.382442 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.382088 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/025bed99-b1ce-4015-a0b6-cb53a49942c3-cert\") pod \"ingress-canary-8n4dm\" (UID: \"025bed99-b1ce-4015-a0b6-cb53a49942c3\") " pod="openshift-ingress-canary/ingress-canary-8n4dm" Jul 27 20:34:58.382442 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.382123 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txcfq\" (UniqueName: \"kubernetes.io/projected/3dfcc64a-c1c8-45b1-aa8a-5ba64a1df28c-kube-api-access-txcfq\") pod \"network-check-source-7d88cb55d8-zk5pq\" (UID: \"3dfcc64a-c1c8-45b1-aa8a-5ba64a1df28c\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-zk5pq" Jul 27 20:34:58.382442 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.382151 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43074e6a-caf7-4f21-95eb-9df294467f17-metrics-tls\") pod \"dns-default-qfczc\" (UID: \"43074e6a-caf7-4f21-95eb-9df294467f17\") " pod="openshift-dns/dns-default-qfczc" Jul 27 20:34:58.382442 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.382176 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/44beca5c-6e02-4013-9941-62fd7ee205dc-installation-pull-secrets\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:34:58.382442 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.382201 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8b97\" (UniqueName: \"kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-kube-api-access-l8b97\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:34:58.382442 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.382229 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/739a7fa3-aa14-4e4d-958e-f16b7c81fd5a-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-jncsv\" (UID: \"739a7fa3-aa14-4e4d-958e-f16b7c81fd5a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-jncsv" Jul 27 20:34:58.382442 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.382251 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-tls\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:34:58.382442 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.382278 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/44beca5c-6e02-4013-9941-62fd7ee205dc-ca-trust-extracted\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:34:58.382442 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.382293 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-bound-sa-token\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:34:58.382442 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.382313 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90a58abb-4c3b-4fe3-a65c-d942e5df5fe2-config\") pod \"service-ca-operator-5d6c75f84f-9gqn4\" (UID: \"90a58abb-4c3b-4fe3-a65c-d942e5df5fe2\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9gqn4" Jul 27 20:34:58.382442 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.382328 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/739a7fa3-aa14-4e4d-958e-f16b7c81fd5a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-jncsv\" (UID: \"739a7fa3-aa14-4e4d-958e-f16b7c81fd5a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-jncsv" Jul 27 20:34:58.382442 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:58.382412 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 20:34:58.383119 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:58.382465 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/739a7fa3-aa14-4e4d-958e-f16b7c81fd5a-networking-console-plugin-cert podName:739a7fa3-aa14-4e4d-958e-f16b7c81fd5a nodeName:}" failed. No retries permitted until 2026-07-27 20:34:58.882447361 +0000 UTC m=+36.635691675 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/739a7fa3-aa14-4e4d-958e-f16b7c81fd5a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-jncsv" (UID: "739a7fa3-aa14-4e4d-958e-f16b7c81fd5a") : secret "networking-console-plugin-cert" not found Jul 27 20:34:58.383119 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.382564 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07514f38-661f-48c6-b1ef-7b96f23194cc-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn\" (UID: \"07514f38-661f-48c6-b1ef-7b96f23194cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn" Jul 27 20:34:58.383119 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.382895 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/43074e6a-caf7-4f21-95eb-9df294467f17-config-volume\") pod \"dns-default-qfczc\" (UID: \"43074e6a-caf7-4f21-95eb-9df294467f17\") " pod="openshift-dns/dns-default-qfczc" Jul 27 20:34:58.383119 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.383014 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43074e6a-caf7-4f21-95eb-9df294467f17-tmp-dir\") pod \"dns-default-qfczc\" (UID: \"43074e6a-caf7-4f21-95eb-9df294467f17\") " pod="openshift-dns/dns-default-qfczc" Jul 27 20:34:58.383119 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.383068 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-certificates\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:34:58.383570 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.383505 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/44beca5c-6e02-4013-9941-62fd7ee205dc-trusted-ca\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:34:58.383679 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:58.383618 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 20:34:58.383737 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:58.383694 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43074e6a-caf7-4f21-95eb-9df294467f17-metrics-tls podName:43074e6a-caf7-4f21-95eb-9df294467f17 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:58.883649683 +0000 UTC m=+36.636893991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43074e6a-caf7-4f21-95eb-9df294467f17-metrics-tls") pod "dns-default-qfczc" (UID: "43074e6a-caf7-4f21-95eb-9df294467f17") : secret "dns-default-metrics-tls" not found Jul 27 20:34:58.384439 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.383911 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/739a7fa3-aa14-4e4d-958e-f16b7c81fd5a-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-jncsv\" (UID: \"739a7fa3-aa14-4e4d-958e-f16b7c81fd5a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-jncsv" Jul 27 20:34:58.384439 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:58.384049 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 20:34:58.384439 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:58.384066 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f9c674658-hrc5h: secret "image-registry-tls" not found Jul 27 20:34:58.384439 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:58.384110 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-tls podName:44beca5c-6e02-4013-9941-62fd7ee205dc nodeName:}" failed. No retries permitted until 2026-07-27 20:34:58.884094551 +0000 UTC m=+36.637338879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-tls") pod "image-registry-f9c674658-hrc5h" (UID: "44beca5c-6e02-4013-9941-62fd7ee205dc") : secret "image-registry-tls" not found Jul 27 20:34:58.384439 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.384438 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90a58abb-4c3b-4fe3-a65c-d942e5df5fe2-config\") pod \"service-ca-operator-5d6c75f84f-9gqn4\" (UID: \"90a58abb-4c3b-4fe3-a65c-d942e5df5fe2\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9gqn4" Jul 27 20:34:58.384766 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.384438 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/44beca5c-6e02-4013-9941-62fd7ee205dc-ca-trust-extracted\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:34:58.386867 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.386726 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90a58abb-4c3b-4fe3-a65c-d942e5df5fe2-serving-cert\") pod \"service-ca-operator-5d6c75f84f-9gqn4\" (UID: \"90a58abb-4c3b-4fe3-a65c-d942e5df5fe2\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9gqn4" Jul 27 20:34:58.386965 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.386933 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/44beca5c-6e02-4013-9941-62fd7ee205dc-image-registry-private-configuration\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:34:58.387032 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.387002 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/025bed99-b1ce-4015-a0b6-cb53a49942c3-cert\") pod \"ingress-canary-8n4dm\" (UID: \"025bed99-b1ce-4015-a0b6-cb53a49942c3\") " pod="openshift-ingress-canary/ingress-canary-8n4dm" Jul 27 20:34:58.387159 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.387138 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/44beca5c-6e02-4013-9941-62fd7ee205dc-installation-pull-secrets\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:34:58.387159 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.387153 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/07514f38-661f-48c6-b1ef-7b96f23194cc-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn\" (UID: \"07514f38-661f-48c6-b1ef-7b96f23194cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn" Jul 27 20:34:58.396411 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.396372 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8b97\" (UniqueName: \"kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-kube-api-access-l8b97\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:34:58.397175 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.397125 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp48m\" (UniqueName: \"kubernetes.io/projected/90a58abb-4c3b-4fe3-a65c-d942e5df5fe2-kube-api-access-cp48m\") pod \"service-ca-operator-5d6c75f84f-9gqn4\" (UID: \"90a58abb-4c3b-4fe3-a65c-d942e5df5fe2\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9gqn4" Jul 27 20:34:58.397324 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.397204 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-bound-sa-token\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:34:58.397668 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.397501 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j5ts\" (UniqueName: \"kubernetes.io/projected/43074e6a-caf7-4f21-95eb-9df294467f17-kube-api-access-9j5ts\") pod \"dns-default-qfczc\" (UID: \"43074e6a-caf7-4f21-95eb-9df294467f17\") " pod="openshift-dns/dns-default-qfczc" Jul 27 20:34:58.397668 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.397586 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6htxw\" (UniqueName: \"kubernetes.io/projected/07514f38-661f-48c6-b1ef-7b96f23194cc-kube-api-access-6htxw\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn\" (UID: \"07514f38-661f-48c6-b1ef-7b96f23194cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn" Jul 27 20:34:58.398673 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.398652 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txcfq\" (UniqueName: \"kubernetes.io/projected/3dfcc64a-c1c8-45b1-aa8a-5ba64a1df28c-kube-api-access-txcfq\") pod \"network-check-source-7d88cb55d8-zk5pq\" (UID: \"3dfcc64a-c1c8-45b1-aa8a-5ba64a1df28c\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-zk5pq" Jul 27 20:34:58.398764 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.398661 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwwk7\" (UniqueName: \"kubernetes.io/projected/025bed99-b1ce-4015-a0b6-cb53a49942c3-kube-api-access-gwwk7\") pod \"ingress-canary-8n4dm\" (UID: \"025bed99-b1ce-4015-a0b6-cb53a49942c3\") " pod="openshift-ingress-canary/ingress-canary-8n4dm" Jul 27 20:34:58.430626 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.430594 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn" Jul 27 20:34:58.439594 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.439572 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9gqn4" Jul 27 20:34:58.457751 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.457730 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-zk5pq" Jul 27 20:34:58.483957 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.483924 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8n4dm" Jul 27 20:34:58.712979 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.712892 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:34:58.715263 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.715234 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 20:34:58.715396 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.715270 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wzbh\"" Jul 27 20:34:58.887095 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.887051 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/739a7fa3-aa14-4e4d-958e-f16b7c81fd5a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-jncsv\" (UID: \"739a7fa3-aa14-4e4d-958e-f16b7c81fd5a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-jncsv" Jul 27 20:34:58.887279 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.887190 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43074e6a-caf7-4f21-95eb-9df294467f17-metrics-tls\") pod \"dns-default-qfczc\" (UID: \"43074e6a-caf7-4f21-95eb-9df294467f17\") " pod="openshift-dns/dns-default-qfczc" Jul 27 20:34:58.887279 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:58.887220 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-tls\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:34:58.887279 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:58.887225 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 20:34:58.887423 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:58.887287 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/739a7fa3-aa14-4e4d-958e-f16b7c81fd5a-networking-console-plugin-cert podName:739a7fa3-aa14-4e4d-958e-f16b7c81fd5a nodeName:}" failed. No retries permitted until 2026-07-27 20:34:59.887272719 +0000 UTC m=+37.640517027 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/739a7fa3-aa14-4e4d-958e-f16b7c81fd5a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-jncsv" (UID: "739a7fa3-aa14-4e4d-958e-f16b7c81fd5a") : secret "networking-console-plugin-cert" not found Jul 27 20:34:58.887423 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:58.887315 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 20:34:58.887423 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:58.887325 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 20:34:58.887423 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:58.887342 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f9c674658-hrc5h: secret "image-registry-tls" not found Jul 27 20:34:58.887423 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:58.887371 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43074e6a-caf7-4f21-95eb-9df294467f17-metrics-tls podName:43074e6a-caf7-4f21-95eb-9df294467f17 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:59.887357863 +0000 UTC m=+37.640602172 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43074e6a-caf7-4f21-95eb-9df294467f17-metrics-tls") pod "dns-default-qfczc" (UID: "43074e6a-caf7-4f21-95eb-9df294467f17") : secret "dns-default-metrics-tls" not found Jul 27 20:34:58.887423 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:58.887385 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-tls podName:44beca5c-6e02-4013-9941-62fd7ee205dc nodeName:}" failed. No retries permitted until 2026-07-27 20:34:59.887379232 +0000 UTC m=+37.640623541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-tls") pod "image-registry-f9c674658-hrc5h" (UID: "44beca5c-6e02-4013-9941-62fd7ee205dc") : secret "image-registry-tls" not found Jul 27 20:34:59.251743 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:59.251706 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8n4dm"] Jul 27 20:34:59.255363 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:59.255333 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod025bed99_b1ce_4015_a0b6_cb53a49942c3.slice/crio-b97ca72fcfe9e511cb05c4e5955031758a99d80f0e7a32db6ca7dfcfd4716c45 WatchSource:0}: Error finding container b97ca72fcfe9e511cb05c4e5955031758a99d80f0e7a32db6ca7dfcfd4716c45: Status 404 returned error can't find the container with id b97ca72fcfe9e511cb05c4e5955031758a99d80f0e7a32db6ca7dfcfd4716c45 Jul 27 20:34:59.257767 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:59.257740 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn"] Jul 27 20:34:59.265700 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:59.264851 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-zk5pq"] Jul 27 20:34:59.265700 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:59.265274 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07514f38_661f_48c6_b1ef_7b96f23194cc.slice/crio-17662d3c786518ffec1e2d8817d9c314699e09a1ee6b582041371abf8c285b9d WatchSource:0}: Error finding container 17662d3c786518ffec1e2d8817d9c314699e09a1ee6b582041371abf8c285b9d: Status 404 returned error can't find the container with id 17662d3c786518ffec1e2d8817d9c314699e09a1ee6b582041371abf8c285b9d Jul 27 20:34:59.267256 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:59.267172 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dfcc64a_c1c8_45b1_aa8a_5ba64a1df28c.slice/crio-381567d96a431d1265fa6121e75c5e287586263b866eb69602e097325ef36eae WatchSource:0}: Error finding container 381567d96a431d1265fa6121e75c5e287586263b866eb69602e097325ef36eae: Status 404 returned error can't find the container with id 381567d96a431d1265fa6121e75c5e287586263b866eb69602e097325ef36eae Jul 27 20:34:59.269843 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:59.269823 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9gqn4"] Jul 27 20:34:59.272800 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:34:59.272774 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90a58abb_4c3b_4fe3_a65c_d942e5df5fe2.slice/crio-5443e3d2e9874d1eac9ebc2cb06f014519b566f1ea45222f1304202846ea59b6 WatchSource:0}: Error finding container 5443e3d2e9874d1eac9ebc2cb06f014519b566f1ea45222f1304202846ea59b6: Status 404 returned error can't find the container with id 5443e3d2e9874d1eac9ebc2cb06f014519b566f1ea45222f1304202846ea59b6 Jul 27 20:34:59.712102 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:59.711853 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:34:59.712417 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:59.712392 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:34:59.714424 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:59.714405 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 20:34:59.715225 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:59.715202 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z8hwp\"" Jul 27 20:34:59.900484 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:59.900014 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43074e6a-caf7-4f21-95eb-9df294467f17-metrics-tls\") pod \"dns-default-qfczc\" (UID: \"43074e6a-caf7-4f21-95eb-9df294467f17\") " pod="openshift-dns/dns-default-qfczc" Jul 27 20:34:59.900484 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:59.900063 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-tls\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:34:59.900484 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:59.900114 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/739a7fa3-aa14-4e4d-958e-f16b7c81fd5a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-jncsv\" (UID: \"739a7fa3-aa14-4e4d-958e-f16b7c81fd5a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-jncsv" Jul 27 20:34:59.900484 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:59.900194 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 20:34:59.900484 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:59.900238 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 20:34:59.900484 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:59.900269 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43074e6a-caf7-4f21-95eb-9df294467f17-metrics-tls podName:43074e6a-caf7-4f21-95eb-9df294467f17 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:01.90024598 +0000 UTC m=+39.653490297 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43074e6a-caf7-4f21-95eb-9df294467f17-metrics-tls") pod "dns-default-qfczc" (UID: "43074e6a-caf7-4f21-95eb-9df294467f17") : secret "dns-default-metrics-tls" not found Jul 27 20:34:59.900484 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:59.900289 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/739a7fa3-aa14-4e4d-958e-f16b7c81fd5a-networking-console-plugin-cert podName:739a7fa3-aa14-4e4d-958e-f16b7c81fd5a nodeName:}" failed. No retries permitted until 2026-07-27 20:35:01.900278967 +0000 UTC m=+39.653523280 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/739a7fa3-aa14-4e4d-958e-f16b7c81fd5a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-jncsv" (UID: "739a7fa3-aa14-4e4d-958e-f16b7c81fd5a") : secret "networking-console-plugin-cert" not found Jul 27 20:34:59.900484 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:59.900371 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 20:34:59.900484 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:59.900384 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f9c674658-hrc5h: secret "image-registry-tls" not found Jul 27 20:34:59.900484 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:34:59.900454 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-tls podName:44beca5c-6e02-4013-9941-62fd7ee205dc nodeName:}" failed. No retries permitted until 2026-07-27 20:35:01.900436938 +0000 UTC m=+39.653681261 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-tls") pod "image-registry-f9c674658-hrc5h" (UID: "44beca5c-6e02-4013-9941-62fd7ee205dc") : secret "image-registry-tls" not found Jul 27 20:34:59.989301 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:59.988253 2554 generic.go:356] "Generic (PLEG): container finished" podID="aafbdcb1-b199-4dc8-aa92-7366acb4b04e" containerID="a7505cd1e7daa5a3fa965ca31454421735731e8670a99e8a8fefd42d10470ac3" exitCode=0 Jul 27 20:34:59.989301 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:59.988347 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lkv46" event={"ID":"aafbdcb1-b199-4dc8-aa92-7366acb4b04e","Type":"ContainerDied","Data":"a7505cd1e7daa5a3fa965ca31454421735731e8670a99e8a8fefd42d10470ac3"} Jul 27 20:34:59.991296 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:59.991264 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8n4dm" event={"ID":"025bed99-b1ce-4015-a0b6-cb53a49942c3","Type":"ContainerStarted","Data":"b97ca72fcfe9e511cb05c4e5955031758a99d80f0e7a32db6ca7dfcfd4716c45"} Jul 27 20:34:59.996297 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:59.996208 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9gqn4" event={"ID":"90a58abb-4c3b-4fe3-a65c-d942e5df5fe2","Type":"ContainerStarted","Data":"5443e3d2e9874d1eac9ebc2cb06f014519b566f1ea45222f1304202846ea59b6"} Jul 27 20:34:59.999742 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:34:59.999713 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-zk5pq" event={"ID":"3dfcc64a-c1c8-45b1-aa8a-5ba64a1df28c","Type":"ContainerStarted","Data":"381567d96a431d1265fa6121e75c5e287586263b866eb69602e097325ef36eae"} Jul 27 20:35:00.001876 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:00.001852 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn" event={"ID":"07514f38-661f-48c6-b1ef-7b96f23194cc","Type":"ContainerStarted","Data":"17662d3c786518ffec1e2d8817d9c314699e09a1ee6b582041371abf8c285b9d"} Jul 27 20:35:01.010424 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:01.010382 2554 generic.go:356] "Generic (PLEG): container finished" podID="aafbdcb1-b199-4dc8-aa92-7366acb4b04e" containerID="98e5387239ec5dd9c12a8bdb231107761095f7ab5974adb57b33c9ec56c813ac" exitCode=0 Jul 27 20:35:01.010928 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:01.010480 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lkv46" event={"ID":"aafbdcb1-b199-4dc8-aa92-7366acb4b04e","Type":"ContainerDied","Data":"98e5387239ec5dd9c12a8bdb231107761095f7ab5974adb57b33c9ec56c813ac"} Jul 27 20:35:01.917678 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:01.917645 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-tls\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:35:01.917875 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:01.917709 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/739a7fa3-aa14-4e4d-958e-f16b7c81fd5a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-jncsv\" (UID: \"739a7fa3-aa14-4e4d-958e-f16b7c81fd5a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-jncsv" Jul 27 20:35:01.917875 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:01.917823 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 20:35:01.917875 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:01.917831 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 20:35:01.917875 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:01.917857 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f9c674658-hrc5h: secret "image-registry-tls" not found Jul 27 20:35:01.918028 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:01.917832 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43074e6a-caf7-4f21-95eb-9df294467f17-metrics-tls\") pod \"dns-default-qfczc\" (UID: \"43074e6a-caf7-4f21-95eb-9df294467f17\") " pod="openshift-dns/dns-default-qfczc" Jul 27 20:35:01.918028 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:01.917894 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/739a7fa3-aa14-4e4d-958e-f16b7c81fd5a-networking-console-plugin-cert podName:739a7fa3-aa14-4e4d-958e-f16b7c81fd5a nodeName:}" failed. No retries permitted until 2026-07-27 20:35:05.917872208 +0000 UTC m=+43.671116540 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/739a7fa3-aa14-4e4d-958e-f16b7c81fd5a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-jncsv" (UID: "739a7fa3-aa14-4e4d-958e-f16b7c81fd5a") : secret "networking-console-plugin-cert" not found Jul 27 20:35:01.918028 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:01.917894 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 20:35:01.918028 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:01.917920 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-tls podName:44beca5c-6e02-4013-9941-62fd7ee205dc nodeName:}" failed. No retries permitted until 2026-07-27 20:35:05.917911305 +0000 UTC m=+43.671155614 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-tls") pod "image-registry-f9c674658-hrc5h" (UID: "44beca5c-6e02-4013-9941-62fd7ee205dc") : secret "image-registry-tls" not found Jul 27 20:35:01.918028 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:01.917938 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43074e6a-caf7-4f21-95eb-9df294467f17-metrics-tls podName:43074e6a-caf7-4f21-95eb-9df294467f17 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:05.917930558 +0000 UTC m=+43.671174870 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43074e6a-caf7-4f21-95eb-9df294467f17-metrics-tls") pod "dns-default-qfczc" (UID: "43074e6a-caf7-4f21-95eb-9df294467f17") : secret "dns-default-metrics-tls" not found Jul 27 20:35:02.017054 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:02.017023 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lkv46" event={"ID":"aafbdcb1-b199-4dc8-aa92-7366acb4b04e","Type":"ContainerStarted","Data":"9f0f5933d8adf878e54123e110416d3ae147ba01b9784699829e4fd0fade7b55"} Jul 27 20:35:02.038175 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:02.038117 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lkv46" podStartSLOduration=7.141770731 podStartE2EDuration="39.038099606s" totalImagesPullingTime="31.896328875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:02.036589 +0000 UTC m=+39.789833331" watchObservedRunningTime="2026-07-27 20:35:02.038099606 +0000 UTC m=+39.791343938" Jul 27 20:35:05.025856 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:05.025815 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9gqn4" event={"ID":"90a58abb-4c3b-4fe3-a65c-d942e5df5fe2","Type":"ContainerStarted","Data":"b7da560e9bdfc12fc528a6c775791a16c565b85c2830a5193134376dd219352b"} Jul 27 20:35:05.027957 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:05.027927 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-zk5pq" event={"ID":"3dfcc64a-c1c8-45b1-aa8a-5ba64a1df28c","Type":"ContainerStarted","Data":"53101ddaebfc29372818d68511b0e2363b9d18c7627e7f7e05ea5da54c4290bc"} Jul 27 20:35:05.030106 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:05.030082 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn" event={"ID":"07514f38-661f-48c6-b1ef-7b96f23194cc","Type":"ContainerStarted","Data":"dcb8ddaa3b4ba280240e3a679b1e03e69c88979ccd22bbc025e2588e87c97332"} Jul 27 20:35:05.031877 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:05.031855 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8n4dm" event={"ID":"025bed99-b1ce-4015-a0b6-cb53a49942c3","Type":"ContainerStarted","Data":"81e6ef83fad3d4eb6c397d0379209efcf45ff1a378750c45a7816e054201df57"} Jul 27 20:35:05.057332 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:05.057271 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9gqn4" podStartSLOduration=30.54876824 podStartE2EDuration="36.057248271s" totalImagesPullingTime="5.508480031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:34:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:05.04256099 +0000 UTC m=+42.795805321" watchObservedRunningTime="2026-07-27 20:35:05.057248271 +0000 UTC m=+42.810492603" Jul 27 20:35:05.077596 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:05.077277 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8n4dm" podStartSLOduration=1.545551428 podStartE2EDuration="7.077259553s" totalImagesPullingTime="5.531708125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:05.057664644 +0000 UTC m=+42.810908957" watchObservedRunningTime="2026-07-27 20:35:05.077259553 +0000 UTC m=+42.830503884" Jul 27 20:35:05.094895 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:05.094827 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-zk5pq" podStartSLOduration=31.580455306 podStartE2EDuration="37.094809484s" totalImagesPullingTime="5.514354178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:05.094254826 +0000 UTC m=+42.847499158" watchObservedRunningTime="2026-07-27 20:35:05.094809484 +0000 UTC m=+42.848053821" Jul 27 20:35:05.099482 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:05.099423 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn" podStartSLOduration=32.584015447 podStartE2EDuration="38.099396369s" totalImagesPullingTime="5.515380922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:34:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:05.07790498 +0000 UTC m=+42.831149309" watchObservedRunningTime="2026-07-27 20:35:05.099396369 +0000 UTC m=+42.852640699" Jul 27 20:35:05.953777 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:05.953738 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43074e6a-caf7-4f21-95eb-9df294467f17-metrics-tls\") pod \"dns-default-qfczc\" (UID: \"43074e6a-caf7-4f21-95eb-9df294467f17\") " pod="openshift-dns/dns-default-qfczc" Jul 27 20:35:05.953777 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:05.953778 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-tls\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:35:05.954036 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:05.953808 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/739a7fa3-aa14-4e4d-958e-f16b7c81fd5a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-jncsv\" (UID: \"739a7fa3-aa14-4e4d-958e-f16b7c81fd5a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-jncsv" Jul 27 20:35:05.954036 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:05.953926 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 20:35:05.954036 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:05.953923 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 20:35:05.954036 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:05.953945 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 20:35:05.954036 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:05.953965 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f9c674658-hrc5h: secret "image-registry-tls" not found Jul 27 20:35:05.954036 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:05.953986 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/739a7fa3-aa14-4e4d-958e-f16b7c81fd5a-networking-console-plugin-cert podName:739a7fa3-aa14-4e4d-958e-f16b7c81fd5a nodeName:}" failed. No retries permitted until 2026-07-27 20:35:13.953971243 +0000 UTC m=+51.707215573 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/739a7fa3-aa14-4e4d-958e-f16b7c81fd5a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-jncsv" (UID: "739a7fa3-aa14-4e4d-958e-f16b7c81fd5a") : secret "networking-console-plugin-cert" not found Jul 27 20:35:05.954036 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:05.954012 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43074e6a-caf7-4f21-95eb-9df294467f17-metrics-tls podName:43074e6a-caf7-4f21-95eb-9df294467f17 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:13.95399304 +0000 UTC m=+51.707237355 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43074e6a-caf7-4f21-95eb-9df294467f17-metrics-tls") pod "dns-default-qfczc" (UID: "43074e6a-caf7-4f21-95eb-9df294467f17") : secret "dns-default-metrics-tls" not found Jul 27 20:35:05.954036 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:05.954043 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-tls podName:44beca5c-6e02-4013-9941-62fd7ee205dc nodeName:}" failed. No retries permitted until 2026-07-27 20:35:13.954026436 +0000 UTC m=+51.707270750 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-tls") pod "image-registry-f9c674658-hrc5h" (UID: "44beca5c-6e02-4013-9941-62fd7ee205dc") : secret "image-registry-tls" not found Jul 27 20:35:14.019797 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:14.019757 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43074e6a-caf7-4f21-95eb-9df294467f17-metrics-tls\") pod \"dns-default-qfczc\" (UID: \"43074e6a-caf7-4f21-95eb-9df294467f17\") " pod="openshift-dns/dns-default-qfczc" Jul 27 20:35:14.019797 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:14.019803 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-tls\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:35:14.020218 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:14.019849 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/739a7fa3-aa14-4e4d-958e-f16b7c81fd5a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-jncsv\" (UID: \"739a7fa3-aa14-4e4d-958e-f16b7c81fd5a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-jncsv" Jul 27 20:35:14.020218 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:14.019918 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 20:35:14.020218 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:14.019963 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 20:35:14.020218 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:14.019983 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 20:35:14.020218 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:14.020006 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f9c674658-hrc5h: secret "image-registry-tls" not found Jul 27 20:35:14.020218 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:14.019988 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43074e6a-caf7-4f21-95eb-9df294467f17-metrics-tls podName:43074e6a-caf7-4f21-95eb-9df294467f17 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:30.019967191 +0000 UTC m=+67.773211517 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43074e6a-caf7-4f21-95eb-9df294467f17-metrics-tls") pod "dns-default-qfczc" (UID: "43074e6a-caf7-4f21-95eb-9df294467f17") : secret "dns-default-metrics-tls" not found Jul 27 20:35:14.020218 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:14.020088 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/739a7fa3-aa14-4e4d-958e-f16b7c81fd5a-networking-console-plugin-cert podName:739a7fa3-aa14-4e4d-958e-f16b7c81fd5a nodeName:}" failed. No retries permitted until 2026-07-27 20:35:30.020069471 +0000 UTC m=+67.773313779 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/739a7fa3-aa14-4e4d-958e-f16b7c81fd5a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-jncsv" (UID: "739a7fa3-aa14-4e4d-958e-f16b7c81fd5a") : secret "networking-console-plugin-cert" not found Jul 27 20:35:14.020218 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:14.020140 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-tls podName:44beca5c-6e02-4013-9941-62fd7ee205dc nodeName:}" failed. No retries permitted until 2026-07-27 20:35:30.020133169 +0000 UTC m=+67.773377477 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-tls") pod "image-registry-f9c674658-hrc5h" (UID: "44beca5c-6e02-4013-9941-62fd7ee205dc") : secret "image-registry-tls" not found Jul 27 20:35:23.978864 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:23.978827 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9d44" Jul 27 20:35:27.427981 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:27.427942 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-original-pull-secret\") pod \"global-pull-secret-syncer-72nxw\" (UID: \"f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f\") " pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:35:27.430025 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:27.430005 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 20:35:27.442056 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:27.442034 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f-original-pull-secret\") pod \"global-pull-secret-syncer-72nxw\" (UID: \"f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f\") " pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:35:27.529272 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:27.529230 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8904ad3-db74-4e35-8ca0-1374ae5af9ec-metrics-certs\") pod \"network-metrics-daemon-zh9q6\" (UID: \"a8904ad3-db74-4e35-8ca0-1374ae5af9ec\") " pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:35:27.531350 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:27.531326 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 20:35:27.542059 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:27.542031 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8904ad3-db74-4e35-8ca0-1374ae5af9ec-metrics-certs\") pod \"network-metrics-daemon-zh9q6\" (UID: \"a8904ad3-db74-4e35-8ca0-1374ae5af9ec\") " pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:35:27.630364 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:27.630322 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4xg8\" (UniqueName: \"kubernetes.io/projected/aab3ef63-f667-4177-bb17-b5284f37f7a9-kube-api-access-x4xg8\") pod \"network-check-target-qm26m\" (UID: \"aab3ef63-f667-4177-bb17-b5284f37f7a9\") " pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:35:27.632981 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:27.632959 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4xg8\" (UniqueName: \"kubernetes.io/projected/aab3ef63-f667-4177-bb17-b5284f37f7a9-kube-api-access-x4xg8\") pod \"network-check-target-qm26m\" (UID: \"aab3ef63-f667-4177-bb17-b5284f37f7a9\") " pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:35:27.633710 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:27.633690 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72nxw" Jul 27 20:35:27.758069 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:27.758035 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-72nxw"] Jul 27 20:35:27.761205 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:35:27.761180 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5f20bb2_f6c8_4ab0_9bf4_911c0b2bf99f.slice/crio-beb37f5ecd0ae8b887ad2e31aeabea169578833e37cc50810269c78d822a7c64 WatchSource:0}: Error finding container beb37f5ecd0ae8b887ad2e31aeabea169578833e37cc50810269c78d822a7c64: Status 404 returned error can't find the container with id beb37f5ecd0ae8b887ad2e31aeabea169578833e37cc50810269c78d822a7c64 Jul 27 20:35:27.826063 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:27.826032 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wzbh\"" Jul 27 20:35:27.834699 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:27.834668 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh9q6" Jul 27 20:35:27.928215 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:27.927840 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z8hwp\"" Jul 27 20:35:27.936835 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:27.936736 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:35:27.959909 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:27.959790 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zh9q6"] Jul 27 20:35:27.962851 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:35:27.962825 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8904ad3_db74_4e35_8ca0_1374ae5af9ec.slice/crio-599fce0783e9ca5747d3111c4f4fce0a2e9a20150f8ab8f24c67d536e192b2c7 WatchSource:0}: Error finding container 599fce0783e9ca5747d3111c4f4fce0a2e9a20150f8ab8f24c67d536e192b2c7: Status 404 returned error can't find the container with id 599fce0783e9ca5747d3111c4f4fce0a2e9a20150f8ab8f24c67d536e192b2c7 Jul 27 20:35:28.063590 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.063557 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qm26m"] Jul 27 20:35:28.066375 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:35:28.066346 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaab3ef63_f667_4177_bb17_b5284f37f7a9.slice/crio-5922a6c8f9374288acfc529f07b05f7bf889411ed7145aae5050a4a790e6fe92 WatchSource:0}: Error finding container 5922a6c8f9374288acfc529f07b05f7bf889411ed7145aae5050a4a790e6fe92: Status 404 returned error can't find the container with id 5922a6c8f9374288acfc529f07b05f7bf889411ed7145aae5050a4a790e6fe92 Jul 27 20:35:28.092536 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.092487 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zh9q6" event={"ID":"a8904ad3-db74-4e35-8ca0-1374ae5af9ec","Type":"ContainerStarted","Data":"599fce0783e9ca5747d3111c4f4fce0a2e9a20150f8ab8f24c67d536e192b2c7"} Jul 27 20:35:28.093668 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.093633 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-72nxw" event={"ID":"f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f","Type":"ContainerStarted","Data":"beb37f5ecd0ae8b887ad2e31aeabea169578833e37cc50810269c78d822a7c64"} Jul 27 20:35:28.094696 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.094677 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qm26m" event={"ID":"aab3ef63-f667-4177-bb17-b5284f37f7a9","Type":"ContainerStarted","Data":"5922a6c8f9374288acfc529f07b05f7bf889411ed7145aae5050a4a790e6fe92"} Jul 27 20:35:28.740649 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.740614 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-576d4499bf-5vq2d"] Jul 27 20:35:28.742825 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.742799 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-576d4499bf-5vq2d" Jul 27 20:35:28.748192 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.747880 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 27 20:35:28.748192 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.747939 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 27 20:35:28.748192 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.747880 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 27 20:35:28.748192 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.748150 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 27 20:35:28.752319 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.751369 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-576d4499bf-5vq2d"] Jul 27 20:35:28.840468 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.840433 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmt2m\" (UniqueName: \"kubernetes.io/projected/28948a8a-d674-4a4e-8a82-652262d8656b-kube-api-access-kmt2m\") pod \"klusterlet-addon-workmgr-576d4499bf-5vq2d\" (UID: \"28948a8a-d674-4a4e-8a82-652262d8656b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-576d4499bf-5vq2d" Jul 27 20:35:28.840668 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.840567 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/28948a8a-d674-4a4e-8a82-652262d8656b-klusterlet-config\") pod \"klusterlet-addon-workmgr-576d4499bf-5vq2d\" (UID: \"28948a8a-d674-4a4e-8a82-652262d8656b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-576d4499bf-5vq2d" Jul 27 20:35:28.840668 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.840607 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28948a8a-d674-4a4e-8a82-652262d8656b-tmp\") pod \"klusterlet-addon-workmgr-576d4499bf-5vq2d\" (UID: \"28948a8a-d674-4a4e-8a82-652262d8656b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-576d4499bf-5vq2d" Jul 27 20:35:28.849040 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.849014 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-df4d6c7f7-c6rbs"] Jul 27 20:35:28.851977 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.851027 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-df4d6c7f7-c6rbs" Jul 27 20:35:28.853674 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.853649 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 27 20:35:28.853970 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.853941 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-75n4f\"" Jul 27 20:35:28.854076 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.853975 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 27 20:35:28.854076 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.853998 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 27 20:35:28.854227 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.854091 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 27 20:35:28.854227 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.853952 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 27 20:35:28.854373 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.854360 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 27 20:35:28.875118 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.875086 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-df4d6c7f7-c6rbs"] Jul 27 20:35:28.941371 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.941339 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/28948a8a-d674-4a4e-8a82-652262d8656b-klusterlet-config\") pod \"klusterlet-addon-workmgr-576d4499bf-5vq2d\" (UID: \"28948a8a-d674-4a4e-8a82-652262d8656b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-576d4499bf-5vq2d" Jul 27 20:35:28.941547 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.941386 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28948a8a-d674-4a4e-8a82-652262d8656b-tmp\") pod \"klusterlet-addon-workmgr-576d4499bf-5vq2d\" (UID: \"28948a8a-d674-4a4e-8a82-652262d8656b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-576d4499bf-5vq2d" Jul 27 20:35:28.941625 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.941538 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmt2m\" (UniqueName: \"kubernetes.io/projected/28948a8a-d674-4a4e-8a82-652262d8656b-kube-api-access-kmt2m\") pod \"klusterlet-addon-workmgr-576d4499bf-5vq2d\" (UID: \"28948a8a-d674-4a4e-8a82-652262d8656b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-576d4499bf-5vq2d" Jul 27 20:35:28.941689 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.941625 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqldr\" (UniqueName: \"kubernetes.io/projected/53aaa9bb-eb53-4770-9be9-2e79087a20c7-kube-api-access-gqldr\") pod \"router-default-df4d6c7f7-c6rbs\" (UID: \"53aaa9bb-eb53-4770-9be9-2e79087a20c7\") " pod="openshift-ingress/router-default-df4d6c7f7-c6rbs" Jul 27 20:35:28.941689 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.941666 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/53aaa9bb-eb53-4770-9be9-2e79087a20c7-stats-auth\") pod \"router-default-df4d6c7f7-c6rbs\" (UID: \"53aaa9bb-eb53-4770-9be9-2e79087a20c7\") " pod="openshift-ingress/router-default-df4d6c7f7-c6rbs" Jul 27 20:35:28.941785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.941693 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/53aaa9bb-eb53-4770-9be9-2e79087a20c7-default-certificate\") pod \"router-default-df4d6c7f7-c6rbs\" (UID: \"53aaa9bb-eb53-4770-9be9-2e79087a20c7\") " pod="openshift-ingress/router-default-df4d6c7f7-c6rbs" Jul 27 20:35:28.941785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.941721 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53aaa9bb-eb53-4770-9be9-2e79087a20c7-metrics-certs\") pod \"router-default-df4d6c7f7-c6rbs\" (UID: \"53aaa9bb-eb53-4770-9be9-2e79087a20c7\") " pod="openshift-ingress/router-default-df4d6c7f7-c6rbs" Jul 27 20:35:28.941785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.941770 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28948a8a-d674-4a4e-8a82-652262d8656b-tmp\") pod \"klusterlet-addon-workmgr-576d4499bf-5vq2d\" (UID: \"28948a8a-d674-4a4e-8a82-652262d8656b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-576d4499bf-5vq2d" Jul 27 20:35:28.941914 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.941784 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53aaa9bb-eb53-4770-9be9-2e79087a20c7-service-ca-bundle\") pod \"router-default-df4d6c7f7-c6rbs\" (UID: \"53aaa9bb-eb53-4770-9be9-2e79087a20c7\") " pod="openshift-ingress/router-default-df4d6c7f7-c6rbs" Jul 27 20:35:28.944131 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.944112 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/28948a8a-d674-4a4e-8a82-652262d8656b-klusterlet-config\") pod \"klusterlet-addon-workmgr-576d4499bf-5vq2d\" (UID: \"28948a8a-d674-4a4e-8a82-652262d8656b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-576d4499bf-5vq2d" Jul 27 20:35:28.956325 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:28.956292 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmt2m\" (UniqueName: \"kubernetes.io/projected/28948a8a-d674-4a4e-8a82-652262d8656b-kube-api-access-kmt2m\") pod \"klusterlet-addon-workmgr-576d4499bf-5vq2d\" (UID: \"28948a8a-d674-4a4e-8a82-652262d8656b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-576d4499bf-5vq2d" Jul 27 20:35:29.043231 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:29.043205 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqldr\" (UniqueName: \"kubernetes.io/projected/53aaa9bb-eb53-4770-9be9-2e79087a20c7-kube-api-access-gqldr\") pod \"router-default-df4d6c7f7-c6rbs\" (UID: \"53aaa9bb-eb53-4770-9be9-2e79087a20c7\") " pod="openshift-ingress/router-default-df4d6c7f7-c6rbs" Jul 27 20:35:29.043390 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:29.043252 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/53aaa9bb-eb53-4770-9be9-2e79087a20c7-stats-auth\") pod \"router-default-df4d6c7f7-c6rbs\" (UID: \"53aaa9bb-eb53-4770-9be9-2e79087a20c7\") " pod="openshift-ingress/router-default-df4d6c7f7-c6rbs" Jul 27 20:35:29.043390 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:29.043274 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/53aaa9bb-eb53-4770-9be9-2e79087a20c7-default-certificate\") pod \"router-default-df4d6c7f7-c6rbs\" (UID: \"53aaa9bb-eb53-4770-9be9-2e79087a20c7\") " pod="openshift-ingress/router-default-df4d6c7f7-c6rbs" Jul 27 20:35:29.043390 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:29.043294 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53aaa9bb-eb53-4770-9be9-2e79087a20c7-metrics-certs\") pod \"router-default-df4d6c7f7-c6rbs\" (UID: \"53aaa9bb-eb53-4770-9be9-2e79087a20c7\") " pod="openshift-ingress/router-default-df4d6c7f7-c6rbs" Jul 27 20:35:29.043390 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:29.043347 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53aaa9bb-eb53-4770-9be9-2e79087a20c7-service-ca-bundle\") pod \"router-default-df4d6c7f7-c6rbs\" (UID: \"53aaa9bb-eb53-4770-9be9-2e79087a20c7\") " pod="openshift-ingress/router-default-df4d6c7f7-c6rbs" Jul 27 20:35:29.044131 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:29.044105 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53aaa9bb-eb53-4770-9be9-2e79087a20c7-service-ca-bundle\") pod \"router-default-df4d6c7f7-c6rbs\" (UID: \"53aaa9bb-eb53-4770-9be9-2e79087a20c7\") " pod="openshift-ingress/router-default-df4d6c7f7-c6rbs" Jul 27 20:35:29.046421 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:29.046400 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53aaa9bb-eb53-4770-9be9-2e79087a20c7-metrics-certs\") pod \"router-default-df4d6c7f7-c6rbs\" (UID: \"53aaa9bb-eb53-4770-9be9-2e79087a20c7\") " pod="openshift-ingress/router-default-df4d6c7f7-c6rbs" Jul 27 20:35:29.046582 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:29.046566 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/53aaa9bb-eb53-4770-9be9-2e79087a20c7-stats-auth\") pod \"router-default-df4d6c7f7-c6rbs\" (UID: \"53aaa9bb-eb53-4770-9be9-2e79087a20c7\") " pod="openshift-ingress/router-default-df4d6c7f7-c6rbs" Jul 27 20:35:29.046648 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:29.046607 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/53aaa9bb-eb53-4770-9be9-2e79087a20c7-default-certificate\") pod \"router-default-df4d6c7f7-c6rbs\" (UID: \"53aaa9bb-eb53-4770-9be9-2e79087a20c7\") " pod="openshift-ingress/router-default-df4d6c7f7-c6rbs" Jul 27 20:35:29.055036 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:29.055012 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqldr\" (UniqueName: \"kubernetes.io/projected/53aaa9bb-eb53-4770-9be9-2e79087a20c7-kube-api-access-gqldr\") pod \"router-default-df4d6c7f7-c6rbs\" (UID: \"53aaa9bb-eb53-4770-9be9-2e79087a20c7\") " pod="openshift-ingress/router-default-df4d6c7f7-c6rbs" Jul 27 20:35:29.058171 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:29.058149 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-576d4499bf-5vq2d" Jul 27 20:35:29.103355 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:29.101949 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zh9q6" event={"ID":"a8904ad3-db74-4e35-8ca0-1374ae5af9ec","Type":"ContainerStarted","Data":"8998300aedced9491eca0aa3014a450da9dfd217e5a6ce934473953088d80a87"} Jul 27 20:35:29.103355 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:29.102011 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zh9q6" event={"ID":"a8904ad3-db74-4e35-8ca0-1374ae5af9ec","Type":"ContainerStarted","Data":"6909631f8fe724560aff831567088116efe7eb0e98a569389c7073fa5cc6b493"} Jul 27 20:35:29.105886 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:29.105855 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qm26m" event={"ID":"aab3ef63-f667-4177-bb17-b5284f37f7a9","Type":"ContainerStarted","Data":"cd1e9c0c5b26df4accdef875c86276edcf91dd2ea14e831aef8a019f1d6eb651"} Jul 27 20:35:29.106013 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:29.105916 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:35:29.147136 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:29.147037 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zh9q6" podStartSLOduration=65.253140324 podStartE2EDuration="1m6.147015319s" totalImagesPullingTime="893.874995ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:29.12307979 +0000 UTC m=+66.876324123" watchObservedRunningTime="2026-07-27 20:35:29.147015319 +0000 UTC m=+66.900259651" Jul 27 20:35:29.147642 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:29.147607 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qm26m" podStartSLOduration=66.147596894 podStartE2EDuration="1m6.147596894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:34:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:29.146886549 +0000 UTC m=+66.900130880" watchObservedRunningTime="2026-07-27 20:35:29.147596894 +0000 UTC m=+66.900841226" Jul 27 20:35:29.163958 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:29.163932 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-df4d6c7f7-c6rbs" Jul 27 20:35:29.208077 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:29.208039 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-576d4499bf-5vq2d"] Jul 27 20:35:29.211825 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:35:29.211786 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28948a8a_d674_4a4e_8a82_652262d8656b.slice/crio-cac9b2e4b1e2c38450aaebcfd20a3f6ab368cd853c7646ba16a57ba1c0d821f2 WatchSource:0}: Error finding container cac9b2e4b1e2c38450aaebcfd20a3f6ab368cd853c7646ba16a57ba1c0d821f2: Status 404 returned error can't find the container with id cac9b2e4b1e2c38450aaebcfd20a3f6ab368cd853c7646ba16a57ba1c0d821f2 Jul 27 20:35:29.318513 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:29.318432 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-df4d6c7f7-c6rbs"] Jul 27 20:35:29.321601 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:35:29.321569 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53aaa9bb_eb53_4770_9be9_2e79087a20c7.slice/crio-ca6802b3fcfbf1326bcb50a6acf70ca019aec0a1e08e67c3522bc28ce0532fd1 WatchSource:0}: Error finding container ca6802b3fcfbf1326bcb50a6acf70ca019aec0a1e08e67c3522bc28ce0532fd1: Status 404 returned error can't find the container with id ca6802b3fcfbf1326bcb50a6acf70ca019aec0a1e08e67c3522bc28ce0532fd1 Jul 27 20:35:30.049991 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:30.049946 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/739a7fa3-aa14-4e4d-958e-f16b7c81fd5a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-jncsv\" (UID: \"739a7fa3-aa14-4e4d-958e-f16b7c81fd5a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-jncsv" Jul 27 20:35:30.050449 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:30.050022 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-tls\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:35:30.050449 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:30.050072 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43074e6a-caf7-4f21-95eb-9df294467f17-metrics-tls\") pod \"dns-default-qfczc\" (UID: \"43074e6a-caf7-4f21-95eb-9df294467f17\") " pod="openshift-dns/dns-default-qfczc" Jul 27 20:35:30.052825 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:30.052796 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/739a7fa3-aa14-4e4d-958e-f16b7c81fd5a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-jncsv\" (UID: \"739a7fa3-aa14-4e4d-958e-f16b7c81fd5a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-jncsv" Jul 27 20:35:30.053114 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:30.053091 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43074e6a-caf7-4f21-95eb-9df294467f17-metrics-tls\") pod \"dns-default-qfczc\" (UID: \"43074e6a-caf7-4f21-95eb-9df294467f17\") " pod="openshift-dns/dns-default-qfczc" Jul 27 20:35:30.053199 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:30.053159 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-tls\") pod \"image-registry-f9c674658-hrc5h\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:35:30.112200 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:30.112156 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-df4d6c7f7-c6rbs" event={"ID":"53aaa9bb-eb53-4770-9be9-2e79087a20c7","Type":"ContainerStarted","Data":"826330bccfcc15efcd4accc112671d6089171673440e0956844c03c6fe42693f"} Jul 27 20:35:30.112386 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:30.112220 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-df4d6c7f7-c6rbs" event={"ID":"53aaa9bb-eb53-4770-9be9-2e79087a20c7","Type":"ContainerStarted","Data":"ca6802b3fcfbf1326bcb50a6acf70ca019aec0a1e08e67c3522bc28ce0532fd1"} Jul 27 20:35:30.113564 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:30.113515 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-576d4499bf-5vq2d" event={"ID":"28948a8a-d674-4a4e-8a82-652262d8656b","Type":"ContainerStarted","Data":"cac9b2e4b1e2c38450aaebcfd20a3f6ab368cd853c7646ba16a57ba1c0d821f2"} Jul 27 20:35:30.131253 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:30.131199 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-df4d6c7f7-c6rbs" podStartSLOduration=2.131178748 podStartE2EDuration="2.131178748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:30.130122455 +0000 UTC m=+67.883366786" watchObservedRunningTime="2026-07-27 20:35:30.131178748 +0000 UTC m=+67.884423070" Jul 27 20:35:30.164990 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:30.164950 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-df4d6c7f7-c6rbs" Jul 27 20:35:30.167495 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:30.167471 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-df4d6c7f7-c6rbs" Jul 27 20:35:30.224141 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:30.224115 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hj2k5\"" Jul 27 20:35:30.231823 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:30.231797 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:35:30.252073 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:30.252050 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tnxv4\"" Jul 27 20:35:30.260681 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:30.260656 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-jncsv" Jul 27 20:35:30.266188 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:30.266150 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-89mzs\"" Jul 27 20:35:30.274929 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:30.274860 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qfczc" Jul 27 20:35:30.416715 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:30.416533 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f9c674658-hrc5h"] Jul 27 20:35:30.486956 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:30.486924 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-jncsv"] Jul 27 20:35:30.509637 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:30.509610 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qfczc"] Jul 27 20:35:31.119035 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:31.119003 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-df4d6c7f7-c6rbs" Jul 27 20:35:31.126883 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:31.126821 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-df4d6c7f7-c6rbs" Jul 27 20:35:32.120886 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:32.120845 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7hv5j"] Jul 27 20:35:32.137110 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:32.137079 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7hv5j"] Jul 27 20:35:32.137328 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:32.137305 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7hv5j" Jul 27 20:35:32.139082 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:32.139061 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 27 20:35:32.139239 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:32.139146 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t5cnl\"" Jul 27 20:35:32.141612 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:32.141593 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 27 20:35:32.141806 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:32.141784 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 27 20:35:32.141927 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:32.141914 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 27 20:35:32.267730 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:32.267687 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-crio-socket\") pod \"insights-runtime-extractor-7hv5j\" (UID: \"0e7c5c7a-6104-4fe2-b86b-c037db0458ae\") " pod="openshift-insights/insights-runtime-extractor-7hv5j" Jul 27 20:35:32.267871 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:32.267761 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7hv5j\" (UID: \"0e7c5c7a-6104-4fe2-b86b-c037db0458ae\") " pod="openshift-insights/insights-runtime-extractor-7hv5j" Jul 27 20:35:32.267871 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:32.267794 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7hv5j\" (UID: \"0e7c5c7a-6104-4fe2-b86b-c037db0458ae\") " pod="openshift-insights/insights-runtime-extractor-7hv5j" Jul 27 20:35:32.267871 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:32.267811 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dr8f\" (UniqueName: \"kubernetes.io/projected/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-kube-api-access-4dr8f\") pod \"insights-runtime-extractor-7hv5j\" (UID: \"0e7c5c7a-6104-4fe2-b86b-c037db0458ae\") " pod="openshift-insights/insights-runtime-extractor-7hv5j" Jul 27 20:35:32.268068 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:32.268040 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-data-volume\") pod \"insights-runtime-extractor-7hv5j\" (UID: \"0e7c5c7a-6104-4fe2-b86b-c037db0458ae\") " pod="openshift-insights/insights-runtime-extractor-7hv5j" Jul 27 20:35:32.272033 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:35:32.272008 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44beca5c_6e02_4013_9941_62fd7ee205dc.slice/crio-3d19bdb18585a35b418b66752b5f8439ecfda468cc0333dcea12d9e75947b669 WatchSource:0}: Error finding container 3d19bdb18585a35b418b66752b5f8439ecfda468cc0333dcea12d9e75947b669: Status 404 returned error can't find the container with id 3d19bdb18585a35b418b66752b5f8439ecfda468cc0333dcea12d9e75947b669 Jul 27 20:35:32.272964 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:35:32.272695 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod739a7fa3_aa14_4e4d_958e_f16b7c81fd5a.slice/crio-37b765cba4b1cb10d62d1e464486d619f963becb716a64c7a3885864facf2361 WatchSource:0}: Error finding container 37b765cba4b1cb10d62d1e464486d619f963becb716a64c7a3885864facf2361: Status 404 returned error can't find the container with id 37b765cba4b1cb10d62d1e464486d619f963becb716a64c7a3885864facf2361 Jul 27 20:35:32.273509 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:35:32.273491 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43074e6a_caf7_4f21_95eb_9df294467f17.slice/crio-552c0f638a104df255d83e162881b6d16e2dc3da35cde108f9f92e9b35fa199c WatchSource:0}: Error finding container 552c0f638a104df255d83e162881b6d16e2dc3da35cde108f9f92e9b35fa199c: Status 404 returned error can't find the container with id 552c0f638a104df255d83e162881b6d16e2dc3da35cde108f9f92e9b35fa199c Jul 27 20:35:32.368560 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:32.368507 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-data-volume\") pod \"insights-runtime-extractor-7hv5j\" (UID: \"0e7c5c7a-6104-4fe2-b86b-c037db0458ae\") " pod="openshift-insights/insights-runtime-extractor-7hv5j" Jul 27 20:35:32.368560 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:32.368566 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-crio-socket\") pod \"insights-runtime-extractor-7hv5j\" (UID: \"0e7c5c7a-6104-4fe2-b86b-c037db0458ae\") " pod="openshift-insights/insights-runtime-extractor-7hv5j" Jul 27 20:35:32.368776 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:32.368602 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7hv5j\" (UID: \"0e7c5c7a-6104-4fe2-b86b-c037db0458ae\") " pod="openshift-insights/insights-runtime-extractor-7hv5j" Jul 27 20:35:32.368776 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:32.368630 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7hv5j\" (UID: \"0e7c5c7a-6104-4fe2-b86b-c037db0458ae\") " pod="openshift-insights/insights-runtime-extractor-7hv5j" Jul 27 20:35:32.368776 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:32.368652 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dr8f\" (UniqueName: \"kubernetes.io/projected/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-kube-api-access-4dr8f\") pod \"insights-runtime-extractor-7hv5j\" (UID: \"0e7c5c7a-6104-4fe2-b86b-c037db0458ae\") " pod="openshift-insights/insights-runtime-extractor-7hv5j" Jul 27 20:35:32.368776 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:32.368711 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-crio-socket\") pod \"insights-runtime-extractor-7hv5j\" (UID: \"0e7c5c7a-6104-4fe2-b86b-c037db0458ae\") " pod="openshift-insights/insights-runtime-extractor-7hv5j" Jul 27 20:35:32.368776 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:32.368723 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 20:35:32.368776 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:32.368768 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 20:35:32.368991 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:32.368837 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-kube-rbac-proxy-cm podName:0e7c5c7a-6104-4fe2-b86b-c037db0458ae nodeName:}" failed. No retries permitted until 2026-07-27 20:35:32.868815852 +0000 UTC m=+70.622060181 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7hv5j" (UID: "0e7c5c7a-6104-4fe2-b86b-c037db0458ae") : configmap "kube-rbac-proxy" not found Jul 27 20:35:32.368991 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:32.368852 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-insights-runtime-extractor-tls podName:0e7c5c7a-6104-4fe2-b86b-c037db0458ae nodeName:}" failed. No retries permitted until 2026-07-27 20:35:32.868846272 +0000 UTC m=+70.622090615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7hv5j" (UID: "0e7c5c7a-6104-4fe2-b86b-c037db0458ae") : secret "insights-runtime-extractor-tls" not found Jul 27 20:35:32.368991 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:32.368873 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-data-volume\") pod \"insights-runtime-extractor-7hv5j\" (UID: \"0e7c5c7a-6104-4fe2-b86b-c037db0458ae\") " pod="openshift-insights/insights-runtime-extractor-7hv5j" Jul 27 20:35:32.377563 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:32.377479 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dr8f\" (UniqueName: \"kubernetes.io/projected/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-kube-api-access-4dr8f\") pod \"insights-runtime-extractor-7hv5j\" (UID: \"0e7c5c7a-6104-4fe2-b86b-c037db0458ae\") " pod="openshift-insights/insights-runtime-extractor-7hv5j" Jul 27 20:35:32.873595 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:32.873550 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7hv5j\" (UID: \"0e7c5c7a-6104-4fe2-b86b-c037db0458ae\") " pod="openshift-insights/insights-runtime-extractor-7hv5j" Jul 27 20:35:32.873787 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:32.873612 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7hv5j\" (UID: \"0e7c5c7a-6104-4fe2-b86b-c037db0458ae\") " pod="openshift-insights/insights-runtime-extractor-7hv5j" Jul 27 20:35:32.873787 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:32.873669 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 20:35:32.873787 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:32.873756 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 20:35:32.873942 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:32.873761 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-kube-rbac-proxy-cm podName:0e7c5c7a-6104-4fe2-b86b-c037db0458ae nodeName:}" failed. No retries permitted until 2026-07-27 20:35:33.87374044 +0000 UTC m=+71.626984752 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7hv5j" (UID: "0e7c5c7a-6104-4fe2-b86b-c037db0458ae") : configmap "kube-rbac-proxy" not found Jul 27 20:35:32.873942 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:32.873823 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-insights-runtime-extractor-tls podName:0e7c5c7a-6104-4fe2-b86b-c037db0458ae nodeName:}" failed. No retries permitted until 2026-07-27 20:35:33.873810358 +0000 UTC m=+71.627054666 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7hv5j" (UID: "0e7c5c7a-6104-4fe2-b86b-c037db0458ae") : secret "insights-runtime-extractor-tls" not found Jul 27 20:35:32.997421 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:32.997391 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xdrfx"] Jul 27 20:35:33.023201 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:33.023172 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xdrfx"] Jul 27 20:35:33.023339 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:33.023284 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xdrfx" Jul 27 20:35:33.025247 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:33.025223 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 27 20:35:33.025377 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:33.025347 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xdl97\"" Jul 27 20:35:33.075638 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:33.075602 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7f9ddf3e-85fe-4916-81fd-076999b321ee-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-xdrfx\" (UID: \"7f9ddf3e-85fe-4916-81fd-076999b321ee\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xdrfx" Jul 27 20:35:33.126648 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:33.126573 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-jncsv" event={"ID":"739a7fa3-aa14-4e4d-958e-f16b7c81fd5a","Type":"ContainerStarted","Data":"37b765cba4b1cb10d62d1e464486d619f963becb716a64c7a3885864facf2361"} Jul 27 20:35:33.127693 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:33.127672 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qfczc" event={"ID":"43074e6a-caf7-4f21-95eb-9df294467f17","Type":"ContainerStarted","Data":"552c0f638a104df255d83e162881b6d16e2dc3da35cde108f9f92e9b35fa199c"} Jul 27 20:35:33.129031 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:33.128984 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f9c674658-hrc5h" event={"ID":"44beca5c-6e02-4013-9941-62fd7ee205dc","Type":"ContainerStarted","Data":"3d19bdb18585a35b418b66752b5f8439ecfda468cc0333dcea12d9e75947b669"} Jul 27 20:35:33.176746 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:33.176711 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7f9ddf3e-85fe-4916-81fd-076999b321ee-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-xdrfx\" (UID: \"7f9ddf3e-85fe-4916-81fd-076999b321ee\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xdrfx" Jul 27 20:35:33.176902 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:33.176872 2554 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 27 20:35:33.176945 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:33.176936 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f9ddf3e-85fe-4916-81fd-076999b321ee-tls-certificates podName:7f9ddf3e-85fe-4916-81fd-076999b321ee nodeName:}" failed. No retries permitted until 2026-07-27 20:35:33.676920954 +0000 UTC m=+71.430165266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/7f9ddf3e-85fe-4916-81fd-076999b321ee-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-xdrfx" (UID: "7f9ddf3e-85fe-4916-81fd-076999b321ee") : secret "prometheus-operator-admission-webhook-tls" not found Jul 27 20:35:33.444249 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:33.444160 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-xpl57"] Jul 27 20:35:33.448498 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:33.448476 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-xpl57" Jul 27 20:35:33.450803 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:33.450771 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-gdcwd\"" Jul 27 20:35:33.450926 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:33.450820 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 27 20:35:33.450926 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:33.450778 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 27 20:35:33.457391 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:33.457352 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-xpl57"] Jul 27 20:35:33.579903 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:33.579867 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgrxp\" (UniqueName: \"kubernetes.io/projected/f82a32cf-486a-4973-b057-0b79655d301c-kube-api-access-sgrxp\") pod \"downloads-7c97dc4555-xpl57\" (UID: \"f82a32cf-486a-4973-b057-0b79655d301c\") " pod="openshift-console/downloads-7c97dc4555-xpl57" Jul 27 20:35:33.680463 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:33.680415 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7f9ddf3e-85fe-4916-81fd-076999b321ee-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-xdrfx\" (UID: \"7f9ddf3e-85fe-4916-81fd-076999b321ee\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xdrfx" Jul 27 20:35:33.680684 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:33.680484 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgrxp\" (UniqueName: \"kubernetes.io/projected/f82a32cf-486a-4973-b057-0b79655d301c-kube-api-access-sgrxp\") pod \"downloads-7c97dc4555-xpl57\" (UID: \"f82a32cf-486a-4973-b057-0b79655d301c\") " pod="openshift-console/downloads-7c97dc4555-xpl57" Jul 27 20:35:33.683408 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:33.683378 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7f9ddf3e-85fe-4916-81fd-076999b321ee-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-xdrfx\" (UID: \"7f9ddf3e-85fe-4916-81fd-076999b321ee\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xdrfx" Jul 27 20:35:33.689613 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:33.689580 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgrxp\" (UniqueName: \"kubernetes.io/projected/f82a32cf-486a-4973-b057-0b79655d301c-kube-api-access-sgrxp\") pod \"downloads-7c97dc4555-xpl57\" (UID: \"f82a32cf-486a-4973-b057-0b79655d301c\") " pod="openshift-console/downloads-7c97dc4555-xpl57" Jul 27 20:35:33.760742 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:33.760701 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-xpl57" Jul 27 20:35:33.883300 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:33.883262 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7hv5j\" (UID: \"0e7c5c7a-6104-4fe2-b86b-c037db0458ae\") " pod="openshift-insights/insights-runtime-extractor-7hv5j" Jul 27 20:35:33.883495 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:33.883371 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7hv5j\" (UID: \"0e7c5c7a-6104-4fe2-b86b-c037db0458ae\") " pod="openshift-insights/insights-runtime-extractor-7hv5j" Jul 27 20:35:33.883495 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:33.883425 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 20:35:33.883495 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:33.883450 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 20:35:33.883659 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:33.883501 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-insights-runtime-extractor-tls podName:0e7c5c7a-6104-4fe2-b86b-c037db0458ae nodeName:}" failed. No retries permitted until 2026-07-27 20:35:35.88348159 +0000 UTC m=+73.636725898 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7hv5j" (UID: "0e7c5c7a-6104-4fe2-b86b-c037db0458ae") : secret "insights-runtime-extractor-tls" not found Jul 27 20:35:33.883659 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:33.883531 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-kube-rbac-proxy-cm podName:0e7c5c7a-6104-4fe2-b86b-c037db0458ae nodeName:}" failed. No retries permitted until 2026-07-27 20:35:35.883510251 +0000 UTC m=+73.636754559 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7hv5j" (UID: "0e7c5c7a-6104-4fe2-b86b-c037db0458ae") : configmap "kube-rbac-proxy" not found Jul 27 20:35:33.931988 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:33.931948 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xdrfx" Jul 27 20:35:34.209756 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:34.209688 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q55tf_5dccd741-555f-4715-89bc-dd6df8888a9d/dns-node-resolver/0.log" Jul 27 20:35:34.652460 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:34.652432 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xdrfx"] Jul 27 20:35:34.657667 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:35:34.657634 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f9ddf3e_85fe_4916_81fd_076999b321ee.slice/crio-26cc7dc44645d9fdc8f77daef6f20f50c60be89ba8dd808efe720727c033f3a7 WatchSource:0}: Error finding container 26cc7dc44645d9fdc8f77daef6f20f50c60be89ba8dd808efe720727c033f3a7: Status 404 returned error can't find the container with id 26cc7dc44645d9fdc8f77daef6f20f50c60be89ba8dd808efe720727c033f3a7 Jul 27 20:35:34.669992 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:34.669970 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-xpl57"] Jul 27 20:35:34.770066 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:35:34.770022 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf82a32cf_486a_4973_b057_0b79655d301c.slice/crio-6a1740242c2f163ac61af3b4e3d1fcce7bc9e5e1b6d82a16ec3f658aa8ee5141 WatchSource:0}: Error finding container 6a1740242c2f163ac61af3b4e3d1fcce7bc9e5e1b6d82a16ec3f658aa8ee5141: Status 404 returned error can't find the container with id 6a1740242c2f163ac61af3b4e3d1fcce7bc9e5e1b6d82a16ec3f658aa8ee5141 Jul 27 20:35:35.140477 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:35.140387 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f9c674658-hrc5h" event={"ID":"44beca5c-6e02-4013-9941-62fd7ee205dc","Type":"ContainerStarted","Data":"44e22d01b224dd4e2369e0d9eccc7f31a3e7b238c380f16e976fbcd53a45d723"} Jul 27 20:35:35.140477 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:35.140476 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:35:35.142213 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:35.142185 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xdrfx" event={"ID":"7f9ddf3e-85fe-4916-81fd-076999b321ee","Type":"ContainerStarted","Data":"26cc7dc44645d9fdc8f77daef6f20f50c60be89ba8dd808efe720727c033f3a7"} Jul 27 20:35:35.144189 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:35.144155 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-72nxw" event={"ID":"f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f","Type":"ContainerStarted","Data":"18e8772859f728f01baff1e44e8c40fa7259148e9fe08aeba4982ede22e61834"} Jul 27 20:35:35.146341 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:35.146318 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-576d4499bf-5vq2d" event={"ID":"28948a8a-d674-4a4e-8a82-652262d8656b","Type":"ContainerStarted","Data":"0b1b08300b24efc3a6e0429825d07599c1d8bba62ac4400c35523db23fcb40ec"} Jul 27 20:35:35.146606 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:35.146465 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-576d4499bf-5vq2d" Jul 27 20:35:35.148400 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:35.148382 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-576d4499bf-5vq2d" Jul 27 20:35:35.149784 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:35.149759 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-xpl57" event={"ID":"f82a32cf-486a-4973-b057-0b79655d301c","Type":"ContainerStarted","Data":"6a1740242c2f163ac61af3b4e3d1fcce7bc9e5e1b6d82a16ec3f658aa8ee5141"} Jul 27 20:35:35.161014 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:35.160019 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f9c674658-hrc5h" podStartSLOduration=71.160004181 podStartE2EDuration="1m11.160004181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:34:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:35.159453545 +0000 UTC m=+72.912697874" watchObservedRunningTime="2026-07-27 20:35:35.160004181 +0000 UTC m=+72.913248513" Jul 27 20:35:35.190447 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:35.190321 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-576d4499bf-5vq2d" podStartSLOduration=1.607358621 podStartE2EDuration="7.19028309s" totalImagesPullingTime="5.582924469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:35.17573508 +0000 UTC m=+72.928979413" watchObservedRunningTime="2026-07-27 20:35:35.19028309 +0000 UTC m=+72.943527421" Jul 27 20:35:35.191648 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:35.190638 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-72nxw" podStartSLOduration=65.465556824 podStartE2EDuration="1m12.190626445s" totalImagesPullingTime="6.725069621s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:35.18912085 +0000 UTC m=+72.942365182" watchObservedRunningTime="2026-07-27 20:35:35.190626445 +0000 UTC m=+72.943870777" Jul 27 20:35:35.215703 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:35.215676 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l6kb4_ccbf7d58-4b22-4192-8b66-be1dd1f18309/node-ca/0.log" Jul 27 20:35:35.610831 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:35.610787 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-df4d6c7f7-c6rbs_53aaa9bb-eb53-4770-9be9-2e79087a20c7/router/0.log" Jul 27 20:35:35.929761 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:35.928943 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7hv5j\" (UID: \"0e7c5c7a-6104-4fe2-b86b-c037db0458ae\") " pod="openshift-insights/insights-runtime-extractor-7hv5j" Jul 27 20:35:35.929761 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:35.929002 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7hv5j\" (UID: \"0e7c5c7a-6104-4fe2-b86b-c037db0458ae\") " pod="openshift-insights/insights-runtime-extractor-7hv5j" Jul 27 20:35:35.929761 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:35.929162 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 20:35:35.929761 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:35.929226 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-insights-runtime-extractor-tls podName:0e7c5c7a-6104-4fe2-b86b-c037db0458ae nodeName:}" failed. No retries permitted until 2026-07-27 20:35:39.929207931 +0000 UTC m=+77.682452248 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7hv5j" (UID: "0e7c5c7a-6104-4fe2-b86b-c037db0458ae") : secret "insights-runtime-extractor-tls" not found Jul 27 20:35:35.929761 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:35.929624 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 20:35:35.929761 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:35.929678 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-kube-rbac-proxy-cm podName:0e7c5c7a-6104-4fe2-b86b-c037db0458ae nodeName:}" failed. No retries permitted until 2026-07-27 20:35:39.929662166 +0000 UTC m=+77.682906480 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7hv5j" (UID: "0e7c5c7a-6104-4fe2-b86b-c037db0458ae") : configmap "kube-rbac-proxy" not found Jul 27 20:35:36.210583 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:36.210502 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8n4dm_025bed99-b1ce-4015-a0b6-cb53a49942c3/serve-healthcheck-canary/0.log" Jul 27 20:35:37.162484 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:37.162441 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qfczc" event={"ID":"43074e6a-caf7-4f21-95eb-9df294467f17","Type":"ContainerStarted","Data":"dc58142cef96296e7a96be9b6cbae5abffe371f59030059c3d04a675497d5292"} Jul 27 20:35:37.162953 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:37.162503 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qfczc" event={"ID":"43074e6a-caf7-4f21-95eb-9df294467f17","Type":"ContainerStarted","Data":"52449161882d6ae33346212bc37cae37b984a243f1b52084bead1aac60891c65"} Jul 27 20:35:37.162953 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:37.162565 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qfczc" Jul 27 20:35:37.164066 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:37.164042 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xdrfx" event={"ID":"7f9ddf3e-85fe-4916-81fd-076999b321ee","Type":"ContainerStarted","Data":"1169a8126fc94de187f9dff55f690ba6cac7bc2d48099ebb24a418801094ce0f"} Jul 27 20:35:37.164625 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:37.164605 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xdrfx" Jul 27 20:35:37.167014 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:37.166983 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-jncsv" event={"ID":"739a7fa3-aa14-4e4d-958e-f16b7c81fd5a","Type":"ContainerStarted","Data":"32fde199858b5579ca02d2cd0243431db16a7f1f5b61e8d4456414ae353e33ed"} Jul 27 20:35:37.170507 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:37.170489 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xdrfx" Jul 27 20:35:37.179757 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:37.179695 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qfczc" podStartSLOduration=34.498916379 podStartE2EDuration="39.179675938s" totalImagesPullingTime="4.680759559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:37.17791985 +0000 UTC m=+74.931164181" watchObservedRunningTime="2026-07-27 20:35:37.179675938 +0000 UTC m=+74.932920270" Jul 27 20:35:37.211209 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:37.211111 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xdrfx" podStartSLOduration=2.9123523540000003 podStartE2EDuration="5.21109369s" totalImagesPullingTime="2.298741336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:37.192336123 +0000 UTC m=+74.945580454" watchObservedRunningTime="2026-07-27 20:35:37.21109369 +0000 UTC m=+74.964338021" Jul 27 20:35:37.211876 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:37.211843 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-jncsv" podStartSLOduration=45.533777287 podStartE2EDuration="50.211830402s" totalImagesPullingTime="4.678053115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:37.210927026 +0000 UTC m=+74.964171357" watchObservedRunningTime="2026-07-27 20:35:37.211830402 +0000 UTC m=+74.965074778" Jul 27 20:35:39.967414 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:39.967373 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7hv5j\" (UID: \"0e7c5c7a-6104-4fe2-b86b-c037db0458ae\") " pod="openshift-insights/insights-runtime-extractor-7hv5j" Jul 27 20:35:39.967894 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:39.967433 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7hv5j\" (UID: \"0e7c5c7a-6104-4fe2-b86b-c037db0458ae\") " pod="openshift-insights/insights-runtime-extractor-7hv5j" Jul 27 20:35:39.967894 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:39.967501 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 20:35:39.967894 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:39.967582 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-kube-rbac-proxy-cm podName:0e7c5c7a-6104-4fe2-b86b-c037db0458ae nodeName:}" failed. No retries permitted until 2026-07-27 20:35:47.967565333 +0000 UTC m=+85.720809642 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7hv5j" (UID: "0e7c5c7a-6104-4fe2-b86b-c037db0458ae") : configmap "kube-rbac-proxy" not found Jul 27 20:35:39.967894 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:39.967585 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 20:35:39.967894 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:39.967628 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-insights-runtime-extractor-tls podName:0e7c5c7a-6104-4fe2-b86b-c037db0458ae nodeName:}" failed. No retries permitted until 2026-07-27 20:35:47.967616418 +0000 UTC m=+85.720860745 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7hv5j" (UID: "0e7c5c7a-6104-4fe2-b86b-c037db0458ae") : secret "insights-runtime-extractor-tls" not found Jul 27 20:35:46.425642 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.425493 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-q747g"] Jul 27 20:35:46.428836 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.428806 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q747g" Jul 27 20:35:46.431023 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.430979 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 27 20:35:46.431172 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.431123 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 27 20:35:46.432001 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.431787 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 27 20:35:46.432001 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.431821 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 27 20:35:46.432001 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.431821 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 27 20:35:46.432001 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.431900 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-vmtv6\"" Jul 27 20:35:46.439233 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.439209 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-q747g"] Jul 27 20:35:46.462461 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.462424 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mv8nc"] Jul 27 20:35:46.464961 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.464930 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.466997 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.466969 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 27 20:35:46.467262 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.467232 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 27 20:35:46.467560 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.467539 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f459l\"" Jul 27 20:35:46.467704 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.467649 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 27 20:35:46.519308 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.519271 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ae7f6cb-489d-44c4-b7c1-750beedc6453-metrics-client-ca\") pod \"node-exporter-mv8nc\" (UID: \"2ae7f6cb-489d-44c4-b7c1-750beedc6453\") " pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.519494 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.519336 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ae7f6cb-489d-44c4-b7c1-750beedc6453-sys\") pod \"node-exporter-mv8nc\" (UID: \"2ae7f6cb-489d-44c4-b7c1-750beedc6453\") " pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.519494 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.519380 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28347cc0-098d-4024-abb9-ee1f39663a47-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-q747g\" (UID: \"28347cc0-098d-4024-abb9-ee1f39663a47\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q747g" Jul 27 20:35:46.519494 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.519409 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2ae7f6cb-489d-44c4-b7c1-750beedc6453-root\") pod \"node-exporter-mv8nc\" (UID: \"2ae7f6cb-489d-44c4-b7c1-750beedc6453\") " pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.519494 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.519441 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2ae7f6cb-489d-44c4-b7c1-750beedc6453-node-exporter-tls\") pod \"node-exporter-mv8nc\" (UID: \"2ae7f6cb-489d-44c4-b7c1-750beedc6453\") " pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.519494 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.519484 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtqsq\" (UniqueName: \"kubernetes.io/projected/2ae7f6cb-489d-44c4-b7c1-750beedc6453-kube-api-access-mtqsq\") pod \"node-exporter-mv8nc\" (UID: \"2ae7f6cb-489d-44c4-b7c1-750beedc6453\") " pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.519762 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.519557 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2ae7f6cb-489d-44c4-b7c1-750beedc6453-node-exporter-accelerators-collector-config\") pod \"node-exporter-mv8nc\" (UID: \"2ae7f6cb-489d-44c4-b7c1-750beedc6453\") " pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.519762 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.519584 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28347cc0-098d-4024-abb9-ee1f39663a47-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-q747g\" (UID: \"28347cc0-098d-4024-abb9-ee1f39663a47\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q747g" Jul 27 20:35:46.519762 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.519600 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2ae7f6cb-489d-44c4-b7c1-750beedc6453-node-exporter-textfile\") pod \"node-exporter-mv8nc\" (UID: \"2ae7f6cb-489d-44c4-b7c1-750beedc6453\") " pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.519762 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.519632 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtxg8\" (UniqueName: \"kubernetes.io/projected/28347cc0-098d-4024-abb9-ee1f39663a47-kube-api-access-jtxg8\") pod \"openshift-state-metrics-b8f49f5c6-q747g\" (UID: \"28347cc0-098d-4024-abb9-ee1f39663a47\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q747g" Jul 27 20:35:46.519762 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.519678 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ae7f6cb-489d-44c4-b7c1-750beedc6453-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mv8nc\" (UID: \"2ae7f6cb-489d-44c4-b7c1-750beedc6453\") " pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.519762 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.519701 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/28347cc0-098d-4024-abb9-ee1f39663a47-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-q747g\" (UID: \"28347cc0-098d-4024-abb9-ee1f39663a47\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q747g" Jul 27 20:35:46.519762 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.519732 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2ae7f6cb-489d-44c4-b7c1-750beedc6453-node-exporter-wtmp\") pod \"node-exporter-mv8nc\" (UID: \"2ae7f6cb-489d-44c4-b7c1-750beedc6453\") " pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.620300 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.620266 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtxg8\" (UniqueName: \"kubernetes.io/projected/28347cc0-098d-4024-abb9-ee1f39663a47-kube-api-access-jtxg8\") pod \"openshift-state-metrics-b8f49f5c6-q747g\" (UID: \"28347cc0-098d-4024-abb9-ee1f39663a47\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q747g" Jul 27 20:35:46.620300 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.620305 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ae7f6cb-489d-44c4-b7c1-750beedc6453-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mv8nc\" (UID: \"2ae7f6cb-489d-44c4-b7c1-750beedc6453\") " pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.620565 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.620341 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/28347cc0-098d-4024-abb9-ee1f39663a47-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-q747g\" (UID: \"28347cc0-098d-4024-abb9-ee1f39663a47\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q747g" Jul 27 20:35:46.620565 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.620368 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2ae7f6cb-489d-44c4-b7c1-750beedc6453-node-exporter-wtmp\") pod \"node-exporter-mv8nc\" (UID: \"2ae7f6cb-489d-44c4-b7c1-750beedc6453\") " pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.620565 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.620413 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ae7f6cb-489d-44c4-b7c1-750beedc6453-metrics-client-ca\") pod \"node-exporter-mv8nc\" (UID: \"2ae7f6cb-489d-44c4-b7c1-750beedc6453\") " pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.620565 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:46.620534 2554 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 27 20:35:46.620793 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:46.620609 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28347cc0-098d-4024-abb9-ee1f39663a47-openshift-state-metrics-tls podName:28347cc0-098d-4024-abb9-ee1f39663a47 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:47.12058886 +0000 UTC m=+84.873833191 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/28347cc0-098d-4024-abb9-ee1f39663a47-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-q747g" (UID: "28347cc0-098d-4024-abb9-ee1f39663a47") : secret "openshift-state-metrics-tls" not found Jul 27 20:35:46.620793 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.620610 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2ae7f6cb-489d-44c4-b7c1-750beedc6453-node-exporter-wtmp\") pod \"node-exporter-mv8nc\" (UID: \"2ae7f6cb-489d-44c4-b7c1-750beedc6453\") " pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.620793 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.620658 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ae7f6cb-489d-44c4-b7c1-750beedc6453-sys\") pod \"node-exporter-mv8nc\" (UID: \"2ae7f6cb-489d-44c4-b7c1-750beedc6453\") " pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.620793 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.620704 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28347cc0-098d-4024-abb9-ee1f39663a47-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-q747g\" (UID: \"28347cc0-098d-4024-abb9-ee1f39663a47\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q747g" Jul 27 20:35:46.620793 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.620736 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2ae7f6cb-489d-44c4-b7c1-750beedc6453-root\") pod \"node-exporter-mv8nc\" (UID: \"2ae7f6cb-489d-44c4-b7c1-750beedc6453\") " pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.620793 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.620774 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2ae7f6cb-489d-44c4-b7c1-750beedc6453-node-exporter-tls\") pod \"node-exporter-mv8nc\" (UID: \"2ae7f6cb-489d-44c4-b7c1-750beedc6453\") " pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.621120 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.620807 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtqsq\" (UniqueName: \"kubernetes.io/projected/2ae7f6cb-489d-44c4-b7c1-750beedc6453-kube-api-access-mtqsq\") pod \"node-exporter-mv8nc\" (UID: \"2ae7f6cb-489d-44c4-b7c1-750beedc6453\") " pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.621120 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.620818 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2ae7f6cb-489d-44c4-b7c1-750beedc6453-root\") pod \"node-exporter-mv8nc\" (UID: \"2ae7f6cb-489d-44c4-b7c1-750beedc6453\") " pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.621120 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.620777 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ae7f6cb-489d-44c4-b7c1-750beedc6453-sys\") pod \"node-exporter-mv8nc\" (UID: \"2ae7f6cb-489d-44c4-b7c1-750beedc6453\") " pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.621120 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.620868 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2ae7f6cb-489d-44c4-b7c1-750beedc6453-node-exporter-accelerators-collector-config\") pod \"node-exporter-mv8nc\" (UID: \"2ae7f6cb-489d-44c4-b7c1-750beedc6453\") " pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.621120 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.620907 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28347cc0-098d-4024-abb9-ee1f39663a47-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-q747g\" (UID: \"28347cc0-098d-4024-abb9-ee1f39663a47\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q747g" Jul 27 20:35:46.621120 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.621072 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ae7f6cb-489d-44c4-b7c1-750beedc6453-metrics-client-ca\") pod \"node-exporter-mv8nc\" (UID: \"2ae7f6cb-489d-44c4-b7c1-750beedc6453\") " pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.621120 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.621101 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2ae7f6cb-489d-44c4-b7c1-750beedc6453-node-exporter-textfile\") pod \"node-exporter-mv8nc\" (UID: \"2ae7f6cb-489d-44c4-b7c1-750beedc6453\") " pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.621477 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.621391 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2ae7f6cb-489d-44c4-b7c1-750beedc6453-node-exporter-accelerators-collector-config\") pod \"node-exporter-mv8nc\" (UID: \"2ae7f6cb-489d-44c4-b7c1-750beedc6453\") " pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.621477 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.621420 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2ae7f6cb-489d-44c4-b7c1-750beedc6453-node-exporter-textfile\") pod \"node-exporter-mv8nc\" (UID: \"2ae7f6cb-489d-44c4-b7c1-750beedc6453\") " pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.621670 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.621602 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28347cc0-098d-4024-abb9-ee1f39663a47-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-q747g\" (UID: \"28347cc0-098d-4024-abb9-ee1f39663a47\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q747g" Jul 27 20:35:46.623480 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.623458 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2ae7f6cb-489d-44c4-b7c1-750beedc6453-node-exporter-tls\") pod \"node-exporter-mv8nc\" (UID: \"2ae7f6cb-489d-44c4-b7c1-750beedc6453\") " pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.623747 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.623722 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ae7f6cb-489d-44c4-b7c1-750beedc6453-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mv8nc\" (UID: \"2ae7f6cb-489d-44c4-b7c1-750beedc6453\") " pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.623914 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.623885 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28347cc0-098d-4024-abb9-ee1f39663a47-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-q747g\" (UID: \"28347cc0-098d-4024-abb9-ee1f39663a47\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q747g" Jul 27 20:35:46.628704 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.628681 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtxg8\" (UniqueName: \"kubernetes.io/projected/28347cc0-098d-4024-abb9-ee1f39663a47-kube-api-access-jtxg8\") pod \"openshift-state-metrics-b8f49f5c6-q747g\" (UID: \"28347cc0-098d-4024-abb9-ee1f39663a47\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q747g" Jul 27 20:35:46.628966 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.628947 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtqsq\" (UniqueName: \"kubernetes.io/projected/2ae7f6cb-489d-44c4-b7c1-750beedc6453-kube-api-access-mtqsq\") pod \"node-exporter-mv8nc\" (UID: \"2ae7f6cb-489d-44c4-b7c1-750beedc6453\") " pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:46.776481 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:46.776447 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mv8nc" Jul 27 20:35:47.126637 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:47.126548 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/28347cc0-098d-4024-abb9-ee1f39663a47-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-q747g\" (UID: \"28347cc0-098d-4024-abb9-ee1f39663a47\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q747g" Jul 27 20:35:47.126787 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:47.126718 2554 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 27 20:35:47.126846 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:35:47.126794 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28347cc0-098d-4024-abb9-ee1f39663a47-openshift-state-metrics-tls podName:28347cc0-098d-4024-abb9-ee1f39663a47 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:48.126776513 +0000 UTC m=+85.880020839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/28347cc0-098d-4024-abb9-ee1f39663a47-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-q747g" (UID: "28347cc0-098d-4024-abb9-ee1f39663a47") : secret "openshift-state-metrics-tls" not found Jul 27 20:35:47.178481 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:47.178448 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qfczc" Jul 27 20:35:48.035719 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.035670 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7hv5j\" (UID: \"0e7c5c7a-6104-4fe2-b86b-c037db0458ae\") " pod="openshift-insights/insights-runtime-extractor-7hv5j" Jul 27 20:35:48.036195 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.035738 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7hv5j\" (UID: \"0e7c5c7a-6104-4fe2-b86b-c037db0458ae\") " pod="openshift-insights/insights-runtime-extractor-7hv5j" Jul 27 20:35:48.036427 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.036384 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7hv5j\" (UID: \"0e7c5c7a-6104-4fe2-b86b-c037db0458ae\") " pod="openshift-insights/insights-runtime-extractor-7hv5j" Jul 27 20:35:48.038628 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.038605 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e7c5c7a-6104-4fe2-b86b-c037db0458ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7hv5j\" (UID: \"0e7c5c7a-6104-4fe2-b86b-c037db0458ae\") " pod="openshift-insights/insights-runtime-extractor-7hv5j" Jul 27 20:35:48.053588 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.053551 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7hv5j" Jul 27 20:35:48.136464 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.136421 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/28347cc0-098d-4024-abb9-ee1f39663a47-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-q747g\" (UID: \"28347cc0-098d-4024-abb9-ee1f39663a47\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q747g" Jul 27 20:35:48.139342 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.139310 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/28347cc0-098d-4024-abb9-ee1f39663a47-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-q747g\" (UID: \"28347cc0-098d-4024-abb9-ee1f39663a47\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q747g" Jul 27 20:35:48.240151 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.240115 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q747g" Jul 27 20:35:48.502775 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.502743 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6b655fbf85-rrkm8"] Jul 27 20:35:48.505384 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.505359 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:35:48.507723 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.507692 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 27 20:35:48.507723 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.507718 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fetq1el9dmdeq\"" Jul 27 20:35:48.507947 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.507931 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 27 20:35:48.508028 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.507965 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 27 20:35:48.508084 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.507933 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-c4htz\"" Jul 27 20:35:48.508084 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.508073 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 27 20:35:48.508390 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.508372 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 27 20:35:48.517492 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.517469 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b655fbf85-rrkm8"] Jul 27 20:35:48.539132 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.539097 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82cc45e4-ea0f-44b4-8ec1-e3b66cd11469-metrics-client-ca\") pod \"thanos-querier-6b655fbf85-rrkm8\" (UID: \"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469\") " pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:35:48.539132 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.539133 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kfr8\" (UniqueName: \"kubernetes.io/projected/82cc45e4-ea0f-44b4-8ec1-e3b66cd11469-kube-api-access-5kfr8\") pod \"thanos-querier-6b655fbf85-rrkm8\" (UID: \"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469\") " pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:35:48.539363 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.539243 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/82cc45e4-ea0f-44b4-8ec1-e3b66cd11469-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b655fbf85-rrkm8\" (UID: \"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469\") " pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:35:48.539363 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.539281 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82cc45e4-ea0f-44b4-8ec1-e3b66cd11469-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b655fbf85-rrkm8\" (UID: \"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469\") " pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:35:48.539363 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.539328 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82cc45e4-ea0f-44b4-8ec1-e3b66cd11469-secret-grpc-tls\") pod \"thanos-querier-6b655fbf85-rrkm8\" (UID: \"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469\") " pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:35:48.539500 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.539365 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82cc45e4-ea0f-44b4-8ec1-e3b66cd11469-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b655fbf85-rrkm8\" (UID: \"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469\") " pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:35:48.539500 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.539393 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/82cc45e4-ea0f-44b4-8ec1-e3b66cd11469-secret-thanos-querier-tls\") pod \"thanos-querier-6b655fbf85-rrkm8\" (UID: \"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469\") " pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:35:48.539500 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.539419 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/82cc45e4-ea0f-44b4-8ec1-e3b66cd11469-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b655fbf85-rrkm8\" (UID: \"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469\") " pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:35:48.640860 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.640816 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/82cc45e4-ea0f-44b4-8ec1-e3b66cd11469-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b655fbf85-rrkm8\" (UID: \"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469\") " pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:35:48.640860 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.640869 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82cc45e4-ea0f-44b4-8ec1-e3b66cd11469-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b655fbf85-rrkm8\" (UID: \"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469\") " pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:35:48.641119 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.640906 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82cc45e4-ea0f-44b4-8ec1-e3b66cd11469-secret-grpc-tls\") pod \"thanos-querier-6b655fbf85-rrkm8\" (UID: \"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469\") " pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:35:48.641119 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.640933 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82cc45e4-ea0f-44b4-8ec1-e3b66cd11469-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b655fbf85-rrkm8\" (UID: \"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469\") " pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:35:48.641119 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.640951 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/82cc45e4-ea0f-44b4-8ec1-e3b66cd11469-secret-thanos-querier-tls\") pod \"thanos-querier-6b655fbf85-rrkm8\" (UID: \"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469\") " pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:35:48.641119 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.640978 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/82cc45e4-ea0f-44b4-8ec1-e3b66cd11469-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b655fbf85-rrkm8\" (UID: \"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469\") " pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:35:48.641119 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.641017 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82cc45e4-ea0f-44b4-8ec1-e3b66cd11469-metrics-client-ca\") pod \"thanos-querier-6b655fbf85-rrkm8\" (UID: \"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469\") " pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:35:48.641119 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.641044 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kfr8\" (UniqueName: \"kubernetes.io/projected/82cc45e4-ea0f-44b4-8ec1-e3b66cd11469-kube-api-access-5kfr8\") pod \"thanos-querier-6b655fbf85-rrkm8\" (UID: \"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469\") " pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:35:48.642084 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.642050 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82cc45e4-ea0f-44b4-8ec1-e3b66cd11469-metrics-client-ca\") pod \"thanos-querier-6b655fbf85-rrkm8\" (UID: \"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469\") " pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:35:48.644503 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.644444 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/82cc45e4-ea0f-44b4-8ec1-e3b66cd11469-secret-thanos-querier-tls\") pod \"thanos-querier-6b655fbf85-rrkm8\" (UID: \"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469\") " pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:35:48.644503 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.644444 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82cc45e4-ea0f-44b4-8ec1-e3b66cd11469-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b655fbf85-rrkm8\" (UID: \"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469\") " pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:35:48.644674 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.644507 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82cc45e4-ea0f-44b4-8ec1-e3b66cd11469-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b655fbf85-rrkm8\" (UID: \"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469\") " pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:35:48.644848 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.644808 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/82cc45e4-ea0f-44b4-8ec1-e3b66cd11469-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b655fbf85-rrkm8\" (UID: \"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469\") " pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:35:48.644960 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.644945 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82cc45e4-ea0f-44b4-8ec1-e3b66cd11469-secret-grpc-tls\") pod \"thanos-querier-6b655fbf85-rrkm8\" (UID: \"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469\") " pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:35:48.645026 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.644959 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/82cc45e4-ea0f-44b4-8ec1-e3b66cd11469-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b655fbf85-rrkm8\" (UID: \"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469\") " pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:35:48.648846 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.648824 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kfr8\" (UniqueName: \"kubernetes.io/projected/82cc45e4-ea0f-44b4-8ec1-e3b66cd11469-kube-api-access-5kfr8\") pod \"thanos-querier-6b655fbf85-rrkm8\" (UID: \"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469\") " pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:35:48.816055 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:48.815953 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:35:50.476155 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.476122 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f9c674658-hrc5h"] Jul 27 20:35:50.481017 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.480989 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:35:50.831904 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.831869 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn"] Jul 27 20:35:50.834614 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.834590 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" Jul 27 20:35:50.836840 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.836813 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 27 20:35:50.836960 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.836839 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-gfj9g\"" Jul 27 20:35:50.836960 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.836863 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 27 20:35:50.837803 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.837780 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ak2k721a39n3r\"" Jul 27 20:35:50.838057 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.838041 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 27 20:35:50.838810 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.838788 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 27 20:35:50.846842 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.846512 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn"] Jul 27 20:35:50.859777 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.859749 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a57cff31-f24a-46e2-b22f-9bc8af72132c-metrics-server-audit-profiles\") pod \"metrics-server-f4c4fb6b6-mcbpn\" (UID: \"a57cff31-f24a-46e2-b22f-9bc8af72132c\") " pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" Jul 27 20:35:50.859885 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.859790 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a57cff31-f24a-46e2-b22f-9bc8af72132c-client-ca-bundle\") pod \"metrics-server-f4c4fb6b6-mcbpn\" (UID: \"a57cff31-f24a-46e2-b22f-9bc8af72132c\") " pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" Jul 27 20:35:50.859885 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.859848 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a57cff31-f24a-46e2-b22f-9bc8af72132c-audit-log\") pod \"metrics-server-f4c4fb6b6-mcbpn\" (UID: \"a57cff31-f24a-46e2-b22f-9bc8af72132c\") " pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" Jul 27 20:35:50.859885 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.859872 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a57cff31-f24a-46e2-b22f-9bc8af72132c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f4c4fb6b6-mcbpn\" (UID: \"a57cff31-f24a-46e2-b22f-9bc8af72132c\") " pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" Jul 27 20:35:50.860026 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.859890 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a57cff31-f24a-46e2-b22f-9bc8af72132c-secret-metrics-server-client-certs\") pod \"metrics-server-f4c4fb6b6-mcbpn\" (UID: \"a57cff31-f24a-46e2-b22f-9bc8af72132c\") " pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" Jul 27 20:35:50.860026 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.859923 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a57cff31-f24a-46e2-b22f-9bc8af72132c-secret-metrics-server-tls\") pod \"metrics-server-f4c4fb6b6-mcbpn\" (UID: \"a57cff31-f24a-46e2-b22f-9bc8af72132c\") " pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" Jul 27 20:35:50.860026 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.859949 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjw7k\" (UniqueName: \"kubernetes.io/projected/a57cff31-f24a-46e2-b22f-9bc8af72132c-kube-api-access-jjw7k\") pod \"metrics-server-f4c4fb6b6-mcbpn\" (UID: \"a57cff31-f24a-46e2-b22f-9bc8af72132c\") " pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" Jul 27 20:35:50.961251 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.961219 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a57cff31-f24a-46e2-b22f-9bc8af72132c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f4c4fb6b6-mcbpn\" (UID: \"a57cff31-f24a-46e2-b22f-9bc8af72132c\") " pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" Jul 27 20:35:50.961424 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.961260 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a57cff31-f24a-46e2-b22f-9bc8af72132c-secret-metrics-server-client-certs\") pod \"metrics-server-f4c4fb6b6-mcbpn\" (UID: \"a57cff31-f24a-46e2-b22f-9bc8af72132c\") " pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" Jul 27 20:35:50.961424 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.961291 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a57cff31-f24a-46e2-b22f-9bc8af72132c-secret-metrics-server-tls\") pod \"metrics-server-f4c4fb6b6-mcbpn\" (UID: \"a57cff31-f24a-46e2-b22f-9bc8af72132c\") " pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" Jul 27 20:35:50.961424 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.961321 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjw7k\" (UniqueName: \"kubernetes.io/projected/a57cff31-f24a-46e2-b22f-9bc8af72132c-kube-api-access-jjw7k\") pod \"metrics-server-f4c4fb6b6-mcbpn\" (UID: \"a57cff31-f24a-46e2-b22f-9bc8af72132c\") " pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" Jul 27 20:35:50.961424 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.961381 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a57cff31-f24a-46e2-b22f-9bc8af72132c-metrics-server-audit-profiles\") pod \"metrics-server-f4c4fb6b6-mcbpn\" (UID: \"a57cff31-f24a-46e2-b22f-9bc8af72132c\") " pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" Jul 27 20:35:50.961424 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.961403 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a57cff31-f24a-46e2-b22f-9bc8af72132c-client-ca-bundle\") pod \"metrics-server-f4c4fb6b6-mcbpn\" (UID: \"a57cff31-f24a-46e2-b22f-9bc8af72132c\") " pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" Jul 27 20:35:50.961717 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.961455 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a57cff31-f24a-46e2-b22f-9bc8af72132c-audit-log\") pod \"metrics-server-f4c4fb6b6-mcbpn\" (UID: \"a57cff31-f24a-46e2-b22f-9bc8af72132c\") " pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" Jul 27 20:35:50.961867 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.961847 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a57cff31-f24a-46e2-b22f-9bc8af72132c-audit-log\") pod \"metrics-server-f4c4fb6b6-mcbpn\" (UID: \"a57cff31-f24a-46e2-b22f-9bc8af72132c\") " pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" Jul 27 20:35:50.962276 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.962196 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a57cff31-f24a-46e2-b22f-9bc8af72132c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f4c4fb6b6-mcbpn\" (UID: \"a57cff31-f24a-46e2-b22f-9bc8af72132c\") " pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" Jul 27 20:35:50.962686 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.962659 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a57cff31-f24a-46e2-b22f-9bc8af72132c-metrics-server-audit-profiles\") pod \"metrics-server-f4c4fb6b6-mcbpn\" (UID: \"a57cff31-f24a-46e2-b22f-9bc8af72132c\") " pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" Jul 27 20:35:50.964274 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.964249 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a57cff31-f24a-46e2-b22f-9bc8af72132c-secret-metrics-server-client-certs\") pod \"metrics-server-f4c4fb6b6-mcbpn\" (UID: \"a57cff31-f24a-46e2-b22f-9bc8af72132c\") " pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" Jul 27 20:35:50.964705 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.964683 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a57cff31-f24a-46e2-b22f-9bc8af72132c-client-ca-bundle\") pod \"metrics-server-f4c4fb6b6-mcbpn\" (UID: \"a57cff31-f24a-46e2-b22f-9bc8af72132c\") " pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" Jul 27 20:35:50.964903 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.964881 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a57cff31-f24a-46e2-b22f-9bc8af72132c-secret-metrics-server-tls\") pod \"metrics-server-f4c4fb6b6-mcbpn\" (UID: \"a57cff31-f24a-46e2-b22f-9bc8af72132c\") " pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" Jul 27 20:35:50.970769 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:50.970741 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjw7k\" (UniqueName: \"kubernetes.io/projected/a57cff31-f24a-46e2-b22f-9bc8af72132c-kube-api-access-jjw7k\") pod \"metrics-server-f4c4fb6b6-mcbpn\" (UID: \"a57cff31-f24a-46e2-b22f-9bc8af72132c\") " pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" Jul 27 20:35:51.150639 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.150549 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" Jul 27 20:35:51.750371 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.750334 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77d4547b8-jp6jp"] Jul 27 20:35:51.760593 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.760567 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:35:51.764342 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.764029 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 27 20:35:51.764342 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.764182 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 27 20:35:51.764342 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.764238 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 27 20:35:51.764342 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.764266 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rmhbg\"" Jul 27 20:35:51.764859 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.764472 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 27 20:35:51.764859 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.764470 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 27 20:35:51.765245 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.765221 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77d4547b8-jp6jp"] Jul 27 20:35:51.769499 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.769478 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 27 20:35:51.870208 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.870156 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fc8fb42-6da2-4263-adfd-facb12253758-trusted-ca-bundle\") pod \"console-77d4547b8-jp6jp\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:35:51.870381 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.870220 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbq6f\" (UniqueName: \"kubernetes.io/projected/8fc8fb42-6da2-4263-adfd-facb12253758-kube-api-access-bbq6f\") pod \"console-77d4547b8-jp6jp\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:35:51.870381 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.870301 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8fc8fb42-6da2-4263-adfd-facb12253758-oauth-serving-cert\") pod \"console-77d4547b8-jp6jp\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:35:51.870381 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.870339 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8fc8fb42-6da2-4263-adfd-facb12253758-console-config\") pod \"console-77d4547b8-jp6jp\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:35:51.870381 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.870369 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8fc8fb42-6da2-4263-adfd-facb12253758-console-oauth-config\") pod \"console-77d4547b8-jp6jp\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:35:51.870588 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.870427 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fc8fb42-6da2-4263-adfd-facb12253758-console-serving-cert\") pod \"console-77d4547b8-jp6jp\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:35:51.870588 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.870487 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8fc8fb42-6da2-4263-adfd-facb12253758-service-ca\") pod \"console-77d4547b8-jp6jp\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:35:51.975213 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.971936 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbq6f\" (UniqueName: \"kubernetes.io/projected/8fc8fb42-6da2-4263-adfd-facb12253758-kube-api-access-bbq6f\") pod \"console-77d4547b8-jp6jp\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:35:51.975213 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.971984 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8fc8fb42-6da2-4263-adfd-facb12253758-oauth-serving-cert\") pod \"console-77d4547b8-jp6jp\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:35:51.975213 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.972315 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8fc8fb42-6da2-4263-adfd-facb12253758-console-config\") pod \"console-77d4547b8-jp6jp\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:35:51.975213 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.972348 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8fc8fb42-6da2-4263-adfd-facb12253758-console-oauth-config\") pod \"console-77d4547b8-jp6jp\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:35:51.975213 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.972384 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fc8fb42-6da2-4263-adfd-facb12253758-console-serving-cert\") pod \"console-77d4547b8-jp6jp\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:35:51.975213 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.972422 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8fc8fb42-6da2-4263-adfd-facb12253758-service-ca\") pod \"console-77d4547b8-jp6jp\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:35:51.975213 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.972492 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fc8fb42-6da2-4263-adfd-facb12253758-trusted-ca-bundle\") pod \"console-77d4547b8-jp6jp\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:35:51.975213 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.972724 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8fc8fb42-6da2-4263-adfd-facb12253758-oauth-serving-cert\") pod \"console-77d4547b8-jp6jp\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:35:51.975213 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.973197 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8fc8fb42-6da2-4263-adfd-facb12253758-console-config\") pod \"console-77d4547b8-jp6jp\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:35:51.975213 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.973296 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8fc8fb42-6da2-4263-adfd-facb12253758-service-ca\") pod \"console-77d4547b8-jp6jp\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:35:51.975213 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.973358 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fc8fb42-6da2-4263-adfd-facb12253758-trusted-ca-bundle\") pod \"console-77d4547b8-jp6jp\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:35:51.975842 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.975588 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fc8fb42-6da2-4263-adfd-facb12253758-console-serving-cert\") pod \"console-77d4547b8-jp6jp\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:35:51.975842 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.975706 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8fc8fb42-6da2-4263-adfd-facb12253758-console-oauth-config\") pod \"console-77d4547b8-jp6jp\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:35:51.981638 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:51.981611 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbq6f\" (UniqueName: \"kubernetes.io/projected/8fc8fb42-6da2-4263-adfd-facb12253758-kube-api-access-bbq6f\") pod \"console-77d4547b8-jp6jp\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:35:52.072992 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:52.072905 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:35:52.424100 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:35:52.424066 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ae7f6cb_489d_44c4_b7c1_750beedc6453.slice/crio-1e6d2c28b4b3ef147e5fc2619920c5031b55734017d9df8cb62840e330e18c91 WatchSource:0}: Error finding container 1e6d2c28b4b3ef147e5fc2619920c5031b55734017d9df8cb62840e330e18c91: Status 404 returned error can't find the container with id 1e6d2c28b4b3ef147e5fc2619920c5031b55734017d9df8cb62840e330e18c91 Jul 27 20:35:52.596426 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:52.596390 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7hv5j"] Jul 27 20:35:52.688678 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:35:52.688609 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e7c5c7a_6104_4fe2_b86b_c037db0458ae.slice/crio-24edbc9d005b20f5320a8ddb02619331aa22fe7fed1fbee0c9dac7e290113eb2 WatchSource:0}: Error finding container 24edbc9d005b20f5320a8ddb02619331aa22fe7fed1fbee0c9dac7e290113eb2: Status 404 returned error can't find the container with id 24edbc9d005b20f5320a8ddb02619331aa22fe7fed1fbee0c9dac7e290113eb2 Jul 27 20:35:52.824895 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:52.824863 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn"] Jul 27 20:35:52.831138 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:35:52.831084 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda57cff31_f24a_46e2_b22f_9bc8af72132c.slice/crio-767ab05d805c5f43d00d014d693bfd04f718dfa3bbb18966b4bfb94c538b56db WatchSource:0}: Error finding container 767ab05d805c5f43d00d014d693bfd04f718dfa3bbb18966b4bfb94c538b56db: Status 404 returned error can't find the container with id 767ab05d805c5f43d00d014d693bfd04f718dfa3bbb18966b4bfb94c538b56db Jul 27 20:35:52.834074 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:52.834045 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-q747g"] Jul 27 20:35:52.838669 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:52.838645 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77d4547b8-jp6jp"] Jul 27 20:35:52.839337 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:52.839314 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b655fbf85-rrkm8"] Jul 27 20:35:52.841333 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:35:52.840968 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fc8fb42_6da2_4263_adfd_facb12253758.slice/crio-b14edb51170fcb540a32d918592461beec503f5082b2256ea3a2c8b694049fc2 WatchSource:0}: Error finding container b14edb51170fcb540a32d918592461beec503f5082b2256ea3a2c8b694049fc2: Status 404 returned error can't find the container with id b14edb51170fcb540a32d918592461beec503f5082b2256ea3a2c8b694049fc2 Jul 27 20:35:53.236725 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:53.236679 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d4547b8-jp6jp" event={"ID":"8fc8fb42-6da2-4263-adfd-facb12253758","Type":"ContainerStarted","Data":"b14edb51170fcb540a32d918592461beec503f5082b2256ea3a2c8b694049fc2"} Jul 27 20:35:53.238393 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:53.238361 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" event={"ID":"a57cff31-f24a-46e2-b22f-9bc8af72132c","Type":"ContainerStarted","Data":"767ab05d805c5f43d00d014d693bfd04f718dfa3bbb18966b4bfb94c538b56db"} Jul 27 20:35:53.241891 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:53.241853 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q747g" event={"ID":"28347cc0-098d-4024-abb9-ee1f39663a47","Type":"ContainerStarted","Data":"ef96b7b46df19218cbb1fc3ce0fc3fcc881e0c7b264ec01608ea9543e9f1ae0d"} Jul 27 20:35:53.242005 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:53.241919 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q747g" event={"ID":"28347cc0-098d-4024-abb9-ee1f39663a47","Type":"ContainerStarted","Data":"d20ba2cc5c27cbefccb8d19621790c7b3d078ce050e942f5bcd0370e293f3c82"} Jul 27 20:35:53.242005 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:53.241948 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q747g" event={"ID":"28347cc0-098d-4024-abb9-ee1f39663a47","Type":"ContainerStarted","Data":"aa1dc591a1e108b1dbed75e8ac533baea079fa19d72eedda60c6944455d477b7"} Jul 27 20:35:53.243840 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:53.243811 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mv8nc" event={"ID":"2ae7f6cb-489d-44c4-b7c1-750beedc6453","Type":"ContainerStarted","Data":"1e6d2c28b4b3ef147e5fc2619920c5031b55734017d9df8cb62840e330e18c91"} Jul 27 20:35:53.245636 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:53.245608 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" event={"ID":"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469","Type":"ContainerStarted","Data":"54e1ba161cd8623619aabeeb6bdddf2b3818fca31fa792d85581ad052b17404f"} Jul 27 20:35:53.247416 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:53.247391 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7hv5j" event={"ID":"0e7c5c7a-6104-4fe2-b86b-c037db0458ae","Type":"ContainerStarted","Data":"24edbc9d005b20f5320a8ddb02619331aa22fe7fed1fbee0c9dac7e290113eb2"} Jul 27 20:35:53.253353 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:53.253326 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-xpl57" event={"ID":"f82a32cf-486a-4973-b057-0b79655d301c","Type":"ContainerStarted","Data":"288b5184142f5bff439923f883af3df56a358caf7443d821af0bb7daf9102e76"} Jul 27 20:35:53.254432 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:53.254368 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-xpl57" Jul 27 20:35:53.270727 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:53.270660 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-xpl57" podStartSLOduration=2.280822836 podStartE2EDuration="20.27063766s" totalImagesPullingTime="17.989814824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:53.269198513 +0000 UTC m=+91.022442845" watchObservedRunningTime="2026-07-27 20:35:53.27063766 +0000 UTC m=+91.023881992" Jul 27 20:35:53.276035 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:53.276008 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-xpl57" Jul 27 20:35:54.286296 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:54.286254 2554 generic.go:356] "Generic (PLEG): container finished" podID="2ae7f6cb-489d-44c4-b7c1-750beedc6453" containerID="5d946ed31589621ee3188797f61b0ab440a41f7d4b293dabc9e3cfe1fcbee0f7" exitCode=0 Jul 27 20:35:54.287533 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:54.287484 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mv8nc" event={"ID":"2ae7f6cb-489d-44c4-b7c1-750beedc6453","Type":"ContainerDied","Data":"5d946ed31589621ee3188797f61b0ab440a41f7d4b293dabc9e3cfe1fcbee0f7"} Jul 27 20:35:55.307420 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:55.307370 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mv8nc" event={"ID":"2ae7f6cb-489d-44c4-b7c1-750beedc6453","Type":"ContainerStarted","Data":"17709312cdc92e3e631d1427b2e5e92780b826a56473ee3e641a92f640edba37"} Jul 27 20:35:55.308442 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:55.308359 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mv8nc" event={"ID":"2ae7f6cb-489d-44c4-b7c1-750beedc6453","Type":"ContainerStarted","Data":"eb8a7c681b6931a8c17637ba2f6564eb1cfa0804d5640498690d10653fb390ea"} Jul 27 20:35:55.327552 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:35:55.327134 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mv8nc" podStartSLOduration=7.808487235 podStartE2EDuration="9.327111757s" totalImagesPullingTime="1.377157049s" totalInitContainerRuntime="141.467473ms" isStatefulPod=true podCreationTimestamp="2026-07-27 20:35:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:55.326652225 +0000 UTC m=+93.079896576" watchObservedRunningTime="2026-07-27 20:35:55.327111757 +0000 UTC m=+93.080356088" Jul 27 20:36:00.116369 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:00.116332 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qm26m" Jul 27 20:36:04.360209 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:04.360141 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d4547b8-jp6jp" event={"ID":"8fc8fb42-6da2-4263-adfd-facb12253758","Type":"ContainerStarted","Data":"25f7586037ad7517939b679f3e5838b4fcb3b311c3a301ef4f59dd8b15371a2a"} Jul 27 20:36:04.362540 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:04.362471 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" event={"ID":"a57cff31-f24a-46e2-b22f-9bc8af72132c","Type":"ContainerStarted","Data":"e25d2ab2fb660f832a3f4822d0910b03263fc7e7f0cef6529bd7a1f56e5e078b"} Jul 27 20:36:04.365384 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:04.365288 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q747g" event={"ID":"28347cc0-098d-4024-abb9-ee1f39663a47","Type":"ContainerStarted","Data":"5760977c124ad06830a672d7e7c4c9d82ba58116579a27a51eefee027aa5ea99"} Jul 27 20:36:04.367333 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:04.367301 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" event={"ID":"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469","Type":"ContainerStarted","Data":"485e8f7b7fac9f27c17c5cff6cce59f75763b337d69511c1930e759ad52ac178"} Jul 27 20:36:04.377995 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:04.377817 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77d4547b8-jp6jp" podStartSLOduration=2.097529271 podStartE2EDuration="13.377800415s" totalImagesPullingTime="11.280271144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:36:04.377191582 +0000 UTC m=+102.130436127" watchObservedRunningTime="2026-07-27 20:36:04.377800415 +0000 UTC m=+102.131044747" Jul 27 20:36:04.393158 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:04.393084 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q747g" podStartSLOduration=7.744637135 podStartE2EDuration="18.393062412s" totalImagesPullingTime="10.648425277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:36:04.392156348 +0000 UTC m=+102.145400693" watchObservedRunningTime="2026-07-27 20:36:04.393062412 +0000 UTC m=+102.146306744" Jul 27 20:36:04.410680 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:04.410634 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" podStartSLOduration=3.116628786 podStartE2EDuration="14.410617005s" totalImagesPullingTime="11.293988219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:36:04.40939729 +0000 UTC m=+102.162641621" watchObservedRunningTime="2026-07-27 20:36:04.410617005 +0000 UTC m=+102.163861336" Jul 27 20:36:05.375852 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:05.375688 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" event={"ID":"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469","Type":"ContainerStarted","Data":"78530964b1cfa61125797e5512cd31968372e9dab3466552ad0da143a4a96ca1"} Jul 27 20:36:05.375852 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:05.375780 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" event={"ID":"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469","Type":"ContainerStarted","Data":"439c69453b802d65c7466859e31750ad795771bf3bd3b887748425a2d7b356c9"} Jul 27 20:36:05.379971 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:05.379902 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7hv5j" event={"ID":"0e7c5c7a-6104-4fe2-b86b-c037db0458ae","Type":"ContainerStarted","Data":"1bd27915a7014fc53872bc5d455382d9b6b7c32464563378e8c8ca3d90b4996c"} Jul 27 20:36:09.396000 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:09.395957 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" event={"ID":"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469","Type":"ContainerStarted","Data":"5fd538c000fecced3954badf3031c2ac4166a41516377e65fa8ec9e11e589b27"} Jul 27 20:36:09.396487 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:09.396037 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" event={"ID":"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469","Type":"ContainerStarted","Data":"158751ecc45f393cf05f194c263562b887fdc5b29553c5abd25c09a27af562e5"} Jul 27 20:36:09.396487 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:09.396075 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" event={"ID":"82cc45e4-ea0f-44b4-8ec1-e3b66cd11469","Type":"ContainerStarted","Data":"f770d24ff36895b1c0c22c1d5d787495e1454fb6a253cac9eb24494a3b828213"} Jul 27 20:36:09.396487 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:09.396118 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:36:09.397896 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:09.397860 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7hv5j" event={"ID":"0e7c5c7a-6104-4fe2-b86b-c037db0458ae","Type":"ContainerStarted","Data":"39bcf74ca10e551a663b3a6f8f8c772dcf3464a7d16b0a5062f0a288cf5025ea"} Jul 27 20:36:09.401891 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:09.401869 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" Jul 27 20:36:09.423058 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:09.422999 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6b655fbf85-rrkm8" podStartSLOduration=6.113051923 podStartE2EDuration="21.422984448s" totalImagesPullingTime="15.309932525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:36:09.416791369 +0000 UTC m=+107.170035728" watchObservedRunningTime="2026-07-27 20:36:09.422984448 +0000 UTC m=+107.176229016" Jul 27 20:36:11.151361 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:11.151315 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" Jul 27 20:36:11.151971 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:11.151400 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" Jul 27 20:36:12.073945 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:12.073909 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:36:12.074233 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:12.074063 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:36:12.079393 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:12.079368 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:36:12.416915 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:12.416830 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:36:13.418092 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:13.417991 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7hv5j" event={"ID":"0e7c5c7a-6104-4fe2-b86b-c037db0458ae","Type":"ContainerStarted","Data":"cb99624af3ffca5deead0cced4c2499f1a8376ef33bfee004f5ff499df3b8453"} Jul 27 20:36:13.435998 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:13.435947 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7hv5j" podStartSLOduration=21.150055489 podStartE2EDuration="41.435933819s" totalImagesPullingTime="20.28587833s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:35:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:36:13.435568326 +0000 UTC m=+111.188812658" watchObservedRunningTime="2026-07-27 20:36:13.435933819 +0000 UTC m=+111.189178150" Jul 27 20:36:15.497323 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:15.497272 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-f9c674658-hrc5h" podUID="44beca5c-6e02-4013-9941-62fd7ee205dc" containerName="registry" containerID="cri-o://44e22d01b224dd4e2369e0d9eccc7f31a3e7b238c380f16e976fbcd53a45d723" gracePeriod=30 Jul 27 20:36:15.778054 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:15.778023 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:36:15.903120 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:15.903083 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/44beca5c-6e02-4013-9941-62fd7ee205dc-trusted-ca\") pod \"44beca5c-6e02-4013-9941-62fd7ee205dc\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " Jul 27 20:36:15.903120 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:15.903125 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/44beca5c-6e02-4013-9941-62fd7ee205dc-installation-pull-secrets\") pod \"44beca5c-6e02-4013-9941-62fd7ee205dc\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " Jul 27 20:36:15.903410 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:15.903142 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8b97\" (UniqueName: \"kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-kube-api-access-l8b97\") pod \"44beca5c-6e02-4013-9941-62fd7ee205dc\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " Jul 27 20:36:15.903410 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:15.903247 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/44beca5c-6e02-4013-9941-62fd7ee205dc-image-registry-private-configuration\") pod \"44beca5c-6e02-4013-9941-62fd7ee205dc\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " Jul 27 20:36:15.903410 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:15.903292 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-bound-sa-token\") pod \"44beca5c-6e02-4013-9941-62fd7ee205dc\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " Jul 27 20:36:15.903410 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:15.903345 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-tls\") pod \"44beca5c-6e02-4013-9941-62fd7ee205dc\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " Jul 27 20:36:15.903410 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:15.903369 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/44beca5c-6e02-4013-9941-62fd7ee205dc-ca-trust-extracted\") pod \"44beca5c-6e02-4013-9941-62fd7ee205dc\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " Jul 27 20:36:15.903410 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:15.903413 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-certificates\") pod \"44beca5c-6e02-4013-9941-62fd7ee205dc\" (UID: \"44beca5c-6e02-4013-9941-62fd7ee205dc\") " Jul 27 20:36:15.903753 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:15.903593 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44beca5c-6e02-4013-9941-62fd7ee205dc-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "44beca5c-6e02-4013-9941-62fd7ee205dc" (UID: "44beca5c-6e02-4013-9941-62fd7ee205dc"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:36:15.904118 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:15.903858 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/44beca5c-6e02-4013-9941-62fd7ee205dc-trusted-ca\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:36:15.904118 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:15.904076 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "44beca5c-6e02-4013-9941-62fd7ee205dc" (UID: "44beca5c-6e02-4013-9941-62fd7ee205dc"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:36:15.905968 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:15.905889 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-kube-api-access-l8b97" (OuterVolumeSpecName: "kube-api-access-l8b97") pod "44beca5c-6e02-4013-9941-62fd7ee205dc" (UID: "44beca5c-6e02-4013-9941-62fd7ee205dc"). InnerVolumeSpecName "kube-api-access-l8b97". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:36:15.906080 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:15.906015 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44beca5c-6e02-4013-9941-62fd7ee205dc-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "44beca5c-6e02-4013-9941-62fd7ee205dc" (UID: "44beca5c-6e02-4013-9941-62fd7ee205dc"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:36:15.906141 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:15.906091 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44beca5c-6e02-4013-9941-62fd7ee205dc-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "44beca5c-6e02-4013-9941-62fd7ee205dc" (UID: "44beca5c-6e02-4013-9941-62fd7ee205dc"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:36:15.906261 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:15.906243 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "44beca5c-6e02-4013-9941-62fd7ee205dc" (UID: "44beca5c-6e02-4013-9941-62fd7ee205dc"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:36:15.906373 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:15.906353 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "44beca5c-6e02-4013-9941-62fd7ee205dc" (UID: "44beca5c-6e02-4013-9941-62fd7ee205dc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:36:15.913368 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:15.913344 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44beca5c-6e02-4013-9941-62fd7ee205dc-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "44beca5c-6e02-4013-9941-62fd7ee205dc" (UID: "44beca5c-6e02-4013-9941-62fd7ee205dc"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 20:36:16.004545 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:16.004483 2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-certificates\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:36:16.004545 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:16.004547 2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/44beca5c-6e02-4013-9941-62fd7ee205dc-installation-pull-secrets\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:36:16.004783 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:16.004557 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8b97\" (UniqueName: \"kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-kube-api-access-l8b97\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:36:16.004783 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:16.004567 2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/44beca5c-6e02-4013-9941-62fd7ee205dc-image-registry-private-configuration\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:36:16.004783 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:16.004579 2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-bound-sa-token\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:36:16.004783 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:16.004588 2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44beca5c-6e02-4013-9941-62fd7ee205dc-registry-tls\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:36:16.004783 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:16.004596 2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/44beca5c-6e02-4013-9941-62fd7ee205dc-ca-trust-extracted\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:36:16.432196 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:16.432112 2554 generic.go:356] "Generic (PLEG): container finished" podID="90a58abb-4c3b-4fe3-a65c-d942e5df5fe2" containerID="b7da560e9bdfc12fc528a6c775791a16c565b85c2830a5193134376dd219352b" exitCode=0 Jul 27 20:36:16.432445 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:16.432189 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9gqn4" event={"ID":"90a58abb-4c3b-4fe3-a65c-d942e5df5fe2","Type":"ContainerDied","Data":"b7da560e9bdfc12fc528a6c775791a16c565b85c2830a5193134376dd219352b"} Jul 27 20:36:16.432633 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:16.432613 2554 scope.go:117] "RemoveContainer" containerID="b7da560e9bdfc12fc528a6c775791a16c565b85c2830a5193134376dd219352b" Jul 27 20:36:16.433453 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:16.433428 2554 generic.go:356] "Generic (PLEG): container finished" podID="44beca5c-6e02-4013-9941-62fd7ee205dc" containerID="44e22d01b224dd4e2369e0d9eccc7f31a3e7b238c380f16e976fbcd53a45d723" exitCode=0 Jul 27 20:36:16.433578 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:16.433463 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f9c674658-hrc5h" Jul 27 20:36:16.433578 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:16.433489 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f9c674658-hrc5h" event={"ID":"44beca5c-6e02-4013-9941-62fd7ee205dc","Type":"ContainerDied","Data":"44e22d01b224dd4e2369e0d9eccc7f31a3e7b238c380f16e976fbcd53a45d723"} Jul 27 20:36:16.433578 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:16.433542 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f9c674658-hrc5h" event={"ID":"44beca5c-6e02-4013-9941-62fd7ee205dc","Type":"ContainerDied","Data":"3d19bdb18585a35b418b66752b5f8439ecfda468cc0333dcea12d9e75947b669"} Jul 27 20:36:16.433578 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:16.433569 2554 scope.go:117] "RemoveContainer" containerID="44e22d01b224dd4e2369e0d9eccc7f31a3e7b238c380f16e976fbcd53a45d723" Jul 27 20:36:16.458922 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:16.458896 2554 scope.go:117] "RemoveContainer" containerID="44e22d01b224dd4e2369e0d9eccc7f31a3e7b238c380f16e976fbcd53a45d723" Jul 27 20:36:16.459301 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:36:16.459275 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44e22d01b224dd4e2369e0d9eccc7f31a3e7b238c380f16e976fbcd53a45d723\": container with ID starting with 44e22d01b224dd4e2369e0d9eccc7f31a3e7b238c380f16e976fbcd53a45d723 not found: ID does not exist" containerID="44e22d01b224dd4e2369e0d9eccc7f31a3e7b238c380f16e976fbcd53a45d723" Jul 27 20:36:16.459391 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:16.459312 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44e22d01b224dd4e2369e0d9eccc7f31a3e7b238c380f16e976fbcd53a45d723"} err="failed to get container status \"44e22d01b224dd4e2369e0d9eccc7f31a3e7b238c380f16e976fbcd53a45d723\": rpc error: code = NotFound desc = could not find container \"44e22d01b224dd4e2369e0d9eccc7f31a3e7b238c380f16e976fbcd53a45d723\": container with ID starting with 44e22d01b224dd4e2369e0d9eccc7f31a3e7b238c380f16e976fbcd53a45d723 not found: ID does not exist" Jul 27 20:36:16.488727 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:16.488694 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f9c674658-hrc5h"] Jul 27 20:36:16.493168 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:16.493139 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-f9c674658-hrc5h"] Jul 27 20:36:16.717435 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:16.717356 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44beca5c-6e02-4013-9941-62fd7ee205dc" path="/var/lib/kubelet/pods/44beca5c-6e02-4013-9941-62fd7ee205dc/volumes" Jul 27 20:36:17.438911 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:17.438871 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9gqn4" event={"ID":"90a58abb-4c3b-4fe3-a65c-d942e5df5fe2","Type":"ContainerStarted","Data":"569066ba9b36c09aea2a3611af8ae3081c17e3eb1f8dbe8aba51d33cf548a09a"} Jul 27 20:36:26.476980 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:26.476941 2554 generic.go:356] "Generic (PLEG): container finished" podID="07514f38-661f-48c6-b1ef-7b96f23194cc" containerID="dcb8ddaa3b4ba280240e3a679b1e03e69c88979ccd22bbc025e2588e87c97332" exitCode=0 Jul 27 20:36:26.477398 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:26.477001 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn" event={"ID":"07514f38-661f-48c6-b1ef-7b96f23194cc","Type":"ContainerDied","Data":"dcb8ddaa3b4ba280240e3a679b1e03e69c88979ccd22bbc025e2588e87c97332"} Jul 27 20:36:26.477398 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:26.477299 2554 scope.go:117] "RemoveContainer" containerID="dcb8ddaa3b4ba280240e3a679b1e03e69c88979ccd22bbc025e2588e87c97332" Jul 27 20:36:27.482310 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:27.482271 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn" event={"ID":"07514f38-661f-48c6-b1ef-7b96f23194cc","Type":"ContainerStarted","Data":"a4e4f6539a6f6c9fecdd155d924febd4dcae985ef2113bfeb92a47179d02cbdb"} Jul 27 20:36:31.156824 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:31.156791 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" Jul 27 20:36:31.160717 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:36:31.160693 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-f4c4fb6b6-mcbpn" Jul 27 20:37:25.726782 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:25.726746 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77d4547b8-jp6jp"] Jul 27 20:37:50.748640 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:50.748565 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-77d4547b8-jp6jp" podUID="8fc8fb42-6da2-4263-adfd-facb12253758" containerName="console" containerID="cri-o://25f7586037ad7517939b679f3e5838b4fcb3b311c3a301ef4f59dd8b15371a2a" gracePeriod=15 Jul 27 20:37:50.992188 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:50.992164 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:37:51.061035 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.060943 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8fc8fb42-6da2-4263-adfd-facb12253758-service-ca\") pod \"8fc8fb42-6da2-4263-adfd-facb12253758\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " Jul 27 20:37:51.061035 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.060990 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbq6f\" (UniqueName: \"kubernetes.io/projected/8fc8fb42-6da2-4263-adfd-facb12253758-kube-api-access-bbq6f\") pod \"8fc8fb42-6da2-4263-adfd-facb12253758\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " Jul 27 20:37:51.061035 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.061025 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8fc8fb42-6da2-4263-adfd-facb12253758-console-oauth-config\") pod \"8fc8fb42-6da2-4263-adfd-facb12253758\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " Jul 27 20:37:51.061300 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.061080 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8fc8fb42-6da2-4263-adfd-facb12253758-oauth-serving-cert\") pod \"8fc8fb42-6da2-4263-adfd-facb12253758\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " Jul 27 20:37:51.061300 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.061115 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fc8fb42-6da2-4263-adfd-facb12253758-trusted-ca-bundle\") pod \"8fc8fb42-6da2-4263-adfd-facb12253758\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " Jul 27 20:37:51.061404 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.061301 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8fc8fb42-6da2-4263-adfd-facb12253758-console-config\") pod \"8fc8fb42-6da2-4263-adfd-facb12253758\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " Jul 27 20:37:51.061404 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.061342 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fc8fb42-6da2-4263-adfd-facb12253758-console-serving-cert\") pod \"8fc8fb42-6da2-4263-adfd-facb12253758\" (UID: \"8fc8fb42-6da2-4263-adfd-facb12253758\") " Jul 27 20:37:51.061506 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.061384 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fc8fb42-6da2-4263-adfd-facb12253758-service-ca" (OuterVolumeSpecName: "service-ca") pod "8fc8fb42-6da2-4263-adfd-facb12253758" (UID: "8fc8fb42-6da2-4263-adfd-facb12253758"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:37:51.061628 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.061606 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8fc8fb42-6da2-4263-adfd-facb12253758-service-ca\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:37:51.061793 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.061609 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fc8fb42-6da2-4263-adfd-facb12253758-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8fc8fb42-6da2-4263-adfd-facb12253758" (UID: "8fc8fb42-6da2-4263-adfd-facb12253758"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:37:51.061863 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.061618 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fc8fb42-6da2-4263-adfd-facb12253758-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8fc8fb42-6da2-4263-adfd-facb12253758" (UID: "8fc8fb42-6da2-4263-adfd-facb12253758"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:37:51.061863 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.061647 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fc8fb42-6da2-4263-adfd-facb12253758-console-config" (OuterVolumeSpecName: "console-config") pod "8fc8fb42-6da2-4263-adfd-facb12253758" (UID: "8fc8fb42-6da2-4263-adfd-facb12253758"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:37:51.063500 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.063477 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fc8fb42-6da2-4263-adfd-facb12253758-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8fc8fb42-6da2-4263-adfd-facb12253758" (UID: "8fc8fb42-6da2-4263-adfd-facb12253758"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:37:51.063500 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.063481 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fc8fb42-6da2-4263-adfd-facb12253758-kube-api-access-bbq6f" (OuterVolumeSpecName: "kube-api-access-bbq6f") pod "8fc8fb42-6da2-4263-adfd-facb12253758" (UID: "8fc8fb42-6da2-4263-adfd-facb12253758"). InnerVolumeSpecName "kube-api-access-bbq6f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:37:51.063724 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.063702 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fc8fb42-6da2-4263-adfd-facb12253758-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8fc8fb42-6da2-4263-adfd-facb12253758" (UID: "8fc8fb42-6da2-4263-adfd-facb12253758"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:37:51.162117 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.162080 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8fc8fb42-6da2-4263-adfd-facb12253758-oauth-serving-cert\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:37:51.162117 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.162108 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fc8fb42-6da2-4263-adfd-facb12253758-trusted-ca-bundle\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:37:51.162117 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.162118 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8fc8fb42-6da2-4263-adfd-facb12253758-console-config\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:37:51.162117 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.162127 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fc8fb42-6da2-4263-adfd-facb12253758-console-serving-cert\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:37:51.162378 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.162136 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbq6f\" (UniqueName: \"kubernetes.io/projected/8fc8fb42-6da2-4263-adfd-facb12253758-kube-api-access-bbq6f\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:37:51.162378 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.162146 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8fc8fb42-6da2-4263-adfd-facb12253758-console-oauth-config\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:37:51.799823 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.799788 2554 generic.go:356] "Generic (PLEG): container finished" podID="8fc8fb42-6da2-4263-adfd-facb12253758" containerID="25f7586037ad7517939b679f3e5838b4fcb3b311c3a301ef4f59dd8b15371a2a" exitCode=0 Jul 27 20:37:51.800219 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.799835 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d4547b8-jp6jp" Jul 27 20:37:51.800219 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.799838 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d4547b8-jp6jp" event={"ID":"8fc8fb42-6da2-4263-adfd-facb12253758","Type":"ContainerDied","Data":"25f7586037ad7517939b679f3e5838b4fcb3b311c3a301ef4f59dd8b15371a2a"} Jul 27 20:37:51.800219 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.799969 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d4547b8-jp6jp" event={"ID":"8fc8fb42-6da2-4263-adfd-facb12253758","Type":"ContainerDied","Data":"b14edb51170fcb540a32d918592461beec503f5082b2256ea3a2c8b694049fc2"} Jul 27 20:37:51.800219 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.799998 2554 scope.go:117] "RemoveContainer" containerID="25f7586037ad7517939b679f3e5838b4fcb3b311c3a301ef4f59dd8b15371a2a" Jul 27 20:37:51.808958 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.808941 2554 scope.go:117] "RemoveContainer" containerID="25f7586037ad7517939b679f3e5838b4fcb3b311c3a301ef4f59dd8b15371a2a" Jul 27 20:37:51.809259 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:37:51.809241 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25f7586037ad7517939b679f3e5838b4fcb3b311c3a301ef4f59dd8b15371a2a\": container with ID starting with 25f7586037ad7517939b679f3e5838b4fcb3b311c3a301ef4f59dd8b15371a2a not found: ID does not exist" containerID="25f7586037ad7517939b679f3e5838b4fcb3b311c3a301ef4f59dd8b15371a2a" Jul 27 20:37:51.809320 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.809269 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25f7586037ad7517939b679f3e5838b4fcb3b311c3a301ef4f59dd8b15371a2a"} err="failed to get container status \"25f7586037ad7517939b679f3e5838b4fcb3b311c3a301ef4f59dd8b15371a2a\": rpc error: code = NotFound desc = could not find container \"25f7586037ad7517939b679f3e5838b4fcb3b311c3a301ef4f59dd8b15371a2a\": container with ID starting with 25f7586037ad7517939b679f3e5838b4fcb3b311c3a301ef4f59dd8b15371a2a not found: ID does not exist" Jul 27 20:37:51.820006 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.819976 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77d4547b8-jp6jp"] Jul 27 20:37:51.821817 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:51.821796 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77d4547b8-jp6jp"] Jul 27 20:37:52.716826 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:37:52.716794 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fc8fb42-6da2-4263-adfd-facb12253758" path="/var/lib/kubelet/pods/8fc8fb42-6da2-4263-adfd-facb12253758/volumes" Jul 27 20:39:22.596017 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:39:22.595981 2554 kubelet.go:1648] "Image garbage collection succeeded" Jul 27 20:40:00.611300 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:00.611267 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b"] Jul 27 20:40:00.613753 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:00.611560 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fc8fb42-6da2-4263-adfd-facb12253758" containerName="console" Jul 27 20:40:00.613753 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:00.611572 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fc8fb42-6da2-4263-adfd-facb12253758" containerName="console" Jul 27 20:40:00.613753 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:00.611598 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44beca5c-6e02-4013-9941-62fd7ee205dc" containerName="registry" Jul 27 20:40:00.613753 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:00.611603 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="44beca5c-6e02-4013-9941-62fd7ee205dc" containerName="registry" Jul 27 20:40:00.613753 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:00.611649 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fc8fb42-6da2-4263-adfd-facb12253758" containerName="console" Jul 27 20:40:00.613753 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:00.611658 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="44beca5c-6e02-4013-9941-62fd7ee205dc" containerName="registry" Jul 27 20:40:00.614731 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:00.614713 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b" Jul 27 20:40:00.616869 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:00.616851 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 27 20:40:00.616957 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:00.616903 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 27 20:40:00.617339 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:00.617320 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ntvl4\"" Jul 27 20:40:00.623677 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:00.623650 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b"] Jul 27 20:40:00.671933 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:00.671895 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cqp7\" (UniqueName: \"kubernetes.io/projected/e0e2036d-48e3-4b78-8806-f665dac3937c-kube-api-access-4cqp7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b\" (UID: \"e0e2036d-48e3-4b78-8806-f665dac3937c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b" Jul 27 20:40:00.671933 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:00.671941 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0e2036d-48e3-4b78-8806-f665dac3937c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b\" (UID: \"e0e2036d-48e3-4b78-8806-f665dac3937c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b" Jul 27 20:40:00.672158 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:00.671959 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0e2036d-48e3-4b78-8806-f665dac3937c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b\" (UID: \"e0e2036d-48e3-4b78-8806-f665dac3937c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b" Jul 27 20:40:00.772968 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:00.772930 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cqp7\" (UniqueName: \"kubernetes.io/projected/e0e2036d-48e3-4b78-8806-f665dac3937c-kube-api-access-4cqp7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b\" (UID: \"e0e2036d-48e3-4b78-8806-f665dac3937c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b" Jul 27 20:40:00.772968 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:00.772975 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0e2036d-48e3-4b78-8806-f665dac3937c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b\" (UID: \"e0e2036d-48e3-4b78-8806-f665dac3937c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b" Jul 27 20:40:00.773173 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:00.772994 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0e2036d-48e3-4b78-8806-f665dac3937c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b\" (UID: \"e0e2036d-48e3-4b78-8806-f665dac3937c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b" Jul 27 20:40:00.773367 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:00.773347 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0e2036d-48e3-4b78-8806-f665dac3937c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b\" (UID: \"e0e2036d-48e3-4b78-8806-f665dac3937c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b" Jul 27 20:40:00.773406 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:00.773352 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0e2036d-48e3-4b78-8806-f665dac3937c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b\" (UID: \"e0e2036d-48e3-4b78-8806-f665dac3937c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b" Jul 27 20:40:00.781352 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:00.781327 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cqp7\" (UniqueName: \"kubernetes.io/projected/e0e2036d-48e3-4b78-8806-f665dac3937c-kube-api-access-4cqp7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b\" (UID: \"e0e2036d-48e3-4b78-8806-f665dac3937c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b" Jul 27 20:40:00.924771 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:00.924692 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b" Jul 27 20:40:01.057464 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:01.057430 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b"] Jul 27 20:40:01.060486 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:40:01.060441 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0e2036d_48e3_4b78_8806_f665dac3937c.slice/crio-e44053858b0f11d84f0a555c9d47fad005eee6a563bec9d4d4bfdda2641c4460 WatchSource:0}: Error finding container e44053858b0f11d84f0a555c9d47fad005eee6a563bec9d4d4bfdda2641c4460: Status 404 returned error can't find the container with id e44053858b0f11d84f0a555c9d47fad005eee6a563bec9d4d4bfdda2641c4460 Jul 27 20:40:01.062310 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:01.062296 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 20:40:01.270369 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:01.270337 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b" event={"ID":"e0e2036d-48e3-4b78-8806-f665dac3937c","Type":"ContainerStarted","Data":"e44053858b0f11d84f0a555c9d47fad005eee6a563bec9d4d4bfdda2641c4460"} Jul 27 20:40:01.755271 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:01.755233 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-924kq"] Jul 27 20:40:01.759397 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:01.759380 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-924kq" Jul 27 20:40:01.761621 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:01.761592 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-fzbjz\"" Jul 27 20:40:01.761756 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:01.761592 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 27 20:40:01.761965 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:01.761948 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 27 20:40:01.770186 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:01.770164 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-924kq"] Jul 27 20:40:01.782718 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:01.782695 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36835fce-707f-4fe2-8200-403719cd70e7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-924kq\" (UID: \"36835fce-707f-4fe2-8200-403719cd70e7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-924kq" Jul 27 20:40:01.782832 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:01.782727 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z42p\" (UniqueName: \"kubernetes.io/projected/36835fce-707f-4fe2-8200-403719cd70e7-kube-api-access-9z42p\") pod \"cert-manager-cainjector-559cdd8c87-924kq\" (UID: \"36835fce-707f-4fe2-8200-403719cd70e7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-924kq" Jul 27 20:40:01.883365 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:01.883310 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36835fce-707f-4fe2-8200-403719cd70e7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-924kq\" (UID: \"36835fce-707f-4fe2-8200-403719cd70e7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-924kq" Jul 27 20:40:01.883564 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:01.883378 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z42p\" (UniqueName: \"kubernetes.io/projected/36835fce-707f-4fe2-8200-403719cd70e7-kube-api-access-9z42p\") pod \"cert-manager-cainjector-559cdd8c87-924kq\" (UID: \"36835fce-707f-4fe2-8200-403719cd70e7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-924kq" Jul 27 20:40:01.893445 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:01.893409 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36835fce-707f-4fe2-8200-403719cd70e7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-924kq\" (UID: \"36835fce-707f-4fe2-8200-403719cd70e7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-924kq" Jul 27 20:40:01.893445 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:01.893443 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z42p\" (UniqueName: \"kubernetes.io/projected/36835fce-707f-4fe2-8200-403719cd70e7-kube-api-access-9z42p\") pod \"cert-manager-cainjector-559cdd8c87-924kq\" (UID: \"36835fce-707f-4fe2-8200-403719cd70e7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-924kq" Jul 27 20:40:02.084546 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:02.084447 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-924kq" Jul 27 20:40:02.224502 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:02.224406 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-924kq"] Jul 27 20:40:02.227272 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:40:02.227238 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36835fce_707f_4fe2_8200_403719cd70e7.slice/crio-b8b76c432bd10091548b4d08743905dfc1c5878aa14a016e0d852856c0e72f59 WatchSource:0}: Error finding container b8b76c432bd10091548b4d08743905dfc1c5878aa14a016e0d852856c0e72f59: Status 404 returned error can't find the container with id b8b76c432bd10091548b4d08743905dfc1c5878aa14a016e0d852856c0e72f59 Jul 27 20:40:02.277351 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:02.277315 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-924kq" event={"ID":"36835fce-707f-4fe2-8200-403719cd70e7","Type":"ContainerStarted","Data":"b8b76c432bd10091548b4d08743905dfc1c5878aa14a016e0d852856c0e72f59"} Jul 27 20:40:09.311169 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:09.311137 2554 generic.go:356] "Generic (PLEG): container finished" podID="e0e2036d-48e3-4b78-8806-f665dac3937c" containerID="5246f026064be2b469ef5645d44f6699879e893db1f8e76bf6e9640727b71241" exitCode=0 Jul 27 20:40:09.311626 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:09.311233 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b" event={"ID":"e0e2036d-48e3-4b78-8806-f665dac3937c","Type":"ContainerDied","Data":"5246f026064be2b469ef5645d44f6699879e893db1f8e76bf6e9640727b71241"} Jul 27 20:40:09.312964 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:09.312906 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-924kq" event={"ID":"36835fce-707f-4fe2-8200-403719cd70e7","Type":"ContainerStarted","Data":"ef4c0d00bdffc6c8be01f3e582930f81a55012c40c9d68f0618df5123de049d1"} Jul 27 20:40:09.348247 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:09.348188 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-924kq" podStartSLOduration=1.726524588 podStartE2EDuration="8.348168553s" totalImagesPullingTime="6.621643965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:40:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:40:09.346367275 +0000 UTC m=+347.099611625" watchObservedRunningTime="2026-07-27 20:40:09.348168553 +0000 UTC m=+347.101412884" Jul 27 20:40:11.300584 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:11.300546 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-lvx54"] Jul 27 20:40:11.303832 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:11.303816 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-lvx54" Jul 27 20:40:11.305648 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:11.305627 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ts6qn\"" Jul 27 20:40:11.313655 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:11.313635 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-lvx54"] Jul 27 20:40:11.368435 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:11.368401 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99k5c\" (UniqueName: \"kubernetes.io/projected/7830e054-9eee-4368-90f1-2de51b571a16-kube-api-access-99k5c\") pod \"cert-manager-55b4d954d5-lvx54\" (UID: \"7830e054-9eee-4368-90f1-2de51b571a16\") " pod="cert-manager/cert-manager-55b4d954d5-lvx54" Jul 27 20:40:11.368647 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:11.368452 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7830e054-9eee-4368-90f1-2de51b571a16-bound-sa-token\") pod \"cert-manager-55b4d954d5-lvx54\" (UID: \"7830e054-9eee-4368-90f1-2de51b571a16\") " pod="cert-manager/cert-manager-55b4d954d5-lvx54" Jul 27 20:40:11.469771 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:11.469720 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99k5c\" (UniqueName: \"kubernetes.io/projected/7830e054-9eee-4368-90f1-2de51b571a16-kube-api-access-99k5c\") pod \"cert-manager-55b4d954d5-lvx54\" (UID: \"7830e054-9eee-4368-90f1-2de51b571a16\") " pod="cert-manager/cert-manager-55b4d954d5-lvx54" Jul 27 20:40:11.469941 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:11.469801 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7830e054-9eee-4368-90f1-2de51b571a16-bound-sa-token\") pod \"cert-manager-55b4d954d5-lvx54\" (UID: \"7830e054-9eee-4368-90f1-2de51b571a16\") " pod="cert-manager/cert-manager-55b4d954d5-lvx54" Jul 27 20:40:11.477485 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:11.477451 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7830e054-9eee-4368-90f1-2de51b571a16-bound-sa-token\") pod \"cert-manager-55b4d954d5-lvx54\" (UID: \"7830e054-9eee-4368-90f1-2de51b571a16\") " pod="cert-manager/cert-manager-55b4d954d5-lvx54" Jul 27 20:40:11.477623 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:11.477506 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99k5c\" (UniqueName: \"kubernetes.io/projected/7830e054-9eee-4368-90f1-2de51b571a16-kube-api-access-99k5c\") pod \"cert-manager-55b4d954d5-lvx54\" (UID: \"7830e054-9eee-4368-90f1-2de51b571a16\") " pod="cert-manager/cert-manager-55b4d954d5-lvx54" Jul 27 20:40:11.612937 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:11.612851 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-lvx54" Jul 27 20:40:11.739176 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:11.739151 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-lvx54"] Jul 27 20:40:11.741350 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:40:11.741324 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7830e054_9eee_4368_90f1_2de51b571a16.slice/crio-a1f297f9b50bd72dda252197ac78ef8fba6d89c3f8452d699cb9d7669145e519 WatchSource:0}: Error finding container a1f297f9b50bd72dda252197ac78ef8fba6d89c3f8452d699cb9d7669145e519: Status 404 returned error can't find the container with id a1f297f9b50bd72dda252197ac78ef8fba6d89c3f8452d699cb9d7669145e519 Jul 27 20:40:12.325654 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:12.325621 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-lvx54" event={"ID":"7830e054-9eee-4368-90f1-2de51b571a16","Type":"ContainerStarted","Data":"fe2db0eada2d59744f99cd9e67512de7839136aa241a998132eaefd10475f0ae"} Jul 27 20:40:12.325654 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:12.325661 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-lvx54" event={"ID":"7830e054-9eee-4368-90f1-2de51b571a16","Type":"ContainerStarted","Data":"a1f297f9b50bd72dda252197ac78ef8fba6d89c3f8452d699cb9d7669145e519"} Jul 27 20:40:12.340847 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:12.340795 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-lvx54" podStartSLOduration=1.340775019 podStartE2EDuration="1.340775019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:40:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:40:12.34021904 +0000 UTC m=+350.093463369" watchObservedRunningTime="2026-07-27 20:40:12.340775019 +0000 UTC m=+350.094019351" Jul 27 20:40:16.348682 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:16.348600 2554 generic.go:356] "Generic (PLEG): container finished" podID="e0e2036d-48e3-4b78-8806-f665dac3937c" containerID="6fd2c49e815eb0d954606ee38a716b5457a8e8d53ad886f37bfe9d8a000b08f5" exitCode=0 Jul 27 20:40:16.348682 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:16.348672 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b" event={"ID":"e0e2036d-48e3-4b78-8806-f665dac3937c","Type":"ContainerDied","Data":"6fd2c49e815eb0d954606ee38a716b5457a8e8d53ad886f37bfe9d8a000b08f5"} Jul 27 20:40:24.386224 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:24.386182 2554 generic.go:356] "Generic (PLEG): container finished" podID="e0e2036d-48e3-4b78-8806-f665dac3937c" containerID="466d12e6e3cccf91412a39a9b468a2441cad0666364bb295dfa85723d10bd4aa" exitCode=0 Jul 27 20:40:24.386663 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:24.386274 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b" event={"ID":"e0e2036d-48e3-4b78-8806-f665dac3937c","Type":"ContainerDied","Data":"466d12e6e3cccf91412a39a9b468a2441cad0666364bb295dfa85723d10bd4aa"} Jul 27 20:40:25.532359 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:25.532333 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b" Jul 27 20:40:25.692421 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:25.692332 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0e2036d-48e3-4b78-8806-f665dac3937c-bundle\") pod \"e0e2036d-48e3-4b78-8806-f665dac3937c\" (UID: \"e0e2036d-48e3-4b78-8806-f665dac3937c\") " Jul 27 20:40:25.692421 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:25.692386 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0e2036d-48e3-4b78-8806-f665dac3937c-util\") pod \"e0e2036d-48e3-4b78-8806-f665dac3937c\" (UID: \"e0e2036d-48e3-4b78-8806-f665dac3937c\") " Jul 27 20:40:25.692639 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:25.692471 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cqp7\" (UniqueName: \"kubernetes.io/projected/e0e2036d-48e3-4b78-8806-f665dac3937c-kube-api-access-4cqp7\") pod \"e0e2036d-48e3-4b78-8806-f665dac3937c\" (UID: \"e0e2036d-48e3-4b78-8806-f665dac3937c\") " Jul 27 20:40:25.692817 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:25.692790 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0e2036d-48e3-4b78-8806-f665dac3937c-bundle" (OuterVolumeSpecName: "bundle") pod "e0e2036d-48e3-4b78-8806-f665dac3937c" (UID: "e0e2036d-48e3-4b78-8806-f665dac3937c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 20:40:25.694835 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:25.694807 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0e2036d-48e3-4b78-8806-f665dac3937c-kube-api-access-4cqp7" (OuterVolumeSpecName: "kube-api-access-4cqp7") pod "e0e2036d-48e3-4b78-8806-f665dac3937c" (UID: "e0e2036d-48e3-4b78-8806-f665dac3937c"). InnerVolumeSpecName "kube-api-access-4cqp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:40:25.697321 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:25.697300 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0e2036d-48e3-4b78-8806-f665dac3937c-util" (OuterVolumeSpecName: "util") pod "e0e2036d-48e3-4b78-8806-f665dac3937c" (UID: "e0e2036d-48e3-4b78-8806-f665dac3937c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 20:40:25.793498 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:25.793464 2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0e2036d-48e3-4b78-8806-f665dac3937c-util\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:40:25.793498 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:25.793494 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cqp7\" (UniqueName: \"kubernetes.io/projected/e0e2036d-48e3-4b78-8806-f665dac3937c-kube-api-access-4cqp7\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:40:25.793498 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:25.793505 2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0e2036d-48e3-4b78-8806-f665dac3937c-bundle\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:40:26.395760 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:26.395728 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b" Jul 27 20:40:26.395928 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:26.395731 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvz9b" event={"ID":"e0e2036d-48e3-4b78-8806-f665dac3937c","Type":"ContainerDied","Data":"e44053858b0f11d84f0a555c9d47fad005eee6a563bec9d4d4bfdda2641c4460"} Jul 27 20:40:26.395928 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:26.395864 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e44053858b0f11d84f0a555c9d47fad005eee6a563bec9d4d4bfdda2641c4460" Jul 27 20:40:47.619655 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.619618 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-77cbdf6c7d-m5cw6"] Jul 27 20:40:47.620123 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.619911 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0e2036d-48e3-4b78-8806-f665dac3937c" containerName="extract" Jul 27 20:40:47.620123 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.619922 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0e2036d-48e3-4b78-8806-f665dac3937c" containerName="extract" Jul 27 20:40:47.620123 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.619941 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0e2036d-48e3-4b78-8806-f665dac3937c" containerName="pull" Jul 27 20:40:47.620123 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.619946 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0e2036d-48e3-4b78-8806-f665dac3937c" containerName="pull" Jul 27 20:40:47.620123 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.619954 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0e2036d-48e3-4b78-8806-f665dac3937c" containerName="util" Jul 27 20:40:47.620123 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.619959 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0e2036d-48e3-4b78-8806-f665dac3937c" containerName="util" Jul 27 20:40:47.620123 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.620010 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0e2036d-48e3-4b78-8806-f665dac3937c" containerName="extract" Jul 27 20:40:47.621923 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.621906 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-m5cw6" Jul 27 20:40:47.624625 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.624584 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 27 20:40:47.624625 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.624622 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 27 20:40:47.624789 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.624630 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 27 20:40:47.624789 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.624635 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-nz6c6\"" Jul 27 20:40:47.624789 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.624707 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 27 20:40:47.624965 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.624950 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 27 20:40:47.631406 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.631383 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77cbdf6c7d-m5cw6"] Jul 27 20:40:47.667358 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.667322 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e05ebed4-4a60-48e7-a800-83a89156b03d-metrics-cert\") pod \"lws-controller-manager-77cbdf6c7d-m5cw6\" (UID: \"e05ebed4-4a60-48e7-a800-83a89156b03d\") " pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-m5cw6" Jul 27 20:40:47.667574 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.667381 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e05ebed4-4a60-48e7-a800-83a89156b03d-cert\") pod \"lws-controller-manager-77cbdf6c7d-m5cw6\" (UID: \"e05ebed4-4a60-48e7-a800-83a89156b03d\") " pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-m5cw6" Jul 27 20:40:47.667574 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.667442 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sn2z\" (UniqueName: \"kubernetes.io/projected/e05ebed4-4a60-48e7-a800-83a89156b03d-kube-api-access-2sn2z\") pod \"lws-controller-manager-77cbdf6c7d-m5cw6\" (UID: \"e05ebed4-4a60-48e7-a800-83a89156b03d\") " pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-m5cw6" Jul 27 20:40:47.667574 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.667482 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e05ebed4-4a60-48e7-a800-83a89156b03d-manager-config\") pod \"lws-controller-manager-77cbdf6c7d-m5cw6\" (UID: \"e05ebed4-4a60-48e7-a800-83a89156b03d\") " pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-m5cw6" Jul 27 20:40:47.767894 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.767857 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e05ebed4-4a60-48e7-a800-83a89156b03d-cert\") pod \"lws-controller-manager-77cbdf6c7d-m5cw6\" (UID: \"e05ebed4-4a60-48e7-a800-83a89156b03d\") " pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-m5cw6" Jul 27 20:40:47.768069 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.767913 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sn2z\" (UniqueName: \"kubernetes.io/projected/e05ebed4-4a60-48e7-a800-83a89156b03d-kube-api-access-2sn2z\") pod \"lws-controller-manager-77cbdf6c7d-m5cw6\" (UID: \"e05ebed4-4a60-48e7-a800-83a89156b03d\") " pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-m5cw6" Jul 27 20:40:47.768069 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.767946 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e05ebed4-4a60-48e7-a800-83a89156b03d-manager-config\") pod \"lws-controller-manager-77cbdf6c7d-m5cw6\" (UID: \"e05ebed4-4a60-48e7-a800-83a89156b03d\") " pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-m5cw6" Jul 27 20:40:47.768069 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.767993 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e05ebed4-4a60-48e7-a800-83a89156b03d-metrics-cert\") pod \"lws-controller-manager-77cbdf6c7d-m5cw6\" (UID: \"e05ebed4-4a60-48e7-a800-83a89156b03d\") " pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-m5cw6" Jul 27 20:40:47.768707 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.768683 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e05ebed4-4a60-48e7-a800-83a89156b03d-manager-config\") pod \"lws-controller-manager-77cbdf6c7d-m5cw6\" (UID: \"e05ebed4-4a60-48e7-a800-83a89156b03d\") " pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-m5cw6" Jul 27 20:40:47.770618 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.770597 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e05ebed4-4a60-48e7-a800-83a89156b03d-metrics-cert\") pod \"lws-controller-manager-77cbdf6c7d-m5cw6\" (UID: \"e05ebed4-4a60-48e7-a800-83a89156b03d\") " pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-m5cw6" Jul 27 20:40:47.770618 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.770616 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e05ebed4-4a60-48e7-a800-83a89156b03d-cert\") pod \"lws-controller-manager-77cbdf6c7d-m5cw6\" (UID: \"e05ebed4-4a60-48e7-a800-83a89156b03d\") " pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-m5cw6" Jul 27 20:40:47.776187 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.776165 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sn2z\" (UniqueName: \"kubernetes.io/projected/e05ebed4-4a60-48e7-a800-83a89156b03d-kube-api-access-2sn2z\") pod \"lws-controller-manager-77cbdf6c7d-m5cw6\" (UID: \"e05ebed4-4a60-48e7-a800-83a89156b03d\") " pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-m5cw6" Jul 27 20:40:47.932415 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:47.932322 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-m5cw6" Jul 27 20:40:48.066808 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:48.066770 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77cbdf6c7d-m5cw6"] Jul 27 20:40:48.068347 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:40:48.068321 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode05ebed4_4a60_48e7_a800_83a89156b03d.slice/crio-e0b8f0a88de9bee34984949b7c8acdd82777053c9e734ba500d0aeb401111113 WatchSource:0}: Error finding container e0b8f0a88de9bee34984949b7c8acdd82777053c9e734ba500d0aeb401111113: Status 404 returned error can't find the container with id e0b8f0a88de9bee34984949b7c8acdd82777053c9e734ba500d0aeb401111113 Jul 27 20:40:48.483310 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:48.483271 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-m5cw6" event={"ID":"e05ebed4-4a60-48e7-a800-83a89156b03d","Type":"ContainerStarted","Data":"e0b8f0a88de9bee34984949b7c8acdd82777053c9e734ba500d0aeb401111113"} Jul 27 20:40:50.494106 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:50.494065 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-m5cw6" event={"ID":"e05ebed4-4a60-48e7-a800-83a89156b03d","Type":"ContainerStarted","Data":"a7e6796e3261c2aeb58f433ed250f21967d9db77ac2d0b281ce380f54adb1072"} Jul 27 20:40:50.494509 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:50.494187 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-m5cw6" Jul 27 20:40:50.510580 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:50.510513 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-m5cw6" podStartSLOduration=2.140217546 podStartE2EDuration="3.510498573s" totalImagesPullingTime="1.370281027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:40:50.508635867 +0000 UTC m=+388.261880197" watchObservedRunningTime="2026-07-27 20:40:50.510498573 +0000 UTC m=+388.263742904" Jul 27 20:40:56.379174 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:56.379134 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5767d7b464-vs9z6"] Jul 27 20:40:56.402439 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:56.402363 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5767d7b464-vs9z6"] Jul 27 20:40:56.402642 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:56.402477 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-vs9z6" Jul 27 20:40:56.406506 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:56.406483 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 27 20:40:56.406720 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:56.406695 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 27 20:40:56.406834 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:56.406792 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 27 20:40:56.406892 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:56.406869 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 27 20:40:56.406933 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:56.406878 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8slmf\"" Jul 27 20:40:56.438228 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:56.438194 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5df6c70-9499-4379-805d-531bb940f0f6-tmp\") pod \"opendatahub-operator-controller-manager-5767d7b464-vs9z6\" (UID: \"b5df6c70-9499-4379-805d-531bb940f0f6\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-vs9z6" Jul 27 20:40:56.438407 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:56.438265 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2699b\" (UniqueName: \"kubernetes.io/projected/b5df6c70-9499-4379-805d-531bb940f0f6-kube-api-access-2699b\") pod \"opendatahub-operator-controller-manager-5767d7b464-vs9z6\" (UID: \"b5df6c70-9499-4379-805d-531bb940f0f6\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-vs9z6" Jul 27 20:40:56.438407 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:56.438312 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b5df6c70-9499-4379-805d-531bb940f0f6-manifests\") pod \"opendatahub-operator-controller-manager-5767d7b464-vs9z6\" (UID: \"b5df6c70-9499-4379-805d-531bb940f0f6\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-vs9z6" Jul 27 20:40:56.438407 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:56.438378 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b5df6c70-9499-4379-805d-531bb940f0f6-webhook-cert\") pod \"opendatahub-operator-controller-manager-5767d7b464-vs9z6\" (UID: \"b5df6c70-9499-4379-805d-531bb940f0f6\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-vs9z6" Jul 27 20:40:56.438535 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:56.438421 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b5df6c70-9499-4379-805d-531bb940f0f6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5767d7b464-vs9z6\" (UID: \"b5df6c70-9499-4379-805d-531bb940f0f6\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-vs9z6" Jul 27 20:40:56.539353 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:56.539309 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2699b\" (UniqueName: \"kubernetes.io/projected/b5df6c70-9499-4379-805d-531bb940f0f6-kube-api-access-2699b\") pod \"opendatahub-operator-controller-manager-5767d7b464-vs9z6\" (UID: \"b5df6c70-9499-4379-805d-531bb940f0f6\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-vs9z6" Jul 27 20:40:56.539353 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:56.539358 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b5df6c70-9499-4379-805d-531bb940f0f6-manifests\") pod \"opendatahub-operator-controller-manager-5767d7b464-vs9z6\" (UID: \"b5df6c70-9499-4379-805d-531bb940f0f6\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-vs9z6" Jul 27 20:40:56.539652 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:56.539400 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b5df6c70-9499-4379-805d-531bb940f0f6-webhook-cert\") pod \"opendatahub-operator-controller-manager-5767d7b464-vs9z6\" (UID: \"b5df6c70-9499-4379-805d-531bb940f0f6\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-vs9z6" Jul 27 20:40:56.539652 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:56.539430 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b5df6c70-9499-4379-805d-531bb940f0f6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5767d7b464-vs9z6\" (UID: \"b5df6c70-9499-4379-805d-531bb940f0f6\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-vs9z6" Jul 27 20:40:56.539652 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:56.539465 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5df6c70-9499-4379-805d-531bb940f0f6-tmp\") pod \"opendatahub-operator-controller-manager-5767d7b464-vs9z6\" (UID: \"b5df6c70-9499-4379-805d-531bb940f0f6\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-vs9z6" Jul 27 20:40:56.539878 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:56.539850 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b5df6c70-9499-4379-805d-531bb940f0f6-manifests\") pod \"opendatahub-operator-controller-manager-5767d7b464-vs9z6\" (UID: \"b5df6c70-9499-4379-805d-531bb940f0f6\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-vs9z6" Jul 27 20:40:56.542071 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:56.542038 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5df6c70-9499-4379-805d-531bb940f0f6-tmp\") pod \"opendatahub-operator-controller-manager-5767d7b464-vs9z6\" (UID: \"b5df6c70-9499-4379-805d-531bb940f0f6\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-vs9z6" Jul 27 20:40:56.542203 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:56.542094 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b5df6c70-9499-4379-805d-531bb940f0f6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5767d7b464-vs9z6\" (UID: \"b5df6c70-9499-4379-805d-531bb940f0f6\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-vs9z6" Jul 27 20:40:56.542261 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:56.542206 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b5df6c70-9499-4379-805d-531bb940f0f6-webhook-cert\") pod \"opendatahub-operator-controller-manager-5767d7b464-vs9z6\" (UID: \"b5df6c70-9499-4379-805d-531bb940f0f6\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-vs9z6" Jul 27 20:40:56.546450 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:56.546426 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2699b\" (UniqueName: \"kubernetes.io/projected/b5df6c70-9499-4379-805d-531bb940f0f6-kube-api-access-2699b\") pod \"opendatahub-operator-controller-manager-5767d7b464-vs9z6\" (UID: \"b5df6c70-9499-4379-805d-531bb940f0f6\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-vs9z6" Jul 27 20:40:56.713204 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:56.713086 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-vs9z6" Jul 27 20:40:56.860204 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:56.860139 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5767d7b464-vs9z6"] Jul 27 20:40:56.862595 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:40:56.862563 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5df6c70_9499_4379_805d_531bb940f0f6.slice/crio-bf04f5b954e5250f99fc32f45dca30a74a41cd129e4f69bb83c2cdad0d243682 WatchSource:0}: Error finding container bf04f5b954e5250f99fc32f45dca30a74a41cd129e4f69bb83c2cdad0d243682: Status 404 returned error can't find the container with id bf04f5b954e5250f99fc32f45dca30a74a41cd129e4f69bb83c2cdad0d243682 Jul 27 20:40:57.526748 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:40:57.526695 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-vs9z6" event={"ID":"b5df6c70-9499-4379-805d-531bb940f0f6","Type":"ContainerStarted","Data":"bf04f5b954e5250f99fc32f45dca30a74a41cd129e4f69bb83c2cdad0d243682"} Jul 27 20:41:00.543050 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:00.543015 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-vs9z6" event={"ID":"b5df6c70-9499-4379-805d-531bb940f0f6","Type":"ContainerStarted","Data":"d25d1d6a4fcefe808a7097cecddc6b03fdd39f4f22090b82db40a83e52782559"} Jul 27 20:41:01.501116 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:01.501084 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-m5cw6" Jul 27 20:41:01.550356 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:01.550325 2554 generic.go:356] "Generic (PLEG): container finished" podID="b5df6c70-9499-4379-805d-531bb940f0f6" containerID="d25d1d6a4fcefe808a7097cecddc6b03fdd39f4f22090b82db40a83e52782559" exitCode=0 Jul 27 20:41:01.550802 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:01.550395 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-vs9z6" event={"ID":"b5df6c70-9499-4379-805d-531bb940f0f6","Type":"ContainerDied","Data":"d25d1d6a4fcefe808a7097cecddc6b03fdd39f4f22090b82db40a83e52782559"} Jul 27 20:41:02.557954 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:02.557920 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-vs9z6" event={"ID":"b5df6c70-9499-4379-805d-531bb940f0f6","Type":"ContainerStarted","Data":"ca4eb3d533f43a0e5b45dfc82a187c7c11313dd7494fb3672b4a29e96052e8e1"} Jul 27 20:41:02.558367 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:02.558010 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-vs9z6" Jul 27 20:41:02.579715 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:02.579658 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-vs9z6" podStartSLOduration=2.266822486 podStartE2EDuration="6.579636271s" totalImagesPullingTime="3.234209718s" totalInitContainerRuntime="1.078604067s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:40:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:41:02.576635767 +0000 UTC m=+400.329880098" watchObservedRunningTime="2026-07-27 20:41:02.579636271 +0000 UTC m=+400.332880597" Jul 27 20:41:13.565160 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:13.565125 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-vs9z6" Jul 27 20:41:16.164735 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:16.164694 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-57b999c94c-x8vwc"] Jul 27 20:41:16.168368 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:16.168348 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57b999c94c-x8vwc" Jul 27 20:41:16.171162 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:16.171143 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 27 20:41:16.171283 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:16.171239 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-r6j5r\"" Jul 27 20:41:16.174217 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:16.174196 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 27 20:41:16.182199 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:16.182173 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57b999c94c-x8vwc"] Jul 27 20:41:16.311785 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:16.311751 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr27m\" (UniqueName: \"kubernetes.io/projected/489c6cee-5c33-4463-a787-f3d8596d6d80-kube-api-access-fr27m\") pod \"kube-auth-proxy-57b999c94c-x8vwc\" (UID: \"489c6cee-5c33-4463-a787-f3d8596d6d80\") " pod="openshift-ingress/kube-auth-proxy-57b999c94c-x8vwc" Jul 27 20:41:16.311957 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:16.311805 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/489c6cee-5c33-4463-a787-f3d8596d6d80-tls-certs\") pod \"kube-auth-proxy-57b999c94c-x8vwc\" (UID: \"489c6cee-5c33-4463-a787-f3d8596d6d80\") " pod="openshift-ingress/kube-auth-proxy-57b999c94c-x8vwc" Jul 27 20:41:16.311957 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:16.311865 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/489c6cee-5c33-4463-a787-f3d8596d6d80-tmp\") pod \"kube-auth-proxy-57b999c94c-x8vwc\" (UID: \"489c6cee-5c33-4463-a787-f3d8596d6d80\") " pod="openshift-ingress/kube-auth-proxy-57b999c94c-x8vwc" Jul 27 20:41:16.412770 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:16.412731 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr27m\" (UniqueName: \"kubernetes.io/projected/489c6cee-5c33-4463-a787-f3d8596d6d80-kube-api-access-fr27m\") pod \"kube-auth-proxy-57b999c94c-x8vwc\" (UID: \"489c6cee-5c33-4463-a787-f3d8596d6d80\") " pod="openshift-ingress/kube-auth-proxy-57b999c94c-x8vwc" Jul 27 20:41:16.412938 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:16.412786 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/489c6cee-5c33-4463-a787-f3d8596d6d80-tls-certs\") pod \"kube-auth-proxy-57b999c94c-x8vwc\" (UID: \"489c6cee-5c33-4463-a787-f3d8596d6d80\") " pod="openshift-ingress/kube-auth-proxy-57b999c94c-x8vwc" Jul 27 20:41:16.412938 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:16.412802 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/489c6cee-5c33-4463-a787-f3d8596d6d80-tmp\") pod \"kube-auth-proxy-57b999c94c-x8vwc\" (UID: \"489c6cee-5c33-4463-a787-f3d8596d6d80\") " pod="openshift-ingress/kube-auth-proxy-57b999c94c-x8vwc" Jul 27 20:41:16.415282 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:16.415223 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/489c6cee-5c33-4463-a787-f3d8596d6d80-tmp\") pod \"kube-auth-proxy-57b999c94c-x8vwc\" (UID: \"489c6cee-5c33-4463-a787-f3d8596d6d80\") " pod="openshift-ingress/kube-auth-proxy-57b999c94c-x8vwc" Jul 27 20:41:16.415496 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:16.415478 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/489c6cee-5c33-4463-a787-f3d8596d6d80-tls-certs\") pod \"kube-auth-proxy-57b999c94c-x8vwc\" (UID: \"489c6cee-5c33-4463-a787-f3d8596d6d80\") " pod="openshift-ingress/kube-auth-proxy-57b999c94c-x8vwc" Jul 27 20:41:16.420624 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:16.420604 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr27m\" (UniqueName: \"kubernetes.io/projected/489c6cee-5c33-4463-a787-f3d8596d6d80-kube-api-access-fr27m\") pod \"kube-auth-proxy-57b999c94c-x8vwc\" (UID: \"489c6cee-5c33-4463-a787-f3d8596d6d80\") " pod="openshift-ingress/kube-auth-proxy-57b999c94c-x8vwc" Jul 27 20:41:16.478089 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:16.478059 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57b999c94c-x8vwc" Jul 27 20:41:16.620946 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:16.620924 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57b999c94c-x8vwc"] Jul 27 20:41:16.623678 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:41:16.623650 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod489c6cee_5c33_4463_a787_f3d8596d6d80.slice/crio-5d48919bd6d2c0f97397acba04e3b17d04a61f9a0bdcf0e732be78f7b9183b49 WatchSource:0}: Error finding container 5d48919bd6d2c0f97397acba04e3b17d04a61f9a0bdcf0e732be78f7b9183b49: Status 404 returned error can't find the container with id 5d48919bd6d2c0f97397acba04e3b17d04a61f9a0bdcf0e732be78f7b9183b49 Jul 27 20:41:17.628776 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:17.628734 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57b999c94c-x8vwc" event={"ID":"489c6cee-5c33-4463-a787-f3d8596d6d80","Type":"ContainerStarted","Data":"5d48919bd6d2c0f97397acba04e3b17d04a61f9a0bdcf0e732be78f7b9183b49"} Jul 27 20:41:19.640044 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:19.640006 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57b999c94c-x8vwc" event={"ID":"489c6cee-5c33-4463-a787-f3d8596d6d80","Type":"ContainerStarted","Data":"fedd76ca3e0de982f8b9409a7eb62126b417a0be6729cbf4bcadf5da04cbf64b"} Jul 27 20:41:19.656448 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:41:19.656399 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-57b999c94c-x8vwc" podStartSLOduration=1.287011827 podStartE2EDuration="3.656382819s" totalImagesPullingTime="2.369370992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:41:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:41:19.655238515 +0000 UTC m=+417.408482845" watchObservedRunningTime="2026-07-27 20:41:19.656382819 +0000 UTC m=+417.409627154" Jul 27 20:43:10.347372 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:43:10.347331 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-xg2c5"] Jul 27 20:43:10.350699 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:43:10.350678 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xg2c5" Jul 27 20:43:10.355563 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:43:10.355540 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 27 20:43:10.355701 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:43:10.355590 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 27 20:43:10.355701 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:43:10.355597 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6tzdk\"" Jul 27 20:43:10.356069 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:43:10.356045 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 27 20:43:10.356160 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:43:10.356045 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 27 20:43:10.363028 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:43:10.362998 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-xg2c5"] Jul 27 20:43:10.488715 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:43:10.488668 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/acd14682-de2b-42c1-bf99-463af417fe65-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-xg2c5\" (UID: \"acd14682-de2b-42c1-bf99-463af417fe65\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xg2c5" Jul 27 20:43:10.488715 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:43:10.488714 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/acd14682-de2b-42c1-bf99-463af417fe65-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-xg2c5\" (UID: \"acd14682-de2b-42c1-bf99-463af417fe65\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xg2c5" Jul 27 20:43:10.488977 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:43:10.488794 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdbxh\" (UniqueName: \"kubernetes.io/projected/acd14682-de2b-42c1-bf99-463af417fe65-kube-api-access-zdbxh\") pod \"kuadrant-console-plugin-66b5774985-xg2c5\" (UID: \"acd14682-de2b-42c1-bf99-463af417fe65\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xg2c5" Jul 27 20:43:10.589483 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:43:10.589439 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdbxh\" (UniqueName: \"kubernetes.io/projected/acd14682-de2b-42c1-bf99-463af417fe65-kube-api-access-zdbxh\") pod \"kuadrant-console-plugin-66b5774985-xg2c5\" (UID: \"acd14682-de2b-42c1-bf99-463af417fe65\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xg2c5" Jul 27 20:43:10.589683 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:43:10.589552 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/acd14682-de2b-42c1-bf99-463af417fe65-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-xg2c5\" (UID: \"acd14682-de2b-42c1-bf99-463af417fe65\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xg2c5" Jul 27 20:43:10.589683 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:43:10.589576 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/acd14682-de2b-42c1-bf99-463af417fe65-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-xg2c5\" (UID: \"acd14682-de2b-42c1-bf99-463af417fe65\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xg2c5" Jul 27 20:43:10.590153 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:43:10.590134 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/acd14682-de2b-42c1-bf99-463af417fe65-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-xg2c5\" (UID: \"acd14682-de2b-42c1-bf99-463af417fe65\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xg2c5" Jul 27 20:43:10.592306 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:43:10.592283 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/acd14682-de2b-42c1-bf99-463af417fe65-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-xg2c5\" (UID: \"acd14682-de2b-42c1-bf99-463af417fe65\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xg2c5" Jul 27 20:43:10.597693 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:43:10.597633 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdbxh\" (UniqueName: \"kubernetes.io/projected/acd14682-de2b-42c1-bf99-463af417fe65-kube-api-access-zdbxh\") pod \"kuadrant-console-plugin-66b5774985-xg2c5\" (UID: \"acd14682-de2b-42c1-bf99-463af417fe65\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xg2c5" Jul 27 20:43:10.660144 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:43:10.660106 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xg2c5" Jul 27 20:43:10.815671 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:43:10.815644 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-xg2c5"] Jul 27 20:43:10.817488 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:43:10.817463 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podacd14682_de2b_42c1_bf99_463af417fe65.slice/crio-c4a7da43e17e5ae012659925a987d933319737b33ad279131a1c1d95bbe3ba6b WatchSource:0}: Error finding container c4a7da43e17e5ae012659925a987d933319737b33ad279131a1c1d95bbe3ba6b: Status 404 returned error can't find the container with id c4a7da43e17e5ae012659925a987d933319737b33ad279131a1c1d95bbe3ba6b Jul 27 20:43:11.122758 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:43:11.122728 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xg2c5" event={"ID":"acd14682-de2b-42c1-bf99-463af417fe65","Type":"ContainerStarted","Data":"c4a7da43e17e5ae012659925a987d933319737b33ad279131a1c1d95bbe3ba6b"} Jul 27 20:43:32.235993 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:43:32.235959 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xg2c5" event={"ID":"acd14682-de2b-42c1-bf99-463af417fe65","Type":"ContainerStarted","Data":"d5a8d1bb483be0f9ce91d570bddc57e3f36817397d2f112d4a985830e9fba600"} Jul 27 20:43:32.258167 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:43:32.258103 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xg2c5" podStartSLOduration=1.034939827 podStartE2EDuration="22.258085783s" totalImagesPullingTime="21.223145956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:43:32.255512663 +0000 UTC m=+550.008757017" watchObservedRunningTime="2026-07-27 20:43:32.258085783 +0000 UTC m=+550.011330114" Jul 27 20:44:06.227454 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:06.227414 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:44:06.248333 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:06.248296 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:44:06.248498 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:06.248419 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-szhjk" Jul 27 20:44:06.250419 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:06.250397 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 27 20:44:06.256742 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:06.256721 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:44:06.394753 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:06.394717 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d426b8b2-c8eb-4d5c-a1d9-4addddee7ccd-config-file\") pod \"limitador-limitador-54d6d988d5-szhjk\" (UID: \"d426b8b2-c8eb-4d5c-a1d9-4addddee7ccd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-szhjk" Jul 27 20:44:06.394925 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:06.394782 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48s5g\" (UniqueName: \"kubernetes.io/projected/d426b8b2-c8eb-4d5c-a1d9-4addddee7ccd-kube-api-access-48s5g\") pod \"limitador-limitador-54d6d988d5-szhjk\" (UID: \"d426b8b2-c8eb-4d5c-a1d9-4addddee7ccd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-szhjk" Jul 27 20:44:06.495829 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:06.495791 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48s5g\" (UniqueName: \"kubernetes.io/projected/d426b8b2-c8eb-4d5c-a1d9-4addddee7ccd-kube-api-access-48s5g\") pod \"limitador-limitador-54d6d988d5-szhjk\" (UID: \"d426b8b2-c8eb-4d5c-a1d9-4addddee7ccd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-szhjk" Jul 27 20:44:06.496020 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:06.495870 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d426b8b2-c8eb-4d5c-a1d9-4addddee7ccd-config-file\") pod \"limitador-limitador-54d6d988d5-szhjk\" (UID: \"d426b8b2-c8eb-4d5c-a1d9-4addddee7ccd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-szhjk" Jul 27 20:44:06.496562 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:06.496508 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d426b8b2-c8eb-4d5c-a1d9-4addddee7ccd-config-file\") pod \"limitador-limitador-54d6d988d5-szhjk\" (UID: \"d426b8b2-c8eb-4d5c-a1d9-4addddee7ccd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-szhjk" Jul 27 20:44:06.503499 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:06.503468 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48s5g\" (UniqueName: \"kubernetes.io/projected/d426b8b2-c8eb-4d5c-a1d9-4addddee7ccd-kube-api-access-48s5g\") pod \"limitador-limitador-54d6d988d5-szhjk\" (UID: \"d426b8b2-c8eb-4d5c-a1d9-4addddee7ccd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-szhjk" Jul 27 20:44:06.558783 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:06.558726 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-szhjk" Jul 27 20:44:06.621996 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:06.621950 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-9b5fl"] Jul 27 20:44:06.626923 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:06.626271 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9b5fl" Jul 27 20:44:06.628403 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:06.628379 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5lp2t\"" Jul 27 20:44:06.631371 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:06.631349 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9b5fl"] Jul 27 20:44:06.697914 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:06.697885 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:44:06.698219 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:06.698195 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26pp6\" (UniqueName: \"kubernetes.io/projected/5ddad922-5540-48b8-a1c5-6d80f9b3b6b4-kube-api-access-26pp6\") pod \"authorino-58cd955675-9b5fl\" (UID: \"5ddad922-5540-48b8-a1c5-6d80f9b3b6b4\") " pod="kuadrant-system/authorino-58cd955675-9b5fl" Jul 27 20:44:06.699979 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:44:06.699939 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd426b8b2_c8eb_4d5c_a1d9_4addddee7ccd.slice/crio-1b3ab029d001d4e4827cc30a630d584c5b2b79708a443b2950d5bee7c20f33ca WatchSource:0}: Error finding container 1b3ab029d001d4e4827cc30a630d584c5b2b79708a443b2950d5bee7c20f33ca: Status 404 returned error can't find the container with id 1b3ab029d001d4e4827cc30a630d584c5b2b79708a443b2950d5bee7c20f33ca Jul 27 20:44:06.799442 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:06.799344 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26pp6\" (UniqueName: \"kubernetes.io/projected/5ddad922-5540-48b8-a1c5-6d80f9b3b6b4-kube-api-access-26pp6\") pod \"authorino-58cd955675-9b5fl\" (UID: \"5ddad922-5540-48b8-a1c5-6d80f9b3b6b4\") " pod="kuadrant-system/authorino-58cd955675-9b5fl" Jul 27 20:44:06.806817 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:06.806782 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26pp6\" (UniqueName: \"kubernetes.io/projected/5ddad922-5540-48b8-a1c5-6d80f9b3b6b4-kube-api-access-26pp6\") pod \"authorino-58cd955675-9b5fl\" (UID: \"5ddad922-5540-48b8-a1c5-6d80f9b3b6b4\") " pod="kuadrant-system/authorino-58cd955675-9b5fl" Jul 27 20:44:06.938618 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:06.938581 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9b5fl" Jul 27 20:44:07.068365 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:07.068343 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9b5fl"] Jul 27 20:44:07.070310 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:44:07.070279 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ddad922_5540_48b8_a1c5_6d80f9b3b6b4.slice/crio-ccf67958ced75d5dee6c3f5accffdecd3fe4b6d117529447f8a1080d053fa290 WatchSource:0}: Error finding container ccf67958ced75d5dee6c3f5accffdecd3fe4b6d117529447f8a1080d053fa290: Status 404 returned error can't find the container with id ccf67958ced75d5dee6c3f5accffdecd3fe4b6d117529447f8a1080d053fa290 Jul 27 20:44:07.392421 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:07.392283 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9b5fl" event={"ID":"5ddad922-5540-48b8-a1c5-6d80f9b3b6b4","Type":"ContainerStarted","Data":"ccf67958ced75d5dee6c3f5accffdecd3fe4b6d117529447f8a1080d053fa290"} Jul 27 20:44:07.394279 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:07.394230 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-szhjk" event={"ID":"d426b8b2-c8eb-4d5c-a1d9-4addddee7ccd","Type":"ContainerStarted","Data":"1b3ab029d001d4e4827cc30a630d584c5b2b79708a443b2950d5bee7c20f33ca"} Jul 27 20:44:11.420401 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:11.420295 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-szhjk" event={"ID":"d426b8b2-c8eb-4d5c-a1d9-4addddee7ccd","Type":"ContainerStarted","Data":"2047b9d49dceac77d1365761675bbfe02cf310d04cba307958c0bbfddd9dbbd6"} Jul 27 20:44:11.420401 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:11.420369 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-szhjk" Jul 27 20:44:11.421763 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:11.421734 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9b5fl" event={"ID":"5ddad922-5540-48b8-a1c5-6d80f9b3b6b4","Type":"ContainerStarted","Data":"6cc638cd9fa0de50d23ec2771edfefcd52aa2cbcf4bab6b090c518b081a70040"} Jul 27 20:44:11.433936 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:11.433886 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-szhjk" podStartSLOduration=1.048467556 podStartE2EDuration="5.433873485s" totalImagesPullingTime="4.385405929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:44:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:44:11.433232618 +0000 UTC m=+589.186476948" watchObservedRunningTime="2026-07-27 20:44:11.433873485 +0000 UTC m=+589.187117867" Jul 27 20:44:11.446207 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:11.446124 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-9b5fl" podStartSLOduration=1.429085756 podStartE2EDuration="5.446105341s" totalImagesPullingTime="4.017019585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:44:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:44:11.445778806 +0000 UTC m=+589.199023139" watchObservedRunningTime="2026-07-27 20:44:11.446105341 +0000 UTC m=+589.199349673" Jul 27 20:44:11.775281 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:11.775246 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9b5fl"] Jul 27 20:44:13.430946 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:13.430865 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-9b5fl" podUID="5ddad922-5540-48b8-a1c5-6d80f9b3b6b4" containerName="authorino" containerID="cri-o://6cc638cd9fa0de50d23ec2771edfefcd52aa2cbcf4bab6b090c518b081a70040" gracePeriod=30 Jul 27 20:44:13.677972 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:13.677943 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9b5fl" Jul 27 20:44:13.761337 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:13.761308 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26pp6\" (UniqueName: \"kubernetes.io/projected/5ddad922-5540-48b8-a1c5-6d80f9b3b6b4-kube-api-access-26pp6\") pod \"5ddad922-5540-48b8-a1c5-6d80f9b3b6b4\" (UID: \"5ddad922-5540-48b8-a1c5-6d80f9b3b6b4\") " Jul 27 20:44:13.763676 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:13.763651 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ddad922-5540-48b8-a1c5-6d80f9b3b6b4-kube-api-access-26pp6" (OuterVolumeSpecName: "kube-api-access-26pp6") pod "5ddad922-5540-48b8-a1c5-6d80f9b3b6b4" (UID: "5ddad922-5540-48b8-a1c5-6d80f9b3b6b4"). InnerVolumeSpecName "kube-api-access-26pp6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:44:13.861980 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:13.861944 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26pp6\" (UniqueName: \"kubernetes.io/projected/5ddad922-5540-48b8-a1c5-6d80f9b3b6b4-kube-api-access-26pp6\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:44:14.437160 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:14.437122 2554 generic.go:356] "Generic (PLEG): container finished" podID="5ddad922-5540-48b8-a1c5-6d80f9b3b6b4" containerID="6cc638cd9fa0de50d23ec2771edfefcd52aa2cbcf4bab6b090c518b081a70040" exitCode=0 Jul 27 20:44:14.437634 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:14.437179 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9b5fl" Jul 27 20:44:14.437634 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:14.437210 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9b5fl" event={"ID":"5ddad922-5540-48b8-a1c5-6d80f9b3b6b4","Type":"ContainerDied","Data":"6cc638cd9fa0de50d23ec2771edfefcd52aa2cbcf4bab6b090c518b081a70040"} Jul 27 20:44:14.437634 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:14.437254 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9b5fl" event={"ID":"5ddad922-5540-48b8-a1c5-6d80f9b3b6b4","Type":"ContainerDied","Data":"ccf67958ced75d5dee6c3f5accffdecd3fe4b6d117529447f8a1080d053fa290"} Jul 27 20:44:14.437634 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:14.437271 2554 scope.go:117] "RemoveContainer" containerID="6cc638cd9fa0de50d23ec2771edfefcd52aa2cbcf4bab6b090c518b081a70040" Jul 27 20:44:14.446716 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:14.446701 2554 scope.go:117] "RemoveContainer" containerID="6cc638cd9fa0de50d23ec2771edfefcd52aa2cbcf4bab6b090c518b081a70040" Jul 27 20:44:14.446963 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:44:14.446946 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cc638cd9fa0de50d23ec2771edfefcd52aa2cbcf4bab6b090c518b081a70040\": container with ID starting with 6cc638cd9fa0de50d23ec2771edfefcd52aa2cbcf4bab6b090c518b081a70040 not found: ID does not exist" containerID="6cc638cd9fa0de50d23ec2771edfefcd52aa2cbcf4bab6b090c518b081a70040" Jul 27 20:44:14.447026 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:14.446970 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cc638cd9fa0de50d23ec2771edfefcd52aa2cbcf4bab6b090c518b081a70040"} err="failed to get container status \"6cc638cd9fa0de50d23ec2771edfefcd52aa2cbcf4bab6b090c518b081a70040\": rpc error: code = NotFound desc = could not find container \"6cc638cd9fa0de50d23ec2771edfefcd52aa2cbcf4bab6b090c518b081a70040\": container with ID starting with 6cc638cd9fa0de50d23ec2771edfefcd52aa2cbcf4bab6b090c518b081a70040 not found: ID does not exist" Jul 27 20:44:14.456856 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:14.456833 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9b5fl"] Jul 27 20:44:14.459882 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:14.459860 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-9b5fl"] Jul 27 20:44:14.717991 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:14.717912 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ddad922-5540-48b8-a1c5-6d80f9b3b6b4" path="/var/lib/kubelet/pods/5ddad922-5540-48b8-a1c5-6d80f9b3b6b4/volumes" Jul 27 20:44:22.427696 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:22.427660 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-szhjk" Jul 27 20:44:39.672479 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:39.672437 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-gp72c"] Jul 27 20:44:39.672913 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:39.672803 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ddad922-5540-48b8-a1c5-6d80f9b3b6b4" containerName="authorino" Jul 27 20:44:39.672913 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:39.672816 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ddad922-5540-48b8-a1c5-6d80f9b3b6b4" containerName="authorino" Jul 27 20:44:39.672913 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:39.672887 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ddad922-5540-48b8-a1c5-6d80f9b3b6b4" containerName="authorino" Jul 27 20:44:39.676969 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:39.676954 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-gp72c" Jul 27 20:44:39.679465 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:39.679447 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5lp2t\"" Jul 27 20:44:39.679597 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:39.679448 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 27 20:44:39.682675 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:39.682653 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-gp72c"] Jul 27 20:44:39.725912 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:39.725878 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-gp72c"] Jul 27 20:44:39.726156 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:44:39.726135 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-5n6wc tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-5n6wc tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-gp72c" podUID="69fd0668-b420-4cd5-966e-bd4da6c37ac3" Jul 27 20:44:39.757206 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:39.757172 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-786cd5fc79-tjnrv"] Jul 27 20:44:39.760289 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:39.760274 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-786cd5fc79-tjnrv" Jul 27 20:44:39.767888 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:39.767861 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-786cd5fc79-tjnrv"] Jul 27 20:44:39.786490 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:39.786457 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/69fd0668-b420-4cd5-966e-bd4da6c37ac3-tls-cert\") pod \"authorino-76877994-gp72c\" (UID: \"69fd0668-b420-4cd5-966e-bd4da6c37ac3\") " pod="kuadrant-system/authorino-76877994-gp72c" Jul 27 20:44:39.786653 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:39.786589 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n6wc\" (UniqueName: \"kubernetes.io/projected/69fd0668-b420-4cd5-966e-bd4da6c37ac3-kube-api-access-5n6wc\") pod \"authorino-76877994-gp72c\" (UID: \"69fd0668-b420-4cd5-966e-bd4da6c37ac3\") " pod="kuadrant-system/authorino-76877994-gp72c" Jul 27 20:44:39.887326 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:39.887287 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/69fd0668-b420-4cd5-966e-bd4da6c37ac3-tls-cert\") pod \"authorino-76877994-gp72c\" (UID: \"69fd0668-b420-4cd5-966e-bd4da6c37ac3\") " pod="kuadrant-system/authorino-76877994-gp72c" Jul 27 20:44:39.887504 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:39.887348 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c7fe876e-8381-4c36-92fb-0860e7087909-tls-cert\") pod \"authorino-786cd5fc79-tjnrv\" (UID: \"c7fe876e-8381-4c36-92fb-0860e7087909\") " pod="kuadrant-system/authorino-786cd5fc79-tjnrv" Jul 27 20:44:39.887504 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:39.887388 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvnps\" (UniqueName: \"kubernetes.io/projected/c7fe876e-8381-4c36-92fb-0860e7087909-kube-api-access-xvnps\") pod \"authorino-786cd5fc79-tjnrv\" (UID: \"c7fe876e-8381-4c36-92fb-0860e7087909\") " pod="kuadrant-system/authorino-786cd5fc79-tjnrv" Jul 27 20:44:39.887504 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:39.887433 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n6wc\" (UniqueName: \"kubernetes.io/projected/69fd0668-b420-4cd5-966e-bd4da6c37ac3-kube-api-access-5n6wc\") pod \"authorino-76877994-gp72c\" (UID: \"69fd0668-b420-4cd5-966e-bd4da6c37ac3\") " pod="kuadrant-system/authorino-76877994-gp72c" Jul 27 20:44:39.889932 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:39.889912 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/69fd0668-b420-4cd5-966e-bd4da6c37ac3-tls-cert\") pod \"authorino-76877994-gp72c\" (UID: \"69fd0668-b420-4cd5-966e-bd4da6c37ac3\") " pod="kuadrant-system/authorino-76877994-gp72c" Jul 27 20:44:39.894807 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:39.894780 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n6wc\" (UniqueName: \"kubernetes.io/projected/69fd0668-b420-4cd5-966e-bd4da6c37ac3-kube-api-access-5n6wc\") pod \"authorino-76877994-gp72c\" (UID: \"69fd0668-b420-4cd5-966e-bd4da6c37ac3\") " pod="kuadrant-system/authorino-76877994-gp72c" Jul 27 20:44:39.988001 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:39.987966 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvnps\" (UniqueName: \"kubernetes.io/projected/c7fe876e-8381-4c36-92fb-0860e7087909-kube-api-access-xvnps\") pod \"authorino-786cd5fc79-tjnrv\" (UID: \"c7fe876e-8381-4c36-92fb-0860e7087909\") " pod="kuadrant-system/authorino-786cd5fc79-tjnrv" Jul 27 20:44:39.988201 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:39.988076 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c7fe876e-8381-4c36-92fb-0860e7087909-tls-cert\") pod \"authorino-786cd5fc79-tjnrv\" (UID: \"c7fe876e-8381-4c36-92fb-0860e7087909\") " pod="kuadrant-system/authorino-786cd5fc79-tjnrv" Jul 27 20:44:39.990645 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:39.990623 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c7fe876e-8381-4c36-92fb-0860e7087909-tls-cert\") pod \"authorino-786cd5fc79-tjnrv\" (UID: \"c7fe876e-8381-4c36-92fb-0860e7087909\") " pod="kuadrant-system/authorino-786cd5fc79-tjnrv" Jul 27 20:44:39.996881 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:39.996857 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvnps\" (UniqueName: \"kubernetes.io/projected/c7fe876e-8381-4c36-92fb-0860e7087909-kube-api-access-xvnps\") pod \"authorino-786cd5fc79-tjnrv\" (UID: \"c7fe876e-8381-4c36-92fb-0860e7087909\") " pod="kuadrant-system/authorino-786cd5fc79-tjnrv" Jul 27 20:44:40.070251 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:40.070209 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-786cd5fc79-tjnrv" Jul 27 20:44:40.200419 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:40.200395 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-786cd5fc79-tjnrv"] Jul 27 20:44:40.202665 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:44:40.202586 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7fe876e_8381_4c36_92fb_0860e7087909.slice/crio-8b6cb9b2fb55411746c7a26a737b692fc2065f116f9e82a34d989ecc6c3c0f9a WatchSource:0}: Error finding container 8b6cb9b2fb55411746c7a26a737b692fc2065f116f9e82a34d989ecc6c3c0f9a: Status 404 returned error can't find the container with id 8b6cb9b2fb55411746c7a26a737b692fc2065f116f9e82a34d989ecc6c3c0f9a Jul 27 20:44:40.561768 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:40.561739 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-gp72c" Jul 27 20:44:40.561983 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:40.561740 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-786cd5fc79-tjnrv" event={"ID":"c7fe876e-8381-4c36-92fb-0860e7087909","Type":"ContainerStarted","Data":"8b6cb9b2fb55411746c7a26a737b692fc2065f116f9e82a34d989ecc6c3c0f9a"} Jul 27 20:44:40.569821 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:40.569798 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-gp72c" Jul 27 20:44:40.693064 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:40.693025 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5n6wc\" (UniqueName: \"kubernetes.io/projected/69fd0668-b420-4cd5-966e-bd4da6c37ac3-kube-api-access-5n6wc\") pod \"69fd0668-b420-4cd5-966e-bd4da6c37ac3\" (UID: \"69fd0668-b420-4cd5-966e-bd4da6c37ac3\") " Jul 27 20:44:40.693426 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:40.693074 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/69fd0668-b420-4cd5-966e-bd4da6c37ac3-tls-cert\") pod \"69fd0668-b420-4cd5-966e-bd4da6c37ac3\" (UID: \"69fd0668-b420-4cd5-966e-bd4da6c37ac3\") " Jul 27 20:44:40.695430 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:40.695397 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69fd0668-b420-4cd5-966e-bd4da6c37ac3-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "69fd0668-b420-4cd5-966e-bd4da6c37ac3" (UID: "69fd0668-b420-4cd5-966e-bd4da6c37ac3"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:44:40.695546 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:40.695435 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69fd0668-b420-4cd5-966e-bd4da6c37ac3-kube-api-access-5n6wc" (OuterVolumeSpecName: "kube-api-access-5n6wc") pod "69fd0668-b420-4cd5-966e-bd4da6c37ac3" (UID: "69fd0668-b420-4cd5-966e-bd4da6c37ac3"). InnerVolumeSpecName "kube-api-access-5n6wc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:44:40.794538 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:40.794490 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5n6wc\" (UniqueName: \"kubernetes.io/projected/69fd0668-b420-4cd5-966e-bd4da6c37ac3-kube-api-access-5n6wc\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:44:40.794538 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:40.794538 2554 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/69fd0668-b420-4cd5-966e-bd4da6c37ac3-tls-cert\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:44:41.567706 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:41.567675 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-gp72c" Jul 27 20:44:41.567706 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:41.567689 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-786cd5fc79-tjnrv" event={"ID":"c7fe876e-8381-4c36-92fb-0860e7087909","Type":"ContainerStarted","Data":"3c72ded2ab25fdf47a8a1e0c882700011b593e88557f4b88e37fbf87ed944bf1"} Jul 27 20:44:41.595723 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:41.595686 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-gp72c"] Jul 27 20:44:41.601452 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:41.601421 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-gp72c"] Jul 27 20:44:41.614798 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:41.614742 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-786cd5fc79-tjnrv" podStartSLOduration=1.889964611 podStartE2EDuration="2.614720557s" totalImagesPullingTime="724.755946ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:44:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:44:41.612216386 +0000 UTC m=+619.365460716" watchObservedRunningTime="2026-07-27 20:44:41.614720557 +0000 UTC m=+619.367964889" Jul 27 20:44:42.721779 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:44:42.721739 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69fd0668-b420-4cd5-966e-bd4da6c37ac3" path="/var/lib/kubelet/pods/69fd0668-b420-4cd5-966e-bd4da6c37ac3/volumes" Jul 27 20:45:22.928836 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:45:22.928798 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:45:43.333018 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:45:43.332980 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:45:52.726105 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:45:52.726065 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:46:00.332676 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:00.332641 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:46:08.726356 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:08.726316 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:46:30.030293 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:30.030241 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:46:33.629295 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:33.629257 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl"] Jul 27 20:46:33.632532 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:33.632500 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl" Jul 27 20:46:33.634770 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:33.634743 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 27 20:46:33.635432 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:33.635412 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vxgfz\"" Jul 27 20:46:33.635552 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:33.635434 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 27 20:46:33.635552 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:33.635413 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 27 20:46:33.643109 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:33.643091 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl"] Jul 27 20:46:33.670348 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:33.670312 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ebefdbc-3495-4100-a8cf-21512e99071a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl\" (UID: \"8ebefdbc-3495-4100-a8cf-21512e99071a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl" Jul 27 20:46:33.670510 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:33.670365 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ebefdbc-3495-4100-a8cf-21512e99071a-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl\" (UID: \"8ebefdbc-3495-4100-a8cf-21512e99071a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl" Jul 27 20:46:33.670510 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:33.670427 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ebefdbc-3495-4100-a8cf-21512e99071a-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl\" (UID: \"8ebefdbc-3495-4100-a8cf-21512e99071a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl" Jul 27 20:46:33.670510 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:33.670446 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcddt\" (UniqueName: \"kubernetes.io/projected/8ebefdbc-3495-4100-a8cf-21512e99071a-kube-api-access-zcddt\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl\" (UID: \"8ebefdbc-3495-4100-a8cf-21512e99071a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl" Jul 27 20:46:33.670510 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:33.670497 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ebefdbc-3495-4100-a8cf-21512e99071a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl\" (UID: \"8ebefdbc-3495-4100-a8cf-21512e99071a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl" Jul 27 20:46:33.670681 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:33.670566 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ebefdbc-3495-4100-a8cf-21512e99071a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl\" (UID: \"8ebefdbc-3495-4100-a8cf-21512e99071a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl" Jul 27 20:46:33.771821 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:33.771782 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ebefdbc-3495-4100-a8cf-21512e99071a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl\" (UID: \"8ebefdbc-3495-4100-a8cf-21512e99071a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl" Jul 27 20:46:33.771821 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:33.771829 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ebefdbc-3495-4100-a8cf-21512e99071a-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl\" (UID: \"8ebefdbc-3495-4100-a8cf-21512e99071a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl" Jul 27 20:46:33.772072 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:33.771885 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ebefdbc-3495-4100-a8cf-21512e99071a-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl\" (UID: \"8ebefdbc-3495-4100-a8cf-21512e99071a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl" Jul 27 20:46:33.772072 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:33.771904 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcddt\" (UniqueName: \"kubernetes.io/projected/8ebefdbc-3495-4100-a8cf-21512e99071a-kube-api-access-zcddt\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl\" (UID: \"8ebefdbc-3495-4100-a8cf-21512e99071a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl" Jul 27 20:46:33.772072 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:33.771934 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ebefdbc-3495-4100-a8cf-21512e99071a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl\" (UID: \"8ebefdbc-3495-4100-a8cf-21512e99071a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl" Jul 27 20:46:33.772072 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:33.771960 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ebefdbc-3495-4100-a8cf-21512e99071a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl\" (UID: \"8ebefdbc-3495-4100-a8cf-21512e99071a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl" Jul 27 20:46:33.772282 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:33.772254 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ebefdbc-3495-4100-a8cf-21512e99071a-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl\" (UID: \"8ebefdbc-3495-4100-a8cf-21512e99071a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl" Jul 27 20:46:33.772413 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:33.772395 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ebefdbc-3495-4100-a8cf-21512e99071a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl\" (UID: \"8ebefdbc-3495-4100-a8cf-21512e99071a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl" Jul 27 20:46:33.772469 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:33.772415 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ebefdbc-3495-4100-a8cf-21512e99071a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl\" (UID: \"8ebefdbc-3495-4100-a8cf-21512e99071a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl" Jul 27 20:46:33.774490 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:33.774468 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ebefdbc-3495-4100-a8cf-21512e99071a-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl\" (UID: \"8ebefdbc-3495-4100-a8cf-21512e99071a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl" Jul 27 20:46:33.774629 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:33.774613 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ebefdbc-3495-4100-a8cf-21512e99071a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl\" (UID: \"8ebefdbc-3495-4100-a8cf-21512e99071a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl" Jul 27 20:46:33.779950 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:33.779930 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcddt\" (UniqueName: \"kubernetes.io/projected/8ebefdbc-3495-4100-a8cf-21512e99071a-kube-api-access-zcddt\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl\" (UID: \"8ebefdbc-3495-4100-a8cf-21512e99071a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl" Jul 27 20:46:33.942007 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:33.941925 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl" Jul 27 20:46:34.076869 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:34.076828 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl"] Jul 27 20:46:34.079570 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:46:34.079544 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ebefdbc_3495_4100_a8cf_21512e99071a.slice/crio-5cbf4201a815c8d6d7bdfd5b7534ee2d5d4d02e7c49bebe862bdf088e1009132 WatchSource:0}: Error finding container 5cbf4201a815c8d6d7bdfd5b7534ee2d5d4d02e7c49bebe862bdf088e1009132: Status 404 returned error can't find the container with id 5cbf4201a815c8d6d7bdfd5b7534ee2d5d4d02e7c49bebe862bdf088e1009132 Jul 27 20:46:34.080834 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:34.080812 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 20:46:35.086176 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:35.086137 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl" event={"ID":"8ebefdbc-3495-4100-a8cf-21512e99071a","Type":"ContainerStarted","Data":"5cbf4201a815c8d6d7bdfd5b7534ee2d5d4d02e7c49bebe862bdf088e1009132"} Jul 27 20:46:36.091626 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:36.091586 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl" event={"ID":"8ebefdbc-3495-4100-a8cf-21512e99071a","Type":"ContainerStarted","Data":"41cfd40d3b0874b03b529620233acd5a5ae42fa8a6a53a6b0d6286b3dab16f00"} Jul 27 20:46:36.109635 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:36.109579 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl" podStartSLOduration=2.053170026 podStartE2EDuration="3.109564875s" totalImagesPullingTime="1.056394849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:46:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:46:36.108418708 +0000 UTC m=+733.861663049" watchObservedRunningTime="2026-07-27 20:46:36.109564875 +0000 UTC m=+733.862809206" Jul 27 20:46:43.231163 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:43.231129 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:46:43.943003 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:43.942966 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl" Jul 27 20:46:43.943214 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:43.943061 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl" Jul 27 20:46:43.955449 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:43.955426 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl" Jul 27 20:46:44.140251 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:46:44.140221 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl" Jul 27 20:47:37.407306 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:37.407274 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-86c6c7b8f4-77k7r"] Jul 27 20:47:37.410614 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:37.410598 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86c6c7b8f4-77k7r" Jul 27 20:47:37.417540 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:37.417498 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86c6c7b8f4-77k7r"] Jul 27 20:47:37.536119 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:37.536074 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nznm\" (UniqueName: \"kubernetes.io/projected/3ff356b3-0549-4788-bd56-ab5d0325ea1d-kube-api-access-4nznm\") pod \"authorino-86c6c7b8f4-77k7r\" (UID: \"3ff356b3-0549-4788-bd56-ab5d0325ea1d\") " pod="kuadrant-system/authorino-86c6c7b8f4-77k7r" Jul 27 20:47:37.536326 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:37.536213 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3ff356b3-0549-4788-bd56-ab5d0325ea1d-tls-cert\") pod \"authorino-86c6c7b8f4-77k7r\" (UID: \"3ff356b3-0549-4788-bd56-ab5d0325ea1d\") " pod="kuadrant-system/authorino-86c6c7b8f4-77k7r" Jul 27 20:47:37.637066 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:37.637009 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3ff356b3-0549-4788-bd56-ab5d0325ea1d-tls-cert\") pod \"authorino-86c6c7b8f4-77k7r\" (UID: \"3ff356b3-0549-4788-bd56-ab5d0325ea1d\") " pod="kuadrant-system/authorino-86c6c7b8f4-77k7r" Jul 27 20:47:37.637290 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:37.637093 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nznm\" (UniqueName: \"kubernetes.io/projected/3ff356b3-0549-4788-bd56-ab5d0325ea1d-kube-api-access-4nznm\") pod \"authorino-86c6c7b8f4-77k7r\" (UID: \"3ff356b3-0549-4788-bd56-ab5d0325ea1d\") " pod="kuadrant-system/authorino-86c6c7b8f4-77k7r" Jul 27 20:47:37.639811 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:37.639779 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3ff356b3-0549-4788-bd56-ab5d0325ea1d-tls-cert\") pod \"authorino-86c6c7b8f4-77k7r\" (UID: \"3ff356b3-0549-4788-bd56-ab5d0325ea1d\") " pod="kuadrant-system/authorino-86c6c7b8f4-77k7r" Jul 27 20:47:37.645251 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:37.645232 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nznm\" (UniqueName: \"kubernetes.io/projected/3ff356b3-0549-4788-bd56-ab5d0325ea1d-kube-api-access-4nznm\") pod \"authorino-86c6c7b8f4-77k7r\" (UID: \"3ff356b3-0549-4788-bd56-ab5d0325ea1d\") " pod="kuadrant-system/authorino-86c6c7b8f4-77k7r" Jul 27 20:47:37.720468 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:37.720384 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86c6c7b8f4-77k7r" Jul 27 20:47:37.854124 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:37.854100 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86c6c7b8f4-77k7r"] Jul 27 20:47:37.856170 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:47:37.856135 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ff356b3_0549_4788_bd56_ab5d0325ea1d.slice/crio-76314b758b074839eadb4cfc3aa02013081c3874eafeac61d946dc543c52acdc WatchSource:0}: Error finding container 76314b758b074839eadb4cfc3aa02013081c3874eafeac61d946dc543c52acdc: Status 404 returned error can't find the container with id 76314b758b074839eadb4cfc3aa02013081c3874eafeac61d946dc543c52acdc Jul 27 20:47:38.382385 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:38.382345 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86c6c7b8f4-77k7r" event={"ID":"3ff356b3-0549-4788-bd56-ab5d0325ea1d","Type":"ContainerStarted","Data":"d2ec0ca3c769d3c51a8f175b1911c59631091bd6e3abce3446fc436600c3eb1c"} Jul 27 20:47:38.382568 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:38.382395 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86c6c7b8f4-77k7r" event={"ID":"3ff356b3-0549-4788-bd56-ab5d0325ea1d","Type":"ContainerStarted","Data":"76314b758b074839eadb4cfc3aa02013081c3874eafeac61d946dc543c52acdc"} Jul 27 20:47:38.397155 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:38.397090 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-86c6c7b8f4-77k7r" podStartSLOduration=0.972150613 podStartE2EDuration="1.397070806s" totalImagesPullingTime="424.920193ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:47:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:47:38.396412071 +0000 UTC m=+796.149656402" watchObservedRunningTime="2026-07-27 20:47:38.397070806 +0000 UTC m=+796.150315139" Jul 27 20:47:38.430668 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:38.430634 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-786cd5fc79-tjnrv"] Jul 27 20:47:38.431148 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:38.430847 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-786cd5fc79-tjnrv" podUID="c7fe876e-8381-4c36-92fb-0860e7087909" containerName="authorino" containerID="cri-o://3c72ded2ab25fdf47a8a1e0c882700011b593e88557f4b88e37fbf87ed944bf1" gracePeriod=30 Jul 27 20:47:38.698698 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:38.698659 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-786cd5fc79-tjnrv" Jul 27 20:47:38.849245 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:38.849163 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c7fe876e-8381-4c36-92fb-0860e7087909-tls-cert\") pod \"c7fe876e-8381-4c36-92fb-0860e7087909\" (UID: \"c7fe876e-8381-4c36-92fb-0860e7087909\") " Jul 27 20:47:38.849245 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:38.849203 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvnps\" (UniqueName: \"kubernetes.io/projected/c7fe876e-8381-4c36-92fb-0860e7087909-kube-api-access-xvnps\") pod \"c7fe876e-8381-4c36-92fb-0860e7087909\" (UID: \"c7fe876e-8381-4c36-92fb-0860e7087909\") " Jul 27 20:47:38.851400 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:38.851367 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7fe876e-8381-4c36-92fb-0860e7087909-kube-api-access-xvnps" (OuterVolumeSpecName: "kube-api-access-xvnps") pod "c7fe876e-8381-4c36-92fb-0860e7087909" (UID: "c7fe876e-8381-4c36-92fb-0860e7087909"). InnerVolumeSpecName "kube-api-access-xvnps". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:47:38.859843 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:38.859808 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7fe876e-8381-4c36-92fb-0860e7087909-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c7fe876e-8381-4c36-92fb-0860e7087909" (UID: "c7fe876e-8381-4c36-92fb-0860e7087909"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:47:38.950536 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:38.950499 2554 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c7fe876e-8381-4c36-92fb-0860e7087909-tls-cert\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:47:38.950536 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:38.950542 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvnps\" (UniqueName: \"kubernetes.io/projected/c7fe876e-8381-4c36-92fb-0860e7087909-kube-api-access-xvnps\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:47:39.389347 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:39.389312 2554 generic.go:356] "Generic (PLEG): container finished" podID="c7fe876e-8381-4c36-92fb-0860e7087909" containerID="3c72ded2ab25fdf47a8a1e0c882700011b593e88557f4b88e37fbf87ed944bf1" exitCode=0 Jul 27 20:47:39.389513 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:39.389358 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-786cd5fc79-tjnrv" Jul 27 20:47:39.389513 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:39.389394 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-786cd5fc79-tjnrv" event={"ID":"c7fe876e-8381-4c36-92fb-0860e7087909","Type":"ContainerDied","Data":"3c72ded2ab25fdf47a8a1e0c882700011b593e88557f4b88e37fbf87ed944bf1"} Jul 27 20:47:39.389513 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:39.389441 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-786cd5fc79-tjnrv" event={"ID":"c7fe876e-8381-4c36-92fb-0860e7087909","Type":"ContainerDied","Data":"8b6cb9b2fb55411746c7a26a737b692fc2065f116f9e82a34d989ecc6c3c0f9a"} Jul 27 20:47:39.389513 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:39.389467 2554 scope.go:117] "RemoveContainer" containerID="3c72ded2ab25fdf47a8a1e0c882700011b593e88557f4b88e37fbf87ed944bf1" Jul 27 20:47:39.398718 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:39.398597 2554 scope.go:117] "RemoveContainer" containerID="3c72ded2ab25fdf47a8a1e0c882700011b593e88557f4b88e37fbf87ed944bf1" Jul 27 20:47:39.398920 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:47:39.398901 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c72ded2ab25fdf47a8a1e0c882700011b593e88557f4b88e37fbf87ed944bf1\": container with ID starting with 3c72ded2ab25fdf47a8a1e0c882700011b593e88557f4b88e37fbf87ed944bf1 not found: ID does not exist" containerID="3c72ded2ab25fdf47a8a1e0c882700011b593e88557f4b88e37fbf87ed944bf1" Jul 27 20:47:39.398984 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:39.398931 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c72ded2ab25fdf47a8a1e0c882700011b593e88557f4b88e37fbf87ed944bf1"} err="failed to get container status \"3c72ded2ab25fdf47a8a1e0c882700011b593e88557f4b88e37fbf87ed944bf1\": rpc error: code = NotFound desc = could not find container \"3c72ded2ab25fdf47a8a1e0c882700011b593e88557f4b88e37fbf87ed944bf1\": container with ID starting with 3c72ded2ab25fdf47a8a1e0c882700011b593e88557f4b88e37fbf87ed944bf1 not found: ID does not exist" Jul 27 20:47:39.414053 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:39.414024 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-786cd5fc79-tjnrv"] Jul 27 20:47:39.419704 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:39.419678 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-786cd5fc79-tjnrv"] Jul 27 20:47:40.724755 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:47:40.724707 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7fe876e-8381-4c36-92fb-0860e7087909" path="/var/lib/kubelet/pods/c7fe876e-8381-4c36-92fb-0860e7087909/volumes" Jul 27 20:48:10.634298 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:48:10.634268 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:48:20.330165 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:48:20.330127 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:48:31.432147 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:48:31.432106 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:50:12.519438 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:50:12.519399 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:50:48.726085 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:50:48.726010 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:50:58.034297 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:50:58.034262 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:51:08.726292 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:51:08.726251 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:51:16.023651 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:51:16.023611 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:51:27.039580 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:51:27.039541 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:51:37.037941 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:51:37.037909 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:51:48.430317 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:51:48.430280 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:51:58.128239 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:51:58.128201 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:52:23.822748 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:52:23.822710 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:52:35.919894 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:52:35.919864 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:52:59.731248 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:52:59.731208 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:53:20.644864 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:53:20.644825 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:53:31.326990 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:53:31.326957 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:53:42.834849 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:53:42.834811 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:53:52.229077 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:53:52.229044 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:54:01.629583 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:54:01.629548 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:54:11.123271 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:54:11.123236 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:55:59.726786 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:55:59.726743 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:56:11.823510 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:56:11.823462 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:56:20.632354 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:56:20.632321 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:56:34.734394 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:56:34.734357 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:56:44.631467 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:56:44.631384 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:56:54.428226 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:56:54.428187 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:57:03.030266 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:57:03.030230 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:57:14.024687 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:57:14.024645 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:57:25.124925 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:57:25.124889 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:57:34.028809 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:57:34.028768 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:57:44.922969 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:57:44.922933 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:58:05.931478 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:05.931439 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:58:15.731305 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:15.731198 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:58:24.132827 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:24.132792 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58"] Jul 27 20:58:24.133456 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:24.133259 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7fe876e-8381-4c36-92fb-0860e7087909" containerName="authorino" Jul 27 20:58:24.133456 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:24.133274 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7fe876e-8381-4c36-92fb-0860e7087909" containerName="authorino" Jul 27 20:58:24.133456 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:24.133370 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7fe876e-8381-4c36-92fb-0860e7087909" containerName="authorino" Jul 27 20:58:24.136528 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:24.136497 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" Jul 27 20:58:24.138659 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:24.138634 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-8dd21d38-kserve-self-signed-certs\"" Jul 27 20:58:24.160937 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:24.160898 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58"] Jul 27 20:58:24.215180 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:24.215142 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18034f09-5f98-43c6-84b9-30d4f32e6ff7-dshm\") pod \"e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58\" (UID: \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\") " pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" Jul 27 20:58:24.215381 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:24.215199 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18034f09-5f98-43c6-84b9-30d4f32e6ff7-tls-certs\") pod \"e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58\" (UID: \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\") " pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" Jul 27 20:58:24.215381 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:24.215254 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18034f09-5f98-43c6-84b9-30d4f32e6ff7-home\") pod \"e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58\" (UID: \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\") " pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" Jul 27 20:58:24.215381 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:24.215271 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn94j\" (UniqueName: \"kubernetes.io/projected/18034f09-5f98-43c6-84b9-30d4f32e6ff7-kube-api-access-jn94j\") pod \"e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58\" (UID: \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\") " pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" Jul 27 20:58:24.215381 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:24.215352 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18034f09-5f98-43c6-84b9-30d4f32e6ff7-model-cache\") pod \"e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58\" (UID: \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\") " pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" Jul 27 20:58:24.215381 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:24.215381 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18034f09-5f98-43c6-84b9-30d4f32e6ff7-tmp-dir\") pod \"e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58\" (UID: \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\") " pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" Jul 27 20:58:24.316706 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:24.316664 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18034f09-5f98-43c6-84b9-30d4f32e6ff7-dshm\") pod \"e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58\" (UID: \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\") " pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" Jul 27 20:58:24.316900 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:24.316737 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18034f09-5f98-43c6-84b9-30d4f32e6ff7-tls-certs\") pod \"e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58\" (UID: \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\") " pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" Jul 27 20:58:24.316900 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:24.316773 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18034f09-5f98-43c6-84b9-30d4f32e6ff7-home\") pod \"e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58\" (UID: \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\") " pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" Jul 27 20:58:24.316900 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:24.316797 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn94j\" (UniqueName: \"kubernetes.io/projected/18034f09-5f98-43c6-84b9-30d4f32e6ff7-kube-api-access-jn94j\") pod \"e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58\" (UID: \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\") " pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" Jul 27 20:58:24.316900 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:24.316837 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18034f09-5f98-43c6-84b9-30d4f32e6ff7-model-cache\") pod \"e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58\" (UID: \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\") " pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" Jul 27 20:58:24.316900 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:24.316859 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18034f09-5f98-43c6-84b9-30d4f32e6ff7-tmp-dir\") pod \"e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58\" (UID: \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\") " pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" Jul 27 20:58:24.317197 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:24.317173 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18034f09-5f98-43c6-84b9-30d4f32e6ff7-home\") pod \"e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58\" (UID: \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\") " pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" Jul 27 20:58:24.317263 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:24.317224 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18034f09-5f98-43c6-84b9-30d4f32e6ff7-model-cache\") pod \"e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58\" (UID: \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\") " pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" Jul 27 20:58:24.317312 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:24.317253 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18034f09-5f98-43c6-84b9-30d4f32e6ff7-tmp-dir\") pod \"e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58\" (UID: \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\") " pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" Jul 27 20:58:24.319158 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:24.319129 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18034f09-5f98-43c6-84b9-30d4f32e6ff7-dshm\") pod \"e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58\" (UID: \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\") " pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" Jul 27 20:58:24.319368 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:24.319349 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18034f09-5f98-43c6-84b9-30d4f32e6ff7-tls-certs\") pod \"e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58\" (UID: \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\") " pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" Jul 27 20:58:24.324989 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:24.324966 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn94j\" (UniqueName: \"kubernetes.io/projected/18034f09-5f98-43c6-84b9-30d4f32e6ff7-kube-api-access-jn94j\") pod \"e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58\" (UID: \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\") " pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" Jul 27 20:58:24.447065 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:24.446972 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" Jul 27 20:58:24.584529 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:24.584492 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58"] Jul 27 20:58:24.586465 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:58:24.586433 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18034f09_5f98_43c6_84b9_30d4f32e6ff7.slice/crio-5b5020ceacc5784dc0dcd99a2a257c026902b937629d336824e1a9c145cc469d WatchSource:0}: Error finding container 5b5020ceacc5784dc0dcd99a2a257c026902b937629d336824e1a9c145cc469d: Status 404 returned error can't find the container with id 5b5020ceacc5784dc0dcd99a2a257c026902b937629d336824e1a9c145cc469d Jul 27 20:58:25.348234 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:25.348199 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" event={"ID":"18034f09-5f98-43c6-84b9-30d4f32e6ff7","Type":"ContainerStarted","Data":"958405a64e32076e2a692ebe5f87f7edcf9e1f33e49eb41ee07f44cc465122c1"} Jul 27 20:58:25.348671 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:25.348241 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" event={"ID":"18034f09-5f98-43c6-84b9-30d4f32e6ff7","Type":"ContainerStarted","Data":"5b5020ceacc5784dc0dcd99a2a257c026902b937629d336824e1a9c145cc469d"} Jul 27 20:58:25.364580 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:25.364514 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" podStartSLOduration=1.3645004649999999 podStartE2EDuration="1.364500465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:58:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:58:25.362321636 +0000 UTC m=+1443.115565964" watchObservedRunningTime="2026-07-27 20:58:25.364500465 +0000 UTC m=+1443.117744795" Jul 27 20:58:28.035475 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:28.035432 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:58:34.447423 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:34.447328 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" Jul 27 20:58:34.447895 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:34.447465 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" Jul 27 20:58:34.459977 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:34.459942 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" Jul 27 20:58:35.410641 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:35.410613 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" Jul 27 20:58:43.630990 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:43.630958 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j"] Jul 27 20:58:43.634566 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:43.634549 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" Jul 27 20:58:43.642300 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:43.637087 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-8dd21d38-kserve-self-signed-certs\"" Jul 27 20:58:43.646562 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:43.646536 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j"] Jul 27 20:58:43.790807 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:43.790772 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/561ef873-157d-4e87-b090-7e125856111a-home\") pod \"e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j\" (UID: \"561ef873-157d-4e87-b090-7e125856111a\") " pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" Jul 27 20:58:43.790807 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:43.790811 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/561ef873-157d-4e87-b090-7e125856111a-dshm\") pod \"e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j\" (UID: \"561ef873-157d-4e87-b090-7e125856111a\") " pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" Jul 27 20:58:43.791054 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:43.790829 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/561ef873-157d-4e87-b090-7e125856111a-model-cache\") pod \"e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j\" (UID: \"561ef873-157d-4e87-b090-7e125856111a\") " pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" Jul 27 20:58:43.791054 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:43.790952 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/561ef873-157d-4e87-b090-7e125856111a-tmp-dir\") pod \"e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j\" (UID: \"561ef873-157d-4e87-b090-7e125856111a\") " pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" Jul 27 20:58:43.791054 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:43.790984 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/561ef873-157d-4e87-b090-7e125856111a-tls-certs\") pod \"e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j\" (UID: \"561ef873-157d-4e87-b090-7e125856111a\") " pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" Jul 27 20:58:43.791173 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:43.791054 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntq6c\" (UniqueName: \"kubernetes.io/projected/561ef873-157d-4e87-b090-7e125856111a-kube-api-access-ntq6c\") pod \"e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j\" (UID: \"561ef873-157d-4e87-b090-7e125856111a\") " pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" Jul 27 20:58:43.891561 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:43.891435 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntq6c\" (UniqueName: \"kubernetes.io/projected/561ef873-157d-4e87-b090-7e125856111a-kube-api-access-ntq6c\") pod \"e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j\" (UID: \"561ef873-157d-4e87-b090-7e125856111a\") " pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" Jul 27 20:58:43.891561 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:43.891490 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/561ef873-157d-4e87-b090-7e125856111a-home\") pod \"e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j\" (UID: \"561ef873-157d-4e87-b090-7e125856111a\") " pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" Jul 27 20:58:43.891561 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:43.891543 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/561ef873-157d-4e87-b090-7e125856111a-dshm\") pod \"e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j\" (UID: \"561ef873-157d-4e87-b090-7e125856111a\") " pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" Jul 27 20:58:43.891858 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:43.891567 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/561ef873-157d-4e87-b090-7e125856111a-model-cache\") pod \"e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j\" (UID: \"561ef873-157d-4e87-b090-7e125856111a\") " pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" Jul 27 20:58:43.891858 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:43.891634 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/561ef873-157d-4e87-b090-7e125856111a-tmp-dir\") pod \"e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j\" (UID: \"561ef873-157d-4e87-b090-7e125856111a\") " pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" Jul 27 20:58:43.891858 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:43.891658 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/561ef873-157d-4e87-b090-7e125856111a-tls-certs\") pod \"e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j\" (UID: \"561ef873-157d-4e87-b090-7e125856111a\") " pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" Jul 27 20:58:43.892021 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:43.891985 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/561ef873-157d-4e87-b090-7e125856111a-home\") pod \"e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j\" (UID: \"561ef873-157d-4e87-b090-7e125856111a\") " pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" Jul 27 20:58:43.892021 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:43.892001 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/561ef873-157d-4e87-b090-7e125856111a-model-cache\") pod \"e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j\" (UID: \"561ef873-157d-4e87-b090-7e125856111a\") " pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" Jul 27 20:58:43.892095 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:43.892067 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/561ef873-157d-4e87-b090-7e125856111a-tmp-dir\") pod \"e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j\" (UID: \"561ef873-157d-4e87-b090-7e125856111a\") " pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" Jul 27 20:58:43.894012 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:43.893989 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/561ef873-157d-4e87-b090-7e125856111a-dshm\") pod \"e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j\" (UID: \"561ef873-157d-4e87-b090-7e125856111a\") " pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" Jul 27 20:58:43.894287 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:43.894269 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/561ef873-157d-4e87-b090-7e125856111a-tls-certs\") pod \"e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j\" (UID: \"561ef873-157d-4e87-b090-7e125856111a\") " pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" Jul 27 20:58:43.899263 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:43.899242 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntq6c\" (UniqueName: \"kubernetes.io/projected/561ef873-157d-4e87-b090-7e125856111a-kube-api-access-ntq6c\") pod \"e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j\" (UID: \"561ef873-157d-4e87-b090-7e125856111a\") " pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" Jul 27 20:58:43.951151 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:43.951111 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" Jul 27 20:58:44.083104 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:44.083077 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j"] Jul 27 20:58:44.085158 ip-10-0-130-119 kubenswrapper[2554]: W0727 20:58:44.085124 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod561ef873_157d_4e87_b090_7e125856111a.slice/crio-b93776a29e5e4112b4480fdbc10bf2ff6064a80661515d82b4c9f56e8027ce8e WatchSource:0}: Error finding container b93776a29e5e4112b4480fdbc10bf2ff6064a80661515d82b4c9f56e8027ce8e: Status 404 returned error can't find the container with id b93776a29e5e4112b4480fdbc10bf2ff6064a80661515d82b4c9f56e8027ce8e Jul 27 20:58:44.443277 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:44.443190 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" event={"ID":"561ef873-157d-4e87-b090-7e125856111a","Type":"ContainerStarted","Data":"5f53579120ac94e5e7347cde84bbc0c38e5cfb3310c89291227905bc6d29e11b"} Jul 27 20:58:44.443277 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:44.443242 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" event={"ID":"561ef873-157d-4e87-b090-7e125856111a","Type":"ContainerStarted","Data":"b93776a29e5e4112b4480fdbc10bf2ff6064a80661515d82b4c9f56e8027ce8e"} Jul 27 20:58:44.462965 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:44.462917 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" podStartSLOduration=1.462900797 podStartE2EDuration="1.462900797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:58:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:58:44.461372167 +0000 UTC m=+1462.214616497" watchObservedRunningTime="2026-07-27 20:58:44.462900797 +0000 UTC m=+1462.216145126" Jul 27 20:58:47.434484 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:47.434446 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:58:53.951514 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:53.951479 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" Jul 27 20:58:53.951994 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:53.951540 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" Jul 27 20:58:53.963929 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:53.963904 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" Jul 27 20:58:54.501062 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:58:54.501033 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" Jul 27 20:59:09.740621 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:09.740590 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58"] Jul 27 20:59:10.737069 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:10.737032 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j"] Jul 27 20:59:14.434919 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:14.434882 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:59:24.760432 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:24.760375 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" podUID="18034f09-5f98-43c6-84b9-30d4f32e6ff7" containerName="main" containerID="cri-o://958405a64e32076e2a692ebe5f87f7edcf9e1f33e49eb41ee07f44cc465122c1" gracePeriod=45 Jul 27 20:59:25.020104 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.020034 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" Jul 27 20:59:25.155374 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.155338 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jn94j\" (UniqueName: \"kubernetes.io/projected/18034f09-5f98-43c6-84b9-30d4f32e6ff7-kube-api-access-jn94j\") pod \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\" (UID: \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\") " Jul 27 20:59:25.155374 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.155386 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18034f09-5f98-43c6-84b9-30d4f32e6ff7-home\") pod \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\" (UID: \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\") " Jul 27 20:59:25.155672 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.155423 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18034f09-5f98-43c6-84b9-30d4f32e6ff7-dshm\") pod \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\" (UID: \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\") " Jul 27 20:59:25.155672 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.155469 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18034f09-5f98-43c6-84b9-30d4f32e6ff7-tls-certs\") pod \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\" (UID: \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\") " Jul 27 20:59:25.155672 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.155511 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18034f09-5f98-43c6-84b9-30d4f32e6ff7-tmp-dir\") pod \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\" (UID: \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\") " Jul 27 20:59:25.155672 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.155572 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18034f09-5f98-43c6-84b9-30d4f32e6ff7-model-cache\") pod \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\" (UID: \"18034f09-5f98-43c6-84b9-30d4f32e6ff7\") " Jul 27 20:59:25.155874 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.155699 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18034f09-5f98-43c6-84b9-30d4f32e6ff7-home" (OuterVolumeSpecName: "home") pod "18034f09-5f98-43c6-84b9-30d4f32e6ff7" (UID: "18034f09-5f98-43c6-84b9-30d4f32e6ff7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 20:59:25.155874 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.155845 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18034f09-5f98-43c6-84b9-30d4f32e6ff7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "18034f09-5f98-43c6-84b9-30d4f32e6ff7" (UID: "18034f09-5f98-43c6-84b9-30d4f32e6ff7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 20:59:25.155966 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.155879 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18034f09-5f98-43c6-84b9-30d4f32e6ff7-model-cache" (OuterVolumeSpecName: "model-cache") pod "18034f09-5f98-43c6-84b9-30d4f32e6ff7" (UID: "18034f09-5f98-43c6-84b9-30d4f32e6ff7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 20:59:25.155966 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.155909 2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18034f09-5f98-43c6-84b9-30d4f32e6ff7-tmp-dir\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:59:25.155966 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.155929 2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18034f09-5f98-43c6-84b9-30d4f32e6ff7-home\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:59:25.157894 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.157863 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18034f09-5f98-43c6-84b9-30d4f32e6ff7-dshm" (OuterVolumeSpecName: "dshm") pod "18034f09-5f98-43c6-84b9-30d4f32e6ff7" (UID: "18034f09-5f98-43c6-84b9-30d4f32e6ff7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 20:59:25.158022 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.157892 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18034f09-5f98-43c6-84b9-30d4f32e6ff7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "18034f09-5f98-43c6-84b9-30d4f32e6ff7" (UID: "18034f09-5f98-43c6-84b9-30d4f32e6ff7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:59:25.158022 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.157931 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18034f09-5f98-43c6-84b9-30d4f32e6ff7-kube-api-access-jn94j" (OuterVolumeSpecName: "kube-api-access-jn94j") pod "18034f09-5f98-43c6-84b9-30d4f32e6ff7" (UID: "18034f09-5f98-43c6-84b9-30d4f32e6ff7"). InnerVolumeSpecName "kube-api-access-jn94j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:59:25.256730 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.256681 2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18034f09-5f98-43c6-84b9-30d4f32e6ff7-model-cache\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:59:25.256730 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.256726 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jn94j\" (UniqueName: \"kubernetes.io/projected/18034f09-5f98-43c6-84b9-30d4f32e6ff7-kube-api-access-jn94j\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:59:25.256730 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.256736 2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18034f09-5f98-43c6-84b9-30d4f32e6ff7-dshm\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:59:25.256730 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.256745 2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18034f09-5f98-43c6-84b9-30d4f32e6ff7-tls-certs\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:59:25.634071 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.634033 2554 generic.go:356] "Generic (PLEG): container finished" podID="18034f09-5f98-43c6-84b9-30d4f32e6ff7" containerID="958405a64e32076e2a692ebe5f87f7edcf9e1f33e49eb41ee07f44cc465122c1" exitCode=0 Jul 27 20:59:25.634071 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.634066 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" Jul 27 20:59:25.634071 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.634075 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" event={"ID":"18034f09-5f98-43c6-84b9-30d4f32e6ff7","Type":"ContainerDied","Data":"958405a64e32076e2a692ebe5f87f7edcf9e1f33e49eb41ee07f44cc465122c1"} Jul 27 20:59:25.634345 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.634108 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58" event={"ID":"18034f09-5f98-43c6-84b9-30d4f32e6ff7","Type":"ContainerDied","Data":"5b5020ceacc5784dc0dcd99a2a257c026902b937629d336824e1a9c145cc469d"} Jul 27 20:59:25.634345 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.634127 2554 scope.go:117] "RemoveContainer" containerID="958405a64e32076e2a692ebe5f87f7edcf9e1f33e49eb41ee07f44cc465122c1" Jul 27 20:59:25.643363 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.643347 2554 scope.go:117] "RemoveContainer" containerID="958405a64e32076e2a692ebe5f87f7edcf9e1f33e49eb41ee07f44cc465122c1" Jul 27 20:59:25.643673 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:59:25.643655 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"958405a64e32076e2a692ebe5f87f7edcf9e1f33e49eb41ee07f44cc465122c1\": container with ID starting with 958405a64e32076e2a692ebe5f87f7edcf9e1f33e49eb41ee07f44cc465122c1 not found: ID does not exist" containerID="958405a64e32076e2a692ebe5f87f7edcf9e1f33e49eb41ee07f44cc465122c1" Jul 27 20:59:25.643713 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.643684 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"958405a64e32076e2a692ebe5f87f7edcf9e1f33e49eb41ee07f44cc465122c1"} err="failed to get container status \"958405a64e32076e2a692ebe5f87f7edcf9e1f33e49eb41ee07f44cc465122c1\": rpc error: code = NotFound desc = could not find container \"958405a64e32076e2a692ebe5f87f7edcf9e1f33e49eb41ee07f44cc465122c1\": container with ID starting with 958405a64e32076e2a692ebe5f87f7edcf9e1f33e49eb41ee07f44cc465122c1 not found: ID does not exist" Jul 27 20:59:25.653348 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.653325 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58"] Jul 27 20:59:25.657033 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.657009 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-8dd21d38-kserve-85bfdfbb95-v6k58"] Jul 27 20:59:25.756459 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:25.756412 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" podUID="561ef873-157d-4e87-b090-7e125856111a" containerName="main" containerID="cri-o://5f53579120ac94e5e7347cde84bbc0c38e5cfb3310c89291227905bc6d29e11b" gracePeriod=45 Jul 27 20:59:26.011384 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.011357 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" Jul 27 20:59:26.164999 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.164959 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/561ef873-157d-4e87-b090-7e125856111a-home\") pod \"561ef873-157d-4e87-b090-7e125856111a\" (UID: \"561ef873-157d-4e87-b090-7e125856111a\") " Jul 27 20:59:26.165188 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.165016 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/561ef873-157d-4e87-b090-7e125856111a-model-cache\") pod \"561ef873-157d-4e87-b090-7e125856111a\" (UID: \"561ef873-157d-4e87-b090-7e125856111a\") " Jul 27 20:59:26.165188 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.165055 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntq6c\" (UniqueName: \"kubernetes.io/projected/561ef873-157d-4e87-b090-7e125856111a-kube-api-access-ntq6c\") pod \"561ef873-157d-4e87-b090-7e125856111a\" (UID: \"561ef873-157d-4e87-b090-7e125856111a\") " Jul 27 20:59:26.165188 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.165077 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/561ef873-157d-4e87-b090-7e125856111a-tmp-dir\") pod \"561ef873-157d-4e87-b090-7e125856111a\" (UID: \"561ef873-157d-4e87-b090-7e125856111a\") " Jul 27 20:59:26.165188 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.165122 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/561ef873-157d-4e87-b090-7e125856111a-dshm\") pod \"561ef873-157d-4e87-b090-7e125856111a\" (UID: \"561ef873-157d-4e87-b090-7e125856111a\") " Jul 27 20:59:26.165188 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.165164 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/561ef873-157d-4e87-b090-7e125856111a-tls-certs\") pod \"561ef873-157d-4e87-b090-7e125856111a\" (UID: \"561ef873-157d-4e87-b090-7e125856111a\") " Jul 27 20:59:26.165437 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.165234 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/561ef873-157d-4e87-b090-7e125856111a-home" (OuterVolumeSpecName: "home") pod "561ef873-157d-4e87-b090-7e125856111a" (UID: "561ef873-157d-4e87-b090-7e125856111a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 20:59:26.165437 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.165345 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/561ef873-157d-4e87-b090-7e125856111a-model-cache" (OuterVolumeSpecName: "model-cache") pod "561ef873-157d-4e87-b090-7e125856111a" (UID: "561ef873-157d-4e87-b090-7e125856111a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 20:59:26.165437 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.165361 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/561ef873-157d-4e87-b090-7e125856111a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "561ef873-157d-4e87-b090-7e125856111a" (UID: "561ef873-157d-4e87-b090-7e125856111a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 20:59:26.165437 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.165378 2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/561ef873-157d-4e87-b090-7e125856111a-home\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:59:26.167436 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.167405 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/561ef873-157d-4e87-b090-7e125856111a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "561ef873-157d-4e87-b090-7e125856111a" (UID: "561ef873-157d-4e87-b090-7e125856111a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:59:26.167436 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.167425 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/561ef873-157d-4e87-b090-7e125856111a-kube-api-access-ntq6c" (OuterVolumeSpecName: "kube-api-access-ntq6c") pod "561ef873-157d-4e87-b090-7e125856111a" (UID: "561ef873-157d-4e87-b090-7e125856111a"). InnerVolumeSpecName "kube-api-access-ntq6c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:59:26.167436 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.167413 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/561ef873-157d-4e87-b090-7e125856111a-dshm" (OuterVolumeSpecName: "dshm") pod "561ef873-157d-4e87-b090-7e125856111a" (UID: "561ef873-157d-4e87-b090-7e125856111a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 20:59:26.266767 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.266733 2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/561ef873-157d-4e87-b090-7e125856111a-dshm\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:59:26.266767 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.266762 2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/561ef873-157d-4e87-b090-7e125856111a-tls-certs\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:59:26.266963 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.266778 2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/561ef873-157d-4e87-b090-7e125856111a-model-cache\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:59:26.266963 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.266792 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntq6c\" (UniqueName: \"kubernetes.io/projected/561ef873-157d-4e87-b090-7e125856111a-kube-api-access-ntq6c\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:59:26.266963 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.266803 2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/561ef873-157d-4e87-b090-7e125856111a-tmp-dir\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\"" Jul 27 20:59:26.640897 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.640809 2554 generic.go:356] "Generic (PLEG): container finished" podID="561ef873-157d-4e87-b090-7e125856111a" containerID="5f53579120ac94e5e7347cde84bbc0c38e5cfb3310c89291227905bc6d29e11b" exitCode=0 Jul 27 20:59:26.640897 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.640850 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" Jul 27 20:59:26.640897 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.640860 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" event={"ID":"561ef873-157d-4e87-b090-7e125856111a","Type":"ContainerDied","Data":"5f53579120ac94e5e7347cde84bbc0c38e5cfb3310c89291227905bc6d29e11b"} Jul 27 20:59:26.640897 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.640889 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j" event={"ID":"561ef873-157d-4e87-b090-7e125856111a","Type":"ContainerDied","Data":"b93776a29e5e4112b4480fdbc10bf2ff6064a80661515d82b4c9f56e8027ce8e"} Jul 27 20:59:26.641199 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.640905 2554 scope.go:117] "RemoveContainer" containerID="5f53579120ac94e5e7347cde84bbc0c38e5cfb3310c89291227905bc6d29e11b" Jul 27 20:59:26.649955 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.649934 2554 scope.go:117] "RemoveContainer" containerID="5f53579120ac94e5e7347cde84bbc0c38e5cfb3310c89291227905bc6d29e11b" Jul 27 20:59:26.650168 ip-10-0-130-119 kubenswrapper[2554]: E0727 20:59:26.650151 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f53579120ac94e5e7347cde84bbc0c38e5cfb3310c89291227905bc6d29e11b\": container with ID starting with 5f53579120ac94e5e7347cde84bbc0c38e5cfb3310c89291227905bc6d29e11b not found: ID does not exist" containerID="5f53579120ac94e5e7347cde84bbc0c38e5cfb3310c89291227905bc6d29e11b" Jul 27 20:59:26.650204 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.650175 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f53579120ac94e5e7347cde84bbc0c38e5cfb3310c89291227905bc6d29e11b"} err="failed to get container status \"5f53579120ac94e5e7347cde84bbc0c38e5cfb3310c89291227905bc6d29e11b\": rpc error: code = NotFound desc = could not find container \"5f53579120ac94e5e7347cde84bbc0c38e5cfb3310c89291227905bc6d29e11b\": container with ID starting with 5f53579120ac94e5e7347cde84bbc0c38e5cfb3310c89291227905bc6d29e11b not found: ID does not exist" Jul 27 20:59:26.659868 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.659845 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j"] Jul 27 20:59:26.665600 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.665580 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-8dd21d38-kserve-7c5c58748c-mkt7j"] Jul 27 20:59:26.718300 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.718270 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18034f09-5f98-43c6-84b9-30d4f32e6ff7" path="/var/lib/kubelet/pods/18034f09-5f98-43c6-84b9-30d4f32e6ff7/volumes" Jul 27 20:59:26.718691 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:26.718677 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="561ef873-157d-4e87-b090-7e125856111a" path="/var/lib/kubelet/pods/561ef873-157d-4e87-b090-7e125856111a/volumes" Jul 27 20:59:28.531352 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:28.531310 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:59:38.032195 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:38.032158 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 20:59:50.422408 ip-10-0-130-119 kubenswrapper[2554]: I0727 20:59:50.422311 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:00:00.524342 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:00:00.524306 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:00:10.140092 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:00:10.140054 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:00:18.323717 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:00:18.323680 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:00:27.924569 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:00:27.924535 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:00:37.516152 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:00:37.516115 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:00:50.791508 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:00:50.791476 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:01:00.031978 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:01:00.031937 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:01:09.925803 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:01:09.925770 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:01:19.726639 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:01:19.726601 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:01:33.130113 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:01:33.130078 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:01:41.325642 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:01:41.325611 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:01:53.126712 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:01:53.126676 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:02:05.541203 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:02:05.541167 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:02:17.239488 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:02:17.239453 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:02:26.041077 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:02:26.041038 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:02:48.525571 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:02:48.525462 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:03:04.537727 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:03:04.537692 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:03:36.328878 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:03:36.328843 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:03:47.632893 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:03:47.632854 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:04:20.250892 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:04:20.250856 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:04:31.837483 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:04:31.837442 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:05:03.928567 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:05:03.928508 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:05:16.030529 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:05:16.030481 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:05:33.237694 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:05:33.237654 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:07:02.025440 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:07:02.025408 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:07:08.424723 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:07:08.424680 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:07:17.924898 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:07:17.924865 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:07:38.822867 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:07:38.822828 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-szhjk"] Jul 27 21:08:02.734844 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:02.734804 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86c6c7b8f4-77k7r_3ff356b3-0549-4788-bd56-ab5d0325ea1d/authorino/0.log" Jul 27 21:08:08.988498 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:08.988466 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5767d7b464-vs9z6_b5df6c70-9499-4379-805d-531bb940f0f6/copy-manifests/0.log" Jul 27 21:08:08.995219 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:08.995190 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5767d7b464-vs9z6_b5df6c70-9499-4379-805d-531bb940f0f6/manager/0.log" Jul 27 21:08:10.846051 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:10.846026 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86c6c7b8f4-77k7r_3ff356b3-0549-4788-bd56-ab5d0325ea1d/authorino/0.log" Jul 27 21:08:11.171833 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:11.171765 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-xg2c5_acd14682-de2b-42c1-bf99-463af417fe65/kuadrant-console-plugin/0.log" Jul 27 21:08:11.544560 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:11.544506 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-szhjk_d426b8b2-c8eb-4d5c-a1d9-4addddee7ccd/limitador/0.log" Jul 27 21:08:12.401158 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:12.401127 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57b999c94c-x8vwc_489c6cee-5c33-4463-a787-f3d8596d6d80/kube-auth-proxy/0.log" Jul 27 21:08:12.892959 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:12.892919 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-df4d6c7f7-c6rbs_53aaa9bb-eb53-4770-9be9-2e79087a20c7/router/0.log" Jul 27 21:08:13.809014 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:13.808989 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-8m7nl_8ebefdbc-3495-4100-a8cf-21512e99071a/main/0.log" Jul 27 21:08:18.878390 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:18.878350 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mmb4n/must-gather-jp9t9"] Jul 27 21:08:18.878873 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:18.878689 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="561ef873-157d-4e87-b090-7e125856111a" containerName="main" Jul 27 21:08:18.878873 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:18.878701 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="561ef873-157d-4e87-b090-7e125856111a" containerName="main" Jul 27 21:08:18.878873 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:18.878712 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18034f09-5f98-43c6-84b9-30d4f32e6ff7" containerName="main" Jul 27 21:08:18.878873 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:18.878717 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="18034f09-5f98-43c6-84b9-30d4f32e6ff7" containerName="main" Jul 27 21:08:18.878873 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:18.878784 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="18034f09-5f98-43c6-84b9-30d4f32e6ff7" containerName="main" Jul 27 21:08:18.878873 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:18.878794 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="561ef873-157d-4e87-b090-7e125856111a" containerName="main" Jul 27 21:08:18.881834 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:18.881812 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mmb4n/must-gather-jp9t9" Jul 27 21:08:18.883998 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:18.883975 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mmb4n\"/\"kube-root-ca.crt\"" Jul 27 21:08:18.884369 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:18.884346 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mmb4n\"/\"openshift-service-ca.crt\"" Jul 27 21:08:18.884451 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:18.884356 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mmb4n\"/\"default-dockercfg-xnqkl\"" Jul 27 21:08:18.891340 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:18.891315 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mmb4n/must-gather-jp9t9"] Jul 27 21:08:18.973288 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:18.973250 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-552wf\" (UniqueName: \"kubernetes.io/projected/1cdd55ae-7950-4cce-85f3-7def7c45b6b6-kube-api-access-552wf\") pod \"must-gather-jp9t9\" (UID: \"1cdd55ae-7950-4cce-85f3-7def7c45b6b6\") " pod="openshift-must-gather-mmb4n/must-gather-jp9t9" Jul 27 21:08:18.973479 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:18.973326 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1cdd55ae-7950-4cce-85f3-7def7c45b6b6-must-gather-output\") pod \"must-gather-jp9t9\" (UID: \"1cdd55ae-7950-4cce-85f3-7def7c45b6b6\") " pod="openshift-must-gather-mmb4n/must-gather-jp9t9" Jul 27 21:08:19.074373 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:19.074334 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-552wf\" (UniqueName: \"kubernetes.io/projected/1cdd55ae-7950-4cce-85f3-7def7c45b6b6-kube-api-access-552wf\") pod \"must-gather-jp9t9\" (UID: \"1cdd55ae-7950-4cce-85f3-7def7c45b6b6\") " pod="openshift-must-gather-mmb4n/must-gather-jp9t9" Jul 27 21:08:19.074573 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:19.074386 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1cdd55ae-7950-4cce-85f3-7def7c45b6b6-must-gather-output\") pod \"must-gather-jp9t9\" (UID: \"1cdd55ae-7950-4cce-85f3-7def7c45b6b6\") " pod="openshift-must-gather-mmb4n/must-gather-jp9t9" Jul 27 21:08:19.074721 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:19.074707 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1cdd55ae-7950-4cce-85f3-7def7c45b6b6-must-gather-output\") pod \"must-gather-jp9t9\" (UID: \"1cdd55ae-7950-4cce-85f3-7def7c45b6b6\") " pod="openshift-must-gather-mmb4n/must-gather-jp9t9" Jul 27 21:08:19.082471 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:19.082443 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-552wf\" (UniqueName: \"kubernetes.io/projected/1cdd55ae-7950-4cce-85f3-7def7c45b6b6-kube-api-access-552wf\") pod \"must-gather-jp9t9\" (UID: \"1cdd55ae-7950-4cce-85f3-7def7c45b6b6\") " pod="openshift-must-gather-mmb4n/must-gather-jp9t9" Jul 27 21:08:19.191868 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:19.191774 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mmb4n/must-gather-jp9t9" Jul 27 21:08:19.325915 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:19.325890 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mmb4n/must-gather-jp9t9"] Jul 27 21:08:19.327833 ip-10-0-130-119 kubenswrapper[2554]: W0727 21:08:19.327797 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1cdd55ae_7950_4cce_85f3_7def7c45b6b6.slice/crio-ddc50b82d10821d81b686d46fb0f4bfaa0361138f40ab04da627a146fdbe0ac6 WatchSource:0}: Error finding container ddc50b82d10821d81b686d46fb0f4bfaa0361138f40ab04da627a146fdbe0ac6: Status 404 returned error can't find the container with id ddc50b82d10821d81b686d46fb0f4bfaa0361138f40ab04da627a146fdbe0ac6 Jul 27 21:08:19.329778 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:19.329759 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 21:08:20.090839 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:20.090800 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mmb4n/must-gather-jp9t9" event={"ID":"1cdd55ae-7950-4cce-85f3-7def7c45b6b6","Type":"ContainerStarted","Data":"ddc50b82d10821d81b686d46fb0f4bfaa0361138f40ab04da627a146fdbe0ac6"} Jul 27 21:08:21.099864 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:21.099831 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mmb4n/must-gather-jp9t9" event={"ID":"1cdd55ae-7950-4cce-85f3-7def7c45b6b6","Type":"ContainerStarted","Data":"587b7ef37eee85fec38567cc810aa77dbba6fdc7bac398dda4919ab2d5cfefd2"} Jul 27 21:08:21.100242 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:21.099875 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mmb4n/must-gather-jp9t9" event={"ID":"1cdd55ae-7950-4cce-85f3-7def7c45b6b6","Type":"ContainerStarted","Data":"3b358ed053e9a1ecbe6b89a318109305bf55c1b89562f147e718bd6476bed169"} Jul 27 21:08:21.115890 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:21.115820 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mmb4n/must-gather-jp9t9" podStartSLOduration=2.326552604 podStartE2EDuration="3.115803453s" totalImagesPullingTime="789.250849ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:08:21.115070849 +0000 UTC m=+2038.868315181" watchObservedRunningTime="2026-07-27 21:08:21.115803453 +0000 UTC m=+2038.869047784" Jul 27 21:08:21.723823 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:21.723795 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-72nxw_f5f20bb2-f6c8-4ab0-9bf4-911c0b2bf99f/global-pull-secret-syncer/0.log" Jul 27 21:08:21.927665 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:21.927638 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mvmqf_c504af2f-31d3-47cc-a8f2-bf1562671e1c/konnectivity-agent/0.log" Jul 27 21:08:21.948936 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:21.948906 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-119.ec2.internal_7cd07560a4c9074965365583990e4d9f/haproxy/0.log" Jul 27 21:08:27.273542 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:27.273154 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86c6c7b8f4-77k7r_3ff356b3-0549-4788-bd56-ab5d0325ea1d/authorino/0.log" Jul 27 21:08:27.363386 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:27.363338 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-xg2c5_acd14682-de2b-42c1-bf99-463af417fe65/kuadrant-console-plugin/0.log" Jul 27 21:08:27.590043 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:27.589955 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-szhjk_d426b8b2-c8eb-4d5c-a1d9-4addddee7ccd/limitador/0.log" Jul 27 21:08:29.691541 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:29.691470 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-f4c4fb6b6-mcbpn_a57cff31-f24a-46e2-b22f-9bc8af72132c/metrics-server/0.log" Jul 27 21:08:30.004946 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:30.004911 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mv8nc_2ae7f6cb-489d-44c4-b7c1-750beedc6453/node-exporter/0.log" Jul 27 21:08:30.031753 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:30.031727 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mv8nc_2ae7f6cb-489d-44c4-b7c1-750beedc6453/kube-rbac-proxy/0.log" Jul 27 21:08:30.052987 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:30.052962 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mv8nc_2ae7f6cb-489d-44c4-b7c1-750beedc6453/init-textfile/0.log" Jul 27 21:08:30.077167 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:30.077139 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-q747g_28347cc0-098d-4024-abb9-ee1f39663a47/kube-rbac-proxy-main/0.log" Jul 27 21:08:30.101749 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:30.101712 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-q747g_28347cc0-098d-4024-abb9-ee1f39663a47/kube-rbac-proxy-self/0.log" Jul 27 21:08:30.127404 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:30.127378 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-q747g_28347cc0-098d-4024-abb9-ee1f39663a47/openshift-state-metrics/0.log" Jul 27 21:08:30.380924 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:30.380838 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-xdrfx_7f9ddf3e-85fe-4916-81fd-076999b321ee/prometheus-operator-admission-webhook/0.log" Jul 27 21:08:30.489221 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:30.489188 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b655fbf85-rrkm8_82cc45e4-ea0f-44b4-8ec1-e3b66cd11469/thanos-query/0.log" Jul 27 21:08:30.509924 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:30.509887 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b655fbf85-rrkm8_82cc45e4-ea0f-44b4-8ec1-e3b66cd11469/kube-rbac-proxy-web/0.log" Jul 27 21:08:30.529983 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:30.529955 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b655fbf85-rrkm8_82cc45e4-ea0f-44b4-8ec1-e3b66cd11469/kube-rbac-proxy/0.log" Jul 27 21:08:30.549757 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:30.549726 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b655fbf85-rrkm8_82cc45e4-ea0f-44b4-8ec1-e3b66cd11469/prom-label-proxy/0.log" Jul 27 21:08:30.570893 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:30.570864 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b655fbf85-rrkm8_82cc45e4-ea0f-44b4-8ec1-e3b66cd11469/kube-rbac-proxy-rules/0.log" Jul 27 21:08:30.590757 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:30.590727 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b655fbf85-rrkm8_82cc45e4-ea0f-44b4-8ec1-e3b66cd11469/kube-rbac-proxy-metrics/0.log" Jul 27 21:08:31.800208 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:31.800184 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-jncsv_739a7fa3-aa14-4e4d-958e-f16b7c81fd5a/networking-console-plugin/0.log" Jul 27 21:08:32.045727 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:32.045684 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mmb4n/perf-node-gather-daemonset-mlrn6"] Jul 27 21:08:32.053253 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:32.053161 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-mlrn6" Jul 27 21:08:32.060290 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:32.060252 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mmb4n/perf-node-gather-daemonset-mlrn6"] Jul 27 21:08:32.204613 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:32.204580 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/07e6b219-f445-4fdd-aaf2-dca360a7447b-proc\") pod \"perf-node-gather-daemonset-mlrn6\" (UID: \"07e6b219-f445-4fdd-aaf2-dca360a7447b\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-mlrn6" Jul 27 21:08:32.204928 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:32.204907 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07e6b219-f445-4fdd-aaf2-dca360a7447b-sys\") pod \"perf-node-gather-daemonset-mlrn6\" (UID: \"07e6b219-f445-4fdd-aaf2-dca360a7447b\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-mlrn6" Jul 27 21:08:32.205118 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:32.205102 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvrhm\" (UniqueName: \"kubernetes.io/projected/07e6b219-f445-4fdd-aaf2-dca360a7447b-kube-api-access-vvrhm\") pod \"perf-node-gather-daemonset-mlrn6\" (UID: \"07e6b219-f445-4fdd-aaf2-dca360a7447b\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-mlrn6" Jul 27 21:08:32.205265 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:32.205250 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/07e6b219-f445-4fdd-aaf2-dca360a7447b-podres\") pod \"perf-node-gather-daemonset-mlrn6\" (UID: \"07e6b219-f445-4fdd-aaf2-dca360a7447b\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-mlrn6" Jul 27 21:08:32.205381 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:32.205367 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/07e6b219-f445-4fdd-aaf2-dca360a7447b-lib-modules\") pod \"perf-node-gather-daemonset-mlrn6\" (UID: \"07e6b219-f445-4fdd-aaf2-dca360a7447b\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-mlrn6" Jul 27 21:08:32.306826 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:32.306732 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/07e6b219-f445-4fdd-aaf2-dca360a7447b-podres\") pod \"perf-node-gather-daemonset-mlrn6\" (UID: \"07e6b219-f445-4fdd-aaf2-dca360a7447b\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-mlrn6" Jul 27 21:08:32.307269 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:32.307247 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/07e6b219-f445-4fdd-aaf2-dca360a7447b-lib-modules\") pod \"perf-node-gather-daemonset-mlrn6\" (UID: \"07e6b219-f445-4fdd-aaf2-dca360a7447b\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-mlrn6" Jul 27 21:08:32.307569 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:32.307552 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/07e6b219-f445-4fdd-aaf2-dca360a7447b-proc\") pod \"perf-node-gather-daemonset-mlrn6\" (UID: \"07e6b219-f445-4fdd-aaf2-dca360a7447b\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-mlrn6" Jul 27 21:08:32.307776 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:32.307761 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07e6b219-f445-4fdd-aaf2-dca360a7447b-sys\") pod \"perf-node-gather-daemonset-mlrn6\" (UID: \"07e6b219-f445-4fdd-aaf2-dca360a7447b\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-mlrn6" Jul 27 21:08:32.308011 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:32.307996 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvrhm\" (UniqueName: \"kubernetes.io/projected/07e6b219-f445-4fdd-aaf2-dca360a7447b-kube-api-access-vvrhm\") pod \"perf-node-gather-daemonset-mlrn6\" (UID: \"07e6b219-f445-4fdd-aaf2-dca360a7447b\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-mlrn6" Jul 27 21:08:32.308477 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:32.307708 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/07e6b219-f445-4fdd-aaf2-dca360a7447b-proc\") pod \"perf-node-gather-daemonset-mlrn6\" (UID: \"07e6b219-f445-4fdd-aaf2-dca360a7447b\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-mlrn6" Jul 27 21:08:32.308630 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:32.307466 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/07e6b219-f445-4fdd-aaf2-dca360a7447b-lib-modules\") pod \"perf-node-gather-daemonset-mlrn6\" (UID: \"07e6b219-f445-4fdd-aaf2-dca360a7447b\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-mlrn6" Jul 27 21:08:32.308717 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:32.307895 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07e6b219-f445-4fdd-aaf2-dca360a7447b-sys\") pod \"perf-node-gather-daemonset-mlrn6\" (UID: \"07e6b219-f445-4fdd-aaf2-dca360a7447b\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-mlrn6" Jul 27 21:08:32.308795 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:32.307171 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/07e6b219-f445-4fdd-aaf2-dca360a7447b-podres\") pod \"perf-node-gather-daemonset-mlrn6\" (UID: \"07e6b219-f445-4fdd-aaf2-dca360a7447b\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-mlrn6" Jul 27 21:08:32.316996 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:32.316966 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvrhm\" (UniqueName: \"kubernetes.io/projected/07e6b219-f445-4fdd-aaf2-dca360a7447b-kube-api-access-vvrhm\") pod \"perf-node-gather-daemonset-mlrn6\" (UID: \"07e6b219-f445-4fdd-aaf2-dca360a7447b\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-mlrn6" Jul 27 21:08:32.370749 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:32.370704 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-mlrn6" Jul 27 21:08:32.571766 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:32.571682 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mmb4n/perf-node-gather-daemonset-mlrn6"] Jul 27 21:08:32.577600 ip-10-0-130-119 kubenswrapper[2554]: W0727 21:08:32.577507 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod07e6b219_f445_4fdd_aaf2_dca360a7447b.slice/crio-35d3c7e5bd819675a8385233ccee332a8d054d4d7563b2a843c4ef048dd05c16 WatchSource:0}: Error finding container 35d3c7e5bd819675a8385233ccee332a8d054d4d7563b2a843c4ef048dd05c16: Status 404 returned error can't find the container with id 35d3c7e5bd819675a8385233ccee332a8d054d4d7563b2a843c4ef048dd05c16 Jul 27 21:08:33.025904 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:33.025863 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-xpl57_f82a32cf-486a-4973-b057-0b79655d301c/download-server/0.log" Jul 27 21:08:33.195128 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:33.195094 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-mlrn6" event={"ID":"07e6b219-f445-4fdd-aaf2-dca360a7447b","Type":"ContainerStarted","Data":"72fa194704446e06ec5814ac2a786ad9c22cc62f2f80af77857577ea7f183161"} Jul 27 21:08:33.195365 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:33.195145 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-mlrn6" event={"ID":"07e6b219-f445-4fdd-aaf2-dca360a7447b","Type":"ContainerStarted","Data":"35d3c7e5bd819675a8385233ccee332a8d054d4d7563b2a843c4ef048dd05c16"} Jul 27 21:08:33.195365 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:33.195173 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-mlrn6" Jul 27 21:08:33.213932 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:33.213867 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-mlrn6" podStartSLOduration=1.2138452929999999 podStartE2EDuration="1.213845293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:08:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:08:33.211439643 +0000 UTC m=+2050.964683975" watchObservedRunningTime="2026-07-27 21:08:33.213845293 +0000 UTC m=+2050.967089625" Jul 27 21:08:34.678388 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:34.678360 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qfczc_43074e6a-caf7-4f21-95eb-9df294467f17/dns/0.log" Jul 27 21:08:34.699614 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:34.699543 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qfczc_43074e6a-caf7-4f21-95eb-9df294467f17/kube-rbac-proxy/0.log" Jul 27 21:08:34.795416 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:34.795390 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q55tf_5dccd741-555f-4715-89bc-dd6df8888a9d/dns-node-resolver/0.log" Jul 27 21:08:35.393469 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:35.393436 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l6kb4_ccbf7d58-4b22-4192-8b66-be1dd1f18309/node-ca/0.log" Jul 27 21:08:36.475145 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:36.475113 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57b999c94c-x8vwc_489c6cee-5c33-4463-a787-f3d8596d6d80/kube-auth-proxy/0.log" Jul 27 21:08:36.645666 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:36.645628 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-df4d6c7f7-c6rbs_53aaa9bb-eb53-4770-9be9-2e79087a20c7/router/0.log" Jul 27 21:08:37.381264 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:37.381234 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8n4dm_025bed99-b1ce-4015-a0b6-cb53a49942c3/serve-healthcheck-canary/0.log" Jul 27 21:08:37.965187 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:37.965156 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7hv5j_0e7c5c7a-6104-4fe2-b86b-c037db0458ae/kube-rbac-proxy/0.log" Jul 27 21:08:37.985041 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:37.985013 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7hv5j_0e7c5c7a-6104-4fe2-b86b-c037db0458ae/exporter/0.log" Jul 27 21:08:38.004106 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:38.004074 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7hv5j_0e7c5c7a-6104-4fe2-b86b-c037db0458ae/extractor/0.log" Jul 27 21:08:39.213564 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:39.213503 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-mlrn6" Jul 27 21:08:40.861841 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:40.861711 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5767d7b464-vs9z6_b5df6c70-9499-4379-805d-531bb940f0f6/manager/0.log" Jul 27 21:08:40.881564 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:40.881448 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5767d7b464-vs9z6_b5df6c70-9499-4379-805d-531bb940f0f6/copy-manifests/0.log" Jul 27 21:08:42.228313 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:42.228208 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-77cbdf6c7d-m5cw6_e05ebed4-4a60-48e7-a800-83a89156b03d/manager/0.log" Jul 27 21:08:42.811216 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:42.811187 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57b999c94c-x8vwc_489c6cee-5c33-4463-a787-f3d8596d6d80/kube-auth-proxy/0.log" Jul 27 21:08:42.959174 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:42.959097 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-df4d6c7f7-c6rbs_53aaa9bb-eb53-4770-9be9-2e79087a20c7/router/0.log" Jul 27 21:08:44.258648 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:44.258572 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57b999c94c-x8vwc_489c6cee-5c33-4463-a787-f3d8596d6d80/kube-auth-proxy/0.log" Jul 27 21:08:44.404641 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:44.404615 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-df4d6c7f7-c6rbs_53aaa9bb-eb53-4770-9be9-2e79087a20c7/router/0.log" Jul 27 21:08:47.587355 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:47.587329 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn_07514f38-661f-48c6-b1ef-7b96f23194cc/kube-storage-version-migrator-operator/1.log" Jul 27 21:08:47.588184 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:47.588167 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-7gcjn_07514f38-661f-48c6-b1ef-7b96f23194cc/kube-storage-version-migrator-operator/0.log" Jul 27 21:08:48.954854 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:48.954828 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lkv46_aafbdcb1-b199-4dc8-aa92-7366acb4b04e/kube-multus-additional-cni-plugins/0.log" Jul 27 21:08:48.981010 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:48.980985 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lkv46_aafbdcb1-b199-4dc8-aa92-7366acb4b04e/egress-router-binary-copy/0.log" Jul 27 21:08:49.003374 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:49.003321 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lkv46_aafbdcb1-b199-4dc8-aa92-7366acb4b04e/cni-plugins/0.log" Jul 27 21:08:49.024735 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:49.024709 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lkv46_aafbdcb1-b199-4dc8-aa92-7366acb4b04e/bond-cni-plugin/0.log" Jul 27 21:08:49.046452 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:49.046422 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lkv46_aafbdcb1-b199-4dc8-aa92-7366acb4b04e/routeoverride-cni/0.log" Jul 27 21:08:49.068670 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:49.068647 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lkv46_aafbdcb1-b199-4dc8-aa92-7366acb4b04e/whereabouts-cni-bincopy/0.log" Jul 27 21:08:49.090769 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:49.090739 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lkv46_aafbdcb1-b199-4dc8-aa92-7366acb4b04e/whereabouts-cni/0.log" Jul 27 21:08:49.292725 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:49.292693 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-j4lwg_166099a0-d343-4494-a962-5ad47838e44f/kube-multus/0.log" Jul 27 21:08:49.441703 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:49.441676 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zh9q6_a8904ad3-db74-4e35-8ca0-1374ae5af9ec/network-metrics-daemon/0.log" Jul 27 21:08:49.459011 ip-10-0-130-119 kubenswrapper[2554]: I0727 21:08:49.458979 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zh9q6_a8904ad3-db74-4e35-8ca0-1374ae5af9ec/kube-rbac-proxy/0.log"