Jul 16 21:49:39.492652 ip-10-0-137-177 systemd[1]: Starting Kubernetes Kubelet... Jul 16 21:49:40.135113 ip-10-0-137-177 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 21:49:40.135113 ip-10-0-137-177 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 16 21:49:40.135113 ip-10-0-137-177 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 21:49:40.135113 ip-10-0-137-177 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 16 21:49:40.135113 ip-10-0-137-177 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 21:49:40.135113 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.938438 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 16 21:49:40.135113 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946588 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 21:49:40.135113 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946606 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 21:49:40.135113 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946610 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 21:49:40.135113 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946613 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 21:49:40.135113 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946616 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 21:49:40.135113 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946619 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 21:49:40.135113 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946622 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 21:49:40.135113 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946624 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 21:49:40.023250 ip-10-0-137-177 systemd[1]: Started Kubernetes Kubelet. Jul 16 21:49:40.285075 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946627 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 21:49:40.285075 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946630 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 21:49:40.285075 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946632 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 21:49:40.285075 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946635 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 21:49:40.285075 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946638 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 21:49:40.285075 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946640 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 21:49:40.285075 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946643 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 21:49:40.285075 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946646 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 21:49:40.285075 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946650 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 21:49:40.285075 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946655 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 21:49:40.285075 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946658 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 21:49:40.285075 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946661 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 21:49:40.285075 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946665 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 21:49:40.285075 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946668 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 21:49:40.285075 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946671 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 21:49:40.285075 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946674 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 21:49:40.285075 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946677 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 21:49:40.285075 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946680 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 21:49:40.285075 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946682 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 21:49:40.285075 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946685 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 21:49:40.286487 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946687 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 21:49:40.286487 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946700 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 21:49:40.286487 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946702 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 21:49:40.286487 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946706 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 21:49:40.286487 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946708 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 21:49:40.286487 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946711 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 21:49:40.286487 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946714 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 21:49:40.286487 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946717 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 21:49:40.286487 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946719 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 21:49:40.286487 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946722 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 21:49:40.286487 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946725 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 21:49:40.286487 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946727 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 21:49:40.286487 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946730 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 21:49:40.286487 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946732 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 21:49:40.286487 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946735 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 21:49:40.286487 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946737 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 21:49:40.286487 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946740 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 21:49:40.286487 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946743 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 21:49:40.286487 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946745 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 21:49:40.286487 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946748 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 21:49:40.287356 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946750 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 21:49:40.287356 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946753 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 21:49:40.287356 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946757 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 21:49:40.287356 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946762 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 21:49:40.287356 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946766 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 21:49:40.287356 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946769 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 21:49:40.287356 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946772 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 21:49:40.287356 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946774 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 21:49:40.287356 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946777 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 21:49:40.287356 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946780 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 21:49:40.287356 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946782 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 21:49:40.287356 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946785 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 21:49:40.287356 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946787 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 21:49:40.287356 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946790 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 21:49:40.287356 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946793 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 21:49:40.287356 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946796 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 21:49:40.287356 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946798 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 21:49:40.287356 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946801 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 21:49:40.287356 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946803 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 21:49:40.287356 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946806 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 21:49:40.287975 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946809 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 21:49:40.287975 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946811 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 21:49:40.287975 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946814 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 21:49:40.287975 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946816 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 21:49:40.287975 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946818 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 21:49:40.287975 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946821 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 21:49:40.287975 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946824 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 21:49:40.287975 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946826 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 21:49:40.287975 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946829 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 21:49:40.287975 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946833 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 21:49:40.287975 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946836 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 21:49:40.287975 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946838 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 21:49:40.287975 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946841 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 21:49:40.287975 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946845 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 21:49:40.287975 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946849 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 21:49:40.287975 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946852 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 21:49:40.287975 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946855 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 21:49:40.287975 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946857 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 21:49:40.287975 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946860 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 21:49:40.288635 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946863 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 21:49:40.288635 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946865 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 21:49:40.288635 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946868 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 21:49:40.288635 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946871 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 21:49:40.288635 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946873 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 21:49:40.288635 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946876 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 16 21:49:40.288635 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946878 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 21:49:40.288635 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946882 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 21:49:40.288635 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946886 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 21:49:40.288635 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946889 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 21:49:40.288635 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946892 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 21:49:40.288635 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.946895 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 21:49:40.288635 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947680 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 21:49:40.288635 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947687 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 21:49:40.288635 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947691 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 21:49:40.288635 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947693 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 21:49:40.288635 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947697 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 21:49:40.288635 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947700 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 21:49:40.288635 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947703 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 21:49:40.289182 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947705 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 21:49:40.289182 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947708 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 21:49:40.289182 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947710 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 21:49:40.289182 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947713 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 21:49:40.289182 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947715 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 21:49:40.289182 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947718 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 21:49:40.289182 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947721 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 21:49:40.289182 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947724 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 21:49:40.289182 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947727 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 21:49:40.289182 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947730 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 21:49:40.289182 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947734 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 21:49:40.289182 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947737 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 21:49:40.289182 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947742 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 21:49:40.289182 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947746 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 21:49:40.289182 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947749 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 21:49:40.289182 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947752 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 21:49:40.289182 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947755 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 21:49:40.289182 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947758 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 21:49:40.289182 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947761 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 21:49:40.289182 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947763 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 21:49:40.289870 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947766 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 21:49:40.289870 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947770 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 21:49:40.289870 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947773 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 21:49:40.289870 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947775 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 21:49:40.289870 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947778 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 21:49:40.289870 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947782 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 21:49:40.289870 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947785 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 21:49:40.289870 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947787 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 21:49:40.289870 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947790 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 21:49:40.289870 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947794 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 21:49:40.289870 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947798 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 21:49:40.289870 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947801 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 21:49:40.289870 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947803 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 21:49:40.289870 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947806 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 21:49:40.289870 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947808 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 21:49:40.289870 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947811 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 21:49:40.289870 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947813 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 21:49:40.289870 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947816 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 16 21:49:40.289870 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947819 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 21:49:40.290450 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947821 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 21:49:40.290450 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947824 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 21:49:40.290450 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947827 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 21:49:40.290450 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947829 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 21:49:40.290450 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947833 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 21:49:40.290450 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947836 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 21:49:40.290450 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947841 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 21:49:40.290450 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947844 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 21:49:40.290450 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947846 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 21:49:40.290450 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947849 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 21:49:40.290450 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947851 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 21:49:40.290450 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947853 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 21:49:40.290450 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947856 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 21:49:40.290450 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947861 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 21:49:40.290450 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947864 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 21:49:40.290450 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947866 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 21:49:40.290450 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947869 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 21:49:40.290450 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947871 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 21:49:40.290450 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947874 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 21:49:40.290450 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947876 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 21:49:40.291150 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947879 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 21:49:40.291150 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947881 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 21:49:40.291150 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947885 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 21:49:40.291150 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947887 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 21:49:40.291150 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947890 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 21:49:40.291150 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947892 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 21:49:40.291150 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947895 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 21:49:40.291150 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947897 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 21:49:40.291150 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947900 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 21:49:40.291150 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947903 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 21:49:40.291150 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947905 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 21:49:40.291150 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947908 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 21:49:40.291150 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947910 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 21:49:40.291150 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947913 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 21:49:40.291150 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947916 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 21:49:40.291150 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947919 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 21:49:40.291150 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947921 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 21:49:40.291150 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947925 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 21:49:40.291150 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947928 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 21:49:40.291150 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947931 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 21:49:40.291833 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947934 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 21:49:40.291833 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947937 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 21:49:40.291833 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947939 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 21:49:40.291833 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947942 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 21:49:40.291833 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947945 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 21:49:40.291833 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947948 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 21:49:40.291833 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947951 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 21:49:40.291833 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947954 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 21:49:40.291833 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947956 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 21:49:40.291833 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947959 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 21:49:40.291833 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947963 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 21:49:40.291833 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947966 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 21:49:40.291833 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.947968 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 21:49:40.291833 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948395 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 21:49:40.291833 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948400 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 21:49:40.291833 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948403 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 21:49:40.291833 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948406 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 21:49:40.291833 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948408 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 21:49:40.291833 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948411 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 21:49:40.292563 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948414 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 21:49:40.292563 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948417 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 21:49:40.292563 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948419 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 16 21:49:40.292563 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948422 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 21:49:40.292563 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948424 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 21:49:40.292563 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948427 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 21:49:40.292563 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948430 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 21:49:40.292563 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948432 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 21:49:40.292563 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948435 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 21:49:40.292563 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948437 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 21:49:40.292563 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948440 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 21:49:40.292563 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948446 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 21:49:40.292563 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948450 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 21:49:40.292563 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948453 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 21:49:40.292563 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948455 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 21:49:40.292563 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948458 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 21:49:40.292563 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948462 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 21:49:40.292563 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948465 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 21:49:40.292563 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948470 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 21:49:40.292563 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948473 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 21:49:40.293349 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948476 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 21:49:40.293349 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948478 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 21:49:40.293349 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948481 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 21:49:40.293349 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948485 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 21:49:40.293349 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948487 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 21:49:40.293349 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948490 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 21:49:40.293349 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948492 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 21:49:40.293349 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948495 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 21:49:40.293349 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948498 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 21:49:40.293349 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948500 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 21:49:40.293349 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948503 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 21:49:40.293349 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948508 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 21:49:40.293349 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948511 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 21:49:40.293349 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948514 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 21:49:40.293349 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948517 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 21:49:40.293349 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948519 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 21:49:40.293349 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948522 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 21:49:40.293349 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948525 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 21:49:40.293349 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948528 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 21:49:40.295679 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948530 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 21:49:40.295679 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948533 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 21:49:40.295679 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948535 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 21:49:40.295679 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948538 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 21:49:40.295679 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948542 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 21:49:40.295679 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948545 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 21:49:40.295679 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948547 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 21:49:40.295679 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948550 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 21:49:40.295679 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948559 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 21:49:40.295679 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948562 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 21:49:40.295679 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948565 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 21:49:40.295679 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948568 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 21:49:40.295679 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948571 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 21:49:40.295679 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948574 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 21:49:40.295679 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948576 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 21:49:40.295679 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948578 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 21:49:40.295679 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948581 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 21:49:40.295679 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948584 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 21:49:40.295679 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948587 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 21:49:40.295679 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948589 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 21:49:40.297665 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948592 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 21:49:40.297665 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948594 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 21:49:40.297665 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948597 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 21:49:40.297665 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948600 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 21:49:40.297665 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948602 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 21:49:40.297665 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948605 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 21:49:40.297665 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948607 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 21:49:40.297665 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948609 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 21:49:40.297665 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948612 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 21:49:40.297665 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948614 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 21:49:40.297665 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948617 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 21:49:40.297665 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948619 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 21:49:40.297665 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948621 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 21:49:40.297665 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948624 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 21:49:40.297665 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948627 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 21:49:40.297665 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948629 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 21:49:40.297665 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948635 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 21:49:40.297665 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948638 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 21:49:40.297665 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948641 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 21:49:40.297665 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948644 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 21:49:40.298414 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948646 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 21:49:40.298414 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948649 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 21:49:40.298414 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948651 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 21:49:40.298414 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948655 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 21:49:40.298414 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948658 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 21:49:40.298414 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948660 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 21:49:40.298414 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948663 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 21:49:40.298414 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948665 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 21:49:40.298414 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948668 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 21:49:40.298414 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948670 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 21:49:40.298414 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948673 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 21:49:40.298414 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948676 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 21:49:40.298414 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948678 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 21:49:40.298414 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.948681 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 21:49:40.298414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948756 2566 flags.go:64] FLAG: --address="0.0.0.0" Jul 16 21:49:40.298414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948763 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 16 21:49:40.298414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948770 2566 flags.go:64] FLAG: --anonymous-auth="true" Jul 16 21:49:40.298414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948777 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 16 21:49:40.298414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948783 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 16 21:49:40.298414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948788 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 16 21:49:40.298414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948795 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 16 21:49:40.300334 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948802 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 16 21:49:40.300334 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948806 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 16 21:49:40.300334 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948809 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 16 21:49:40.300334 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948813 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 16 21:49:40.300334 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948816 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 16 21:49:40.300334 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948819 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 16 21:49:40.300334 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948822 2566 flags.go:64] FLAG: --cgroup-root="" Jul 16 21:49:40.300334 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948827 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 16 21:49:40.300334 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948830 2566 flags.go:64] FLAG: --client-ca-file="" Jul 16 21:49:40.300334 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948834 2566 flags.go:64] FLAG: --cloud-provider="external" Jul 16 21:49:40.300334 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948837 2566 flags.go:64] FLAG: --cluster-dns="[]" Jul 16 21:49:40.300334 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948842 2566 flags.go:64] FLAG: --cluster-domain="" Jul 16 21:49:40.300334 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948845 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 16 21:49:40.300334 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948848 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 16 21:49:40.300334 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948853 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 16 21:49:40.300334 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948856 2566 flags.go:64] FLAG: --container-log-max-files="5" Jul 16 21:49:40.300334 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948860 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 16 21:49:40.300334 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948863 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 16 21:49:40.300334 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948866 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 16 21:49:40.300334 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948869 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 16 21:49:40.300334 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948872 2566 flags.go:64] FLAG: --contention-profiling="false" Jul 16 21:49:40.300334 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948876 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 16 21:49:40.300334 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948878 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 16 21:49:40.300334 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948882 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 16 21:49:40.302744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948884 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 16 21:49:40.302744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948889 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 16 21:49:40.302744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948892 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 16 21:49:40.302744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948894 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 16 21:49:40.302744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948897 2566 flags.go:64] FLAG: --enable-load-reader="false" Jul 16 21:49:40.302744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948900 2566 flags.go:64] FLAG: --enable-server="true" Jul 16 21:49:40.302744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948903 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 16 21:49:40.302744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948907 2566 flags.go:64] FLAG: --event-burst="100" Jul 16 21:49:40.302744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948910 2566 flags.go:64] FLAG: --event-qps="50" Jul 16 21:49:40.302744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948913 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 16 21:49:40.302744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948916 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 16 21:49:40.302744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948919 2566 flags.go:64] FLAG: --eviction-hard="" Jul 16 21:49:40.302744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948923 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 16 21:49:40.302744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948925 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 16 21:49:40.302744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948928 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 16 21:49:40.302744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948933 2566 flags.go:64] FLAG: --eviction-soft="" Jul 16 21:49:40.302744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948936 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 16 21:49:40.302744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948939 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 16 21:49:40.302744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948942 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 16 21:49:40.302744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948945 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jul 16 21:49:40.302744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948948 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 16 21:49:40.302744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948951 2566 flags.go:64] FLAG: --fail-swap-on="true" Jul 16 21:49:40.302744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948955 2566 flags.go:64] FLAG: --feature-gates="" Jul 16 21:49:40.302744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948959 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jul 16 21:49:40.302744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948962 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 16 21:49:40.304924 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948965 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 16 21:49:40.304924 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948968 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 16 21:49:40.304924 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948971 2566 flags.go:64] FLAG: --healthz-port="10248" Jul 16 21:49:40.304924 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948974 2566 flags.go:64] FLAG: --help="false" Jul 16 21:49:40.304924 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948976 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-137-177.ec2.internal" Jul 16 21:49:40.304924 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948980 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 16 21:49:40.304924 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948983 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jul 16 21:49:40.304924 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948985 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 16 21:49:40.304924 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948989 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 16 21:49:40.304924 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948992 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 16 21:49:40.304924 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948995 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 16 21:49:40.304924 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.948997 2566 flags.go:64] FLAG: --image-service-endpoint="" Jul 16 21:49:40.304924 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949000 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 16 21:49:40.304924 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949003 2566 flags.go:64] FLAG: --kube-api-burst="100" Jul 16 21:49:40.304924 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949006 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 16 21:49:40.304924 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949009 2566 flags.go:64] FLAG: --kube-api-qps="50" Jul 16 21:49:40.304924 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949012 2566 flags.go:64] FLAG: --kube-reserved="" Jul 16 21:49:40.304924 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949015 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 16 21:49:40.304924 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949017 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 16 21:49:40.304924 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949020 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jul 16 21:49:40.304924 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949023 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 16 21:49:40.304924 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949026 2566 flags.go:64] FLAG: --lock-file="" Jul 16 21:49:40.304924 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949030 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 16 21:49:40.304924 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949033 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 16 21:49:40.305736 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949036 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 16 21:49:40.305736 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949041 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jul 16 21:49:40.305736 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949044 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 16 21:49:40.305736 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949047 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jul 16 21:49:40.305736 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949050 2566 flags.go:64] FLAG: --logging-format="text" Jul 16 21:49:40.305736 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949054 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 16 21:49:40.305736 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949058 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 16 21:49:40.305736 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949060 2566 flags.go:64] FLAG: --manifest-url="" Jul 16 21:49:40.305736 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949063 2566 flags.go:64] FLAG: --manifest-url-header="" Jul 16 21:49:40.305736 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949068 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 16 21:49:40.305736 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949071 2566 flags.go:64] FLAG: --max-open-files="1000000" Jul 16 21:49:40.305736 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949075 2566 flags.go:64] FLAG: --max-pods="110" Jul 16 21:49:40.305736 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949078 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 16 21:49:40.305736 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949081 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 16 21:49:40.305736 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949084 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jul 16 21:49:40.305736 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949087 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 16 21:49:40.305736 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949090 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 16 21:49:40.305736 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949093 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 16 21:49:40.305736 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949095 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 16 21:49:40.305736 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949103 2566 flags.go:64] FLAG: --node-status-max-images="50" Jul 16 21:49:40.305736 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949111 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 16 21:49:40.305736 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949114 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jul 16 21:49:40.305736 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949117 2566 flags.go:64] FLAG: --pod-cidr="" Jul 16 21:49:40.311414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949120 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 16 21:49:40.311414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949125 2566 flags.go:64] FLAG: --pod-manifest-path="" Jul 16 21:49:40.311414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949128 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jul 16 21:49:40.311414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949131 2566 flags.go:64] FLAG: --pods-per-core="0" Jul 16 21:49:40.311414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949134 2566 flags.go:64] FLAG: --port="10250" Jul 16 21:49:40.311414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949137 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 16 21:49:40.311414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949140 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05c22131b7ff4d752" Jul 16 21:49:40.311414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949144 2566 flags.go:64] FLAG: --qos-reserved="" Jul 16 21:49:40.311414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949147 2566 flags.go:64] FLAG: --read-only-port="10255" Jul 16 21:49:40.311414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949150 2566 flags.go:64] FLAG: --register-node="true" Jul 16 21:49:40.311414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949153 2566 flags.go:64] FLAG: --register-with-taints="" Jul 16 21:49:40.311414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949157 2566 flags.go:64] FLAG: --registry-burst="10" Jul 16 21:49:40.311414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949161 2566 flags.go:64] FLAG: --registry-qps="5" Jul 16 21:49:40.311414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949163 2566 flags.go:64] FLAG: --reserved-cpus="" Jul 16 21:49:40.311414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949166 2566 flags.go:64] FLAG: --reserved-memory="" Jul 16 21:49:40.311414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949171 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 16 21:49:40.311414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949174 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 16 21:49:40.311414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949177 2566 flags.go:64] FLAG: --rotate-certificates="false" Jul 16 21:49:40.311414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949180 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 16 21:49:40.311414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949183 2566 flags.go:64] FLAG: --runonce="false" Jul 16 21:49:40.311414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949185 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 16 21:49:40.311414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949189 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 16 21:49:40.311414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949191 2566 flags.go:64] FLAG: --seccomp-default="false" Jul 16 21:49:40.311414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949194 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 16 21:49:40.311414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949197 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 16 21:49:40.312255 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949200 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 16 21:49:40.312255 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949203 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 16 21:49:40.312255 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949206 2566 flags.go:64] FLAG: --storage-driver-password="root" Jul 16 21:49:40.312255 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949209 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jul 16 21:49:40.312255 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949212 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jul 16 21:49:40.312255 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949215 2566 flags.go:64] FLAG: --storage-driver-user="root" Jul 16 21:49:40.312255 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949218 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 16 21:49:40.312255 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949221 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 16 21:49:40.312255 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949224 2566 flags.go:64] FLAG: --system-cgroups="" Jul 16 21:49:40.312255 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949226 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 16 21:49:40.312255 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949232 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 16 21:49:40.312255 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949234 2566 flags.go:64] FLAG: --tls-cert-file="" Jul 16 21:49:40.312255 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949237 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 16 21:49:40.312255 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949242 2566 flags.go:64] FLAG: --tls-min-version="" Jul 16 21:49:40.312255 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949246 2566 flags.go:64] FLAG: --tls-private-key-file="" Jul 16 21:49:40.312255 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949248 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jul 16 21:49:40.312255 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949251 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 16 21:49:40.312255 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949254 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jul 16 21:49:40.312255 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949257 2566 flags.go:64] FLAG: --v="2" Jul 16 21:49:40.312255 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949261 2566 flags.go:64] FLAG: --version="false" Jul 16 21:49:40.312255 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949265 2566 flags.go:64] FLAG: --vmodule="" Jul 16 21:49:40.312255 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949269 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 16 21:49:40.312255 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949274 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 16 21:49:40.312255 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949407 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 21:49:40.312255 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949411 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 21:49:40.427946 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949414 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 21:49:40.427946 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949417 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 21:49:40.427946 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949420 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 21:49:40.427946 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949423 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 21:49:40.427946 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949426 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 21:49:40.427946 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949429 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 21:49:40.427946 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949431 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 21:49:40.427946 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949434 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 21:49:40.427946 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949437 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 21:49:40.427946 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949439 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 21:49:40.427946 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949442 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 21:49:40.427946 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949445 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 21:49:40.427946 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949447 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 21:49:40.427946 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949450 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 21:49:40.427946 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949453 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 21:49:40.427946 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949456 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 21:49:40.427946 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949459 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 21:49:40.427946 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949462 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 21:49:40.427946 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949464 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 21:49:40.427946 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949467 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 21:49:40.428745 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949469 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 21:49:40.428745 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949473 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 21:49:40.428745 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949476 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 21:49:40.428745 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949478 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 21:49:40.428745 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949481 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 21:49:40.428745 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949483 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 21:49:40.428745 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949486 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 21:49:40.428745 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949490 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 21:49:40.428745 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949495 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 21:49:40.428745 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949500 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 21:49:40.428745 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949503 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 21:49:40.428745 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949506 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 21:49:40.428745 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949509 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 21:49:40.428745 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949512 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 21:49:40.428745 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949515 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 21:49:40.428745 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949518 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 21:49:40.428745 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949520 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 21:49:40.428745 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949523 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 21:49:40.429374 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949526 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 21:49:40.429374 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949528 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 21:49:40.429374 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949531 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 21:49:40.429374 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949533 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 21:49:40.429374 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949536 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 21:49:40.429374 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949538 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 21:49:40.429374 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949541 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 21:49:40.429374 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949544 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 21:49:40.429374 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949546 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 21:49:40.429374 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949549 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 21:49:40.429374 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949551 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 16 21:49:40.429374 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949554 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 21:49:40.429374 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949557 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 21:49:40.429374 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949559 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 21:49:40.429374 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949562 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 21:49:40.429374 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949566 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 21:49:40.429374 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949568 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 21:49:40.429374 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949570 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 21:49:40.429374 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949573 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 21:49:40.429374 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949576 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 21:49:40.430004 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949578 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 21:49:40.430004 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949581 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 21:49:40.430004 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949583 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 21:49:40.430004 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949588 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 21:49:40.430004 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949590 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 21:49:40.430004 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949593 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 21:49:40.430004 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949596 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 21:49:40.430004 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949598 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 21:49:40.430004 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949601 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 21:49:40.430004 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949603 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 21:49:40.430004 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949605 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 21:49:40.430004 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949608 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 21:49:40.430004 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949611 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 21:49:40.430004 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949614 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 21:49:40.430004 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949616 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 21:49:40.430004 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949619 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 21:49:40.430004 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949621 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 21:49:40.430004 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949624 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 21:49:40.430004 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949627 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 21:49:40.430004 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949629 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 21:49:40.430629 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949632 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 21:49:40.430629 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949634 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 21:49:40.430629 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949637 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 21:49:40.430629 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949639 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 21:49:40.430629 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949643 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 21:49:40.430629 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949646 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 21:49:40.430629 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949649 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 21:49:40.430629 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949653 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 21:49:40.430629 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949655 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 21:49:40.430629 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949658 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 21:49:40.430629 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949660 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 21:49:40.430629 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949663 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 21:49:40.430629 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949665 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 21:49:40.430629 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949669 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 21:49:40.430629 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949672 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 21:49:40.430629 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949675 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 21:49:40.430629 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949679 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 21:49:40.430629 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949681 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 21:49:40.430629 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.949684 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 21:49:40.431251 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.949696 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 21:49:40.431251 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.957173 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 16 21:49:40.431251 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.957190 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 16 21:49:40.431251 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.957209 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 16 21:49:40.431251 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.957215 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 16 21:49:40.431251 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957273 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 21:49:40.431251 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957278 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 21:49:40.431251 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957281 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 21:49:40.431251 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957284 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 21:49:40.431251 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957287 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 21:49:40.431251 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957290 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 21:49:40.431251 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957293 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 21:49:40.431251 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957296 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 21:49:40.431251 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957299 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 21:49:40.431673 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957301 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 21:49:40.431673 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957304 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 21:49:40.431673 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957307 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 21:49:40.431673 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957310 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 21:49:40.431673 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957312 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 21:49:40.431673 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957315 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 16 21:49:40.431673 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957318 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 21:49:40.431673 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957321 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 21:49:40.431673 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957324 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 21:49:40.431673 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957326 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 21:49:40.431673 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957329 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 21:49:40.431673 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957332 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 21:49:40.431673 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957334 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 21:49:40.431673 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957352 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 21:49:40.431673 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957357 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 21:49:40.431673 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957361 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 21:49:40.431673 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957364 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 21:49:40.431673 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957367 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 21:49:40.431673 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957370 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 21:49:40.431673 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957373 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 21:49:40.432294 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957376 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 21:49:40.432294 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957378 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 21:49:40.432294 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957404 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 21:49:40.432294 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957407 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 21:49:40.432294 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957410 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 21:49:40.432294 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957413 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 21:49:40.432294 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957415 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 21:49:40.432294 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957418 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 21:49:40.432294 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957421 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 21:49:40.432294 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957423 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 21:49:40.432294 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957426 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 21:49:40.432294 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957429 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 21:49:40.432294 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957431 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 21:49:40.432294 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957434 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 21:49:40.432294 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957436 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 21:49:40.432294 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957439 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 21:49:40.432294 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957441 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 21:49:40.432294 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957444 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 21:49:40.432294 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957447 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 21:49:40.432294 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957450 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 21:49:40.432916 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957452 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 21:49:40.432916 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957455 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 21:49:40.432916 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957459 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 21:49:40.432916 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957462 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 21:49:40.432916 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957465 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 21:49:40.432916 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957468 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 21:49:40.432916 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957471 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 21:49:40.432916 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957474 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 21:49:40.432916 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957477 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 21:49:40.432916 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957480 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 21:49:40.432916 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957482 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 21:49:40.432916 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957485 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 21:49:40.432916 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957489 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 21:49:40.432916 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957492 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 21:49:40.432916 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957496 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 21:49:40.432916 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957499 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 21:49:40.432916 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957501 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 21:49:40.432916 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957503 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 21:49:40.432916 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957506 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 21:49:40.433467 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957508 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 21:49:40.433467 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957511 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 21:49:40.433467 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957514 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 21:49:40.433467 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957516 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 21:49:40.433467 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957519 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 21:49:40.433467 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957521 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 21:49:40.433467 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957524 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 21:49:40.433467 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957528 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 21:49:40.433467 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957531 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 21:49:40.433467 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957534 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 21:49:40.433467 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957538 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 21:49:40.433467 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957541 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 21:49:40.433467 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957544 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 21:49:40.433467 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957546 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 21:49:40.433467 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957549 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 21:49:40.433467 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957552 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 21:49:40.433467 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957554 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 21:49:40.433467 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957557 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 21:49:40.433467 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957559 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 21:49:40.433985 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957562 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 21:49:40.433985 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957564 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 21:49:40.433985 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957567 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 21:49:40.433985 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957570 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 21:49:40.433985 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957572 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 21:49:40.433985 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957575 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 21:49:40.433985 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957577 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 21:49:40.433985 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957580 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 21:49:40.433985 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957584 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 21:49:40.433985 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957587 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 21:49:40.433985 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957589 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 21:49:40.433985 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957592 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 21:49:40.433985 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.957597 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 21:49:40.433985 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957719 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 21:49:40.433985 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957723 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 21:49:40.434476 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957726 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 21:49:40.434476 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957729 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 21:49:40.434476 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957732 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 21:49:40.434476 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957736 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 21:49:40.434476 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957738 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 21:49:40.434476 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957741 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 21:49:40.434476 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957745 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 21:49:40.434476 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957749 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 21:49:40.434476 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957756 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 21:49:40.434476 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957759 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 21:49:40.434476 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957762 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 21:49:40.434476 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957765 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 21:49:40.434476 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957767 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 21:49:40.434476 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957770 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 21:49:40.434476 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957773 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 21:49:40.434476 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957776 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 21:49:40.434476 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957778 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 21:49:40.434476 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957781 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 21:49:40.434476 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957783 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 21:49:40.434476 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957786 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 21:49:40.435025 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957788 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 21:49:40.435025 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957791 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 21:49:40.435025 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957794 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 21:49:40.435025 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957796 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 21:49:40.435025 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957799 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 16 21:49:40.435025 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957801 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 21:49:40.435025 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957806 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 21:49:40.435025 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957808 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 21:49:40.435025 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957811 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 21:49:40.435025 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957813 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 21:49:40.435025 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957816 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 21:49:40.435025 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957818 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 21:49:40.435025 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957821 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 21:49:40.435025 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957823 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 21:49:40.435025 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957826 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 21:49:40.435025 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957829 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 21:49:40.435025 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957833 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 21:49:40.435025 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957835 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 21:49:40.435025 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957838 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 21:49:40.435025 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957841 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 21:49:40.435633 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957844 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 21:49:40.435633 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957847 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 21:49:40.435633 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957849 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 21:49:40.435633 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957852 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 21:49:40.435633 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957855 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 21:49:40.435633 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957857 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 21:49:40.435633 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957860 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 21:49:40.435633 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957862 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 21:49:40.435633 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957865 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 21:49:40.435633 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957867 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 21:49:40.435633 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957869 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 21:49:40.435633 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957872 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 21:49:40.435633 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957875 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 21:49:40.435633 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957877 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 21:49:40.435633 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957880 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 21:49:40.435633 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957882 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 21:49:40.435633 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957885 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 21:49:40.435633 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957888 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 21:49:40.435633 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957892 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 21:49:40.435633 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957894 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 21:49:40.436197 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957897 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 21:49:40.436197 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957900 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 21:49:40.436197 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957902 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 21:49:40.436197 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957905 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 21:49:40.436197 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957907 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 21:49:40.436197 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957910 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 21:49:40.436197 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957913 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 21:49:40.436197 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957915 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 21:49:40.436197 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957918 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 21:49:40.436197 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957920 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 21:49:40.436197 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957923 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 21:49:40.436197 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957926 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 21:49:40.436197 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957930 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 21:49:40.436197 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957932 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 21:49:40.436197 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957935 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 21:49:40.436197 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957937 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 21:49:40.436197 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957939 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 21:49:40.436197 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957942 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 21:49:40.436197 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957946 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 21:49:40.436826 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957949 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 21:49:40.436826 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957952 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 21:49:40.436826 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957955 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 21:49:40.436826 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957958 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 21:49:40.436826 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957961 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 21:49:40.436826 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957963 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 21:49:40.436826 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957967 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 21:49:40.436826 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957969 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 21:49:40.436826 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957972 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 21:49:40.436826 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957975 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 21:49:40.436826 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957978 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 21:49:40.436826 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957982 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 21:49:40.436826 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957984 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 21:49:40.436826 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957987 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 21:49:40.436826 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957989 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 21:49:40.436826 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957992 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 21:49:40.436826 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957994 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 21:49:40.436826 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:39.957997 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 21:49:40.437307 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.958002 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 21:49:40.437307 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.958122 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jul 16 21:49:40.437307 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.960416 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 16 21:49:40.437307 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.962218 2566 server.go:1019] "Starting client certificate rotation" Jul 16 21:49:40.437307 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.962325 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 21:49:40.437307 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.962366 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 21:49:40.437307 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.965194 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 21:49:40.437307 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.970672 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 21:49:40.437307 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.984029 2566 log.go:25] "Validated CRI v1 runtime API" Jul 16 21:49:40.437307 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.989146 2566 log.go:25] "Validated CRI v1 image API" Jul 16 21:49:40.437307 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.989952 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 16 21:49:40.437307 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.992581 2566 fs.go:135] Filesystem UUIDs: map[35c1959b-d208-494b-834e-9a5a179a9a05:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9233d5c7-d35b-47a3-bc56-fc708a54e59d:/dev/nvme0n1p3] Jul 16 21:49:40.437760 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.992597 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 16 21:49:40.437760 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.997300 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 21:49:40.437934 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.999218 2566 manager.go:216] Machine: {Timestamp:2026-07-16 21:49:39.997779497 +0000 UTC m=+0.372941863 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101649 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28c862081dba220bed9d46cf711f49 SystemUUID:ec28c862-081d-ba22-0bed-9d46cf711f49 BootID:72c1ac89-0fa2-483b-9949-dd4033fcf40c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:01:fe:c4:2a:a5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:01:fe:c4:2a:a5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:34:22:ab:2c:c3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 16 21:49:40.437934 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.999329 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 16 21:49:40.437934 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:39.999436 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 16 21:49:40.437934 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.002767 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 16 21:49:40.437934 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.002803 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-177.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 16 21:49:40.437934 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.003683 2566 topology_manager.go:138] "Creating topology manager with none policy" Jul 16 21:49:40.437934 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.003697 2566 container_manager_linux.go:309] "Creating device plugin manager" Jul 16 21:49:40.437934 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.003708 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 21:49:40.437934 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.004503 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 21:49:40.437934 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.006280 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 16 21:49:40.437934 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.010648 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 16 21:49:40.437934 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.010778 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 16 21:49:40.437934 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.010808 2566 kubelet.go:486] "Attempting to sync node with API server" Jul 16 21:49:40.437934 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.010830 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 16 21:49:40.437934 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.010849 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 16 21:49:40.437934 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.010862 2566 kubelet.go:398] "Adding apiserver pod source" Jul 16 21:49:40.437934 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.010872 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 16 21:49:40.437934 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.011244 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.011260 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.013696 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.015567 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.015594 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.016220 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.016233 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.016239 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.016256 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.016265 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.016270 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.016416 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.016423 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.016430 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.016436 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.016451 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.016459 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.017323 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.017330 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.020923 2566 server.go:1268] "Started kubelet" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.021024 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.021176 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.021539 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.022958 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:40.023067 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-177.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:40.023062 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.022698 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-177.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.024045 2566 server.go:310] "Adding debug handlers to kubelet server" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:40.028287 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:40.027425 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-177.ec2.internal.18c2e38904b16cfc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-177.ec2.internal,UID:ip-10-0-137-177.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-177.ec2.internal,},FirstTimestamp:2026-07-16 21:49:40.020899068 +0000 UTC m=+0.396061433,LastTimestamp:2026-07-16 21:49:40.020899068 +0000 UTC m=+0.396061433,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-177.ec2.internal,}" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.033513 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.033524 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:40.033587 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-177.ec2.internal\" not found" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.034242 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.034257 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.034257 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.034333 2566 reconstruct.go:97] "Volume reconstruction finished" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.034340 2566 reconciler.go:29] "Reconciler: start to sync state" Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.036692 2566 factory.go:55] Registering systemd factory Jul 16 21:49:40.438755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.036710 2566 factory.go:223] Registration of the systemd container factory successfully Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:40.036841 2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-177.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.037057 2566 factory.go:153] Registering CRI-O factory Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.037074 2566 factory.go:223] Registration of the crio container factory successfully Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.037123 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.037147 2566 factory.go:103] Registering Raw factory Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.037167 2566 manager.go:1196] Started watching for new ooms in manager Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.037667 2566 manager.go:349] Starting recovery of all containers Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.046650 2566 manager.go:354] Recovery completed Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:40.046824 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.048039 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9j5nn" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.050720 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.054571 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-177.ec2.internal" event="NodeHasSufficientMemory" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.054598 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.054608 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-177.ec2.internal" event="NodeHasSufficientPID" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.055116 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.055124 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.055140 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.055171 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.055846 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-177.ec2.internal" event="NodeHasSufficientMemory" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.055871 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.055880 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-177.ec2.internal" event="NodeHasSufficientPID" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.057066 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9j5nn" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.059087 2566 policy_none.go:49] "None policy: Start" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.059102 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.059114 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.060908 2566 policy_none.go:47] "Start" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:40.134002 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-177.ec2.internal\" not found" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.156958 2566 manager.go:337] "Starting Device Plugin manager" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:40.157050 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.157064 2566 server.go:87] "Starting device plugin registration server" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.157326 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.157340 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.157435 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.157509 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.157517 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:40.157995 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:40.158045 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-177.ec2.internal\" not found" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.161340 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.162625 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.162664 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.162683 2566 kubelet.go:2448] "Starting kubelet main sync loop" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:40.162720 2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.165142 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:40.243136 2566 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-177.ec2.internal\" not found" node="ip-10-0-137-177.ec2.internal" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.258239 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 21:49:40.439889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.259147 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-177.ec2.internal" event="NodeHasSufficientMemory" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.259197 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.259219 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-177.ec2.internal" event="NodeHasSufficientPID" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.259241 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-177.ec2.internal" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.263134 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-177.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-177.ec2.internal"] Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.263188 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.264575 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-177.ec2.internal" event="NodeHasSufficientMemory" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.264597 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.264608 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-177.ec2.internal" event="NodeHasSufficientPID" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.266760 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.266883 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-177.ec2.internal" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.266912 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.267423 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-177.ec2.internal" event="NodeHasSufficientMemory" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.267453 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.267424 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-177.ec2.internal" event="NodeHasSufficientMemory" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.267489 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.267465 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-177.ec2.internal" event="NodeHasSufficientPID" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.267508 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-177.ec2.internal" event="NodeHasSufficientPID" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.268455 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-177.ec2.internal" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:40.268474 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-177.ec2.internal\": node \"ip-10-0-137-177.ec2.internal\" not found" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.269562 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-177.ec2.internal" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.269584 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.270203 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-177.ec2.internal" event="NodeHasSufficientMemory" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.270230 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.270243 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-177.ec2.internal" event="NodeHasSufficientPID" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:40.290961 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-177.ec2.internal\" not found" node="ip-10-0-137-177.ec2.internal" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:40.317326 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-177.ec2.internal\" not found" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:40.318844 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-177.ec2.internal\" not found" node="ip-10-0-137-177.ec2.internal" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.335914 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26ecc05f6cb32b6cce46006257574c33-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-177.ec2.internal\" (UID: \"26ecc05f6cb32b6cce46006257574c33\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-177.ec2.internal" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.335937 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7de9d8a70964726f44a2fadad5252519-config\") pod \"kube-apiserver-proxy-ip-10-0-137-177.ec2.internal\" (UID: \"7de9d8a70964726f44a2fadad5252519\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-177.ec2.internal" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.335956 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/26ecc05f6cb32b6cce46006257574c33-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-177.ec2.internal\" (UID: \"26ecc05f6cb32b6cce46006257574c33\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-177.ec2.internal" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:40.417850 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-177.ec2.internal\" not found" Jul 16 21:49:40.548904 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.436624 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7de9d8a70964726f44a2fadad5252519-config\") pod \"kube-apiserver-proxy-ip-10-0-137-177.ec2.internal\" (UID: \"7de9d8a70964726f44a2fadad5252519\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-177.ec2.internal" Jul 16 21:49:40.549859 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.436661 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/26ecc05f6cb32b6cce46006257574c33-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-177.ec2.internal\" (UID: \"26ecc05f6cb32b6cce46006257574c33\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-177.ec2.internal" Jul 16 21:49:40.549859 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.436678 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26ecc05f6cb32b6cce46006257574c33-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-177.ec2.internal\" (UID: \"26ecc05f6cb32b6cce46006257574c33\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-177.ec2.internal" Jul 16 21:49:40.549859 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.436731 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/26ecc05f6cb32b6cce46006257574c33-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-177.ec2.internal\" (UID: \"26ecc05f6cb32b6cce46006257574c33\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-177.ec2.internal" Jul 16 21:49:40.549859 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.436784 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7de9d8a70964726f44a2fadad5252519-config\") pod \"kube-apiserver-proxy-ip-10-0-137-177.ec2.internal\" (UID: \"7de9d8a70964726f44a2fadad5252519\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-177.ec2.internal" Jul 16 21:49:40.549859 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.436817 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26ecc05f6cb32b6cce46006257574c33-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-177.ec2.internal\" (UID: \"26ecc05f6cb32b6cce46006257574c33\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-177.ec2.internal" Jul 16 21:49:40.549859 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:40.519042 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-177.ec2.internal\" not found" Jul 16 21:49:40.680172 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.593624 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-177.ec2.internal" Jul 16 21:49:40.680172 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:40.619741 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-177.ec2.internal\" not found" Jul 16 21:49:40.680172 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:40.624897 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-177.ec2.internal" Jul 16 21:49:41.939894 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:40.719869 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-177.ec2.internal\" not found" Jul 16 21:49:42.076543 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:41.960454 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-177.ec2.internal\" not found" Jul 16 21:49:42.076543 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:42.060922 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-177.ec2.internal\" not found" Jul 16 21:49:42.224552 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:42.101485 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 16 21:49:42.224552 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:42.101646 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 21:49:42.224552 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:42.161967 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-177.ec2.internal\" not found" Jul 16 21:49:42.224552 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:42.203484 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 21:44:41 +0000 UTC" deadline="2028-02-12 02:24:48.219342717 +0000 UTC" Jul 16 21:49:42.224552 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:42.203519 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13804h35m6.01582831s" Jul 16 21:49:42.325001 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:42.242793 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 21:49:42.325001 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:42.262731 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-177.ec2.internal\" not found" Jul 16 21:49:42.401797 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:42.363774 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-177.ec2.internal\" not found" Jul 16 21:49:42.477394 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:42.464223 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-177.ec2.internal\" not found" Jul 16 21:49:42.602753 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:42.499099 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ecc05f6cb32b6cce46006257574c33.slice/crio-1f0806a5fd6641daa05732d3540e3a52e89a60b9e5a3ad8f4c20f6f884ca2096 WatchSource:0}: Error finding container 1f0806a5fd6641daa05732d3540e3a52e89a60b9e5a3ad8f4c20f6f884ca2096: Status 404 returned error can't find the container with id 1f0806a5fd6641daa05732d3540e3a52e89a60b9e5a3ad8f4c20f6f884ca2096 Jul 16 21:49:42.602753 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:42.499543 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7de9d8a70964726f44a2fadad5252519.slice/crio-d35f0ab70181012108d1f41a1779d29331e864c1d8df82097a690fe042220064 WatchSource:0}: Error finding container d35f0ab70181012108d1f41a1779d29331e864c1d8df82097a690fe042220064: Status 404 returned error can't find the container with id d35f0ab70181012108d1f41a1779d29331e864c1d8df82097a690fe042220064 Jul 16 21:49:42.602753 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:42.509544 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 21:49:42.602753 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:42.565243 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-177.ec2.internal\" not found" Jul 16 21:49:42.726733 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:42.609220 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 21:49:42.726733 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:42.610825 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 21:49:42.726733 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:42.674036 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-177.ec2.internal" Jul 16 21:49:42.726733 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:42.693693 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 21:49:42.726733 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:42.694804 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-177.ec2.internal" Jul 16 21:49:42.726733 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:42.703864 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.152432 2566 apiserver.go:52] "Watching apiserver" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.162490 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.164320 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-w9jn7","kube-system/kube-apiserver-proxy-ip-10-0-137-177.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-177.ec2.internal","openshift-multus/multus-4vjsw","openshift-multus/multus-additional-cni-plugins-n9km8","openshift-multus/network-metrics-daemon-j7587","openshift-ovn-kubernetes/ovnkube-node-hz2pt","kube-system/konnectivity-agent-7kxg4","openshift-cluster-node-tuning-operator/tuned-26nvd","openshift-dns/node-resolver-t792r","openshift-image-registry/node-ca-dxsz6","openshift-network-diagnostics/network-check-target-c9f2s","openshift-network-operator/iptables-alerter-c79zl"] Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.166966 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.169588 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.169809 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rrf4x\"" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.169981 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.170289 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:43.170364 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9f2s" podUID="97c82c64-748f-4a8d-b4e3-3111b7d31cdc" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.172130 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.173977 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.174248 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c79zl" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.174343 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-72hsc\"" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.174476 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.174614 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.174823 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.176706 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.177243 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.177313 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.177407 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-g2c6x\"" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.177504 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.178767 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n9km8" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.179401 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4v8lq\"" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.180961 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7kxg4" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.181835 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.182287 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.183320 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:43.183386 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7587" podUID="4b90276c-b68f-49a9-b571-13174fb91f20" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.183626 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.184256 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 16 21:49:43.198717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.184938 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 16 21:49:43.200677 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.184987 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xzz8h\"" Jul 16 21:49:43.200677 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185013 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 16 21:49:43.200677 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185136 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 16 21:49:43.200677 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185166 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jsjqp\"" Jul 16 21:49:43.200677 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185238 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj27t\" (UniqueName: \"kubernetes.io/projected/cc8ca5f8-2879-4b67-9727-c032a94b137a-kube-api-access-lj27t\") pod \"iptables-alerter-c79zl\" (UID: \"cc8ca5f8-2879-4b67-9727-c032a94b137a\") " pod="openshift-network-operator/iptables-alerter-c79zl" Jul 16 21:49:43.200677 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185269 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-host-run-k8s-cni-cncf-io\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.200677 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185293 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-hostroot\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.200677 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185320 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/27c6b349-4c75-4068-b041-c79c6ab52fcc-multus-daemon-config\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.200677 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185345 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-etc-sysctl-d\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.200677 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185368 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-lib-modules\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.200677 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185377 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 16 21:49:43.200677 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185392 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-etc-modprobe-d\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.200677 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185413 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-sys\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.200677 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185452 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-host\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.200677 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185510 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fc36f9ea-6173-4dd8-abd3-8845ef171c58-registration-dir\") pod \"aws-ebs-csi-driver-node-pxsnl\" (UID: \"fc36f9ea-6173-4dd8-abd3-8845ef171c58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" Jul 16 21:49:43.200677 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185568 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-cnibin\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.200677 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185597 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-var-lib-kubelet\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.200677 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185620 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5k5h\" (UniqueName: \"kubernetes.io/projected/5f565fa4-5ca1-4074-8479-431dcf337f8d-kube-api-access-s5k5h\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.200677 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185645 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fc36f9ea-6173-4dd8-abd3-8845ef171c58-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pxsnl\" (UID: \"fc36f9ea-6173-4dd8-abd3-8845ef171c58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" Jul 16 21:49:43.202058 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185668 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fc36f9ea-6173-4dd8-abd3-8845ef171c58-socket-dir\") pod \"aws-ebs-csi-driver-node-pxsnl\" (UID: \"fc36f9ea-6173-4dd8-abd3-8845ef171c58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" Jul 16 21:49:43.202058 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185691 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fc36f9ea-6173-4dd8-abd3-8845ef171c58-etc-selinux\") pod \"aws-ebs-csi-driver-node-pxsnl\" (UID: \"fc36f9ea-6173-4dd8-abd3-8845ef171c58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" Jul 16 21:49:43.202058 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185729 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-etc-sysctl-conf\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.202058 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185769 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.202058 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185826 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cc8ca5f8-2879-4b67-9727-c032a94b137a-iptables-alerter-script\") pod \"iptables-alerter-c79zl\" (UID: \"cc8ca5f8-2879-4b67-9727-c032a94b137a\") " pod="openshift-network-operator/iptables-alerter-c79zl" Jul 16 21:49:43.202058 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185858 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-system-cni-dir\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.202058 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185904 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27c6b349-4c75-4068-b041-c79c6ab52fcc-cni-binary-copy\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.202058 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185928 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-host-run-netns\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.202058 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185950 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-host-var-lib-cni-multus\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.202058 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.185997 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-host-var-lib-cni-bin\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.202058 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.186783 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-etc-kubernetes\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.202058 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.186813 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g97f4\" (UniqueName: \"kubernetes.io/projected/27c6b349-4c75-4068-b041-c79c6ab52fcc-kube-api-access-g97f4\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.202058 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.186902 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-etc-systemd\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.202058 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.186940 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fc36f9ea-6173-4dd8-abd3-8845ef171c58-sys-fs\") pod \"aws-ebs-csi-driver-node-pxsnl\" (UID: \"fc36f9ea-6173-4dd8-abd3-8845ef171c58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" Jul 16 21:49:43.202058 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.197972 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8lhz\" (UniqueName: \"kubernetes.io/projected/fc36f9ea-6173-4dd8-abd3-8845ef171c58-kube-api-access-f8lhz\") pod \"aws-ebs-csi-driver-node-pxsnl\" (UID: \"fc36f9ea-6173-4dd8-abd3-8845ef171c58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" Jul 16 21:49:43.202058 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.198000 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc8ca5f8-2879-4b67-9727-c032a94b137a-host-slash\") pod \"iptables-alerter-c79zl\" (UID: \"cc8ca5f8-2879-4b67-9727-c032a94b137a\") " pod="openshift-network-operator/iptables-alerter-c79zl" Jul 16 21:49:43.202058 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.198022 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-host-run-multus-certs\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.202917 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.198045 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-etc-kubernetes\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.202917 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.198069 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5f565fa4-5ca1-4074-8479-431dcf337f8d-etc-tuned\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.202917 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.198090 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f565fa4-5ca1-4074-8479-431dcf337f8d-tmp\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.202917 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.198115 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fc36f9ea-6173-4dd8-abd3-8845ef171c58-device-dir\") pod \"aws-ebs-csi-driver-node-pxsnl\" (UID: \"fc36f9ea-6173-4dd8-abd3-8845ef171c58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" Jul 16 21:49:43.202917 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.198139 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-multus-cni-dir\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.202917 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.198336 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-multus-socket-dir-parent\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.202917 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.198364 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-host-var-lib-kubelet\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.202917 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.198432 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-multus-conf-dir\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.202917 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.198468 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-etc-sysconfig\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.202917 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.198493 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-run\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.202917 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.198519 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9glrc\" (UniqueName: \"kubernetes.io/projected/97c82c64-748f-4a8d-b4e3-3111b7d31cdc-kube-api-access-9glrc\") pod \"network-check-target-c9f2s\" (UID: \"97c82c64-748f-4a8d-b4e3-3111b7d31cdc\") " pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:49:43.202917 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.198543 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-os-release\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.202917 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.199195 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 21:49:43.202917 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.199450 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 16 21:49:43.202917 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.199531 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dfk6l\"" Jul 16 21:49:43.202917 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.199580 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 16 21:49:43.202917 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.199650 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 16 21:49:43.202917 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.199768 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 16 21:49:43.202917 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.200991 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 16 21:49:43.202917 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.201125 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 16 21:49:43.202917 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.201239 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:49:43.204182 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:43.201312 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jn7" podUID="4509b338-7e48-41c0-b1ef-fe88c6165229" Jul 16 21:49:43.263381 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.205850 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t792r" Jul 16 21:49:43.263381 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.208196 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dxsz6" Jul 16 21:49:43.263381 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.208968 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7rhgs\"" Jul 16 21:49:43.263381 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.209045 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 16 21:49:43.263381 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.209152 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 16 21:49:43.263381 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.210514 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 16 21:49:43.263381 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.211031 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 16 21:49:43.263381 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.211258 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 16 21:49:43.263381 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.211536 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-s824p\"" Jul 16 21:49:43.263381 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.212042 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nm2lm" Jul 16 21:49:43.263381 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.218225 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nm2lm" Jul 16 21:49:43.324632 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.275451 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 16 21:49:43.324632 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.298714 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-etc-sysctl-d\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.324632 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.298755 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b90276c-b68f-49a9-b571-13174fb91f20-metrics-certs\") pod \"network-metrics-daemon-j7587\" (UID: \"4b90276c-b68f-49a9-b571-13174fb91f20\") " pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:49:43.324632 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.298784 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83b40b54-0510-4714-b103-e35e3684f3a1-konnectivity-ca\") pod \"konnectivity-agent-7kxg4\" (UID: \"83b40b54-0510-4714-b103-e35e3684f3a1\") " pod="kube-system/konnectivity-agent-7kxg4" Jul 16 21:49:43.324632 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.298809 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-etc-openvswitch\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.324632 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.298832 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/75c7e977-7b28-42d0-a6e6-0532f2932368-env-overrides\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.324632 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.298855 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4509b338-7e48-41c0-b1ef-fe88c6165229-original-pull-secret\") pod \"global-pull-secret-syncer-w9jn7\" (UID: \"4509b338-7e48-41c0-b1ef-fe88c6165229\") " pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:49:43.324632 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.298881 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-sys\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.324632 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.298904 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-host\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.324632 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.298926 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fc36f9ea-6173-4dd8-abd3-8845ef171c58-registration-dir\") pod \"aws-ebs-csi-driver-node-pxsnl\" (UID: \"fc36f9ea-6173-4dd8-abd3-8845ef171c58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" Jul 16 21:49:43.324632 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.298959 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-node-log\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.324632 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.298980 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4509b338-7e48-41c0-b1ef-fe88c6165229-kubelet-config\") pod \"global-pull-secret-syncer-w9jn7\" (UID: \"4509b338-7e48-41c0-b1ef-fe88c6165229\") " pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:49:43.324632 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299000 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/66c41459-8447-46fb-9701-03511287936d-cnibin\") pod \"multus-additional-cni-plugins-n9km8\" (UID: \"66c41459-8447-46fb-9701-03511287936d\") " pod="openshift-multus/multus-additional-cni-plugins-n9km8" Jul 16 21:49:43.324632 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299024 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-var-lib-kubelet\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.324632 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299057 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fc36f9ea-6173-4dd8-abd3-8845ef171c58-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pxsnl\" (UID: \"fc36f9ea-6173-4dd8-abd3-8845ef171c58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" Jul 16 21:49:43.324632 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299112 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fc36f9ea-6173-4dd8-abd3-8845ef171c58-socket-dir\") pod \"aws-ebs-csi-driver-node-pxsnl\" (UID: \"fc36f9ea-6173-4dd8-abd3-8845ef171c58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" Jul 16 21:49:43.324632 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299136 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-var-lib-kubelet\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.331347 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299140 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.331347 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299168 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/75c7e977-7b28-42d0-a6e6-0532f2932368-ovn-node-metrics-cert\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.331347 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299178 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-sys\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.331347 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299194 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3fd95e60-8961-41fc-a136-25b7b76fbc55-hosts-file\") pod \"node-resolver-t792r\" (UID: \"3fd95e60-8961-41fc-a136-25b7b76fbc55\") " pod="openshift-dns/node-resolver-t792r" Jul 16 21:49:43.331347 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299218 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-host\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.331347 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299222 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-etc-sysctl-conf\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.331347 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299250 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cc8ca5f8-2879-4b67-9727-c032a94b137a-iptables-alerter-script\") pod \"iptables-alerter-c79zl\" (UID: \"cc8ca5f8-2879-4b67-9727-c032a94b137a\") " pod="openshift-network-operator/iptables-alerter-c79zl" Jul 16 21:49:43.331347 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299258 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fc36f9ea-6173-4dd8-abd3-8845ef171c58-registration-dir\") pod \"aws-ebs-csi-driver-node-pxsnl\" (UID: \"fc36f9ea-6173-4dd8-abd3-8845ef171c58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" Jul 16 21:49:43.331347 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299310 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27c6b349-4c75-4068-b041-c79c6ab52fcc-cni-binary-copy\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.331347 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299331 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-host-run-netns\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.331347 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299351 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-host-var-lib-cni-multus\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.331347 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299371 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-etc-kubernetes\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.331347 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299392 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g97f4\" (UniqueName: \"kubernetes.io/projected/27c6b349-4c75-4068-b041-c79c6ab52fcc-kube-api-access-g97f4\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.331347 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299438 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-etc-sysctl-conf\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.331347 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299436 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83b40b54-0510-4714-b103-e35e3684f3a1-agent-certs\") pod \"konnectivity-agent-7kxg4\" (UID: \"83b40b54-0510-4714-b103-e35e3684f3a1\") " pod="kube-system/konnectivity-agent-7kxg4" Jul 16 21:49:43.331347 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299558 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fc36f9ea-6173-4dd8-abd3-8845ef171c58-socket-dir\") pod \"aws-ebs-csi-driver-node-pxsnl\" (UID: \"fc36f9ea-6173-4dd8-abd3-8845ef171c58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" Jul 16 21:49:43.331347 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299595 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-host-var-lib-cni-bin\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.333282 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299624 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-etc-systemd\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.333282 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299649 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fc36f9ea-6173-4dd8-abd3-8845ef171c58-sys-fs\") pod \"aws-ebs-csi-driver-node-pxsnl\" (UID: \"fc36f9ea-6173-4dd8-abd3-8845ef171c58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" Jul 16 21:49:43.333282 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299676 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbmmf\" (UniqueName: \"kubernetes.io/projected/4b90276c-b68f-49a9-b571-13174fb91f20-kube-api-access-gbmmf\") pod \"network-metrics-daemon-j7587\" (UID: \"4b90276c-b68f-49a9-b571-13174fb91f20\") " pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:49:43.333282 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299718 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-run-systemd\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.333282 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299754 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-var-lib-openvswitch\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.333282 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299781 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-host-cni-netd\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.333282 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299860 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-etc-kubernetes\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.333282 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299889 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fc36f9ea-6173-4dd8-abd3-8845ef171c58-device-dir\") pod \"aws-ebs-csi-driver-node-pxsnl\" (UID: \"fc36f9ea-6173-4dd8-abd3-8845ef171c58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" Jul 16 21:49:43.333282 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299917 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/66c41459-8447-46fb-9701-03511287936d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n9km8\" (UID: \"66c41459-8447-46fb-9701-03511287936d\") " pod="openshift-multus/multus-additional-cni-plugins-n9km8" Jul 16 21:49:43.333282 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299947 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-host-cni-bin\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.333282 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299972 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4509b338-7e48-41c0-b1ef-fe88c6165229-dbus\") pod \"global-pull-secret-syncer-w9jn7\" (UID: \"4509b338-7e48-41c0-b1ef-fe88c6165229\") " pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:49:43.333282 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.299995 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fd95e60-8961-41fc-a136-25b7b76fbc55-tmp-dir\") pod \"node-resolver-t792r\" (UID: \"3fd95e60-8961-41fc-a136-25b7b76fbc55\") " pod="openshift-dns/node-resolver-t792r" Jul 16 21:49:43.333282 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300020 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5q9n\" (UniqueName: \"kubernetes.io/projected/3fd95e60-8961-41fc-a136-25b7b76fbc55-kube-api-access-r5q9n\") pod \"node-resolver-t792r\" (UID: \"3fd95e60-8961-41fc-a136-25b7b76fbc55\") " pod="openshift-dns/node-resolver-t792r" Jul 16 21:49:43.333282 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300047 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-multus-cni-dir\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.333282 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300073 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-multus-socket-dir-parent\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.333282 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300079 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27c6b349-4c75-4068-b041-c79c6ab52fcc-cni-binary-copy\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.333282 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300097 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-etc-sysconfig\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.334629 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300122 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grc6v\" (UniqueName: \"kubernetes.io/projected/75c7e977-7b28-42d0-a6e6-0532f2932368-kube-api-access-grc6v\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.334629 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300150 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-host-run-netns\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.334629 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300182 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/66c41459-8447-46fb-9701-03511287936d-cni-binary-copy\") pod \"multus-additional-cni-plugins-n9km8\" (UID: \"66c41459-8447-46fb-9701-03511287936d\") " pod="openshift-multus/multus-additional-cni-plugins-n9km8" Jul 16 21:49:43.334629 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300196 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-host-var-lib-cni-multus\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.334629 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300209 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/66c41459-8447-46fb-9701-03511287936d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n9km8\" (UID: \"66c41459-8447-46fb-9701-03511287936d\") " pod="openshift-multus/multus-additional-cni-plugins-n9km8" Jul 16 21:49:43.334629 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300327 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-etc-kubernetes\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.334629 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300381 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-host-kubelet\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.334629 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300406 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-systemd-units\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.334629 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300445 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/75c7e977-7b28-42d0-a6e6-0532f2932368-ovnkube-config\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.334629 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300473 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj27t\" (UniqueName: \"kubernetes.io/projected/cc8ca5f8-2879-4b67-9727-c032a94b137a-kube-api-access-lj27t\") pod \"iptables-alerter-c79zl\" (UID: \"cc8ca5f8-2879-4b67-9727-c032a94b137a\") " pod="openshift-network-operator/iptables-alerter-c79zl" Jul 16 21:49:43.334629 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300504 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-host-run-k8s-cni-cncf-io\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.334629 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300542 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/27c6b349-4c75-4068-b041-c79c6ab52fcc-multus-daemon-config\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.334629 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300567 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-lib-modules\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.334629 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300593 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-log-socket\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.334629 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300617 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/75c7e977-7b28-42d0-a6e6-0532f2932368-ovnkube-script-lib\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.334629 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300643 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-etc-modprobe-d\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.334629 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300668 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/66c41459-8447-46fb-9701-03511287936d-os-release\") pod \"multus-additional-cni-plugins-n9km8\" (UID: \"66c41459-8447-46fb-9701-03511287936d\") " pod="openshift-multus/multus-additional-cni-plugins-n9km8" Jul 16 21:49:43.336777 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300694 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/66c41459-8447-46fb-9701-03511287936d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n9km8\" (UID: \"66c41459-8447-46fb-9701-03511287936d\") " pod="openshift-multus/multus-additional-cni-plugins-n9km8" Jul 16 21:49:43.336777 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300719 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-cnibin\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.336777 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300744 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5k5h\" (UniqueName: \"kubernetes.io/projected/5f565fa4-5ca1-4074-8479-431dcf337f8d-kube-api-access-s5k5h\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.336777 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300768 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fc36f9ea-6173-4dd8-abd3-8845ef171c58-etc-selinux\") pod \"aws-ebs-csi-driver-node-pxsnl\" (UID: \"fc36f9ea-6173-4dd8-abd3-8845ef171c58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" Jul 16 21:49:43.336777 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300792 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66c41459-8447-46fb-9701-03511287936d-system-cni-dir\") pod \"multus-additional-cni-plugins-n9km8\" (UID: \"66c41459-8447-46fb-9701-03511287936d\") " pod="openshift-multus/multus-additional-cni-plugins-n9km8" Jul 16 21:49:43.336777 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300818 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cc2270c6-d609-45af-be97-86e77cae77fa-serviceca\") pod \"node-ca-dxsz6\" (UID: \"cc2270c6-d609-45af-be97-86e77cae77fa\") " pod="openshift-image-registry/node-ca-dxsz6" Jul 16 21:49:43.336777 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300845 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-system-cni-dir\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.336777 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300868 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-host-run-netns\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.336777 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300917 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-run-ovn\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.336777 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300944 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8lhz\" (UniqueName: \"kubernetes.io/projected/fc36f9ea-6173-4dd8-abd3-8845ef171c58-kube-api-access-f8lhz\") pod \"aws-ebs-csi-driver-node-pxsnl\" (UID: \"fc36f9ea-6173-4dd8-abd3-8845ef171c58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" Jul 16 21:49:43.336777 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300972 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r75l\" (UniqueName: \"kubernetes.io/projected/66c41459-8447-46fb-9701-03511287936d-kube-api-access-2r75l\") pod \"multus-additional-cni-plugins-n9km8\" (UID: \"66c41459-8447-46fb-9701-03511287936d\") " pod="openshift-multus/multus-additional-cni-plugins-n9km8" Jul 16 21:49:43.336777 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.300999 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc8ca5f8-2879-4b67-9727-c032a94b137a-host-slash\") pod \"iptables-alerter-c79zl\" (UID: \"cc8ca5f8-2879-4b67-9727-c032a94b137a\") " pod="openshift-network-operator/iptables-alerter-c79zl" Jul 16 21:49:43.336777 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301026 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-host-run-multus-certs\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.336777 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301058 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5f565fa4-5ca1-4074-8479-431dcf337f8d-etc-tuned\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.336777 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301089 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f565fa4-5ca1-4074-8479-431dcf337f8d-tmp\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.336777 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301114 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qh6q\" (UniqueName: \"kubernetes.io/projected/cc2270c6-d609-45af-be97-86e77cae77fa-kube-api-access-4qh6q\") pod \"node-ca-dxsz6\" (UID: \"cc2270c6-d609-45af-be97-86e77cae77fa\") " pod="openshift-image-registry/node-ca-dxsz6" Jul 16 21:49:43.336777 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301141 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-host-var-lib-kubelet\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.337895 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301168 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-multus-conf-dir\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.337895 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301194 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-run\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.337895 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301222 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9glrc\" (UniqueName: \"kubernetes.io/projected/97c82c64-748f-4a8d-b4e3-3111b7d31cdc-kube-api-access-9glrc\") pod \"network-check-target-c9f2s\" (UID: \"97c82c64-748f-4a8d-b4e3-3111b7d31cdc\") " pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:49:43.337895 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301249 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-run-openvswitch\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.337895 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301279 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-os-release\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.337895 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301303 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-host-slash\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.337895 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301327 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-host-run-ovn-kubernetes\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.337895 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301351 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc2270c6-d609-45af-be97-86e77cae77fa-host\") pod \"node-ca-dxsz6\" (UID: \"cc2270c6-d609-45af-be97-86e77cae77fa\") " pod="openshift-image-registry/node-ca-dxsz6" Jul 16 21:49:43.337895 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301376 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-hostroot\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.337895 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301490 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-hostroot\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.337895 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301522 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-system-cni-dir\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.337895 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301522 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fc36f9ea-6173-4dd8-abd3-8845ef171c58-sys-fs\") pod \"aws-ebs-csi-driver-node-pxsnl\" (UID: \"fc36f9ea-6173-4dd8-abd3-8845ef171c58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" Jul 16 21:49:43.337895 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301585 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fc36f9ea-6173-4dd8-abd3-8845ef171c58-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pxsnl\" (UID: \"fc36f9ea-6173-4dd8-abd3-8845ef171c58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" Jul 16 21:49:43.337895 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301594 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fc36f9ea-6173-4dd8-abd3-8845ef171c58-etc-selinux\") pod \"aws-ebs-csi-driver-node-pxsnl\" (UID: \"fc36f9ea-6173-4dd8-abd3-8845ef171c58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" Jul 16 21:49:43.337895 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301700 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-etc-sysctl-d\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.337895 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301739 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-host-var-lib-cni-bin\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.337895 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301768 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-etc-systemd\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.337895 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301794 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-multus-cni-dir\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.392012 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301807 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-run\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.392012 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301849 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-host-run-multus-certs\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.392012 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301865 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-os-release\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.392012 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301907 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-multus-socket-dir-parent\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.392012 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301944 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-etc-sysconfig\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.392012 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.302096 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-etc-kubernetes\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.392012 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.302109 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cc8ca5f8-2879-4b67-9727-c032a94b137a-iptables-alerter-script\") pod \"iptables-alerter-c79zl\" (UID: \"cc8ca5f8-2879-4b67-9727-c032a94b137a\") " pod="openshift-network-operator/iptables-alerter-c79zl" Jul 16 21:49:43.392012 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.302174 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fc36f9ea-6173-4dd8-abd3-8845ef171c58-device-dir\") pod \"aws-ebs-csi-driver-node-pxsnl\" (UID: \"fc36f9ea-6173-4dd8-abd3-8845ef171c58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" Jul 16 21:49:43.392012 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.302164 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 16 21:49:43.392012 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.302231 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-host-run-k8s-cni-cncf-io\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.392012 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.301795 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc8ca5f8-2879-4b67-9727-c032a94b137a-host-slash\") pod \"iptables-alerter-c79zl\" (UID: \"cc8ca5f8-2879-4b67-9727-c032a94b137a\") " pod="openshift-network-operator/iptables-alerter-c79zl" Jul 16 21:49:43.392012 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.302455 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-lib-modules\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.392012 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.302530 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5f565fa4-5ca1-4074-8479-431dcf337f8d-etc-modprobe-d\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.392012 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.302703 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-cnibin\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.392012 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.302711 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/27c6b349-4c75-4068-b041-c79c6ab52fcc-multus-daemon-config\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.392012 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.302734 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-host-var-lib-kubelet\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.392012 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.302767 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27c6b349-4c75-4068-b041-c79c6ab52fcc-multus-conf-dir\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.392012 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:43.307294 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 21:49:43.392012 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:43.307315 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 21:49:43.393428 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:43.307327 2566 projected.go:196] Error preparing data for projected volume kube-api-access-9glrc for pod openshift-network-diagnostics/network-check-target-c9f2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:49:43.393428 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:43.307397 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97c82c64-748f-4a8d-b4e3-3111b7d31cdc-kube-api-access-9glrc podName:97c82c64-748f-4a8d-b4e3-3111b7d31cdc nodeName:}" failed. No retries permitted until 2026-07-16 21:49:43.807365947 +0000 UTC m=+3.042493090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9glrc" (UniqueName: "kubernetes.io/projected/97c82c64-748f-4a8d-b4e3-3111b7d31cdc-kube-api-access-9glrc") pod "network-check-target-c9f2s" (UID: "97c82c64-748f-4a8d-b4e3-3111b7d31cdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:49:43.393428 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.308357 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f565fa4-5ca1-4074-8479-431dcf337f8d-tmp\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.393428 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.308512 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5f565fa4-5ca1-4074-8479-431dcf337f8d-etc-tuned\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.393428 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.309410 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-177.ec2.internal" event={"ID":"26ecc05f6cb32b6cce46006257574c33","Type":"ContainerStarted","Data":"1f0806a5fd6641daa05732d3540e3a52e89a60b9e5a3ad8f4c20f6f884ca2096"} Jul 16 21:49:43.393428 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.311491 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-177.ec2.internal" event={"ID":"7de9d8a70964726f44a2fadad5252519","Type":"ContainerStarted","Data":"d35f0ab70181012108d1f41a1779d29331e864c1d8df82097a690fe042220064"} Jul 16 21:49:43.393428 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.311769 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g97f4\" (UniqueName: \"kubernetes.io/projected/27c6b349-4c75-4068-b041-c79c6ab52fcc-kube-api-access-g97f4\") pod \"multus-4vjsw\" (UID: \"27c6b349-4c75-4068-b041-c79c6ab52fcc\") " pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.393428 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.312297 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5k5h\" (UniqueName: \"kubernetes.io/projected/5f565fa4-5ca1-4074-8479-431dcf337f8d-kube-api-access-s5k5h\") pod \"tuned-26nvd\" (UID: \"5f565fa4-5ca1-4074-8479-431dcf337f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.393428 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.313987 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj27t\" (UniqueName: \"kubernetes.io/projected/cc8ca5f8-2879-4b67-9727-c032a94b137a-kube-api-access-lj27t\") pod \"iptables-alerter-c79zl\" (UID: \"cc8ca5f8-2879-4b67-9727-c032a94b137a\") " pod="openshift-network-operator/iptables-alerter-c79zl" Jul 16 21:49:43.393428 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.314192 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8lhz\" (UniqueName: \"kubernetes.io/projected/fc36f9ea-6173-4dd8-abd3-8845ef171c58-kube-api-access-f8lhz\") pod \"aws-ebs-csi-driver-node-pxsnl\" (UID: \"fc36f9ea-6173-4dd8-abd3-8845ef171c58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" Jul 16 21:49:43.393428 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.322288 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4vjsw" Jul 16 21:49:43.404921 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402054 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.404921 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402095 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/75c7e977-7b28-42d0-a6e6-0532f2932368-ovn-node-metrics-cert\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.404921 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402115 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3fd95e60-8961-41fc-a136-25b7b76fbc55-hosts-file\") pod \"node-resolver-t792r\" (UID: \"3fd95e60-8961-41fc-a136-25b7b76fbc55\") " pod="openshift-dns/node-resolver-t792r" Jul 16 21:49:43.404921 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402162 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83b40b54-0510-4714-b103-e35e3684f3a1-agent-certs\") pod \"konnectivity-agent-7kxg4\" (UID: \"83b40b54-0510-4714-b103-e35e3684f3a1\") " pod="kube-system/konnectivity-agent-7kxg4" Jul 16 21:49:43.404921 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402185 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbmmf\" (UniqueName: \"kubernetes.io/projected/4b90276c-b68f-49a9-b571-13174fb91f20-kube-api-access-gbmmf\") pod \"network-metrics-daemon-j7587\" (UID: \"4b90276c-b68f-49a9-b571-13174fb91f20\") " pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:49:43.404921 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402207 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-run-systemd\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.404921 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402226 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-var-lib-openvswitch\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.404921 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402246 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-host-cni-netd\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.404921 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402267 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/66c41459-8447-46fb-9701-03511287936d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n9km8\" (UID: \"66c41459-8447-46fb-9701-03511287936d\") " pod="openshift-multus/multus-additional-cni-plugins-n9km8" Jul 16 21:49:43.404921 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402288 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-host-cni-bin\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.404921 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402308 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4509b338-7e48-41c0-b1ef-fe88c6165229-dbus\") pod \"global-pull-secret-syncer-w9jn7\" (UID: \"4509b338-7e48-41c0-b1ef-fe88c6165229\") " pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:49:43.404921 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402328 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fd95e60-8961-41fc-a136-25b7b76fbc55-tmp-dir\") pod \"node-resolver-t792r\" (UID: \"3fd95e60-8961-41fc-a136-25b7b76fbc55\") " pod="openshift-dns/node-resolver-t792r" Jul 16 21:49:43.404921 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402348 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5q9n\" (UniqueName: \"kubernetes.io/projected/3fd95e60-8961-41fc-a136-25b7b76fbc55-kube-api-access-r5q9n\") pod \"node-resolver-t792r\" (UID: \"3fd95e60-8961-41fc-a136-25b7b76fbc55\") " pod="openshift-dns/node-resolver-t792r" Jul 16 21:49:43.404921 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402371 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grc6v\" (UniqueName: \"kubernetes.io/projected/75c7e977-7b28-42d0-a6e6-0532f2932368-kube-api-access-grc6v\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.404921 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402393 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/66c41459-8447-46fb-9701-03511287936d-cni-binary-copy\") pod \"multus-additional-cni-plugins-n9km8\" (UID: \"66c41459-8447-46fb-9701-03511287936d\") " pod="openshift-multus/multus-additional-cni-plugins-n9km8" Jul 16 21:49:43.404921 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402415 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/66c41459-8447-46fb-9701-03511287936d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n9km8\" (UID: \"66c41459-8447-46fb-9701-03511287936d\") " pod="openshift-multus/multus-additional-cni-plugins-n9km8" Jul 16 21:49:43.404921 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402451 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-host-kubelet\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.405776 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402471 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-systemd-units\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.405776 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402491 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/75c7e977-7b28-42d0-a6e6-0532f2932368-ovnkube-config\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.405776 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402524 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-log-socket\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.405776 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402552 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/75c7e977-7b28-42d0-a6e6-0532f2932368-ovnkube-script-lib\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.405776 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402575 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/66c41459-8447-46fb-9701-03511287936d-os-release\") pod \"multus-additional-cni-plugins-n9km8\" (UID: \"66c41459-8447-46fb-9701-03511287936d\") " pod="openshift-multus/multus-additional-cni-plugins-n9km8" Jul 16 21:49:43.405776 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402595 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/66c41459-8447-46fb-9701-03511287936d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n9km8\" (UID: \"66c41459-8447-46fb-9701-03511287936d\") " pod="openshift-multus/multus-additional-cni-plugins-n9km8" Jul 16 21:49:43.405776 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402621 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66c41459-8447-46fb-9701-03511287936d-system-cni-dir\") pod \"multus-additional-cni-plugins-n9km8\" (UID: \"66c41459-8447-46fb-9701-03511287936d\") " pod="openshift-multus/multus-additional-cni-plugins-n9km8" Jul 16 21:49:43.405776 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402641 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cc2270c6-d609-45af-be97-86e77cae77fa-serviceca\") pod \"node-ca-dxsz6\" (UID: \"cc2270c6-d609-45af-be97-86e77cae77fa\") " pod="openshift-image-registry/node-ca-dxsz6" Jul 16 21:49:43.405776 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402662 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-host-run-netns\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.405776 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402703 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-run-ovn\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.405776 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402726 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r75l\" (UniqueName: \"kubernetes.io/projected/66c41459-8447-46fb-9701-03511287936d-kube-api-access-2r75l\") pod \"multus-additional-cni-plugins-n9km8\" (UID: \"66c41459-8447-46fb-9701-03511287936d\") " pod="openshift-multus/multus-additional-cni-plugins-n9km8" Jul 16 21:49:43.405776 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402752 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qh6q\" (UniqueName: \"kubernetes.io/projected/cc2270c6-d609-45af-be97-86e77cae77fa-kube-api-access-4qh6q\") pod \"node-ca-dxsz6\" (UID: \"cc2270c6-d609-45af-be97-86e77cae77fa\") " pod="openshift-image-registry/node-ca-dxsz6" Jul 16 21:49:43.405776 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402791 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-run-openvswitch\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.405776 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402814 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-host-slash\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.405776 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402835 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-host-run-ovn-kubernetes\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.405776 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402856 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc2270c6-d609-45af-be97-86e77cae77fa-host\") pod \"node-ca-dxsz6\" (UID: \"cc2270c6-d609-45af-be97-86e77cae77fa\") " pod="openshift-image-registry/node-ca-dxsz6" Jul 16 21:49:43.408611 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.406809 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b90276c-b68f-49a9-b571-13174fb91f20-metrics-certs\") pod \"network-metrics-daemon-j7587\" (UID: \"4b90276c-b68f-49a9-b571-13174fb91f20\") " pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:49:43.408611 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.406838 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83b40b54-0510-4714-b103-e35e3684f3a1-konnectivity-ca\") pod \"konnectivity-agent-7kxg4\" (UID: \"83b40b54-0510-4714-b103-e35e3684f3a1\") " pod="kube-system/konnectivity-agent-7kxg4" Jul 16 21:49:43.408611 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.406860 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-etc-openvswitch\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.408611 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.406883 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/75c7e977-7b28-42d0-a6e6-0532f2932368-env-overrides\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.408611 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.406905 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4509b338-7e48-41c0-b1ef-fe88c6165229-original-pull-secret\") pod \"global-pull-secret-syncer-w9jn7\" (UID: \"4509b338-7e48-41c0-b1ef-fe88c6165229\") " pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:49:43.408611 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.406933 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-node-log\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.408611 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.406965 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4509b338-7e48-41c0-b1ef-fe88c6165229-kubelet-config\") pod \"global-pull-secret-syncer-w9jn7\" (UID: \"4509b338-7e48-41c0-b1ef-fe88c6165229\") " pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:49:43.408611 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.406988 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/66c41459-8447-46fb-9701-03511287936d-cnibin\") pod \"multus-additional-cni-plugins-n9km8\" (UID: \"66c41459-8447-46fb-9701-03511287936d\") " pod="openshift-multus/multus-additional-cni-plugins-n9km8" Jul 16 21:49:43.408611 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.403768 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-host-kubelet\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.408611 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.403800 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-systemd-units\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.408611 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.403988 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/66c41459-8447-46fb-9701-03511287936d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n9km8\" (UID: \"66c41459-8447-46fb-9701-03511287936d\") " pod="openshift-multus/multus-additional-cni-plugins-n9km8" Jul 16 21:49:43.408611 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.404069 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-host-run-netns\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.408611 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.404108 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66c41459-8447-46fb-9701-03511287936d-system-cni-dir\") pod \"multus-additional-cni-plugins-n9km8\" (UID: \"66c41459-8447-46fb-9701-03511287936d\") " pod="openshift-multus/multus-additional-cni-plugins-n9km8" Jul 16 21:49:43.408611 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.404260 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/75c7e977-7b28-42d0-a6e6-0532f2932368-ovnkube-config\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.408611 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.404414 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/75c7e977-7b28-42d0-a6e6-0532f2932368-ovnkube-script-lib\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.408611 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.404494 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/66c41459-8447-46fb-9701-03511287936d-os-release\") pod \"multus-additional-cni-plugins-n9km8\" (UID: \"66c41459-8447-46fb-9701-03511287936d\") " pod="openshift-multus/multus-additional-cni-plugins-n9km8" Jul 16 21:49:43.408611 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.404522 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.409505 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.404547 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cc2270c6-d609-45af-be97-86e77cae77fa-serviceca\") pod \"node-ca-dxsz6\" (UID: \"cc2270c6-d609-45af-be97-86e77cae77fa\") " pod="openshift-image-registry/node-ca-dxsz6" Jul 16 21:49:43.409505 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.404558 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-run-ovn\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.409505 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.404594 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-run-systemd\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.409505 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.404596 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-run-openvswitch\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.409505 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.404750 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-host-slash\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.409505 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.404793 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-host-run-ovn-kubernetes\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.409505 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.404844 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc2270c6-d609-45af-be97-86e77cae77fa-host\") pod \"node-ca-dxsz6\" (UID: \"cc2270c6-d609-45af-be97-86e77cae77fa\") " pod="openshift-image-registry/node-ca-dxsz6" Jul 16 21:49:43.409505 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.404857 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/66c41459-8447-46fb-9701-03511287936d-cni-binary-copy\") pod \"multus-additional-cni-plugins-n9km8\" (UID: \"66c41459-8447-46fb-9701-03511287936d\") " pod="openshift-multus/multus-additional-cni-plugins-n9km8" Jul 16 21:49:43.409505 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.404885 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-var-lib-openvswitch\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.409505 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.406757 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83b40b54-0510-4714-b103-e35e3684f3a1-agent-certs\") pod \"konnectivity-agent-7kxg4\" (UID: \"83b40b54-0510-4714-b103-e35e3684f3a1\") " pod="kube-system/konnectivity-agent-7kxg4" Jul 16 21:49:43.409505 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402930 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-host-cni-bin\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.409505 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:43.407299 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:49:43.409505 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:43.407349 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b90276c-b68f-49a9-b571-13174fb91f20-metrics-certs podName:4b90276c-b68f-49a9-b571-13174fb91f20 nodeName:}" failed. No retries permitted until 2026-07-16 21:49:43.907332956 +0000 UTC m=+3.142460095 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b90276c-b68f-49a9-b571-13174fb91f20-metrics-certs") pod "network-metrics-daemon-j7587" (UID: "4b90276c-b68f-49a9-b571-13174fb91f20") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:49:43.409505 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402936 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3fd95e60-8961-41fc-a136-25b7b76fbc55-hosts-file\") pod \"node-resolver-t792r\" (UID: \"3fd95e60-8961-41fc-a136-25b7b76fbc55\") " pod="openshift-dns/node-resolver-t792r" Jul 16 21:49:43.409505 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.407824 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83b40b54-0510-4714-b103-e35e3684f3a1-konnectivity-ca\") pod \"konnectivity-agent-7kxg4\" (UID: \"83b40b54-0510-4714-b103-e35e3684f3a1\") " pod="kube-system/konnectivity-agent-7kxg4" Jul 16 21:49:43.409505 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.402964 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-host-cni-netd\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.409505 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.407900 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-etc-openvswitch\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.409505 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.403018 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4509b338-7e48-41c0-b1ef-fe88c6165229-dbus\") pod \"global-pull-secret-syncer-w9jn7\" (UID: \"4509b338-7e48-41c0-b1ef-fe88c6165229\") " pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:49:43.410337 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.403551 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/66c41459-8447-46fb-9701-03511287936d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n9km8\" (UID: \"66c41459-8447-46fb-9701-03511287936d\") " pod="openshift-multus/multus-additional-cni-plugins-n9km8" Jul 16 21:49:43.410337 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.403285 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fd95e60-8961-41fc-a136-25b7b76fbc55-tmp-dir\") pod \"node-resolver-t792r\" (UID: \"3fd95e60-8961-41fc-a136-25b7b76fbc55\") " pod="openshift-dns/node-resolver-t792r" Jul 16 21:49:43.410337 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.408255 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/75c7e977-7b28-42d0-a6e6-0532f2932368-env-overrides\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.410337 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:43.408321 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 21:49:43.410337 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.408323 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4509b338-7e48-41c0-b1ef-fe88c6165229-kubelet-config\") pod \"global-pull-secret-syncer-w9jn7\" (UID: \"4509b338-7e48-41c0-b1ef-fe88c6165229\") " pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:49:43.410337 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.403732 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-log-socket\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.410337 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:43.408379 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4509b338-7e48-41c0-b1ef-fe88c6165229-original-pull-secret podName:4509b338-7e48-41c0-b1ef-fe88c6165229 nodeName:}" failed. No retries permitted until 2026-07-16 21:49:43.908362212 +0000 UTC m=+3.143489354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4509b338-7e48-41c0-b1ef-fe88c6165229-original-pull-secret") pod "global-pull-secret-syncer-w9jn7" (UID: "4509b338-7e48-41c0-b1ef-fe88c6165229") : object "kube-system"/"original-pull-secret" not registered Jul 16 21:49:43.410337 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.408380 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/66c41459-8447-46fb-9701-03511287936d-cnibin\") pod \"multus-additional-cni-plugins-n9km8\" (UID: \"66c41459-8447-46fb-9701-03511287936d\") " pod="openshift-multus/multus-additional-cni-plugins-n9km8" Jul 16 21:49:43.410337 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.403400 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/66c41459-8447-46fb-9701-03511287936d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n9km8\" (UID: \"66c41459-8447-46fb-9701-03511287936d\") " pod="openshift-multus/multus-additional-cni-plugins-n9km8" Jul 16 21:49:43.410337 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.408458 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/75c7e977-7b28-42d0-a6e6-0532f2932368-node-log\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.410337 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.409699 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/75c7e977-7b28-42d0-a6e6-0532f2932368-ovn-node-metrics-cert\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.416782 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.416557 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grc6v\" (UniqueName: \"kubernetes.io/projected/75c7e977-7b28-42d0-a6e6-0532f2932368-kube-api-access-grc6v\") pod \"ovnkube-node-hz2pt\" (UID: \"75c7e977-7b28-42d0-a6e6-0532f2932368\") " pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.416782 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.416666 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qh6q\" (UniqueName: \"kubernetes.io/projected/cc2270c6-d609-45af-be97-86e77cae77fa-kube-api-access-4qh6q\") pod \"node-ca-dxsz6\" (UID: \"cc2270c6-d609-45af-be97-86e77cae77fa\") " pod="openshift-image-registry/node-ca-dxsz6" Jul 16 21:49:43.416782 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.416701 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbmmf\" (UniqueName: \"kubernetes.io/projected/4b90276c-b68f-49a9-b571-13174fb91f20-kube-api-access-gbmmf\") pod \"network-metrics-daemon-j7587\" (UID: \"4b90276c-b68f-49a9-b571-13174fb91f20\") " pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:49:43.416992 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.416970 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r75l\" (UniqueName: \"kubernetes.io/projected/66c41459-8447-46fb-9701-03511287936d-kube-api-access-2r75l\") pod \"multus-additional-cni-plugins-n9km8\" (UID: \"66c41459-8447-46fb-9701-03511287936d\") " pod="openshift-multus/multus-additional-cni-plugins-n9km8" Jul 16 21:49:43.418170 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.418148 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5q9n\" (UniqueName: \"kubernetes.io/projected/3fd95e60-8961-41fc-a136-25b7b76fbc55-kube-api-access-r5q9n\") pod \"node-resolver-t792r\" (UID: \"3fd95e60-8961-41fc-a136-25b7b76fbc55\") " pod="openshift-dns/node-resolver-t792r" Jul 16 21:49:43.479360 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.479283 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-26nvd" Jul 16 21:49:43.486442 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.486214 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" Jul 16 21:49:43.494028 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:43.494004 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f565fa4_5ca1_4074_8479_431dcf337f8d.slice/crio-c5892a53a64a86b99ac867489a842888b8da9f44f8d28bf0282b530aca38f37c WatchSource:0}: Error finding container c5892a53a64a86b99ac867489a842888b8da9f44f8d28bf0282b530aca38f37c: Status 404 returned error can't find the container with id c5892a53a64a86b99ac867489a842888b8da9f44f8d28bf0282b530aca38f37c Jul 16 21:49:43.496720 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:43.496687 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc36f9ea_6173_4dd8_abd3_8845ef171c58.slice/crio-076fb5dbded28a2310caa82b9b1673e1ab021bceb87d6a271c90d45bddedda92 WatchSource:0}: Error finding container 076fb5dbded28a2310caa82b9b1673e1ab021bceb87d6a271c90d45bddedda92: Status 404 returned error can't find the container with id 076fb5dbded28a2310caa82b9b1673e1ab021bceb87d6a271c90d45bddedda92 Jul 16 21:49:43.501750 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.501721 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c79zl" Jul 16 21:49:43.511319 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:43.511295 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc8ca5f8_2879_4b67_9727_c032a94b137a.slice/crio-d5a44597091963f75810816d16af18c8e5369b71e5ebd4bf19e0c2d60e9f9b7b WatchSource:0}: Error finding container d5a44597091963f75810816d16af18c8e5369b71e5ebd4bf19e0c2d60e9f9b7b: Status 404 returned error can't find the container with id d5a44597091963f75810816d16af18c8e5369b71e5ebd4bf19e0c2d60e9f9b7b Jul 16 21:49:43.655269 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.655234 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n9km8" Jul 16 21:49:43.666564 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.666534 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7kxg4" Jul 16 21:49:43.678774 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.678722 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:49:43.683282 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.683159 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 21:49:43.687119 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.687100 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t792r" Jul 16 21:49:43.693550 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.693530 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dxsz6" Jul 16 21:49:43.808810 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.808720 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9glrc\" (UniqueName: \"kubernetes.io/projected/97c82c64-748f-4a8d-b4e3-3111b7d31cdc-kube-api-access-9glrc\") pod \"network-check-target-c9f2s\" (UID: \"97c82c64-748f-4a8d-b4e3-3111b7d31cdc\") " pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:49:43.808950 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:43.808857 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 21:49:43.808950 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:43.808881 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 21:49:43.808950 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:43.808891 2566 projected.go:196] Error preparing data for projected volume kube-api-access-9glrc for pod openshift-network-diagnostics/network-check-target-c9f2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:49:43.808950 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:43.808941 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97c82c64-748f-4a8d-b4e3-3111b7d31cdc-kube-api-access-9glrc podName:97c82c64-748f-4a8d-b4e3-3111b7d31cdc nodeName:}" failed. No retries permitted until 2026-07-16 21:49:44.808925465 +0000 UTC m=+4.044052620 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9glrc" (UniqueName: "kubernetes.io/projected/97c82c64-748f-4a8d-b4e3-3111b7d31cdc-kube-api-access-9glrc") pod "network-check-target-c9f2s" (UID: "97c82c64-748f-4a8d-b4e3-3111b7d31cdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:49:43.909698 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.909663 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b90276c-b68f-49a9-b571-13174fb91f20-metrics-certs\") pod \"network-metrics-daemon-j7587\" (UID: \"4b90276c-b68f-49a9-b571-13174fb91f20\") " pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:49:43.909937 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:43.909705 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4509b338-7e48-41c0-b1ef-fe88c6165229-original-pull-secret\") pod \"global-pull-secret-syncer-w9jn7\" (UID: \"4509b338-7e48-41c0-b1ef-fe88c6165229\") " pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:49:43.909937 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:43.909813 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 21:49:43.909937 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:43.909877 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4509b338-7e48-41c0-b1ef-fe88c6165229-original-pull-secret podName:4509b338-7e48-41c0-b1ef-fe88c6165229 nodeName:}" failed. No retries permitted until 2026-07-16 21:49:44.909858009 +0000 UTC m=+4.144985149 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4509b338-7e48-41c0-b1ef-fe88c6165229-original-pull-secret") pod "global-pull-secret-syncer-w9jn7" (UID: "4509b338-7e48-41c0-b1ef-fe88c6165229") : object "kube-system"/"original-pull-secret" not registered Jul 16 21:49:43.909937 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:43.909815 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:49:43.910149 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:43.909967 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b90276c-b68f-49a9-b571-13174fb91f20-metrics-certs podName:4b90276c-b68f-49a9-b571-13174fb91f20 nodeName:}" failed. No retries permitted until 2026-07-16 21:49:44.909949436 +0000 UTC m=+4.145076579 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b90276c-b68f-49a9-b571-13174fb91f20-metrics-certs") pod "network-metrics-daemon-j7587" (UID: "4b90276c-b68f-49a9-b571-13174fb91f20") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:49:44.221752 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:44.221666 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 21:44:43 +0000 UTC" deadline="2028-03-08 21:39:18.219386247 +0000 UTC" Jul 16 21:49:44.221752 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:44.221697 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14423h49m33.997692885s" Jul 16 21:49:44.314133 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:44.314095 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" event={"ID":"fc36f9ea-6173-4dd8-abd3-8845ef171c58","Type":"ContainerStarted","Data":"076fb5dbded28a2310caa82b9b1673e1ab021bceb87d6a271c90d45bddedda92"} Jul 16 21:49:44.315138 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:44.315110 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-26nvd" event={"ID":"5f565fa4-5ca1-4074-8479-431dcf337f8d","Type":"ContainerStarted","Data":"c5892a53a64a86b99ac867489a842888b8da9f44f8d28bf0282b530aca38f37c"} Jul 16 21:49:44.316144 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:44.316126 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4vjsw" event={"ID":"27c6b349-4c75-4068-b041-c79c6ab52fcc","Type":"ContainerStarted","Data":"f592dde9947f82a95e9338705c3a1c51a35820229c3b69641074fe3db349320a"} Jul 16 21:49:44.317136 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:44.317115 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c79zl" event={"ID":"cc8ca5f8-2879-4b67-9727-c032a94b137a","Type":"ContainerStarted","Data":"d5a44597091963f75810816d16af18c8e5369b71e5ebd4bf19e0c2d60e9f9b7b"} Jul 16 21:49:44.816508 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:44.816478 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9glrc\" (UniqueName: \"kubernetes.io/projected/97c82c64-748f-4a8d-b4e3-3111b7d31cdc-kube-api-access-9glrc\") pod \"network-check-target-c9f2s\" (UID: \"97c82c64-748f-4a8d-b4e3-3111b7d31cdc\") " pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:49:44.817117 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:44.816655 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 21:49:44.817117 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:44.816676 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 21:49:44.817117 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:44.816688 2566 projected.go:196] Error preparing data for projected volume kube-api-access-9glrc for pod openshift-network-diagnostics/network-check-target-c9f2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:49:44.817117 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:44.816743 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97c82c64-748f-4a8d-b4e3-3111b7d31cdc-kube-api-access-9glrc podName:97c82c64-748f-4a8d-b4e3-3111b7d31cdc nodeName:}" failed. No retries permitted until 2026-07-16 21:49:46.816724918 +0000 UTC m=+6.051852060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9glrc" (UniqueName: "kubernetes.io/projected/97c82c64-748f-4a8d-b4e3-3111b7d31cdc-kube-api-access-9glrc") pod "network-check-target-c9f2s" (UID: "97c82c64-748f-4a8d-b4e3-3111b7d31cdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:49:44.830680 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:44.830643 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75c7e977_7b28_42d0_a6e6_0532f2932368.slice/crio-36e7959af7eeb9f9cba49a8521bcb62113ed646becfd308b1c3cd44e1fec652d WatchSource:0}: Error finding container 36e7959af7eeb9f9cba49a8521bcb62113ed646becfd308b1c3cd44e1fec652d: Status 404 returned error can't find the container with id 36e7959af7eeb9f9cba49a8521bcb62113ed646becfd308b1c3cd44e1fec652d Jul 16 21:49:44.839832 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:44.839804 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66c41459_8447_46fb_9701_03511287936d.slice/crio-0df4ba184e65d7c67177b85ebe84aa767d22afe4c61b85850ca10598e85ec304 WatchSource:0}: Error finding container 0df4ba184e65d7c67177b85ebe84aa767d22afe4c61b85850ca10598e85ec304: Status 404 returned error can't find the container with id 0df4ba184e65d7c67177b85ebe84aa767d22afe4c61b85850ca10598e85ec304 Jul 16 21:49:44.842899 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:49:44.842871 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83b40b54_0510_4714_b103_e35e3684f3a1.slice/crio-282e1270a6032ce6639972d5dc249ead0d2ed43eafa82abd244753fdefd1cc10 WatchSource:0}: Error finding container 282e1270a6032ce6639972d5dc249ead0d2ed43eafa82abd244753fdefd1cc10: Status 404 returned error can't find the container with id 282e1270a6032ce6639972d5dc249ead0d2ed43eafa82abd244753fdefd1cc10 Jul 16 21:49:44.918360 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:44.917814 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b90276c-b68f-49a9-b571-13174fb91f20-metrics-certs\") pod \"network-metrics-daemon-j7587\" (UID: \"4b90276c-b68f-49a9-b571-13174fb91f20\") " pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:49:44.918360 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:44.917856 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4509b338-7e48-41c0-b1ef-fe88c6165229-original-pull-secret\") pod \"global-pull-secret-syncer-w9jn7\" (UID: \"4509b338-7e48-41c0-b1ef-fe88c6165229\") " pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:49:44.918360 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:44.917983 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 21:49:44.918360 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:44.918043 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4509b338-7e48-41c0-b1ef-fe88c6165229-original-pull-secret podName:4509b338-7e48-41c0-b1ef-fe88c6165229 nodeName:}" failed. No retries permitted until 2026-07-16 21:49:46.918021874 +0000 UTC m=+6.153149015 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4509b338-7e48-41c0-b1ef-fe88c6165229-original-pull-secret") pod "global-pull-secret-syncer-w9jn7" (UID: "4509b338-7e48-41c0-b1ef-fe88c6165229") : object "kube-system"/"original-pull-secret" not registered Jul 16 21:49:44.918696 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:44.918374 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:49:44.918696 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:44.918447 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b90276c-b68f-49a9-b571-13174fb91f20-metrics-certs podName:4b90276c-b68f-49a9-b571-13174fb91f20 nodeName:}" failed. No retries permitted until 2026-07-16 21:49:46.918410897 +0000 UTC m=+6.153538040 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b90276c-b68f-49a9-b571-13174fb91f20-metrics-certs") pod "network-metrics-daemon-j7587" (UID: "4b90276c-b68f-49a9-b571-13174fb91f20") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:49:45.223009 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:45.222757 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 21:44:43 +0000 UTC" deadline="2028-01-10 10:06:18.518150284 +0000 UTC" Jul 16 21:49:45.223128 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:45.223015 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13020h16m33.295142729s" Jul 16 21:49:45.306684 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:45.306653 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:49:45.306839 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:45.306781 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9f2s" podUID="97c82c64-748f-4a8d-b4e3-3111b7d31cdc" Jul 16 21:49:45.307208 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:45.307185 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:49:45.307325 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:45.307304 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7587" podUID="4b90276c-b68f-49a9-b571-13174fb91f20" Jul 16 21:49:45.307389 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:45.307376 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:49:45.307492 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:45.307472 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jn7" podUID="4509b338-7e48-41c0-b1ef-fe88c6165229" Jul 16 21:49:45.322903 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:45.322868 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-177.ec2.internal" event={"ID":"7de9d8a70964726f44a2fadad5252519","Type":"ContainerStarted","Data":"ec773c03a462509b143c66394397733ea18468caccd366d15f6b69b9a376c13a"} Jul 16 21:49:45.324455 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:45.324344 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" event={"ID":"75c7e977-7b28-42d0-a6e6-0532f2932368","Type":"ContainerStarted","Data":"36e7959af7eeb9f9cba49a8521bcb62113ed646becfd308b1c3cd44e1fec652d"} Jul 16 21:49:45.325979 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:45.325919 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t792r" event={"ID":"3fd95e60-8961-41fc-a136-25b7b76fbc55","Type":"ContainerStarted","Data":"82c4b674984eb31a2aebb658ed7ca050468be2cd33eb9921ad7295b0f3782be0"} Jul 16 21:49:45.329746 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:45.329710 2566 generic.go:356] "Generic (PLEG): container finished" podID="26ecc05f6cb32b6cce46006257574c33" containerID="c8ff0d0ccfe30c1e3a93a2d9d62aaed3645e3d76e41a9a663ad1f7688de2c42b" exitCode=0 Jul 16 21:49:45.329842 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:45.329780 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-177.ec2.internal" event={"ID":"26ecc05f6cb32b6cce46006257574c33","Type":"ContainerDied","Data":"c8ff0d0ccfe30c1e3a93a2d9d62aaed3645e3d76e41a9a663ad1f7688de2c42b"} Jul 16 21:49:45.331851 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:45.331743 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7kxg4" event={"ID":"83b40b54-0510-4714-b103-e35e3684f3a1","Type":"ContainerStarted","Data":"282e1270a6032ce6639972d5dc249ead0d2ed43eafa82abd244753fdefd1cc10"} Jul 16 21:49:45.333217 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:45.333155 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dxsz6" event={"ID":"cc2270c6-d609-45af-be97-86e77cae77fa","Type":"ContainerStarted","Data":"db5f73266036cd8e3ff3daf45904b46723fa1017d288b7487cabcaa6fff25b79"} Jul 16 21:49:45.337019 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:45.336959 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n9km8" event={"ID":"66c41459-8447-46fb-9701-03511287936d","Type":"ContainerStarted","Data":"0df4ba184e65d7c67177b85ebe84aa767d22afe4c61b85850ca10598e85ec304"} Jul 16 21:49:45.355378 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:45.355326 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-177.ec2.internal" podStartSLOduration=3.355305687 podStartE2EDuration="3.355305687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:49:45.338968884 +0000 UTC m=+4.574096045" watchObservedRunningTime="2026-07-16 21:49:45.355305687 +0000 UTC m=+4.590432848" Jul 16 21:49:46.356192 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:46.356158 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-177.ec2.internal" event={"ID":"26ecc05f6cb32b6cce46006257574c33","Type":"ContainerStarted","Data":"8ad10c16c2302d5e880af4f6ebc965e56d191149fff5ab1bc01a9ed60b79c626"} Jul 16 21:49:46.836255 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:46.836114 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9glrc\" (UniqueName: \"kubernetes.io/projected/97c82c64-748f-4a8d-b4e3-3111b7d31cdc-kube-api-access-9glrc\") pod \"network-check-target-c9f2s\" (UID: \"97c82c64-748f-4a8d-b4e3-3111b7d31cdc\") " pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:49:46.836451 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:46.836267 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 21:49:46.836451 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:46.836287 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 21:49:46.836451 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:46.836299 2566 projected.go:196] Error preparing data for projected volume kube-api-access-9glrc for pod openshift-network-diagnostics/network-check-target-c9f2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:49:46.836451 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:46.836364 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97c82c64-748f-4a8d-b4e3-3111b7d31cdc-kube-api-access-9glrc podName:97c82c64-748f-4a8d-b4e3-3111b7d31cdc nodeName:}" failed. No retries permitted until 2026-07-16 21:49:50.836346803 +0000 UTC m=+10.071473959 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9glrc" (UniqueName: "kubernetes.io/projected/97c82c64-748f-4a8d-b4e3-3111b7d31cdc-kube-api-access-9glrc") pod "network-check-target-c9f2s" (UID: "97c82c64-748f-4a8d-b4e3-3111b7d31cdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:49:46.938041 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:46.937331 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b90276c-b68f-49a9-b571-13174fb91f20-metrics-certs\") pod \"network-metrics-daemon-j7587\" (UID: \"4b90276c-b68f-49a9-b571-13174fb91f20\") " pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:49:46.938041 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:46.937375 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4509b338-7e48-41c0-b1ef-fe88c6165229-original-pull-secret\") pod \"global-pull-secret-syncer-w9jn7\" (UID: \"4509b338-7e48-41c0-b1ef-fe88c6165229\") " pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:49:46.938041 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:46.937522 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 21:49:46.938041 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:46.937579 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4509b338-7e48-41c0-b1ef-fe88c6165229-original-pull-secret podName:4509b338-7e48-41c0-b1ef-fe88c6165229 nodeName:}" failed. No retries permitted until 2026-07-16 21:49:50.937562028 +0000 UTC m=+10.172689170 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4509b338-7e48-41c0-b1ef-fe88c6165229-original-pull-secret") pod "global-pull-secret-syncer-w9jn7" (UID: "4509b338-7e48-41c0-b1ef-fe88c6165229") : object "kube-system"/"original-pull-secret" not registered Jul 16 21:49:46.938041 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:46.937960 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:49:46.938041 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:46.938008 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b90276c-b68f-49a9-b571-13174fb91f20-metrics-certs podName:4b90276c-b68f-49a9-b571-13174fb91f20 nodeName:}" failed. No retries permitted until 2026-07-16 21:49:50.937993589 +0000 UTC m=+10.173120730 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b90276c-b68f-49a9-b571-13174fb91f20-metrics-certs") pod "network-metrics-daemon-j7587" (UID: "4b90276c-b68f-49a9-b571-13174fb91f20") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:49:47.304559 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:47.304523 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:49:47.304719 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:47.304651 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7587" podUID="4b90276c-b68f-49a9-b571-13174fb91f20" Jul 16 21:49:47.305676 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:47.305041 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:49:47.305676 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:47.305138 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jn7" podUID="4509b338-7e48-41c0-b1ef-fe88c6165229" Jul 16 21:49:47.305676 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:47.305264 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:49:47.305676 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:47.305351 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9f2s" podUID="97c82c64-748f-4a8d-b4e3-3111b7d31cdc" Jul 16 21:49:49.303102 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:49.303065 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:49:49.303102 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:49.303106 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:49:49.303585 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:49.303065 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:49:49.303585 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:49.303197 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jn7" podUID="4509b338-7e48-41c0-b1ef-fe88c6165229" Jul 16 21:49:49.303585 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:49.303268 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7587" podUID="4b90276c-b68f-49a9-b571-13174fb91f20" Jul 16 21:49:49.303585 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:49.303332 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9f2s" podUID="97c82c64-748f-4a8d-b4e3-3111b7d31cdc" Jul 16 21:49:50.873120 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:50.873079 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9glrc\" (UniqueName: \"kubernetes.io/projected/97c82c64-748f-4a8d-b4e3-3111b7d31cdc-kube-api-access-9glrc\") pod \"network-check-target-c9f2s\" (UID: \"97c82c64-748f-4a8d-b4e3-3111b7d31cdc\") " pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:49:50.873594 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:50.873237 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 21:49:50.873594 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:50.873270 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 21:49:50.873594 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:50.873285 2566 projected.go:196] Error preparing data for projected volume kube-api-access-9glrc for pod openshift-network-diagnostics/network-check-target-c9f2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:49:50.873594 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:50.873353 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97c82c64-748f-4a8d-b4e3-3111b7d31cdc-kube-api-access-9glrc podName:97c82c64-748f-4a8d-b4e3-3111b7d31cdc nodeName:}" failed. No retries permitted until 2026-07-16 21:49:58.873334054 +0000 UTC m=+18.108461212 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9glrc" (UniqueName: "kubernetes.io/projected/97c82c64-748f-4a8d-b4e3-3111b7d31cdc-kube-api-access-9glrc") pod "network-check-target-c9f2s" (UID: "97c82c64-748f-4a8d-b4e3-3111b7d31cdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:49:50.974467 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:50.974237 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b90276c-b68f-49a9-b571-13174fb91f20-metrics-certs\") pod \"network-metrics-daemon-j7587\" (UID: \"4b90276c-b68f-49a9-b571-13174fb91f20\") " pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:49:50.974467 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:50.974288 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4509b338-7e48-41c0-b1ef-fe88c6165229-original-pull-secret\") pod \"global-pull-secret-syncer-w9jn7\" (UID: \"4509b338-7e48-41c0-b1ef-fe88c6165229\") " pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:49:50.974467 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:50.974409 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 21:49:50.974752 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:50.974499 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4509b338-7e48-41c0-b1ef-fe88c6165229-original-pull-secret podName:4509b338-7e48-41c0-b1ef-fe88c6165229 nodeName:}" failed. No retries permitted until 2026-07-16 21:49:58.974479904 +0000 UTC m=+18.209607041 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4509b338-7e48-41c0-b1ef-fe88c6165229-original-pull-secret") pod "global-pull-secret-syncer-w9jn7" (UID: "4509b338-7e48-41c0-b1ef-fe88c6165229") : object "kube-system"/"original-pull-secret" not registered Jul 16 21:49:50.974752 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:50.974409 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:49:50.974752 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:50.974591 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b90276c-b68f-49a9-b571-13174fb91f20-metrics-certs podName:4b90276c-b68f-49a9-b571-13174fb91f20 nodeName:}" failed. No retries permitted until 2026-07-16 21:49:58.974568694 +0000 UTC m=+18.209695846 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b90276c-b68f-49a9-b571-13174fb91f20-metrics-certs") pod "network-metrics-daemon-j7587" (UID: "4b90276c-b68f-49a9-b571-13174fb91f20") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:49:51.303999 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:51.303939 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:49:51.304170 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:51.304039 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9f2s" podUID="97c82c64-748f-4a8d-b4e3-3111b7d31cdc" Jul 16 21:49:51.304170 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:51.304113 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:49:51.304285 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:51.304254 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7587" podUID="4b90276c-b68f-49a9-b571-13174fb91f20" Jul 16 21:49:51.304339 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:51.304301 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:49:51.304396 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:51.304369 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jn7" podUID="4509b338-7e48-41c0-b1ef-fe88c6165229" Jul 16 21:49:53.303959 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:53.303438 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:49:53.303959 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:53.303586 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7587" podUID="4b90276c-b68f-49a9-b571-13174fb91f20" Jul 16 21:49:53.303959 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:53.303793 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:49:53.303959 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:53.303899 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jn7" podUID="4509b338-7e48-41c0-b1ef-fe88c6165229" Jul 16 21:49:53.303959 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:53.303958 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:49:53.304658 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:53.304015 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9f2s" podUID="97c82c64-748f-4a8d-b4e3-3111b7d31cdc" Jul 16 21:49:55.304011 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:55.303975 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:49:55.304497 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:55.303976 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:49:55.304497 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:55.304105 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jn7" podUID="4509b338-7e48-41c0-b1ef-fe88c6165229" Jul 16 21:49:55.304497 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:55.304219 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9f2s" podUID="97c82c64-748f-4a8d-b4e3-3111b7d31cdc" Jul 16 21:49:55.304497 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:55.304231 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:49:55.304497 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:55.304324 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7587" podUID="4b90276c-b68f-49a9-b571-13174fb91f20" Jul 16 21:49:57.303150 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:57.303116 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:49:57.303622 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:57.303117 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:49:57.303622 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:57.303252 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7587" podUID="4b90276c-b68f-49a9-b571-13174fb91f20" Jul 16 21:49:57.303622 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:57.303259 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:49:57.303622 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:57.303313 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9f2s" podUID="97c82c64-748f-4a8d-b4e3-3111b7d31cdc" Jul 16 21:49:57.303622 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:57.303400 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jn7" podUID="4509b338-7e48-41c0-b1ef-fe88c6165229" Jul 16 21:49:58.935608 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:58.935565 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9glrc\" (UniqueName: \"kubernetes.io/projected/97c82c64-748f-4a8d-b4e3-3111b7d31cdc-kube-api-access-9glrc\") pod \"network-check-target-c9f2s\" (UID: \"97c82c64-748f-4a8d-b4e3-3111b7d31cdc\") " pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:49:58.936112 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:58.935699 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 21:49:58.936112 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:58.935730 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 21:49:58.936112 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:58.935744 2566 projected.go:196] Error preparing data for projected volume kube-api-access-9glrc for pod openshift-network-diagnostics/network-check-target-c9f2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:49:58.936112 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:58.935805 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97c82c64-748f-4a8d-b4e3-3111b7d31cdc-kube-api-access-9glrc podName:97c82c64-748f-4a8d-b4e3-3111b7d31cdc nodeName:}" failed. No retries permitted until 2026-07-16 21:50:14.935789886 +0000 UTC m=+34.170917028 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9glrc" (UniqueName: "kubernetes.io/projected/97c82c64-748f-4a8d-b4e3-3111b7d31cdc-kube-api-access-9glrc") pod "network-check-target-c9f2s" (UID: "97c82c64-748f-4a8d-b4e3-3111b7d31cdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:49:59.036520 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:59.036476 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b90276c-b68f-49a9-b571-13174fb91f20-metrics-certs\") pod \"network-metrics-daemon-j7587\" (UID: \"4b90276c-b68f-49a9-b571-13174fb91f20\") " pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:49:59.036520 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:59.036526 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4509b338-7e48-41c0-b1ef-fe88c6165229-original-pull-secret\") pod \"global-pull-secret-syncer-w9jn7\" (UID: \"4509b338-7e48-41c0-b1ef-fe88c6165229\") " pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:49:59.036735 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:59.036647 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:49:59.036735 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:59.036715 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 21:49:59.036735 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:59.036727 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b90276c-b68f-49a9-b571-13174fb91f20-metrics-certs podName:4b90276c-b68f-49a9-b571-13174fb91f20 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:15.036710428 +0000 UTC m=+34.271837567 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b90276c-b68f-49a9-b571-13174fb91f20-metrics-certs") pod "network-metrics-daemon-j7587" (UID: "4b90276c-b68f-49a9-b571-13174fb91f20") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:49:59.036886 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:59.036770 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4509b338-7e48-41c0-b1ef-fe88c6165229-original-pull-secret podName:4509b338-7e48-41c0-b1ef-fe88c6165229 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:15.036753687 +0000 UTC m=+34.271880841 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4509b338-7e48-41c0-b1ef-fe88c6165229-original-pull-secret") pod "global-pull-secret-syncer-w9jn7" (UID: "4509b338-7e48-41c0-b1ef-fe88c6165229") : object "kube-system"/"original-pull-secret" not registered Jul 16 21:49:59.304015 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:59.303978 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:49:59.304179 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:59.303987 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:49:59.304179 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:59.304108 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9f2s" podUID="97c82c64-748f-4a8d-b4e3-3111b7d31cdc" Jul 16 21:49:59.304179 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:49:59.303987 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:49:59.304329 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:59.304197 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7587" podUID="4b90276c-b68f-49a9-b571-13174fb91f20" Jul 16 21:49:59.304329 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:49:59.304261 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jn7" podUID="4509b338-7e48-41c0-b1ef-fe88c6165229" Jul 16 21:50:01.304465 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:01.304406 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:50:01.304465 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:01.304466 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:50:01.305018 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:01.304439 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:50:01.305018 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:01.304583 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7587" podUID="4b90276c-b68f-49a9-b571-13174fb91f20" Jul 16 21:50:01.305018 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:01.304714 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9f2s" podUID="97c82c64-748f-4a8d-b4e3-3111b7d31cdc" Jul 16 21:50:01.305018 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:01.304813 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jn7" podUID="4509b338-7e48-41c0-b1ef-fe88c6165229" Jul 16 21:50:03.303840 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:03.303625 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:50:03.304305 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:03.303625 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:50:03.304305 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:03.303934 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jn7" podUID="4509b338-7e48-41c0-b1ef-fe88c6165229" Jul 16 21:50:03.304305 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:03.304025 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9f2s" podUID="97c82c64-748f-4a8d-b4e3-3111b7d31cdc" Jul 16 21:50:03.304305 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:03.303672 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:50:03.304305 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:03.304138 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7587" podUID="4b90276c-b68f-49a9-b571-13174fb91f20" Jul 16 21:50:03.390842 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:03.390804 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t792r" event={"ID":"3fd95e60-8961-41fc-a136-25b7b76fbc55","Type":"ContainerStarted","Data":"59989adffc5fc76a4f9b9b923bb57a7e5d88f6ced722caef515daa3afff9fa37"} Jul 16 21:50:03.392145 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:03.392120 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4vjsw" event={"ID":"27c6b349-4c75-4068-b041-c79c6ab52fcc","Type":"ContainerStarted","Data":"3babfa2759c174d7f9d1514ed78311940f285cb8be6b6811cf600737d52b16cf"} Jul 16 21:50:03.393435 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:03.393393 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7kxg4" event={"ID":"83b40b54-0510-4714-b103-e35e3684f3a1","Type":"ContainerStarted","Data":"444dc1d01cf0034c2880bdf497970569c6bcfac7e74f29166aa215b5fa996942"} Jul 16 21:50:03.394759 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:03.394736 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dxsz6" event={"ID":"cc2270c6-d609-45af-be97-86e77cae77fa","Type":"ContainerStarted","Data":"9d2796a1d6fbf49b7cdb59a607bab8e83a8faa68adb84986598126acb88fc43b"} Jul 16 21:50:03.396168 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:03.396145 2566 generic.go:356] "Generic (PLEG): container finished" podID="66c41459-8447-46fb-9701-03511287936d" containerID="9f5f65b318ee8ceb11576f11ea4c111ed27b9ad227a3f6cbcf38f210a7894a16" exitCode=0 Jul 16 21:50:03.396279 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:03.396221 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n9km8" event={"ID":"66c41459-8447-46fb-9701-03511287936d","Type":"ContainerDied","Data":"9f5f65b318ee8ceb11576f11ea4c111ed27b9ad227a3f6cbcf38f210a7894a16"} Jul 16 21:50:03.397652 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:03.397627 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" event={"ID":"fc36f9ea-6173-4dd8-abd3-8845ef171c58","Type":"ContainerStarted","Data":"e039396112e81c6aaade19c3e9ba18ed700f9b0fb44477a2c9e53e7f93ddede8"} Jul 16 21:50:03.398906 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:03.398886 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-26nvd" event={"ID":"5f565fa4-5ca1-4074-8479-431dcf337f8d","Type":"ContainerStarted","Data":"3b7d384ce36bf273afcddac89bdfca7ff2d51b9c98c4f5c25844240b8fbe4639"} Jul 16 21:50:03.411768 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:03.411731 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-t792r" podStartSLOduration=4.424201357 podStartE2EDuration="22.411720232s" totalImagesPullingTime="17.987518875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:03.411510915 +0000 UTC m=+22.646638085" watchObservedRunningTime="2026-07-16 21:50:03.411720232 +0000 UTC m=+22.646847394" Jul 16 21:50:03.412025 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:03.412003 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-177.ec2.internal" podStartSLOduration=21.411996065 podStartE2EDuration="21.411996065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:49:46.375204803 +0000 UTC m=+5.610331964" watchObservedRunningTime="2026-07-16 21:50:03.411996065 +0000 UTC m=+22.647123225" Jul 16 21:50:03.433572 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:03.433528 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dxsz6" podStartSLOduration=4.458119014 podStartE2EDuration="22.433517307s" totalImagesPullingTime="17.975398293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:03.43326551 +0000 UTC m=+22.668392671" watchObservedRunningTime="2026-07-16 21:50:03.433517307 +0000 UTC m=+22.668644513" Jul 16 21:50:03.455699 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:03.455653 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4vjsw" podStartSLOduration=2.95605407 podStartE2EDuration="22.455640182s" totalImagesPullingTime="19.499586112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:03.454555564 +0000 UTC m=+22.689682724" watchObservedRunningTime="2026-07-16 21:50:03.455640182 +0000 UTC m=+22.690767342" Jul 16 21:50:03.493997 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:03.493947 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-26nvd" podStartSLOduration=3.174082297 podStartE2EDuration="22.493930551s" totalImagesPullingTime="19.319848254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:03.493367712 +0000 UTC m=+22.728494872" watchObservedRunningTime="2026-07-16 21:50:03.493930551 +0000 UTC m=+22.729057748" Jul 16 21:50:03.608189 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:03.608095 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7kxg4" podStartSLOduration=4.637670699 podStartE2EDuration="22.608078631s" totalImagesPullingTime="17.970407932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:49:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:03.60794561 +0000 UTC m=+22.843072761" watchObservedRunningTime="2026-07-16 21:50:03.608078631 +0000 UTC m=+22.843205796" Jul 16 21:50:04.389353 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:04.389199 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 16 21:50:04.402213 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:04.402181 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c79zl" event={"ID":"cc8ca5f8-2879-4b67-9727-c032a94b137a","Type":"ContainerStarted","Data":"e8af1e2be7b75359baec90ec56cb88ac0b982dd8be0d31dfebc7bf980156b0a3"} Jul 16 21:50:04.404131 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:04.404103 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" event={"ID":"fc36f9ea-6173-4dd8-abd3-8845ef171c58","Type":"ContainerStarted","Data":"11dafa549bc1f809c2c0230b02c746cd2fe06346c3d6ab5efb3f7eb4f1d60388"} Jul 16 21:50:04.410018 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:04.409948 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hz2pt_75c7e977-7b28-42d0-a6e6-0532f2932368/ovn-acl-logging/0.log" Jul 16 21:50:04.410456 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:04.410399 2566 generic.go:356] "Generic (PLEG): container finished" podID="75c7e977-7b28-42d0-a6e6-0532f2932368" containerID="812778c35cada033a89a91d3f365ad8cfa1db4c8da00a22b4a2a7eae2179f6e4" exitCode=1 Jul 16 21:50:04.410604 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:04.410578 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" event={"ID":"75c7e977-7b28-42d0-a6e6-0532f2932368","Type":"ContainerStarted","Data":"759620c1af2cdc5838409045e5a713ed3079c1f915267077968d91eecc5c8d7a"} Jul 16 21:50:04.410709 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:04.410688 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" event={"ID":"75c7e977-7b28-42d0-a6e6-0532f2932368","Type":"ContainerDied","Data":"812778c35cada033a89a91d3f365ad8cfa1db4c8da00a22b4a2a7eae2179f6e4"} Jul 16 21:50:04.410822 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:04.410750 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" event={"ID":"75c7e977-7b28-42d0-a6e6-0532f2932368","Type":"ContainerStarted","Data":"f2a8fcef0f351c9d76a77967a986b668eb8f8fdcafb216f2606337bdfa81d85a"} Jul 16 21:50:04.421363 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:04.421315 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c79zl" podStartSLOduration=8.663001465 podStartE2EDuration="23.421298805s" totalImagesPullingTime="14.75829734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:04.420812091 +0000 UTC m=+23.655939252" watchObservedRunningTime="2026-07-16 21:50:04.421298805 +0000 UTC m=+23.656425966" Jul 16 21:50:04.478878 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:04.478852 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7kxg4" Jul 16 21:50:04.479563 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:04.479542 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7kxg4" Jul 16 21:50:05.303356 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:05.303313 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:50:05.303700 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:05.303447 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:50:05.303700 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:05.303463 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jn7" podUID="4509b338-7e48-41c0-b1ef-fe88c6165229" Jul 16 21:50:05.303700 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:05.303576 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7587" podUID="4b90276c-b68f-49a9-b571-13174fb91f20" Jul 16 21:50:05.303700 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:05.303658 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:50:05.303880 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:05.303768 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9f2s" podUID="97c82c64-748f-4a8d-b4e3-3111b7d31cdc" Jul 16 21:50:05.309607 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:05.309517 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T21:50:04.389348796Z","UUID":"8f680abe-c33a-40d6-be02-0544750f7038","Handler":null,"Name":"","Endpoint":""} Jul 16 21:50:05.311128 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:05.311112 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 16 21:50:05.311236 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:05.311150 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 16 21:50:05.416283 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:05.416251 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hz2pt_75c7e977-7b28-42d0-a6e6-0532f2932368/ovn-acl-logging/0.log" Jul 16 21:50:05.416796 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:05.416735 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" event={"ID":"75c7e977-7b28-42d0-a6e6-0532f2932368","Type":"ContainerStarted","Data":"14d2e048118a4798e4fa885c85ef5733a7231ebc2aa812a80ab3316d5a65d2b4"} Jul 16 21:50:05.416858 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:05.416830 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" event={"ID":"75c7e977-7b28-42d0-a6e6-0532f2932368","Type":"ContainerStarted","Data":"3b544101aae1cceba9e5dfcc6fc1c73151c4f11c9e98206c215b137b8756db8e"} Jul 16 21:50:05.416916 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:05.416884 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" event={"ID":"75c7e977-7b28-42d0-a6e6-0532f2932368","Type":"ContainerStarted","Data":"426c1a8c53c2f457334346cb2552684f68e1d43aed58452a96718e75cff8a67d"} Jul 16 21:50:05.417407 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:05.417380 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7kxg4" Jul 16 21:50:05.417927 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:05.417907 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7kxg4" Jul 16 21:50:06.421673 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:06.421392 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" event={"ID":"fc36f9ea-6173-4dd8-abd3-8845ef171c58","Type":"ContainerStarted","Data":"a868539992781089db248052a1f9cd1160a1efdc855e5d195658c759b28eafdf"} Jul 16 21:50:06.442169 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:06.442119 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pxsnl" podStartSLOduration=3.611283262 podStartE2EDuration="25.442097963s" totalImagesPullingTime="21.830814701s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:06.440661794 +0000 UTC m=+25.675788955" watchObservedRunningTime="2026-07-16 21:50:06.442097963 +0000 UTC m=+25.677225124" Jul 16 21:50:07.303430 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:07.303383 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:50:07.303430 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:07.303390 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:50:07.303769 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:07.303540 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jn7" podUID="4509b338-7e48-41c0-b1ef-fe88c6165229" Jul 16 21:50:07.303769 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:07.303613 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:50:07.303769 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:07.303751 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9f2s" podUID="97c82c64-748f-4a8d-b4e3-3111b7d31cdc" Jul 16 21:50:07.303934 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:07.303898 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7587" podUID="4b90276c-b68f-49a9-b571-13174fb91f20" Jul 16 21:50:07.427848 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:07.427822 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hz2pt_75c7e977-7b28-42d0-a6e6-0532f2932368/ovn-acl-logging/0.log" Jul 16 21:50:07.428394 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:07.428276 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" event={"ID":"75c7e977-7b28-42d0-a6e6-0532f2932368","Type":"ContainerStarted","Data":"5ba5e299d42e8eb515eda957d771318eff6b1c32e240c2dd89a8aa5f7fef3397"} Jul 16 21:50:09.303911 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:09.303697 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:50:09.304574 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:09.303808 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:50:09.304574 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:09.304019 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9f2s" podUID="97c82c64-748f-4a8d-b4e3-3111b7d31cdc" Jul 16 21:50:09.304574 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:09.303844 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:50:09.304574 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:09.304104 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7587" podUID="4b90276c-b68f-49a9-b571-13174fb91f20" Jul 16 21:50:09.304574 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:09.304208 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jn7" podUID="4509b338-7e48-41c0-b1ef-fe88c6165229" Jul 16 21:50:09.435021 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:09.434984 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n9km8" event={"ID":"66c41459-8447-46fb-9701-03511287936d","Type":"ContainerStarted","Data":"ff97f369bfe5abe8a59c5c19313074d1e96ff74cc15368de998eb3cb9147b10b"} Jul 16 21:50:09.438550 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:09.438531 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hz2pt_75c7e977-7b28-42d0-a6e6-0532f2932368/ovn-acl-logging/0.log" Jul 16 21:50:09.438883 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:09.438854 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" event={"ID":"75c7e977-7b28-42d0-a6e6-0532f2932368","Type":"ContainerStarted","Data":"76b45908ff10cb6f99e03d63dc9ea38d1db6398400f567d4fc0cd51e25e55ede"} Jul 16 21:50:09.439283 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:09.439261 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:50:09.439452 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:09.439414 2566 scope.go:117] "RemoveContainer" containerID="812778c35cada033a89a91d3f365ad8cfa1db4c8da00a22b4a2a7eae2179f6e4" Jul 16 21:50:09.454642 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:09.454620 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:50:10.443348 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:10.443274 2566 generic.go:356] "Generic (PLEG): container finished" podID="66c41459-8447-46fb-9701-03511287936d" containerID="ff97f369bfe5abe8a59c5c19313074d1e96ff74cc15368de998eb3cb9147b10b" exitCode=0 Jul 16 21:50:10.443850 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:10.443366 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n9km8" event={"ID":"66c41459-8447-46fb-9701-03511287936d","Type":"ContainerDied","Data":"ff97f369bfe5abe8a59c5c19313074d1e96ff74cc15368de998eb3cb9147b10b"} Jul 16 21:50:10.448958 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:10.448934 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hz2pt_75c7e977-7b28-42d0-a6e6-0532f2932368/ovn-acl-logging/0.log" Jul 16 21:50:10.468139 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:10.468108 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" event={"ID":"75c7e977-7b28-42d0-a6e6-0532f2932368","Type":"ContainerStarted","Data":"d8e0f6000ae7ee402f15c3253936f68236188c2c9127f5a2923fa3f704cf5147"} Jul 16 21:50:10.468335 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:10.468319 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:50:10.468405 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:10.468382 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:50:10.483634 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:10.483612 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:50:10.500913 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:10.500873 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" podStartSLOduration=10.428319469 podStartE2EDuration="29.500859202s" totalImagesPullingTime="19.072539733s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:10.499696331 +0000 UTC m=+29.734823492" watchObservedRunningTime="2026-07-16 21:50:10.500859202 +0000 UTC m=+29.735986362" Jul 16 21:50:11.256213 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:11.256186 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-c9f2s"] Jul 16 21:50:11.256374 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:11.256286 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:50:11.256374 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:11.256363 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9f2s" podUID="97c82c64-748f-4a8d-b4e3-3111b7d31cdc" Jul 16 21:50:11.258523 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:11.258490 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w9jn7"] Jul 16 21:50:11.258645 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:11.258596 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:50:11.258724 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:11.258701 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jn7" podUID="4509b338-7e48-41c0-b1ef-fe88c6165229" Jul 16 21:50:11.259197 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:11.259173 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j7587"] Jul 16 21:50:11.259312 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:11.259275 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:50:11.259395 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:11.259378 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7587" podUID="4b90276c-b68f-49a9-b571-13174fb91f20" Jul 16 21:50:12.474607 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:12.474568 2566 generic.go:356] "Generic (PLEG): container finished" podID="66c41459-8447-46fb-9701-03511287936d" containerID="46f40486ce23d9dca34cf5a4fcc2ca0427ecd9205022bce447a89273bd87ce79" exitCode=0 Jul 16 21:50:12.474964 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:12.474651 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n9km8" event={"ID":"66c41459-8447-46fb-9701-03511287936d","Type":"ContainerDied","Data":"46f40486ce23d9dca34cf5a4fcc2ca0427ecd9205022bce447a89273bd87ce79"} Jul 16 21:50:13.303609 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:13.303575 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:50:13.303780 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:13.303575 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:50:13.303780 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:13.303686 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:50:13.303780 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:13.303704 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7587" podUID="4b90276c-b68f-49a9-b571-13174fb91f20" Jul 16 21:50:13.303930 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:13.303777 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9f2s" podUID="97c82c64-748f-4a8d-b4e3-3111b7d31cdc" Jul 16 21:50:13.303930 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:13.303869 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jn7" podUID="4509b338-7e48-41c0-b1ef-fe88c6165229" Jul 16 21:50:14.481677 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:14.481497 2566 generic.go:356] "Generic (PLEG): container finished" podID="66c41459-8447-46fb-9701-03511287936d" containerID="d434305cf654cfa0c771f72058b569d61f704b11b1c97e227bde87819664beab" exitCode=0 Jul 16 21:50:14.482228 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:14.481580 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n9km8" event={"ID":"66c41459-8447-46fb-9701-03511287936d","Type":"ContainerDied","Data":"d434305cf654cfa0c771f72058b569d61f704b11b1c97e227bde87819664beab"} Jul 16 21:50:14.953090 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:14.953009 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9glrc\" (UniqueName: \"kubernetes.io/projected/97c82c64-748f-4a8d-b4e3-3111b7d31cdc-kube-api-access-9glrc\") pod \"network-check-target-c9f2s\" (UID: \"97c82c64-748f-4a8d-b4e3-3111b7d31cdc\") " pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:50:14.953224 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:14.953176 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 21:50:14.953224 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:14.953199 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 21:50:14.953224 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:14.953209 2566 projected.go:196] Error preparing data for projected volume kube-api-access-9glrc for pod openshift-network-diagnostics/network-check-target-c9f2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:50:14.953324 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:14.953266 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97c82c64-748f-4a8d-b4e3-3111b7d31cdc-kube-api-access-9glrc podName:97c82c64-748f-4a8d-b4e3-3111b7d31cdc nodeName:}" failed. No retries permitted until 2026-07-16 21:50:46.953249636 +0000 UTC m=+66.188376778 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9glrc" (UniqueName: "kubernetes.io/projected/97c82c64-748f-4a8d-b4e3-3111b7d31cdc-kube-api-access-9glrc") pod "network-check-target-c9f2s" (UID: "97c82c64-748f-4a8d-b4e3-3111b7d31cdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:50:15.054036 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:15.054000 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4509b338-7e48-41c0-b1ef-fe88c6165229-original-pull-secret\") pod \"global-pull-secret-syncer-w9jn7\" (UID: \"4509b338-7e48-41c0-b1ef-fe88c6165229\") " pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:50:15.054209 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:15.054091 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b90276c-b68f-49a9-b571-13174fb91f20-metrics-certs\") pod \"network-metrics-daemon-j7587\" (UID: \"4b90276c-b68f-49a9-b571-13174fb91f20\") " pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:50:15.054209 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:15.054185 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:50:15.054329 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:15.054250 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b90276c-b68f-49a9-b571-13174fb91f20-metrics-certs podName:4b90276c-b68f-49a9-b571-13174fb91f20 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:47.054234578 +0000 UTC m=+66.289361733 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b90276c-b68f-49a9-b571-13174fb91f20-metrics-certs") pod "network-metrics-daemon-j7587" (UID: "4b90276c-b68f-49a9-b571-13174fb91f20") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:50:15.054329 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:15.054183 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 21:50:15.054433 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:15.054336 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4509b338-7e48-41c0-b1ef-fe88c6165229-original-pull-secret podName:4509b338-7e48-41c0-b1ef-fe88c6165229 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:47.054323907 +0000 UTC m=+66.289451050 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4509b338-7e48-41c0-b1ef-fe88c6165229-original-pull-secret") pod "global-pull-secret-syncer-w9jn7" (UID: "4509b338-7e48-41c0-b1ef-fe88c6165229") : object "kube-system"/"original-pull-secret" not registered Jul 16 21:50:15.303497 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:15.303458 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:50:15.303679 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:15.303458 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:50:15.303679 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:15.303586 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9f2s" podUID="97c82c64-748f-4a8d-b4e3-3111b7d31cdc" Jul 16 21:50:15.303679 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:15.303477 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:50:15.303679 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:15.303665 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7587" podUID="4b90276c-b68f-49a9-b571-13174fb91f20" Jul 16 21:50:15.303880 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:15.303755 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jn7" podUID="4509b338-7e48-41c0-b1ef-fe88c6165229" Jul 16 21:50:16.511189 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.511166 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-177.ec2.internal" event="NodeReady" Jul 16 21:50:16.511645 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.511309 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 16 21:50:16.611324 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.611291 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-864c69867d-j5k2t"] Jul 16 21:50:16.614633 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.614611 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:16.617444 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.617407 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 16 21:50:16.617574 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.617544 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kmpcf\"" Jul 16 21:50:16.618161 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.618144 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 16 21:50:16.620761 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.620731 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 16 21:50:16.629026 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.628966 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 16 21:50:16.640730 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.640705 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2bhgs"] Jul 16 21:50:16.644109 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.644087 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2bhgs" Jul 16 21:50:16.647091 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.647072 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zkhpq"] Jul 16 21:50:16.647885 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.647853 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 16 21:50:16.647996 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.647973 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q4vmw\"" Jul 16 21:50:16.648566 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.648546 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 16 21:50:16.650267 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.650251 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zkhpq" Jul 16 21:50:16.652818 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.652799 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 16 21:50:16.652939 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.652919 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-khfb2\"" Jul 16 21:50:16.653020 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.653003 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 16 21:50:16.653332 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.653313 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 16 21:50:16.660867 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.660848 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-864c69867d-j5k2t"] Jul 16 21:50:16.674470 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.674434 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2bhgs"] Jul 16 21:50:16.698336 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.698311 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zkhpq"] Jul 16 21:50:16.765686 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.765607 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-tmp-dir\") pod \"dns-default-2bhgs\" (UID: \"1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40\") " pod="openshift-dns/dns-default-2bhgs" Jul 16 21:50:16.765686 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.765639 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd70582f-df8b-43c0-a20f-40dc0e0f7d94-cert\") pod \"ingress-canary-zkhpq\" (UID: \"bd70582f-df8b-43c0-a20f-40dc0e0f7d94\") " pod="openshift-ingress-canary/ingress-canary-zkhpq" Jul 16 21:50:16.765880 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.765702 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lkdf\" (UniqueName: \"kubernetes.io/projected/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-kube-api-access-8lkdf\") pod \"dns-default-2bhgs\" (UID: \"1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40\") " pod="openshift-dns/dns-default-2bhgs" Jul 16 21:50:16.765880 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.765833 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/846b555e-524b-4bfe-85e3-8782fd7c49ed-installation-pull-secrets\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:16.765880 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.765865 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-certificates\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:16.766031 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.765889 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-config-volume\") pod \"dns-default-2bhgs\" (UID: \"1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40\") " pod="openshift-dns/dns-default-2bhgs" Jul 16 21:50:16.766031 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.765959 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-tls\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:16.766031 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.765982 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-bound-sa-token\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:16.766031 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.766004 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcqqq\" (UniqueName: \"kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-kube-api-access-qcqqq\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:16.766031 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.766027 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-metrics-tls\") pod \"dns-default-2bhgs\" (UID: \"1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40\") " pod="openshift-dns/dns-default-2bhgs" Jul 16 21:50:16.766236 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.766050 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/846b555e-524b-4bfe-85e3-8782fd7c49ed-ca-trust-extracted\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:16.766236 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.766126 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/846b555e-524b-4bfe-85e3-8782fd7c49ed-image-registry-private-configuration\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:16.766236 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.766170 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndj9h\" (UniqueName: \"kubernetes.io/projected/bd70582f-df8b-43c0-a20f-40dc0e0f7d94-kube-api-access-ndj9h\") pod \"ingress-canary-zkhpq\" (UID: \"bd70582f-df8b-43c0-a20f-40dc0e0f7d94\") " pod="openshift-ingress-canary/ingress-canary-zkhpq" Jul 16 21:50:16.766236 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.766201 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/846b555e-524b-4bfe-85e3-8782fd7c49ed-trusted-ca\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:16.864112 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.864074 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:16.867322 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.867286 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lkdf\" (UniqueName: \"kubernetes.io/projected/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-kube-api-access-8lkdf\") pod \"dns-default-2bhgs\" (UID: \"1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40\") " pod="openshift-dns/dns-default-2bhgs" Jul 16 21:50:16.867469 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.867362 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/846b555e-524b-4bfe-85e3-8782fd7c49ed-installation-pull-secrets\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:16.867469 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.867383 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-certificates\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:16.867469 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.867397 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-config-volume\") pod \"dns-default-2bhgs\" (UID: \"1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40\") " pod="openshift-dns/dns-default-2bhgs" Jul 16 21:50:16.867469 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.867435 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-tls\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:16.867689 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.867482 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-bound-sa-token\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:16.867689 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.867521 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcqqq\" (UniqueName: \"kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-kube-api-access-qcqqq\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:16.867689 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:16.867527 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 21:50:16.867689 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:16.867543 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-864c69867d-j5k2t: secret "image-registry-tls" not found Jul 16 21:50:16.867689 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.867552 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-metrics-tls\") pod \"dns-default-2bhgs\" (UID: \"1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40\") " pod="openshift-dns/dns-default-2bhgs" Jul 16 21:50:16.867689 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.867581 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/846b555e-524b-4bfe-85e3-8782fd7c49ed-ca-trust-extracted\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:16.867689 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:16.867592 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-tls podName:846b555e-524b-4bfe-85e3-8782fd7c49ed nodeName:}" failed. No retries permitted until 2026-07-16 21:50:17.367578326 +0000 UTC m=+36.602705463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-tls") pod "image-registry-864c69867d-j5k2t" (UID: "846b555e-524b-4bfe-85e3-8782fd7c49ed") : secret "image-registry-tls" not found Jul 16 21:50:16.867689 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.867620 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/846b555e-524b-4bfe-85e3-8782fd7c49ed-image-registry-private-configuration\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:16.867689 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.867647 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndj9h\" (UniqueName: \"kubernetes.io/projected/bd70582f-df8b-43c0-a20f-40dc0e0f7d94-kube-api-access-ndj9h\") pod \"ingress-canary-zkhpq\" (UID: \"bd70582f-df8b-43c0-a20f-40dc0e0f7d94\") " pod="openshift-ingress-canary/ingress-canary-zkhpq" Jul 16 21:50:16.867689 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.867675 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/846b555e-524b-4bfe-85e3-8782fd7c49ed-trusted-ca\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:16.868153 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.867700 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-tmp-dir\") pod \"dns-default-2bhgs\" (UID: \"1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40\") " pod="openshift-dns/dns-default-2bhgs" Jul 16 21:50:16.868153 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.867726 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd70582f-df8b-43c0-a20f-40dc0e0f7d94-cert\") pod \"ingress-canary-zkhpq\" (UID: \"bd70582f-df8b-43c0-a20f-40dc0e0f7d94\") " pod="openshift-ingress-canary/ingress-canary-zkhpq" Jul 16 21:50:16.868153 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.867961 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/846b555e-524b-4bfe-85e3-8782fd7c49ed-ca-trust-extracted\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:16.868153 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.868148 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-certificates\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:16.868349 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:16.868210 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 21:50:16.868349 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:16.868258 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-metrics-tls podName:1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:17.368241658 +0000 UTC m=+36.603368817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-metrics-tls") pod "dns-default-2bhgs" (UID: "1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40") : secret "dns-default-metrics-tls" not found Jul 16 21:50:16.868481 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.868358 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-config-volume\") pod \"dns-default-2bhgs\" (UID: \"1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40\") " pod="openshift-dns/dns-default-2bhgs" Jul 16 21:50:16.868595 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.868569 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-tmp-dir\") pod \"dns-default-2bhgs\" (UID: \"1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40\") " pod="openshift-dns/dns-default-2bhgs" Jul 16 21:50:16.869109 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.869086 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/846b555e-524b-4bfe-85e3-8782fd7c49ed-trusted-ca\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:16.872026 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.871958 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/846b555e-524b-4bfe-85e3-8782fd7c49ed-installation-pull-secrets\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:16.872026 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.871976 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/846b555e-524b-4bfe-85e3-8782fd7c49ed-image-registry-private-configuration\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:16.872161 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.872034 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd70582f-df8b-43c0-a20f-40dc0e0f7d94-cert\") pod \"ingress-canary-zkhpq\" (UID: \"bd70582f-df8b-43c0-a20f-40dc0e0f7d94\") " pod="openshift-ingress-canary/ingress-canary-zkhpq" Jul 16 21:50:16.878366 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.878337 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-bound-sa-token\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:16.880712 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.880686 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lkdf\" (UniqueName: \"kubernetes.io/projected/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-kube-api-access-8lkdf\") pod \"dns-default-2bhgs\" (UID: \"1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40\") " pod="openshift-dns/dns-default-2bhgs" Jul 16 21:50:16.884018 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.883995 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcqqq\" (UniqueName: \"kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-kube-api-access-qcqqq\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:16.889332 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.889310 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndj9h\" (UniqueName: \"kubernetes.io/projected/bd70582f-df8b-43c0-a20f-40dc0e0f7d94-kube-api-access-ndj9h\") pod \"ingress-canary-zkhpq\" (UID: \"bd70582f-df8b-43c0-a20f-40dc0e0f7d94\") " pod="openshift-ingress-canary/ingress-canary-zkhpq" Jul 16 21:50:16.961544 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.961507 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zkhpq" Jul 16 21:50:16.989557 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:16.989526 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:17.078887 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:17.078573 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:17.123375 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:17.123347 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zkhpq"] Jul 16 21:50:17.127145 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:50:17.127122 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd70582f_df8b_43c0_a20f_40dc0e0f7d94.slice/crio-978d4d3f81f81e6ffcd3d08eb4c74906a2e70683a628e8c001789b88aa99729e WatchSource:0}: Error finding container 978d4d3f81f81e6ffcd3d08eb4c74906a2e70683a628e8c001789b88aa99729e: Status 404 returned error can't find the container with id 978d4d3f81f81e6ffcd3d08eb4c74906a2e70683a628e8c001789b88aa99729e Jul 16 21:50:17.304026 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:17.303924 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:50:17.304026 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:17.303924 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:50:17.304260 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:17.304245 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:50:17.306795 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:17.306774 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wslpm\"" Jul 16 21:50:17.306930 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:17.306911 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 21:50:17.307005 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:17.306983 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 21:50:17.307005 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:17.306992 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 21:50:17.307233 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:17.307218 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 21:50:17.307310 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:17.307249 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5fdwm\"" Jul 16 21:50:17.372234 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:17.372203 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-tls\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:17.372234 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:17.372239 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-metrics-tls\") pod \"dns-default-2bhgs\" (UID: \"1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40\") " pod="openshift-dns/dns-default-2bhgs" Jul 16 21:50:17.372409 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:17.372347 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 21:50:17.372409 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:17.372362 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 21:50:17.372409 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:17.372366 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-864c69867d-j5k2t: secret "image-registry-tls" not found Jul 16 21:50:17.372519 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:17.372415 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-tls podName:846b555e-524b-4bfe-85e3-8782fd7c49ed nodeName:}" failed. No retries permitted until 2026-07-16 21:50:18.372399812 +0000 UTC m=+37.607526950 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-tls") pod "image-registry-864c69867d-j5k2t" (UID: "846b555e-524b-4bfe-85e3-8782fd7c49ed") : secret "image-registry-tls" not found Jul 16 21:50:17.372519 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:17.372444 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-metrics-tls podName:1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:18.372437605 +0000 UTC m=+37.607564743 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-metrics-tls") pod "dns-default-2bhgs" (UID: "1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40") : secret "dns-default-metrics-tls" not found Jul 16 21:50:17.385254 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:17.385226 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:17.489994 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:17.489963 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zkhpq" event={"ID":"bd70582f-df8b-43c0-a20f-40dc0e0f7d94","Type":"ContainerStarted","Data":"978d4d3f81f81e6ffcd3d08eb4c74906a2e70683a628e8c001789b88aa99729e"} Jul 16 21:50:17.491339 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:17.491316 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:17.829145 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:17.829111 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:17.930544 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:17.930509 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:18.234891 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:18.234856 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:18.299414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:18.299379 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:18.383529 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:18.383497 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-metrics-tls\") pod \"dns-default-2bhgs\" (UID: \"1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40\") " pod="openshift-dns/dns-default-2bhgs" Jul 16 21:50:18.383696 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:18.383612 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-tls\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:18.383762 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:18.383726 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 21:50:18.383812 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:18.383789 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-metrics-tls podName:1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:20.383769023 +0000 UTC m=+39.618896164 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-metrics-tls") pod "dns-default-2bhgs" (UID: "1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40") : secret "dns-default-metrics-tls" not found Jul 16 21:50:18.383865 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:18.383729 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 21:50:18.383865 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:18.383840 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-864c69867d-j5k2t: secret "image-registry-tls" not found Jul 16 21:50:18.383934 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:18.383903 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-tls podName:846b555e-524b-4bfe-85e3-8782fd7c49ed nodeName:}" failed. No retries permitted until 2026-07-16 21:50:20.383883075 +0000 UTC m=+39.619010219 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-tls") pod "image-registry-864c69867d-j5k2t" (UID: "846b555e-524b-4bfe-85e3-8782fd7c49ed") : secret "image-registry-tls" not found Jul 16 21:50:19.498977 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:19.498945 2566 generic.go:356] "Generic (PLEG): container finished" podID="66c41459-8447-46fb-9701-03511287936d" containerID="f6115b7727818d921a5dad5f9adbb3ce88e0b7d1847cfaa8db69b410e44932ef" exitCode=0 Jul 16 21:50:19.499451 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:19.498997 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n9km8" event={"ID":"66c41459-8447-46fb-9701-03511287936d","Type":"ContainerDied","Data":"f6115b7727818d921a5dad5f9adbb3ce88e0b7d1847cfaa8db69b410e44932ef"} Jul 16 21:50:19.534783 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:19.534752 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:19.604471 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:19.604414 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:20.111075 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:20.111036 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:20.211863 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:20.211830 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:20.400499 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:20.400400 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-tls\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:20.400499 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:20.400457 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-metrics-tls\") pod \"dns-default-2bhgs\" (UID: \"1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40\") " pod="openshift-dns/dns-default-2bhgs" Jul 16 21:50:20.400674 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:20.400564 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 21:50:20.400674 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:20.400589 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 21:50:20.400674 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:20.400607 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-864c69867d-j5k2t: secret "image-registry-tls" not found Jul 16 21:50:20.400674 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:20.400617 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-metrics-tls podName:1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:24.400604414 +0000 UTC m=+43.635731553 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-metrics-tls") pod "dns-default-2bhgs" (UID: "1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40") : secret "dns-default-metrics-tls" not found Jul 16 21:50:20.400674 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:20.400651 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-tls podName:846b555e-524b-4bfe-85e3-8782fd7c49ed nodeName:}" failed. No retries permitted until 2026-07-16 21:50:24.400638138 +0000 UTC m=+43.635765275 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-tls") pod "image-registry-864c69867d-j5k2t" (UID: "846b555e-524b-4bfe-85e3-8782fd7c49ed") : secret "image-registry-tls" not found Jul 16 21:50:20.505211 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:20.505172 2566 generic.go:356] "Generic (PLEG): container finished" podID="66c41459-8447-46fb-9701-03511287936d" containerID="4ee198ef4dda5f4b401513e495514226e7fbb2682c6356334b8c0410c7501f5f" exitCode=0 Jul 16 21:50:20.505598 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:20.505218 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n9km8" event={"ID":"66c41459-8447-46fb-9701-03511287936d","Type":"ContainerDied","Data":"4ee198ef4dda5f4b401513e495514226e7fbb2682c6356334b8c0410c7501f5f"} Jul 16 21:50:21.511112 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:21.511071 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n9km8" event={"ID":"66c41459-8447-46fb-9701-03511287936d","Type":"ContainerStarted","Data":"27c1c595d855d4abb555be8ad7a84b40c18ecdec11e1aaffe12c2944dbb2981f"} Jul 16 21:50:21.539120 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:21.539064 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-n9km8" podStartSLOduration=9.685353594 podStartE2EDuration="40.53904729s" totalImagesPullingTime="30.853693696s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:21.537896711 +0000 UTC m=+40.773023874" watchObservedRunningTime="2026-07-16 21:50:21.53904729 +0000 UTC m=+40.774174450" Jul 16 21:50:21.664730 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:21.664680 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:21.741128 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:21.741093 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:21.819975 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:21.819876 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:22.514477 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:22.514438 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zkhpq" event={"ID":"bd70582f-df8b-43c0-a20f-40dc0e0f7d94","Type":"ContainerStarted","Data":"edd1aab53cd0c7eeb6e71ffb3f1c65d9f10ae00be7e264225203b2cf5bc8181a"} Jul 16 21:50:22.534108 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:22.534065 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zkhpq" podStartSLOduration=2.14442708 podStartE2EDuration="6.534049794s" totalImagesPullingTime="4.389622714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:22.53292114 +0000 UTC m=+41.768048297" watchObservedRunningTime="2026-07-16 21:50:22.534049794 +0000 UTC m=+41.769176980" Jul 16 21:50:24.427302 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:24.427266 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-metrics-tls\") pod \"dns-default-2bhgs\" (UID: \"1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40\") " pod="openshift-dns/dns-default-2bhgs" Jul 16 21:50:24.427693 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:24.427355 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-tls\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:24.427693 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:24.427411 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 21:50:24.427693 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:24.427454 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 21:50:24.427693 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:24.427464 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-864c69867d-j5k2t: secret "image-registry-tls" not found Jul 16 21:50:24.427693 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:24.427495 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-metrics-tls podName:1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:32.427478908 +0000 UTC m=+51.662606045 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-metrics-tls") pod "dns-default-2bhgs" (UID: "1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40") : secret "dns-default-metrics-tls" not found Jul 16 21:50:24.427693 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:24.427510 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-tls podName:846b555e-524b-4bfe-85e3-8782fd7c49ed nodeName:}" failed. No retries permitted until 2026-07-16 21:50:32.427503794 +0000 UTC m=+51.662630932 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-tls") pod "image-registry-864c69867d-j5k2t" (UID: "846b555e-524b-4bfe-85e3-8782fd7c49ed") : secret "image-registry-tls" not found Jul 16 21:50:32.487717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:32.487673 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-tls\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:32.487717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:32.487722 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-metrics-tls\") pod \"dns-default-2bhgs\" (UID: \"1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40\") " pod="openshift-dns/dns-default-2bhgs" Jul 16 21:50:32.488260 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:32.487817 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 21:50:32.488260 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:32.487837 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-864c69867d-j5k2t: secret "image-registry-tls" not found Jul 16 21:50:32.488260 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:32.487850 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 21:50:32.488260 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:32.487902 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-tls podName:846b555e-524b-4bfe-85e3-8782fd7c49ed nodeName:}" failed. No retries permitted until 2026-07-16 21:50:48.487887054 +0000 UTC m=+67.723014192 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-tls") pod "image-registry-864c69867d-j5k2t" (UID: "846b555e-524b-4bfe-85e3-8782fd7c49ed") : secret "image-registry-tls" not found Jul 16 21:50:32.488260 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:32.487915 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-metrics-tls podName:1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:48.487909137 +0000 UTC m=+67.723036274 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-metrics-tls") pod "dns-default-2bhgs" (UID: "1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40") : secret "dns-default-metrics-tls" not found Jul 16 21:50:34.654360 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:34.654329 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:34.757406 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:34.757377 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:35.488370 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:35.488337 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:35.585792 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:35.585752 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:39.210337 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:39.210298 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:39.307104 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:39.307070 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:39.412158 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:39.412127 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:40.155624 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:40.155592 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:40.260360 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:40.260319 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:40.510632 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:40.510582 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:42.492297 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:42.492268 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hz2pt" Jul 16 21:50:42.657719 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:42.657677 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:42.757781 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:42.757694 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:43.807737 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.807700 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4njh"] Jul 16 21:50:43.810476 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.810454 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4njh" Jul 16 21:50:43.812954 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.812925 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 16 21:50:43.813058 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.812936 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 16 21:50:43.813683 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.813659 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lhfp2\"" Jul 16 21:50:43.813770 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.813664 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 16 21:50:43.822225 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.822205 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4njh"] Jul 16 21:50:43.868637 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.868606 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/85d2de20-f664-4564-953e-e4b7ba798e2c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r4njh\" (UID: \"85d2de20-f664-4564-953e-e4b7ba798e2c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4njh" Jul 16 21:50:43.868637 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.868642 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x42r4\" (UniqueName: \"kubernetes.io/projected/85d2de20-f664-4564-953e-e4b7ba798e2c-kube-api-access-x42r4\") pod \"cluster-samples-operator-79b7c55f87-r4njh\" (UID: \"85d2de20-f664-4564-953e-e4b7ba798e2c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4njh" Jul 16 21:50:43.910467 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.910437 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-sk546"] Jul 16 21:50:43.912162 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.912141 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-sk546" Jul 16 21:50:43.914815 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.914796 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xt2fk\"" Jul 16 21:50:43.914958 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.914941 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 16 21:50:43.915037 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.914999 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 16 21:50:43.916683 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.916659 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-khtbj"] Jul 16 21:50:43.918293 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.918277 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-kp9cp"] Jul 16 21:50:43.918439 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.918408 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-khtbj" Jul 16 21:50:43.919967 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.919952 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9qm6q"] Jul 16 21:50:43.920064 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.920049 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-kp9cp" Jul 16 21:50:43.921117 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:43.921094 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 16 21:50:43.921432 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:43.921400 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"trusted-ca-bundle\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" type="*v1.ConfigMap" Jul 16 21:50:43.921519 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.921409 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7b88cbdcf6-9t7wk"] Jul 16 21:50:43.921579 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.921518 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9qm6q" Jul 16 21:50:43.921816 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:43.921792 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"operator-dockercfg-kq6vg\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"operator-dockercfg-kq6vg\"" type="*v1.Secret" Jul 16 21:50:43.921973 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:43.921949 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 16 21:50:43.922233 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:43.922206 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console-operator\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 16 21:50:43.922334 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:43.922273 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"openshift-insights-serving-cert\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" type="*v1.Secret" Jul 16 21:50:43.922390 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:43.922331 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"service-ca-bundle\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" type="*v1.ConfigMap" Jul 16 21:50:43.922530 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:43.922498 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"console-operator-config\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console-operator\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" type="*v1.ConfigMap" Jul 16 21:50:43.922957 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:43.922927 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console-operator\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 16 21:50:43.923104 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.923089 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-sk546"] Jul 16 21:50:43.923171 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.923148 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:50:43.923866 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:43.923828 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"trusted-ca\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console-operator\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" type="*v1.ConfigMap" Jul 16 21:50:43.924058 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:43.924035 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"serving-cert\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-console-operator\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" type="*v1.Secret" Jul 16 21:50:43.924139 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:43.924081 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"service-ca-operator-dockercfg-p9z89\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-p9z89\"" type="*v1.Secret" Jul 16 21:50:43.924139 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:43.924098 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"serving-cert\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" type="*v1.Secret" Jul 16 21:50:43.924139 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:43.924106 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"service-ca-operator-config\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" type="*v1.ConfigMap" Jul 16 21:50:43.924310 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:43.924180 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"console-operator-dockercfg-t7cqn\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-console-operator\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-t7cqn\"" type="*v1.Secret" Jul 16 21:50:43.924310 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:43.924223 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 16 21:50:43.924588 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:43.924562 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 16 21:50:43.926534 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:43.926507 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"service-ca-bundle\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" type="*v1.ConfigMap" Jul 16 21:50:43.926664 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:43.926586 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"router-metrics-certs-default\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" type="*v1.Secret" Jul 16 21:50:43.926664 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:43.926642 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 16 21:50:43.926784 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:43.926657 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-ingress-cert\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" type="*v1.Secret" Jul 16 21:50:43.926784 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:43.926697 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"router-stats-default\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" type="*v1.Secret" Jul 16 21:50:43.926784 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:43.926749 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 16 21:50:43.926784 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:43.926777 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"router-dockercfg-tqw5w\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tqw5w\"" type="*v1.Secret" Jul 16 21:50:43.933722 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.933702 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-khtbj"] Jul 16 21:50:43.934577 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.934555 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9qm6q"] Jul 16 21:50:43.938582 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.938494 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-kp9cp"] Jul 16 21:50:43.960433 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.960398 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7b88cbdcf6-9t7wk"] Jul 16 21:50:43.969032 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.969005 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/964fa034-949b-4752-8390-dc010d28551a-serving-cert\") pod \"console-operator-565b7b569d-kp9cp\" (UID: \"964fa034-949b-4752-8390-dc010d28551a\") " pod="openshift-console-operator/console-operator-565b7b569d-kp9cp" Jul 16 21:50:43.969144 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.969036 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-metrics-certs\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:50:43.969144 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.969058 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tprbr\" (UniqueName: \"kubernetes.io/projected/2052aa05-a8ad-403f-9b7c-eb84f1e9ef44-kube-api-access-tprbr\") pod \"volume-data-source-validator-78cf4c6f6-sk546\" (UID: \"2052aa05-a8ad-403f-9b7c-eb84f1e9ef44\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-sk546" Jul 16 21:50:43.969144 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.969075 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44b07976-78f7-48e0-9168-869ddd954f1d-service-ca-bundle\") pod \"insights-operator-555d9d7885-khtbj\" (UID: \"44b07976-78f7-48e0-9168-869ddd954f1d\") " pod="openshift-insights/insights-operator-555d9d7885-khtbj" Jul 16 21:50:43.969341 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.969146 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvpz6\" (UniqueName: \"kubernetes.io/projected/964fa034-949b-4752-8390-dc010d28551a-kube-api-access-wvpz6\") pod \"console-operator-565b7b569d-kp9cp\" (UID: \"964fa034-949b-4752-8390-dc010d28551a\") " pod="openshift-console-operator/console-operator-565b7b569d-kp9cp" Jul 16 21:50:43.969341 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.969180 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6213d8c-90b5-4823-ab32-24606edecb40-service-ca-bundle\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:50:43.969341 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.969220 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fr8l\" (UniqueName: \"kubernetes.io/projected/e6213d8c-90b5-4823-ab32-24606edecb40-kube-api-access-2fr8l\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:50:43.969341 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.969247 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9bb29d49-8d26-4c2d-adac-4e149546517b-serving-cert\") pod \"service-ca-operator-5bcbc94c78-9qm6q\" (UID: \"9bb29d49-8d26-4c2d-adac-4e149546517b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9qm6q" Jul 16 21:50:43.969341 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.969292 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/964fa034-949b-4752-8390-dc010d28551a-config\") pod \"console-operator-565b7b569d-kp9cp\" (UID: \"964fa034-949b-4752-8390-dc010d28551a\") " pod="openshift-console-operator/console-operator-565b7b569d-kp9cp" Jul 16 21:50:43.969580 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.969336 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/85d2de20-f664-4564-953e-e4b7ba798e2c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r4njh\" (UID: \"85d2de20-f664-4564-953e-e4b7ba798e2c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4njh" Jul 16 21:50:43.969580 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.969373 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44b07976-78f7-48e0-9168-869ddd954f1d-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-khtbj\" (UID: \"44b07976-78f7-48e0-9168-869ddd954f1d\") " pod="openshift-insights/insights-operator-555d9d7885-khtbj" Jul 16 21:50:43.969580 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.969463 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6v4l\" (UniqueName: \"kubernetes.io/projected/9bb29d49-8d26-4c2d-adac-4e149546517b-kube-api-access-c6v4l\") pod \"service-ca-operator-5bcbc94c78-9qm6q\" (UID: \"9bb29d49-8d26-4c2d-adac-4e149546517b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9qm6q" Jul 16 21:50:43.969580 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:43.969494 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 21:50:43.969580 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.969510 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/964fa034-949b-4752-8390-dc010d28551a-trusted-ca\") pod \"console-operator-565b7b569d-kp9cp\" (UID: \"964fa034-949b-4752-8390-dc010d28551a\") " pod="openshift-console-operator/console-operator-565b7b569d-kp9cp" Jul 16 21:50:43.969580 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.969560 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-default-certificate\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:50:43.969823 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:43.969590 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d2de20-f664-4564-953e-e4b7ba798e2c-samples-operator-tls podName:85d2de20-f664-4564-953e-e4b7ba798e2c nodeName:}" failed. No retries permitted until 2026-07-16 21:50:44.469574294 +0000 UTC m=+63.704701432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/85d2de20-f664-4564-953e-e4b7ba798e2c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-r4njh" (UID: "85d2de20-f664-4564-953e-e4b7ba798e2c") : secret "samples-operator-tls" not found Jul 16 21:50:43.969823 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.969604 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-stats-auth\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:50:43.969823 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.969624 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9bb29d49-8d26-4c2d-adac-4e149546517b-config\") pod \"service-ca-operator-5bcbc94c78-9qm6q\" (UID: \"9bb29d49-8d26-4c2d-adac-4e149546517b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9qm6q" Jul 16 21:50:43.969823 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.969651 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/44b07976-78f7-48e0-9168-869ddd954f1d-snapshots\") pod \"insights-operator-555d9d7885-khtbj\" (UID: \"44b07976-78f7-48e0-9168-869ddd954f1d\") " pod="openshift-insights/insights-operator-555d9d7885-khtbj" Jul 16 21:50:43.969823 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.969666 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/44b07976-78f7-48e0-9168-869ddd954f1d-serving-cert\") pod \"insights-operator-555d9d7885-khtbj\" (UID: \"44b07976-78f7-48e0-9168-869ddd954f1d\") " pod="openshift-insights/insights-operator-555d9d7885-khtbj" Jul 16 21:50:43.969823 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.969691 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x42r4\" (UniqueName: \"kubernetes.io/projected/85d2de20-f664-4564-953e-e4b7ba798e2c-kube-api-access-x42r4\") pod \"cluster-samples-operator-79b7c55f87-r4njh\" (UID: \"85d2de20-f664-4564-953e-e4b7ba798e2c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4njh" Jul 16 21:50:43.969823 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.969708 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7q7q\" (UniqueName: \"kubernetes.io/projected/44b07976-78f7-48e0-9168-869ddd954f1d-kube-api-access-q7q7q\") pod \"insights-operator-555d9d7885-khtbj\" (UID: \"44b07976-78f7-48e0-9168-869ddd954f1d\") " pod="openshift-insights/insights-operator-555d9d7885-khtbj" Jul 16 21:50:43.969823 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.969723 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44b07976-78f7-48e0-9168-869ddd954f1d-tmp\") pod \"insights-operator-555d9d7885-khtbj\" (UID: \"44b07976-78f7-48e0-9168-869ddd954f1d\") " pod="openshift-insights/insights-operator-555d9d7885-khtbj" Jul 16 21:50:43.980071 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:43.980047 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x42r4\" (UniqueName: \"kubernetes.io/projected/85d2de20-f664-4564-953e-e4b7ba798e2c-kube-api-access-x42r4\") pod \"cluster-samples-operator-79b7c55f87-r4njh\" (UID: \"85d2de20-f664-4564-953e-e4b7ba798e2c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4njh" Jul 16 21:50:44.008930 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.008902 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-sbs8l"] Jul 16 21:50:44.010624 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.010606 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-sbs8l" Jul 16 21:50:44.016414 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.016388 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vbdw5"] Jul 16 21:50:44.016519 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.016391 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-m2rkl\"" Jul 16 21:50:44.018194 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.018173 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9szth"] Jul 16 21:50:44.018296 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.018282 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vbdw5" Jul 16 21:50:44.020012 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.019996 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9szth" Jul 16 21:50:44.022788 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.022729 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 16 21:50:44.022788 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.022736 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 16 21:50:44.022982 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.022842 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 16 21:50:44.022982 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.022865 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 16 21:50:44.022982 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.022883 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 16 21:50:44.022982 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.022949 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 16 21:50:44.023176 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.023130 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 16 21:50:44.023176 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.023154 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-tnhd5\"" Jul 16 21:50:44.023176 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.023164 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-5vf9p\"" Jul 16 21:50:44.023329 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.023180 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 16 21:50:44.026481 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.026460 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-sbs8l"] Jul 16 21:50:44.034252 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.034232 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9szth"] Jul 16 21:50:44.035010 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.034991 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vbdw5"] Jul 16 21:50:44.070187 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.070093 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9bb29d49-8d26-4c2d-adac-4e149546517b-config\") pod \"service-ca-operator-5bcbc94c78-9qm6q\" (UID: \"9bb29d49-8d26-4c2d-adac-4e149546517b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9qm6q" Jul 16 21:50:44.070187 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.070131 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr5mv\" (UniqueName: \"kubernetes.io/projected/75364348-7d2b-4320-82d5-7ae05b690a88-kube-api-access-nr5mv\") pod \"cluster-monitoring-operator-76cf8966f8-vbdw5\" (UID: \"75364348-7d2b-4320-82d5-7ae05b690a88\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vbdw5" Jul 16 21:50:44.070187 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.070169 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/396a51f2-d2b9-402a-8668-faa8c446171b-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-9szth\" (UID: \"396a51f2-d2b9-402a-8668-faa8c446171b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9szth" Jul 16 21:50:44.070522 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.070233 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/44b07976-78f7-48e0-9168-869ddd954f1d-snapshots\") pod \"insights-operator-555d9d7885-khtbj\" (UID: \"44b07976-78f7-48e0-9168-869ddd954f1d\") " pod="openshift-insights/insights-operator-555d9d7885-khtbj" Jul 16 21:50:44.070522 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.070263 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/44b07976-78f7-48e0-9168-869ddd954f1d-serving-cert\") pod \"insights-operator-555d9d7885-khtbj\" (UID: \"44b07976-78f7-48e0-9168-869ddd954f1d\") " pod="openshift-insights/insights-operator-555d9d7885-khtbj" Jul 16 21:50:44.070522 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.070288 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7q7q\" (UniqueName: \"kubernetes.io/projected/44b07976-78f7-48e0-9168-869ddd954f1d-kube-api-access-q7q7q\") pod \"insights-operator-555d9d7885-khtbj\" (UID: \"44b07976-78f7-48e0-9168-869ddd954f1d\") " pod="openshift-insights/insights-operator-555d9d7885-khtbj" Jul 16 21:50:44.070522 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.070312 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44b07976-78f7-48e0-9168-869ddd954f1d-tmp\") pod \"insights-operator-555d9d7885-khtbj\" (UID: \"44b07976-78f7-48e0-9168-869ddd954f1d\") " pod="openshift-insights/insights-operator-555d9d7885-khtbj" Jul 16 21:50:44.070522 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.070342 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/964fa034-949b-4752-8390-dc010d28551a-serving-cert\") pod \"console-operator-565b7b569d-kp9cp\" (UID: \"964fa034-949b-4752-8390-dc010d28551a\") " pod="openshift-console-operator/console-operator-565b7b569d-kp9cp" Jul 16 21:50:44.070522 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.070370 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-metrics-certs\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:50:44.070522 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.070398 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tprbr\" (UniqueName: \"kubernetes.io/projected/2052aa05-a8ad-403f-9b7c-eb84f1e9ef44-kube-api-access-tprbr\") pod \"volume-data-source-validator-78cf4c6f6-sk546\" (UID: \"2052aa05-a8ad-403f-9b7c-eb84f1e9ef44\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-sk546" Jul 16 21:50:44.070522 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.070446 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44b07976-78f7-48e0-9168-869ddd954f1d-service-ca-bundle\") pod \"insights-operator-555d9d7885-khtbj\" (UID: \"44b07976-78f7-48e0-9168-869ddd954f1d\") " pod="openshift-insights/insights-operator-555d9d7885-khtbj" Jul 16 21:50:44.070522 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.070470 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvpz6\" (UniqueName: \"kubernetes.io/projected/964fa034-949b-4752-8390-dc010d28551a-kube-api-access-wvpz6\") pod \"console-operator-565b7b569d-kp9cp\" (UID: \"964fa034-949b-4752-8390-dc010d28551a\") " pod="openshift-console-operator/console-operator-565b7b569d-kp9cp" Jul 16 21:50:44.070522 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.070490 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6213d8c-90b5-4823-ab32-24606edecb40-service-ca-bundle\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:50:44.070522 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.070511 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fr8l\" (UniqueName: \"kubernetes.io/projected/e6213d8c-90b5-4823-ab32-24606edecb40-kube-api-access-2fr8l\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:50:44.070963 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.070535 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9bb29d49-8d26-4c2d-adac-4e149546517b-serving-cert\") pod \"service-ca-operator-5bcbc94c78-9qm6q\" (UID: \"9bb29d49-8d26-4c2d-adac-4e149546517b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9qm6q" Jul 16 21:50:44.070963 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.070565 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/75364348-7d2b-4320-82d5-7ae05b690a88-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-vbdw5\" (UID: \"75364348-7d2b-4320-82d5-7ae05b690a88\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vbdw5" Jul 16 21:50:44.070963 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.070588 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/396a51f2-d2b9-402a-8668-faa8c446171b-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-9szth\" (UID: \"396a51f2-d2b9-402a-8668-faa8c446171b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9szth" Jul 16 21:50:44.070963 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.070626 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75364348-7d2b-4320-82d5-7ae05b690a88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-vbdw5\" (UID: \"75364348-7d2b-4320-82d5-7ae05b690a88\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vbdw5" Jul 16 21:50:44.070963 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.070654 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/964fa034-949b-4752-8390-dc010d28551a-config\") pod \"console-operator-565b7b569d-kp9cp\" (UID: \"964fa034-949b-4752-8390-dc010d28551a\") " pod="openshift-console-operator/console-operator-565b7b569d-kp9cp" Jul 16 21:50:44.070963 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.070724 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44b07976-78f7-48e0-9168-869ddd954f1d-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-khtbj\" (UID: \"44b07976-78f7-48e0-9168-869ddd954f1d\") " pod="openshift-insights/insights-operator-555d9d7885-khtbj" Jul 16 21:50:44.070963 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.070797 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt266\" (UniqueName: \"kubernetes.io/projected/cdc0b7f0-dd52-4e63-976f-84c68b6846bc-kube-api-access-pt266\") pod \"network-check-source-7bc5b6bf85-sbs8l\" (UID: \"cdc0b7f0-dd52-4e63-976f-84c68b6846bc\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-sbs8l" Jul 16 21:50:44.070963 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.070852 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6v4l\" (UniqueName: \"kubernetes.io/projected/9bb29d49-8d26-4c2d-adac-4e149546517b-kube-api-access-c6v4l\") pod \"service-ca-operator-5bcbc94c78-9qm6q\" (UID: \"9bb29d49-8d26-4c2d-adac-4e149546517b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9qm6q" Jul 16 21:50:44.070963 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.070887 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/964fa034-949b-4752-8390-dc010d28551a-trusted-ca\") pod \"console-operator-565b7b569d-kp9cp\" (UID: \"964fa034-949b-4752-8390-dc010d28551a\") " pod="openshift-console-operator/console-operator-565b7b569d-kp9cp" Jul 16 21:50:44.070963 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.070907 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/44b07976-78f7-48e0-9168-869ddd954f1d-snapshots\") pod \"insights-operator-555d9d7885-khtbj\" (UID: \"44b07976-78f7-48e0-9168-869ddd954f1d\") " pod="openshift-insights/insights-operator-555d9d7885-khtbj" Jul 16 21:50:44.070963 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.070958 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-default-certificate\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:50:44.071451 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.070971 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44b07976-78f7-48e0-9168-869ddd954f1d-tmp\") pod \"insights-operator-555d9d7885-khtbj\" (UID: \"44b07976-78f7-48e0-9168-869ddd954f1d\") " pod="openshift-insights/insights-operator-555d9d7885-khtbj" Jul 16 21:50:44.071451 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.071012 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-stats-auth\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:50:44.071451 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.071044 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m866s\" (UniqueName: \"kubernetes.io/projected/396a51f2-d2b9-402a-8668-faa8c446171b-kube-api-access-m866s\") pod \"kube-storage-version-migrator-operator-7658d9b749-9szth\" (UID: \"396a51f2-d2b9-402a-8668-faa8c446171b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9szth" Jul 16 21:50:44.081157 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.081131 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tprbr\" (UniqueName: \"kubernetes.io/projected/2052aa05-a8ad-403f-9b7c-eb84f1e9ef44-kube-api-access-tprbr\") pod \"volume-data-source-validator-78cf4c6f6-sk546\" (UID: \"2052aa05-a8ad-403f-9b7c-eb84f1e9ef44\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-sk546" Jul 16 21:50:44.111814 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.111781 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:44.171682 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.171658 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/75364348-7d2b-4320-82d5-7ae05b690a88-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-vbdw5\" (UID: \"75364348-7d2b-4320-82d5-7ae05b690a88\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vbdw5" Jul 16 21:50:44.171837 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.171689 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/396a51f2-d2b9-402a-8668-faa8c446171b-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-9szth\" (UID: \"396a51f2-d2b9-402a-8668-faa8c446171b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9szth" Jul 16 21:50:44.171837 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.171719 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75364348-7d2b-4320-82d5-7ae05b690a88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-vbdw5\" (UID: \"75364348-7d2b-4320-82d5-7ae05b690a88\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vbdw5" Jul 16 21:50:44.171837 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.171769 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt266\" (UniqueName: \"kubernetes.io/projected/cdc0b7f0-dd52-4e63-976f-84c68b6846bc-kube-api-access-pt266\") pod \"network-check-source-7bc5b6bf85-sbs8l\" (UID: \"cdc0b7f0-dd52-4e63-976f-84c68b6846bc\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-sbs8l" Jul 16 21:50:44.171837 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.171800 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m866s\" (UniqueName: \"kubernetes.io/projected/396a51f2-d2b9-402a-8668-faa8c446171b-kube-api-access-m866s\") pod \"kube-storage-version-migrator-operator-7658d9b749-9szth\" (UID: \"396a51f2-d2b9-402a-8668-faa8c446171b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9szth" Jul 16 21:50:44.171837 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.171818 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr5mv\" (UniqueName: \"kubernetes.io/projected/75364348-7d2b-4320-82d5-7ae05b690a88-kube-api-access-nr5mv\") pod \"cluster-monitoring-operator-76cf8966f8-vbdw5\" (UID: \"75364348-7d2b-4320-82d5-7ae05b690a88\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vbdw5" Jul 16 21:50:44.172090 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.171843 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/396a51f2-d2b9-402a-8668-faa8c446171b-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-9szth\" (UID: \"396a51f2-d2b9-402a-8668-faa8c446171b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9szth" Jul 16 21:50:44.172090 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:44.171887 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 21:50:44.172090 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:44.171963 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75364348-7d2b-4320-82d5-7ae05b690a88-cluster-monitoring-operator-tls podName:75364348-7d2b-4320-82d5-7ae05b690a88 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:44.671943566 +0000 UTC m=+63.907070717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/75364348-7d2b-4320-82d5-7ae05b690a88-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-vbdw5" (UID: "75364348-7d2b-4320-82d5-7ae05b690a88") : secret "cluster-monitoring-operator-tls" not found Jul 16 21:50:44.172381 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.172363 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/396a51f2-d2b9-402a-8668-faa8c446171b-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-9szth\" (UID: \"396a51f2-d2b9-402a-8668-faa8c446171b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9szth" Jul 16 21:50:44.172500 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.172484 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/75364348-7d2b-4320-82d5-7ae05b690a88-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-vbdw5\" (UID: \"75364348-7d2b-4320-82d5-7ae05b690a88\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vbdw5" Jul 16 21:50:44.173906 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.173884 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/396a51f2-d2b9-402a-8668-faa8c446171b-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-9szth\" (UID: \"396a51f2-d2b9-402a-8668-faa8c446171b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9szth" Jul 16 21:50:44.180833 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.180803 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m866s\" (UniqueName: \"kubernetes.io/projected/396a51f2-d2b9-402a-8668-faa8c446171b-kube-api-access-m866s\") pod \"kube-storage-version-migrator-operator-7658d9b749-9szth\" (UID: \"396a51f2-d2b9-402a-8668-faa8c446171b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9szth" Jul 16 21:50:44.180940 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.180927 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr5mv\" (UniqueName: \"kubernetes.io/projected/75364348-7d2b-4320-82d5-7ae05b690a88-kube-api-access-nr5mv\") pod \"cluster-monitoring-operator-76cf8966f8-vbdw5\" (UID: \"75364348-7d2b-4320-82d5-7ae05b690a88\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vbdw5" Jul 16 21:50:44.181173 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.181157 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 21:50:44.191609 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.191585 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 21:50:44.201852 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.201831 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt266\" (UniqueName: \"kubernetes.io/projected/cdc0b7f0-dd52-4e63-976f-84c68b6846bc-kube-api-access-pt266\") pod \"network-check-source-7bc5b6bf85-sbs8l\" (UID: \"cdc0b7f0-dd52-4e63-976f-84c68b6846bc\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-sbs8l" Jul 16 21:50:44.212644 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.212623 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:44.221566 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.221543 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-sk546" Jul 16 21:50:44.319923 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.319890 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-sbs8l" Jul 16 21:50:44.334479 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.334450 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9szth" Jul 16 21:50:44.340946 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.340909 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-sk546"] Jul 16 21:50:44.343207 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:50:44.343171 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2052aa05_a8ad_403f_9b7c_eb84f1e9ef44.slice/crio-5e623ef52b07660567ebc96865b76cc032f5df055bc6009c071451f8baa47172 WatchSource:0}: Error finding container 5e623ef52b07660567ebc96865b76cc032f5df055bc6009c071451f8baa47172: Status 404 returned error can't find the container with id 5e623ef52b07660567ebc96865b76cc032f5df055bc6009c071451f8baa47172 Jul 16 21:50:44.474984 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.474947 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/85d2de20-f664-4564-953e-e4b7ba798e2c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r4njh\" (UID: \"85d2de20-f664-4564-953e-e4b7ba798e2c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4njh" Jul 16 21:50:44.475153 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:44.475102 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 21:50:44.475202 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:44.475159 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d2de20-f664-4564-953e-e4b7ba798e2c-samples-operator-tls podName:85d2de20-f664-4564-953e-e4b7ba798e2c nodeName:}" failed. No retries permitted until 2026-07-16 21:50:45.475143817 +0000 UTC m=+64.710270955 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/85d2de20-f664-4564-953e-e4b7ba798e2c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-r4njh" (UID: "85d2de20-f664-4564-953e-e4b7ba798e2c") : secret "samples-operator-tls" not found Jul 16 21:50:44.476278 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.476259 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-sbs8l"] Jul 16 21:50:44.478169 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:50:44.478149 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdc0b7f0_dd52_4e63_976f_84c68b6846bc.slice/crio-70233acf5fa69482426c86d9baa70f3e72ab613f60dc125f5aa65c09b00da520 WatchSource:0}: Error finding container 70233acf5fa69482426c86d9baa70f3e72ab613f60dc125f5aa65c09b00da520: Status 404 returned error can't find the container with id 70233acf5fa69482426c86d9baa70f3e72ab613f60dc125f5aa65c09b00da520 Jul 16 21:50:44.491039 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.491016 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9szth"] Jul 16 21:50:44.493681 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:50:44.493661 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod396a51f2_d2b9_402a_8668_faa8c446171b.slice/crio-2f49cdc2d2af63e06951138db9e61ff37be5585aa7ee3fd3e23ea1d3663df1b4 WatchSource:0}: Error finding container 2f49cdc2d2af63e06951138db9e61ff37be5585aa7ee3fd3e23ea1d3663df1b4: Status 404 returned error can't find the container with id 2f49cdc2d2af63e06951138db9e61ff37be5585aa7ee3fd3e23ea1d3663df1b4 Jul 16 21:50:44.564103 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.564062 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9szth" event={"ID":"396a51f2-d2b9-402a-8668-faa8c446171b","Type":"ContainerStarted","Data":"2f49cdc2d2af63e06951138db9e61ff37be5585aa7ee3fd3e23ea1d3663df1b4"} Jul 16 21:50:44.565207 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.565183 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-sk546" event={"ID":"2052aa05-a8ad-403f-9b7c-eb84f1e9ef44","Type":"ContainerStarted","Data":"5e623ef52b07660567ebc96865b76cc032f5df055bc6009c071451f8baa47172"} Jul 16 21:50:44.566254 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.566235 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-sbs8l" event={"ID":"cdc0b7f0-dd52-4e63-976f-84c68b6846bc","Type":"ContainerStarted","Data":"70233acf5fa69482426c86d9baa70f3e72ab613f60dc125f5aa65c09b00da520"} Jul 16 21:50:44.676749 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.676654 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75364348-7d2b-4320-82d5-7ae05b690a88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-vbdw5\" (UID: \"75364348-7d2b-4320-82d5-7ae05b690a88\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vbdw5" Jul 16 21:50:44.676897 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:44.676793 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 21:50:44.676897 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:44.676858 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75364348-7d2b-4320-82d5-7ae05b690a88-cluster-monitoring-operator-tls podName:75364348-7d2b-4320-82d5-7ae05b690a88 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:45.676842554 +0000 UTC m=+64.911969692 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/75364348-7d2b-4320-82d5-7ae05b690a88-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-vbdw5" (UID: "75364348-7d2b-4320-82d5-7ae05b690a88") : secret "cluster-monitoring-operator-tls" not found Jul 16 21:50:44.744036 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.744003 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 16 21:50:44.786880 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.786838 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 16 21:50:44.791733 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.791704 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fr8l\" (UniqueName: \"kubernetes.io/projected/e6213d8c-90b5-4823-ab32-24606edecb40-kube-api-access-2fr8l\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:50:44.834768 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.834736 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 16 21:50:44.886752 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.886723 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 16 21:50:44.889860 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.889833 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 16 21:50:44.891486 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.891463 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/964fa034-949b-4752-8390-dc010d28551a-config\") pod \"console-operator-565b7b569d-kp9cp\" (UID: \"964fa034-949b-4752-8390-dc010d28551a\") " pod="openshift-console-operator/console-operator-565b7b569d-kp9cp" Jul 16 21:50:44.928349 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.928265 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 16 21:50:44.934714 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.934638 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-default-certificate\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:50:44.936761 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.936537 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 16 21:50:44.942844 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.942823 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/964fa034-949b-4752-8390-dc010d28551a-trusted-ca\") pod \"console-operator-565b7b569d-kp9cp\" (UID: \"964fa034-949b-4752-8390-dc010d28551a\") " pod="openshift-console-operator/console-operator-565b7b569d-kp9cp" Jul 16 21:50:44.958650 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.958623 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 16 21:50:44.959220 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.959193 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 16 21:50:44.961041 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.961017 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44b07976-78f7-48e0-9168-869ddd954f1d-service-ca-bundle\") pod \"insights-operator-555d9d7885-khtbj\" (UID: \"44b07976-78f7-48e0-9168-869ddd954f1d\") " pod="openshift-insights/insights-operator-555d9d7885-khtbj" Jul 16 21:50:44.963909 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.963886 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9bb29d49-8d26-4c2d-adac-4e149546517b-serving-cert\") pod \"service-ca-operator-5bcbc94c78-9qm6q\" (UID: \"9bb29d49-8d26-4c2d-adac-4e149546517b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9qm6q" Jul 16 21:50:44.965920 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.965902 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 16 21:50:44.974657 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.974631 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/44b07976-78f7-48e0-9168-869ddd954f1d-serving-cert\") pod \"insights-operator-555d9d7885-khtbj\" (UID: \"44b07976-78f7-48e0-9168-869ddd954f1d\") " pod="openshift-insights/insights-operator-555d9d7885-khtbj" Jul 16 21:50:44.993731 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:44.993701 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-p9z89\"" Jul 16 21:50:45.028860 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.028826 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 16 21:50:45.030946 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:45.030916 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e6213d8c-90b5-4823-ab32-24606edecb40-service-ca-bundle podName:e6213d8c-90b5-4823-ab32-24606edecb40 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:45.530891369 +0000 UTC m=+64.766018528 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e6213d8c-90b5-4823-ab32-24606edecb40-service-ca-bundle") pod "router-default-7b88cbdcf6-9t7wk" (UID: "e6213d8c-90b5-4823-ab32-24606edecb40") : configmap references non-existent config key: service-ca.crt Jul 16 21:50:45.064498 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.064468 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-kq6vg\"" Jul 16 21:50:45.070631 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:45.070603 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: failed to sync secret cache: timed out waiting for the condition Jul 16 21:50:45.070798 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:45.070635 2566 secret.go:189] Couldn't get secret openshift-console-operator/serving-cert: failed to sync secret cache: timed out waiting for the condition Jul 16 21:50:45.070798 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:45.070615 2566 configmap.go:193] Couldn't get configMap openshift-service-ca-operator/service-ca-operator-config: failed to sync configmap cache: timed out waiting for the condition Jul 16 21:50:45.070798 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:45.070684 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-metrics-certs podName:e6213d8c-90b5-4823-ab32-24606edecb40 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:45.570660146 +0000 UTC m=+64.805787307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-metrics-certs") pod "router-default-7b88cbdcf6-9t7wk" (UID: "e6213d8c-90b5-4823-ab32-24606edecb40") : failed to sync secret cache: timed out waiting for the condition Jul 16 21:50:45.070798 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:45.070702 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/964fa034-949b-4752-8390-dc010d28551a-serving-cert podName:964fa034-949b-4752-8390-dc010d28551a nodeName:}" failed. No retries permitted until 2026-07-16 21:50:45.57069302 +0000 UTC m=+64.805820161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/964fa034-949b-4752-8390-dc010d28551a-serving-cert") pod "console-operator-565b7b569d-kp9cp" (UID: "964fa034-949b-4752-8390-dc010d28551a") : failed to sync secret cache: timed out waiting for the condition Jul 16 21:50:45.070798 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:45.070715 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bb29d49-8d26-4c2d-adac-4e149546517b-config podName:9bb29d49-8d26-4c2d-adac-4e149546517b nodeName:}" failed. No retries permitted until 2026-07-16 21:50:45.570709294 +0000 UTC m=+64.805836433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/configmap/9bb29d49-8d26-4c2d-adac-4e149546517b-config") pod "service-ca-operator-5bcbc94c78-9qm6q" (UID: "9bb29d49-8d26-4c2d-adac-4e149546517b") : failed to sync configmap cache: timed out waiting for the condition Jul 16 21:50:45.071068 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:45.070831 2566 configmap.go:193] Couldn't get configMap openshift-insights/trusted-ca-bundle: failed to sync configmap cache: timed out waiting for the condition Jul 16 21:50:45.071068 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:45.070890 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/44b07976-78f7-48e0-9168-869ddd954f1d-trusted-ca-bundle podName:44b07976-78f7-48e0-9168-869ddd954f1d nodeName:}" failed. No retries permitted until 2026-07-16 21:50:45.570874472 +0000 UTC m=+64.806001615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/44b07976-78f7-48e0-9168-869ddd954f1d-trusted-ca-bundle") pod "insights-operator-555d9d7885-khtbj" (UID: "44b07976-78f7-48e0-9168-869ddd954f1d") : failed to sync configmap cache: timed out waiting for the condition Jul 16 21:50:45.071660 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:45.071643 2566 secret.go:189] Couldn't get secret openshift-ingress/router-stats-default: failed to sync secret cache: timed out waiting for the condition Jul 16 21:50:45.071726 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:45.071697 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-stats-auth podName:e6213d8c-90b5-4823-ab32-24606edecb40 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:45.57168524 +0000 UTC m=+64.806812380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "stats-auth" (UniqueName: "kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-stats-auth") pod "router-default-7b88cbdcf6-9t7wk" (UID: "e6213d8c-90b5-4823-ab32-24606edecb40") : failed to sync secret cache: timed out waiting for the condition Jul 16 21:50:45.079364 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:45.079331 2566 projected.go:291] Couldn't get configMap openshift-service-ca-operator/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jul 16 21:50:45.079569 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:45.079403 2566 projected.go:291] Couldn't get configMap openshift-insights/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jul 16 21:50:45.079569 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:45.079442 2566 projected.go:196] Error preparing data for projected volume kube-api-access-q7q7q for pod openshift-insights/insights-operator-555d9d7885-khtbj: failed to sync configmap cache: timed out waiting for the condition Jul 16 21:50:45.079569 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:45.079499 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44b07976-78f7-48e0-9168-869ddd954f1d-kube-api-access-q7q7q podName:44b07976-78f7-48e0-9168-869ddd954f1d nodeName:}" failed. No retries permitted until 2026-07-16 21:50:45.579483991 +0000 UTC m=+64.814611143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q7q7q" (UniqueName: "kubernetes.io/projected/44b07976-78f7-48e0-9168-869ddd954f1d-kube-api-access-q7q7q") pod "insights-operator-555d9d7885-khtbj" (UID: "44b07976-78f7-48e0-9168-869ddd954f1d") : failed to sync configmap cache: timed out waiting for the condition Jul 16 21:50:45.095718 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.095691 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 16 21:50:45.130775 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.130748 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-t7cqn\"" Jul 16 21:50:45.164029 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.163996 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tqw5w\"" Jul 16 21:50:45.192166 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.192090 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 16 21:50:45.221905 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.221868 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 16 21:50:45.260891 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.260859 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 16 21:50:45.280092 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.280063 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 16 21:50:45.282524 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.282503 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 16 21:50:45.290859 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.290830 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 16 21:50:45.300131 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:45.300100 2566 projected.go:196] Error preparing data for projected volume kube-api-access-c6v4l for pod openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9qm6q: failed to sync configmap cache: timed out waiting for the condition Jul 16 21:50:45.300263 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:45.300183 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bb29d49-8d26-4c2d-adac-4e149546517b-kube-api-access-c6v4l podName:9bb29d49-8d26-4c2d-adac-4e149546517b nodeName:}" failed. No retries permitted until 2026-07-16 21:50:45.800162809 +0000 UTC m=+65.035289952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c6v4l" (UniqueName: "kubernetes.io/projected/9bb29d49-8d26-4c2d-adac-4e149546517b-kube-api-access-c6v4l") pod "service-ca-operator-5bcbc94c78-9qm6q" (UID: "9bb29d49-8d26-4c2d-adac-4e149546517b") : failed to sync configmap cache: timed out waiting for the condition Jul 16 21:50:45.455639 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.455616 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 16 21:50:45.480522 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.480488 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 16 21:50:45.484301 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.484275 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/85d2de20-f664-4564-953e-e4b7ba798e2c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r4njh\" (UID: \"85d2de20-f664-4564-953e-e4b7ba798e2c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4njh" Jul 16 21:50:45.484412 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:45.484393 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 21:50:45.484507 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:45.484483 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d2de20-f664-4564-953e-e4b7ba798e2c-samples-operator-tls podName:85d2de20-f664-4564-953e-e4b7ba798e2c nodeName:}" failed. No retries permitted until 2026-07-16 21:50:47.48446345 +0000 UTC m=+66.719590602 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/85d2de20-f664-4564-953e-e4b7ba798e2c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-r4njh" (UID: "85d2de20-f664-4564-953e-e4b7ba798e2c") : secret "samples-operator-tls" not found Jul 16 21:50:45.492379 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.492277 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvpz6\" (UniqueName: \"kubernetes.io/projected/964fa034-949b-4752-8390-dc010d28551a-kube-api-access-wvpz6\") pod \"console-operator-565b7b569d-kp9cp\" (UID: \"964fa034-949b-4752-8390-dc010d28551a\") " pod="openshift-console-operator/console-operator-565b7b569d-kp9cp" Jul 16 21:50:45.571587 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.571552 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-sk546" event={"ID":"2052aa05-a8ad-403f-9b7c-eb84f1e9ef44","Type":"ContainerStarted","Data":"0ce3e631eea6b663a4f019fabaa8d1dc5074724af62a64b73d57b62401bcc750"} Jul 16 21:50:45.585119 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.585083 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9bb29d49-8d26-4c2d-adac-4e149546517b-config\") pod \"service-ca-operator-5bcbc94c78-9qm6q\" (UID: \"9bb29d49-8d26-4c2d-adac-4e149546517b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9qm6q" Jul 16 21:50:45.585282 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.585164 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7q7q\" (UniqueName: \"kubernetes.io/projected/44b07976-78f7-48e0-9168-869ddd954f1d-kube-api-access-q7q7q\") pod \"insights-operator-555d9d7885-khtbj\" (UID: \"44b07976-78f7-48e0-9168-869ddd954f1d\") " pod="openshift-insights/insights-operator-555d9d7885-khtbj" Jul 16 21:50:45.585282 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.585206 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/964fa034-949b-4752-8390-dc010d28551a-serving-cert\") pod \"console-operator-565b7b569d-kp9cp\" (UID: \"964fa034-949b-4752-8390-dc010d28551a\") " pod="openshift-console-operator/console-operator-565b7b569d-kp9cp" Jul 16 21:50:45.585282 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.585243 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-metrics-certs\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:50:45.585463 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.585285 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6213d8c-90b5-4823-ab32-24606edecb40-service-ca-bundle\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:50:45.585463 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.585372 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44b07976-78f7-48e0-9168-869ddd954f1d-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-khtbj\" (UID: \"44b07976-78f7-48e0-9168-869ddd954f1d\") " pod="openshift-insights/insights-operator-555d9d7885-khtbj" Jul 16 21:50:45.585559 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.585479 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-stats-auth\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:50:45.585691 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:45.585668 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e6213d8c-90b5-4823-ab32-24606edecb40-service-ca-bundle podName:e6213d8c-90b5-4823-ab32-24606edecb40 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:46.585648397 +0000 UTC m=+65.820775538 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e6213d8c-90b5-4823-ab32-24606edecb40-service-ca-bundle") pod "router-default-7b88cbdcf6-9t7wk" (UID: "e6213d8c-90b5-4823-ab32-24606edecb40") : configmap references non-existent config key: service-ca.crt Jul 16 21:50:45.586019 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:45.585993 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 21:50:45.586110 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:45.586069 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-metrics-certs podName:e6213d8c-90b5-4823-ab32-24606edecb40 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:46.586048483 +0000 UTC m=+65.821175642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-metrics-certs") pod "router-default-7b88cbdcf6-9t7wk" (UID: "e6213d8c-90b5-4823-ab32-24606edecb40") : secret "router-metrics-certs-default" not found Jul 16 21:50:45.586194 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.586173 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9bb29d49-8d26-4c2d-adac-4e149546517b-config\") pod \"service-ca-operator-5bcbc94c78-9qm6q\" (UID: \"9bb29d49-8d26-4c2d-adac-4e149546517b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9qm6q" Jul 16 21:50:45.587571 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.587541 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44b07976-78f7-48e0-9168-869ddd954f1d-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-khtbj\" (UID: \"44b07976-78f7-48e0-9168-869ddd954f1d\") " pod="openshift-insights/insights-operator-555d9d7885-khtbj" Jul 16 21:50:45.588855 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.588665 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-stats-auth\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:50:45.588855 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.588729 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7q7q\" (UniqueName: \"kubernetes.io/projected/44b07976-78f7-48e0-9168-869ddd954f1d-kube-api-access-q7q7q\") pod \"insights-operator-555d9d7885-khtbj\" (UID: \"44b07976-78f7-48e0-9168-869ddd954f1d\") " pod="openshift-insights/insights-operator-555d9d7885-khtbj" Jul 16 21:50:45.589011 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.588956 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/964fa034-949b-4752-8390-dc010d28551a-serving-cert\") pod \"console-operator-565b7b569d-kp9cp\" (UID: \"964fa034-949b-4752-8390-dc010d28551a\") " pod="openshift-console-operator/console-operator-565b7b569d-kp9cp" Jul 16 21:50:45.589507 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.589468 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-sk546" podStartSLOduration=1.5170815659999999 podStartE2EDuration="2.589455519s" totalImagesPullingTime="1.072373953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:45.588993436 +0000 UTC m=+64.824120597" watchObservedRunningTime="2026-07-16 21:50:45.589455519 +0000 UTC m=+64.824582697" Jul 16 21:50:45.686042 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.686006 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75364348-7d2b-4320-82d5-7ae05b690a88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-vbdw5\" (UID: \"75364348-7d2b-4320-82d5-7ae05b690a88\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vbdw5" Jul 16 21:50:45.686230 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:45.686171 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 21:50:45.686291 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:45.686246 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75364348-7d2b-4320-82d5-7ae05b690a88-cluster-monitoring-operator-tls podName:75364348-7d2b-4320-82d5-7ae05b690a88 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:47.686225016 +0000 UTC m=+66.921352153 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/75364348-7d2b-4320-82d5-7ae05b690a88-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-vbdw5" (UID: "75364348-7d2b-4320-82d5-7ae05b690a88") : secret "cluster-monitoring-operator-tls" not found Jul 16 21:50:45.726592 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.726542 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:45.731342 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.731317 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-khtbj" Jul 16 21:50:45.738016 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.737987 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-kp9cp" Jul 16 21:50:45.876630 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.876590 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-kp9cp"] Jul 16 21:50:45.879706 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:50:45.879638 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod964fa034_949b_4752_8390_dc010d28551a.slice/crio-4dd2a451fd38b2eddeae9b68d592a77f1cc26292ef995462a41d392424c07282 WatchSource:0}: Error finding container 4dd2a451fd38b2eddeae9b68d592a77f1cc26292ef995462a41d392424c07282: Status 404 returned error can't find the container with id 4dd2a451fd38b2eddeae9b68d592a77f1cc26292ef995462a41d392424c07282 Jul 16 21:50:45.888523 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.888482 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6v4l\" (UniqueName: \"kubernetes.io/projected/9bb29d49-8d26-4c2d-adac-4e149546517b-kube-api-access-c6v4l\") pod \"service-ca-operator-5bcbc94c78-9qm6q\" (UID: \"9bb29d49-8d26-4c2d-adac-4e149546517b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9qm6q" Jul 16 21:50:45.891431 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.891393 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6v4l\" (UniqueName: \"kubernetes.io/projected/9bb29d49-8d26-4c2d-adac-4e149546517b-kube-api-access-c6v4l\") pod \"service-ca-operator-5bcbc94c78-9qm6q\" (UID: \"9bb29d49-8d26-4c2d-adac-4e149546517b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9qm6q" Jul 16 21:50:45.899063 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:45.899000 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-khtbj"] Jul 16 21:50:45.902390 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:50:45.902345 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44b07976_78f7_48e0_9168_869ddd954f1d.slice/crio-3a75d6c18e8857506d9c296309fdf0a68bb8825550ee6f5f752eafe1dd652792 WatchSource:0}: Error finding container 3a75d6c18e8857506d9c296309fdf0a68bb8825550ee6f5f752eafe1dd652792: Status 404 returned error can't find the container with id 3a75d6c18e8857506d9c296309fdf0a68bb8825550ee6f5f752eafe1dd652792 Jul 16 21:50:46.047126 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:46.047043 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9qm6q" Jul 16 21:50:46.190881 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:46.190849 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9qm6q"] Jul 16 21:50:46.575765 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:46.575719 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-kp9cp" event={"ID":"964fa034-949b-4752-8390-dc010d28551a","Type":"ContainerStarted","Data":"4dd2a451fd38b2eddeae9b68d592a77f1cc26292ef995462a41d392424c07282"} Jul 16 21:50:46.577574 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:46.577540 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-khtbj" event={"ID":"44b07976-78f7-48e0-9168-869ddd954f1d","Type":"ContainerStarted","Data":"3a75d6c18e8857506d9c296309fdf0a68bb8825550ee6f5f752eafe1dd652792"} Jul 16 21:50:46.594114 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:46.594086 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-metrics-certs\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:50:46.594263 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:46.594139 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6213d8c-90b5-4823-ab32-24606edecb40-service-ca-bundle\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:50:46.594263 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:46.594192 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 21:50:46.594384 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:46.594298 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-metrics-certs podName:e6213d8c-90b5-4823-ab32-24606edecb40 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:48.594278109 +0000 UTC m=+67.829405253 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-metrics-certs") pod "router-default-7b88cbdcf6-9t7wk" (UID: "e6213d8c-90b5-4823-ab32-24606edecb40") : secret "router-metrics-certs-default" not found Jul 16 21:50:46.594384 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:46.594357 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e6213d8c-90b5-4823-ab32-24606edecb40-service-ca-bundle podName:e6213d8c-90b5-4823-ab32-24606edecb40 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:48.594347824 +0000 UTC m=+67.829474965 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e6213d8c-90b5-4823-ab32-24606edecb40-service-ca-bundle") pod "router-default-7b88cbdcf6-9t7wk" (UID: "e6213d8c-90b5-4823-ab32-24606edecb40") : configmap references non-existent config key: service-ca.crt Jul 16 21:50:46.667333 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:50:46.667300 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bb29d49_8d26_4c2d_adac_4e149546517b.slice/crio-90058603f3b2be5c8b0ec697f45bb0177e03b4205b544b4bda46b1913b4049ec WatchSource:0}: Error finding container 90058603f3b2be5c8b0ec697f45bb0177e03b4205b544b4bda46b1913b4049ec: Status 404 returned error can't find the container with id 90058603f3b2be5c8b0ec697f45bb0177e03b4205b544b4bda46b1913b4049ec Jul 16 21:50:46.999227 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:46.998831 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9glrc\" (UniqueName: \"kubernetes.io/projected/97c82c64-748f-4a8d-b4e3-3111b7d31cdc-kube-api-access-9glrc\") pod \"network-check-target-c9f2s\" (UID: \"97c82c64-748f-4a8d-b4e3-3111b7d31cdc\") " pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:50:47.002192 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:47.002161 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9glrc\" (UniqueName: \"kubernetes.io/projected/97c82c64-748f-4a8d-b4e3-3111b7d31cdc-kube-api-access-9glrc\") pod \"network-check-target-c9f2s\" (UID: \"97c82c64-748f-4a8d-b4e3-3111b7d31cdc\") " pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:50:47.019616 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:47.019590 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wslpm\"" Jul 16 21:50:47.027059 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:47.027033 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:50:47.100301 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:47.100110 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4509b338-7e48-41c0-b1ef-fe88c6165229-original-pull-secret\") pod \"global-pull-secret-syncer-w9jn7\" (UID: \"4509b338-7e48-41c0-b1ef-fe88c6165229\") " pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:50:47.100301 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:47.100243 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b90276c-b68f-49a9-b571-13174fb91f20-metrics-certs\") pod \"network-metrics-daemon-j7587\" (UID: \"4b90276c-b68f-49a9-b571-13174fb91f20\") " pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:50:47.119147 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:47.117255 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 21:50:47.119147 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:47.117527 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 21:50:47.121602 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:47.121569 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 16 21:50:47.121729 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:47.121644 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b90276c-b68f-49a9-b571-13174fb91f20-metrics-certs podName:4b90276c-b68f-49a9-b571-13174fb91f20 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:51.121623268 +0000 UTC m=+130.356750428 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b90276c-b68f-49a9-b571-13174fb91f20-metrics-certs") pod "network-metrics-daemon-j7587" (UID: "4b90276c-b68f-49a9-b571-13174fb91f20") : secret "metrics-daemon-secret" not found Jul 16 21:50:47.124268 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:47.124214 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4509b338-7e48-41c0-b1ef-fe88c6165229-original-pull-secret\") pod \"global-pull-secret-syncer-w9jn7\" (UID: \"4509b338-7e48-41c0-b1ef-fe88c6165229\") " pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:50:47.275468 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:47.275342 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:47.324163 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:47.324131 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jn7" Jul 16 21:50:47.374617 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:47.374528 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:47.492374 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:47.492298 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:47.504505 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:47.504473 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/85d2de20-f664-4564-953e-e4b7ba798e2c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r4njh\" (UID: \"85d2de20-f664-4564-953e-e4b7ba798e2c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4njh" Jul 16 21:50:47.504677 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:47.504650 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 21:50:47.504734 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:47.504721 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d2de20-f664-4564-953e-e4b7ba798e2c-samples-operator-tls podName:85d2de20-f664-4564-953e-e4b7ba798e2c nodeName:}" failed. No retries permitted until 2026-07-16 21:50:51.504700394 +0000 UTC m=+70.739827549 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/85d2de20-f664-4564-953e-e4b7ba798e2c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-r4njh" (UID: "85d2de20-f664-4564-953e-e4b7ba798e2c") : secret "samples-operator-tls" not found Jul 16 21:50:47.582948 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:47.582857 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9szth" event={"ID":"396a51f2-d2b9-402a-8668-faa8c446171b","Type":"ContainerStarted","Data":"3be14b7b0cb91b63e88b012171211b1d61cd4890f9a9ecbcad68d1fbbbc8014d"} Jul 16 21:50:47.584643 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:47.584612 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9qm6q" event={"ID":"9bb29d49-8d26-4c2d-adac-4e149546517b","Type":"ContainerStarted","Data":"90058603f3b2be5c8b0ec697f45bb0177e03b4205b544b4bda46b1913b4049ec"} Jul 16 21:50:47.603530 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:47.603470 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9szth" podStartSLOduration=2.40342237 podStartE2EDuration="4.603456042s" totalImagesPullingTime="2.200033672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:47.602002941 +0000 UTC m=+66.837130103" watchObservedRunningTime="2026-07-16 21:50:47.603456042 +0000 UTC m=+66.838583180" Jul 16 21:50:47.706353 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:47.706306 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75364348-7d2b-4320-82d5-7ae05b690a88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-vbdw5\" (UID: \"75364348-7d2b-4320-82d5-7ae05b690a88\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vbdw5" Jul 16 21:50:47.706561 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:47.706532 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 21:50:47.706630 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:47.706619 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75364348-7d2b-4320-82d5-7ae05b690a88-cluster-monitoring-operator-tls podName:75364348-7d2b-4320-82d5-7ae05b690a88 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:51.706597046 +0000 UTC m=+70.941724200 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/75364348-7d2b-4320-82d5-7ae05b690a88-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-vbdw5" (UID: "75364348-7d2b-4320-82d5-7ae05b690a88") : secret "cluster-monitoring-operator-tls" not found Jul 16 21:50:48.513083 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:48.513037 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-metrics-tls\") pod \"dns-default-2bhgs\" (UID: \"1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40\") " pod="openshift-dns/dns-default-2bhgs" Jul 16 21:50:48.513579 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:48.513107 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-tls\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:50:48.513579 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:48.513181 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 21:50:48.513579 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:48.513227 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 21:50:48.513579 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:48.513240 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-864c69867d-j5k2t: secret "image-registry-tls" not found Jul 16 21:50:48.513579 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:48.513261 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-metrics-tls podName:1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:20.513239484 +0000 UTC m=+99.748366640 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-metrics-tls") pod "dns-default-2bhgs" (UID: "1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40") : secret "dns-default-metrics-tls" not found Jul 16 21:50:48.513579 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:48.513290 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-tls podName:846b555e-524b-4bfe-85e3-8782fd7c49ed nodeName:}" failed. No retries permitted until 2026-07-16 21:51:20.513273358 +0000 UTC m=+99.748400519 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-tls") pod "image-registry-864c69867d-j5k2t" (UID: "846b555e-524b-4bfe-85e3-8782fd7c49ed") : secret "image-registry-tls" not found Jul 16 21:50:48.529862 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:48.529826 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:48.613868 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:48.613806 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-metrics-certs\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:50:48.613868 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:48.613868 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6213d8c-90b5-4823-ab32-24606edecb40-service-ca-bundle\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:50:48.614093 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:48.613954 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 21:50:48.614093 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:48.614016 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-metrics-certs podName:e6213d8c-90b5-4823-ab32-24606edecb40 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:52.613996426 +0000 UTC m=+71.849123564 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-metrics-certs") pod "router-default-7b88cbdcf6-9t7wk" (UID: "e6213d8c-90b5-4823-ab32-24606edecb40") : secret "router-metrics-certs-default" not found Jul 16 21:50:48.614093 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:48.614066 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e6213d8c-90b5-4823-ab32-24606edecb40-service-ca-bundle podName:e6213d8c-90b5-4823-ab32-24606edecb40 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:52.614050622 +0000 UTC m=+71.849177761 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e6213d8c-90b5-4823-ab32-24606edecb40-service-ca-bundle") pod "router-default-7b88cbdcf6-9t7wk" (UID: "e6213d8c-90b5-4823-ab32-24606edecb40") : configmap references non-existent config key: service-ca.crt Jul 16 21:50:48.625037 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:48.625003 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:48.722358 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:48.722316 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:49.766910 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:49.766789 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-c9f2s"] Jul 16 21:50:49.771640 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:50:49.771607 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c82c64_748f_4a8d_b4e3_3111b7d31cdc.slice/crio-883c823f366209b2ae38d75c280f9878282aefdaa2451327702c7d57d6ef88b5 WatchSource:0}: Error finding container 883c823f366209b2ae38d75c280f9878282aefdaa2451327702c7d57d6ef88b5: Status 404 returned error can't find the container with id 883c823f366209b2ae38d75c280f9878282aefdaa2451327702c7d57d6ef88b5 Jul 16 21:50:49.785297 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:49.784867 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w9jn7"] Jul 16 21:50:49.788543 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:50:49.788513 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4509b338_7e48_41c0_b1ef_fe88c6165229.slice/crio-d3dead966250e15a6ebc1e22087bc6eeddc0d155b37a3502ec6388ffa246968b WatchSource:0}: Error finding container d3dead966250e15a6ebc1e22087bc6eeddc0d155b37a3502ec6388ffa246968b: Status 404 returned error can't find the container with id d3dead966250e15a6ebc1e22087bc6eeddc0d155b37a3502ec6388ffa246968b Jul 16 21:50:50.599014 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:50.598969 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w9jn7" event={"ID":"4509b338-7e48-41c0-b1ef-fe88c6165229","Type":"ContainerStarted","Data":"d3dead966250e15a6ebc1e22087bc6eeddc0d155b37a3502ec6388ffa246968b"} Jul 16 21:50:50.601131 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:50.601102 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-c9f2s" event={"ID":"97c82c64-748f-4a8d-b4e3-3111b7d31cdc","Type":"ContainerStarted","Data":"32579c929e9e98aea64efadec2bcae3b2d2c5e5a4eb4f1c7e214ebea0e0aab31"} Jul 16 21:50:50.601275 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:50.601152 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-c9f2s" event={"ID":"97c82c64-748f-4a8d-b4e3-3111b7d31cdc","Type":"ContainerStarted","Data":"883c823f366209b2ae38d75c280f9878282aefdaa2451327702c7d57d6ef88b5"} Jul 16 21:50:50.601892 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:50.601872 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:50:50.604102 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:50.604074 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-sbs8l" event={"ID":"cdc0b7f0-dd52-4e63-976f-84c68b6846bc","Type":"ContainerStarted","Data":"7a8c7a34f4e7b4ddc2959a792d55e574a6890b1f16260b8a942c91c8cf24e73b"} Jul 16 21:50:50.608171 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:50.607572 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kp9cp_964fa034-949b-4752-8390-dc010d28551a/console-operator/0.log" Jul 16 21:50:50.608171 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:50.607609 2566 generic.go:356] "Generic (PLEG): container finished" podID="964fa034-949b-4752-8390-dc010d28551a" containerID="58fc3cc9cb6318f2c583371e67e9f4f2eaa49a62d0da15cc5ff14b9f10f5b147" exitCode=255 Jul 16 21:50:50.608171 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:50.607928 2566 scope.go:117] "RemoveContainer" containerID="58fc3cc9cb6318f2c583371e67e9f4f2eaa49a62d0da15cc5ff14b9f10f5b147" Jul 16 21:50:50.608171 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:50.607948 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-kp9cp" event={"ID":"964fa034-949b-4752-8390-dc010d28551a","Type":"ContainerDied","Data":"58fc3cc9cb6318f2c583371e67e9f4f2eaa49a62d0da15cc5ff14b9f10f5b147"} Jul 16 21:50:50.609801 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:50.609773 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-khtbj" event={"ID":"44b07976-78f7-48e0-9168-869ddd954f1d","Type":"ContainerStarted","Data":"1f0679a06d68ee910847f75376f7ea13e70ebf6a755c0a5a20b37d0edc4e50ff"} Jul 16 21:50:50.643282 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:50.643226 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-c9f2s" podStartSLOduration=69.643206488 podStartE2EDuration="1m9.643206488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:49:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:50.623117985 +0000 UTC m=+69.858245147" watchObservedRunningTime="2026-07-16 21:50:50.643206488 +0000 UTC m=+69.878333651" Jul 16 21:50:50.644082 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:50.643784 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-khtbj" podStartSLOduration=3.950034563 podStartE2EDuration="7.643772346s" totalImagesPullingTime="3.693737783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:50.641533495 +0000 UTC m=+69.876660655" watchObservedRunningTime="2026-07-16 21:50:50.643772346 +0000 UTC m=+69.878899508" Jul 16 21:50:50.683944 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:50.683886 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-sbs8l" podStartSLOduration=2.565777659 podStartE2EDuration="7.683864231s" totalImagesPullingTime="5.118086572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:50.683385939 +0000 UTC m=+69.918513175" watchObservedRunningTime="2026-07-16 21:50:50.683864231 +0000 UTC m=+69.918991393" Jul 16 21:50:50.939789 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:50.939727 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:51.041388 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.041303 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:51.374471 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.374445 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:51.469712 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.469676 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:51.541025 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.540929 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/85d2de20-f664-4564-953e-e4b7ba798e2c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r4njh\" (UID: \"85d2de20-f664-4564-953e-e4b7ba798e2c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4njh" Jul 16 21:50:51.541192 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:51.541087 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 21:50:51.541192 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:51.541165 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d2de20-f664-4564-953e-e4b7ba798e2c-samples-operator-tls podName:85d2de20-f664-4564-953e-e4b7ba798e2c nodeName:}" failed. No retries permitted until 2026-07-16 21:50:59.541144615 +0000 UTC m=+78.776271767 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/85d2de20-f664-4564-953e-e4b7ba798e2c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-r4njh" (UID: "85d2de20-f664-4564-953e-e4b7ba798e2c") : secret "samples-operator-tls" not found Jul 16 21:50:51.615477 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.615443 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kp9cp_964fa034-949b-4752-8390-dc010d28551a/console-operator/1.log" Jul 16 21:50:51.616512 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.616484 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kp9cp_964fa034-949b-4752-8390-dc010d28551a/console-operator/0.log" Jul 16 21:50:51.616652 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.616558 2566 generic.go:356] "Generic (PLEG): container finished" podID="964fa034-949b-4752-8390-dc010d28551a" containerID="ef88c0c4bd4dfee3b92b1e600559e7f5eeaba81b5ac224060aaaf2b8bd0ce788" exitCode=255 Jul 16 21:50:51.616716 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.616681 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-kp9cp" event={"ID":"964fa034-949b-4752-8390-dc010d28551a","Type":"ContainerDied","Data":"ef88c0c4bd4dfee3b92b1e600559e7f5eeaba81b5ac224060aaaf2b8bd0ce788"} Jul 16 21:50:51.616774 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.616734 2566 scope.go:117] "RemoveContainer" containerID="58fc3cc9cb6318f2c583371e67e9f4f2eaa49a62d0da15cc5ff14b9f10f5b147" Jul 16 21:50:51.617033 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.617013 2566 scope.go:117] "RemoveContainer" containerID="ef88c0c4bd4dfee3b92b1e600559e7f5eeaba81b5ac224060aaaf2b8bd0ce788" Jul 16 21:50:51.617257 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:51.617228 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-kp9cp_openshift-console-operator(964fa034-949b-4752-8390-dc010d28551a)\"" pod="openshift-console-operator/console-operator-565b7b569d-kp9cp" podUID="964fa034-949b-4752-8390-dc010d28551a" Jul 16 21:50:51.618891 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.618857 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9qm6q" event={"ID":"9bb29d49-8d26-4c2d-adac-4e149546517b","Type":"ContainerStarted","Data":"7888e751cc693fa07438d38cf7ed24867886ef30054bf6cde95a75e891a47ca0"} Jul 16 21:50:51.639022 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.638984 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:51.665778 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.665749 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bklrd"] Jul 16 21:50:51.708444 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.706103 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bklrd"] Jul 16 21:50:51.708444 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.706227 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:50:51.720464 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.719315 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s89fr\"" Jul 16 21:50:51.720464 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.719569 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 16 21:50:51.720464 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.719759 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 16 21:50:51.724149 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.724077 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:51.743100 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.743046 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9qm6q" podStartSLOduration=4.1317204180000004 podStartE2EDuration="8.74303213s" totalImagesPullingTime="4.611311712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:51.720511775 +0000 UTC m=+70.955638936" watchObservedRunningTime="2026-07-16 21:50:51.74303213 +0000 UTC m=+70.978159288" Jul 16 21:50:51.743575 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.743554 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-data-volume\") pod \"insights-runtime-extractor-bklrd\" (UID: \"f82300d7-fb78-4295-b1a6-37e9f7ed8e18\") " pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:50:51.743682 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.743607 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bklrd\" (UID: \"f82300d7-fb78-4295-b1a6-37e9f7ed8e18\") " pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:50:51.743682 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.743639 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bklrd\" (UID: \"f82300d7-fb78-4295-b1a6-37e9f7ed8e18\") " pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:50:51.743800 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.743696 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-crio-socket\") pod \"insights-runtime-extractor-bklrd\" (UID: \"f82300d7-fb78-4295-b1a6-37e9f7ed8e18\") " pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:50:51.743800 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.743733 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nlwl\" (UniqueName: \"kubernetes.io/projected/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-kube-api-access-9nlwl\") pod \"insights-runtime-extractor-bklrd\" (UID: \"f82300d7-fb78-4295-b1a6-37e9f7ed8e18\") " pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:50:51.744633 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.743955 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75364348-7d2b-4320-82d5-7ae05b690a88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-vbdw5\" (UID: \"75364348-7d2b-4320-82d5-7ae05b690a88\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vbdw5" Jul 16 21:50:51.744759 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:51.744741 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 21:50:51.744830 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:51.744804 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75364348-7d2b-4320-82d5-7ae05b690a88-cluster-monitoring-operator-tls podName:75364348-7d2b-4320-82d5-7ae05b690a88 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:59.74478473 +0000 UTC m=+78.979911868 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/75364348-7d2b-4320-82d5-7ae05b690a88-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-vbdw5" (UID: "75364348-7d2b-4320-82d5-7ae05b690a88") : secret "cluster-monitoring-operator-tls" not found Jul 16 21:50:51.788075 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.788039 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:51.845208 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.845121 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nlwl\" (UniqueName: \"kubernetes.io/projected/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-kube-api-access-9nlwl\") pod \"insights-runtime-extractor-bklrd\" (UID: \"f82300d7-fb78-4295-b1a6-37e9f7ed8e18\") " pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:50:51.845359 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.845289 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-data-volume\") pod \"insights-runtime-extractor-bklrd\" (UID: \"f82300d7-fb78-4295-b1a6-37e9f7ed8e18\") " pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:50:51.845359 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.845323 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bklrd\" (UID: \"f82300d7-fb78-4295-b1a6-37e9f7ed8e18\") " pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:50:51.845359 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.845348 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bklrd\" (UID: \"f82300d7-fb78-4295-b1a6-37e9f7ed8e18\") " pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:50:51.845533 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.845376 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-crio-socket\") pod \"insights-runtime-extractor-bklrd\" (UID: \"f82300d7-fb78-4295-b1a6-37e9f7ed8e18\") " pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:50:51.845533 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.845475 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-crio-socket\") pod \"insights-runtime-extractor-bklrd\" (UID: \"f82300d7-fb78-4295-b1a6-37e9f7ed8e18\") " pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:50:51.845619 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:51.845536 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 21:50:51.845619 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:51.845550 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 21:50:51.845619 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:51.845589 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-kube-rbac-proxy-cm podName:f82300d7-fb78-4295-b1a6-37e9f7ed8e18 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:52.345571102 +0000 UTC m=+71.580698241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bklrd" (UID: "f82300d7-fb78-4295-b1a6-37e9f7ed8e18") : configmap "kube-rbac-proxy" not found Jul 16 21:50:51.845619 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:51.845605 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-insights-runtime-extractor-tls podName:f82300d7-fb78-4295-b1a6-37e9f7ed8e18 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:52.345596465 +0000 UTC m=+71.580723607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bklrd" (UID: "f82300d7-fb78-4295-b1a6-37e9f7ed8e18") : secret "insights-runtime-extractor-tls" not found Jul 16 21:50:51.846098 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.846077 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-data-volume\") pod \"insights-runtime-extractor-bklrd\" (UID: \"f82300d7-fb78-4295-b1a6-37e9f7ed8e18\") " pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:50:51.856333 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:51.856305 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nlwl\" (UniqueName: \"kubernetes.io/projected/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-kube-api-access-9nlwl\") pod \"insights-runtime-extractor-bklrd\" (UID: \"f82300d7-fb78-4295-b1a6-37e9f7ed8e18\") " pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:50:52.349950 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:52.349910 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bklrd\" (UID: \"f82300d7-fb78-4295-b1a6-37e9f7ed8e18\") " pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:50:52.349950 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:52.349949 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bklrd\" (UID: \"f82300d7-fb78-4295-b1a6-37e9f7ed8e18\") " pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:50:52.350468 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:52.350048 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 21:50:52.350468 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:52.350085 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 21:50:52.350468 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:52.350099 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-kube-rbac-proxy-cm podName:f82300d7-fb78-4295-b1a6-37e9f7ed8e18 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:53.350082866 +0000 UTC m=+72.585210008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bklrd" (UID: "f82300d7-fb78-4295-b1a6-37e9f7ed8e18") : configmap "kube-rbac-proxy" not found Jul 16 21:50:52.350468 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:52.350165 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-insights-runtime-extractor-tls podName:f82300d7-fb78-4295-b1a6-37e9f7ed8e18 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:53.350146472 +0000 UTC m=+72.585273618 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bklrd" (UID: "f82300d7-fb78-4295-b1a6-37e9f7ed8e18") : secret "insights-runtime-extractor-tls" not found Jul 16 21:50:52.626499 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:52.626371 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kp9cp_964fa034-949b-4752-8390-dc010d28551a/console-operator/1.log" Jul 16 21:50:52.626790 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:52.626766 2566 scope.go:117] "RemoveContainer" containerID="ef88c0c4bd4dfee3b92b1e600559e7f5eeaba81b5ac224060aaaf2b8bd0ce788" Jul 16 21:50:52.627004 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:52.626978 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-kp9cp_openshift-console-operator(964fa034-949b-4752-8390-dc010d28551a)\"" pod="openshift-console-operator/console-operator-565b7b569d-kp9cp" podUID="964fa034-949b-4752-8390-dc010d28551a" Jul 16 21:50:52.652744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:52.652705 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-metrics-certs\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:50:52.652894 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:52.652759 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6213d8c-90b5-4823-ab32-24606edecb40-service-ca-bundle\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:50:52.652894 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:52.652879 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 21:50:52.652994 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:52.652955 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-metrics-certs podName:e6213d8c-90b5-4823-ab32-24606edecb40 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:00.652934975 +0000 UTC m=+79.888062118 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-metrics-certs") pod "router-default-7b88cbdcf6-9t7wk" (UID: "e6213d8c-90b5-4823-ab32-24606edecb40") : secret "router-metrics-certs-default" not found Jul 16 21:50:52.652994 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:52.652984 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e6213d8c-90b5-4823-ab32-24606edecb40-service-ca-bundle podName:e6213d8c-90b5-4823-ab32-24606edecb40 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:00.652968313 +0000 UTC m=+79.888095463 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e6213d8c-90b5-4823-ab32-24606edecb40-service-ca-bundle") pod "router-default-7b88cbdcf6-9t7wk" (UID: "e6213d8c-90b5-4823-ab32-24606edecb40") : configmap references non-existent config key: service-ca.crt Jul 16 21:50:53.028635 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:53.028598 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:53.225197 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:53.225158 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:53.358731 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:53.358636 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bklrd\" (UID: \"f82300d7-fb78-4295-b1a6-37e9f7ed8e18\") " pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:50:53.358731 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:53.358690 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bklrd\" (UID: \"f82300d7-fb78-4295-b1a6-37e9f7ed8e18\") " pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:50:53.359195 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:53.358816 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 21:50:53.359195 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:53.358891 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-insights-runtime-extractor-tls podName:f82300d7-fb78-4295-b1a6-37e9f7ed8e18 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:55.358871983 +0000 UTC m=+74.593999128 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bklrd" (UID: "f82300d7-fb78-4295-b1a6-37e9f7ed8e18") : secret "insights-runtime-extractor-tls" not found Jul 16 21:50:53.359195 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:53.358828 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 21:50:53.359195 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:53.358978 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-kube-rbac-proxy-cm podName:f82300d7-fb78-4295-b1a6-37e9f7ed8e18 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:55.358959079 +0000 UTC m=+74.594086230 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bklrd" (UID: "f82300d7-fb78-4295-b1a6-37e9f7ed8e18") : configmap "kube-rbac-proxy" not found Jul 16 21:50:53.460464 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:53.460411 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:53.531750 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:53.531714 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:53.728235 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:53.728195 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:53.830702 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:53.830651 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:53.937254 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:53.937227 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t792r_3fd95e60-8961-41fc-a136-25b7b76fbc55/dns-node-resolver/0.log" Jul 16 21:50:54.634430 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:54.634395 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w9jn7" event={"ID":"4509b338-7e48-41c0-b1ef-fe88c6165229","Type":"ContainerStarted","Data":"946afe6c6dba9d9740a24df4ea4092df19ca5e1c013b90639cac2e5ef8d9826a"} Jul 16 21:50:54.653162 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:54.653111 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-w9jn7" podStartSLOduration=69.557543125 podStartE2EDuration="1m13.653095405s" totalImagesPullingTime="4.09555228s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:54.651778017 +0000 UTC m=+73.886905180" watchObservedRunningTime="2026-07-16 21:50:54.653095405 +0000 UTC m=+73.888222564" Jul 16 21:50:54.937278 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:54.937207 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dxsz6_cc2270c6-d609-45af-be97-86e77cae77fa/node-ca/0.log" Jul 16 21:50:55.354625 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:55.354592 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:55.373611 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:55.373576 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bklrd\" (UID: \"f82300d7-fb78-4295-b1a6-37e9f7ed8e18\") " pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:50:55.373802 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:55.373623 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bklrd\" (UID: \"f82300d7-fb78-4295-b1a6-37e9f7ed8e18\") " pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:50:55.373802 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:55.373734 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 21:50:55.373802 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:55.373743 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 21:50:55.373965 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:55.373807 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-kube-rbac-proxy-cm podName:f82300d7-fb78-4295-b1a6-37e9f7ed8e18 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:59.373783228 +0000 UTC m=+78.608910387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bklrd" (UID: "f82300d7-fb78-4295-b1a6-37e9f7ed8e18") : configmap "kube-rbac-proxy" not found Jul 16 21:50:55.373965 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:55.373825 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-insights-runtime-extractor-tls podName:f82300d7-fb78-4295-b1a6-37e9f7ed8e18 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:59.373817391 +0000 UTC m=+78.608944529 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bklrd" (UID: "f82300d7-fb78-4295-b1a6-37e9f7ed8e18") : secret "insights-runtime-extractor-tls" not found Jul 16 21:50:55.452306 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:55.452270 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:55.537874 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:55.537842 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zkhpq_bd70582f-df8b-43c0-a20f-40dc0e0f7d94/serve-healthcheck-canary/0.log" Jul 16 21:50:55.738281 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:55.738253 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-kp9cp" Jul 16 21:50:55.738636 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:55.738310 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-kp9cp" Jul 16 21:50:55.738671 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:55.738659 2566 scope.go:117] "RemoveContainer" containerID="ef88c0c4bd4dfee3b92b1e600559e7f5eeaba81b5ac224060aaaf2b8bd0ce788" Jul 16 21:50:55.738834 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:55.738812 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-kp9cp_openshift-console-operator(964fa034-949b-4752-8390-dc010d28551a)\"" pod="openshift-console-operator/console-operator-565b7b569d-kp9cp" podUID="964fa034-949b-4752-8390-dc010d28551a" Jul 16 21:50:56.294492 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:56.294454 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:56.393625 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:56.393592 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:56.472663 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:56.472624 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:56.680027 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:56.679945 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:59.358102 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:59.358068 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:59.407806 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:59.407772 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bklrd\" (UID: \"f82300d7-fb78-4295-b1a6-37e9f7ed8e18\") " pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:50:59.407806 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:59.407806 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bklrd\" (UID: \"f82300d7-fb78-4295-b1a6-37e9f7ed8e18\") " pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:50:59.408030 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:59.407907 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 21:50:59.408030 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:59.407914 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 21:50:59.408030 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:59.407966 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-kube-rbac-proxy-cm podName:f82300d7-fb78-4295-b1a6-37e9f7ed8e18 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:07.407949644 +0000 UTC m=+86.643076796 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bklrd" (UID: "f82300d7-fb78-4295-b1a6-37e9f7ed8e18") : configmap "kube-rbac-proxy" not found Jul 16 21:50:59.408030 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:59.407980 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-insights-runtime-extractor-tls podName:f82300d7-fb78-4295-b1a6-37e9f7ed8e18 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:07.407974325 +0000 UTC m=+86.643101463 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bklrd" (UID: "f82300d7-fb78-4295-b1a6-37e9f7ed8e18") : secret "insights-runtime-extractor-tls" not found Jul 16 21:50:59.469279 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:59.469246 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:59.572496 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:59.572464 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:59.609261 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:59.609182 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/85d2de20-f664-4564-953e-e4b7ba798e2c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r4njh\" (UID: \"85d2de20-f664-4564-953e-e4b7ba798e2c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4njh" Jul 16 21:50:59.609395 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:59.609303 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 21:50:59.609395 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:59.609356 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d2de20-f664-4564-953e-e4b7ba798e2c-samples-operator-tls podName:85d2de20-f664-4564-953e-e4b7ba798e2c nodeName:}" failed. No retries permitted until 2026-07-16 21:51:15.60934172 +0000 UTC m=+94.844468858 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/85d2de20-f664-4564-953e-e4b7ba798e2c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-r4njh" (UID: "85d2de20-f664-4564-953e-e4b7ba798e2c") : secret "samples-operator-tls" not found Jul 16 21:50:59.674358 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:59.674326 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:50:59.811680 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:50:59.811640 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75364348-7d2b-4320-82d5-7ae05b690a88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-vbdw5\" (UID: \"75364348-7d2b-4320-82d5-7ae05b690a88\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vbdw5" Jul 16 21:50:59.811845 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:59.811774 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 21:50:59.811845 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:50:59.811836 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75364348-7d2b-4320-82d5-7ae05b690a88-cluster-monitoring-operator-tls podName:75364348-7d2b-4320-82d5-7ae05b690a88 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:15.811822254 +0000 UTC m=+95.046949392 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/75364348-7d2b-4320-82d5-7ae05b690a88-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-vbdw5" (UID: "75364348-7d2b-4320-82d5-7ae05b690a88") : secret "cluster-monitoring-operator-tls" not found Jul 16 21:51:00.420517 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:00.420486 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:00.504435 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:00.504394 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:00.720160 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:00.720129 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-metrics-certs\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:51:00.720321 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:00.720174 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6213d8c-90b5-4823-ab32-24606edecb40-service-ca-bundle\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:51:00.720321 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:51:00.720273 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 21:51:00.720391 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:51:00.720335 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-metrics-certs podName:e6213d8c-90b5-4823-ab32-24606edecb40 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:16.720320746 +0000 UTC m=+95.955447884 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-metrics-certs") pod "router-default-7b88cbdcf6-9t7wk" (UID: "e6213d8c-90b5-4823-ab32-24606edecb40") : secret "router-metrics-certs-default" not found Jul 16 21:51:00.720391 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:51:00.720350 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e6213d8c-90b5-4823-ab32-24606edecb40-service-ca-bundle podName:e6213d8c-90b5-4823-ab32-24606edecb40 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:16.72034378 +0000 UTC m=+95.955470918 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e6213d8c-90b5-4823-ab32-24606edecb40-service-ca-bundle") pod "router-default-7b88cbdcf6-9t7wk" (UID: "e6213d8c-90b5-4823-ab32-24606edecb40") : configmap references non-existent config key: service-ca.crt Jul 16 21:51:01.705663 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:01.705611 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:01.970731 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:01.970698 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:02.072171 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:02.072126 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:02.145333 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:02.145291 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:02.419228 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:02.419153 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:02.478809 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:02.478778 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:02.777744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:02.777706 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:03.046300 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:03.046207 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:03.474937 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:03.474897 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:03.576081 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:03.576047 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:03.879888 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:03.879743 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:04.065887 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:04.065843 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:04.255277 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:04.255248 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:04.530987 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:04.530892 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:04.631272 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:04.631227 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:04.700711 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:04.700676 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:05.209208 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:05.209161 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:05.496349 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:05.496319 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:05.872251 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:05.872164 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:06.074617 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:06.074584 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:06.270098 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:06.270063 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:06.715645 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:06.715610 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:06.793606 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:06.793566 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:07.244971 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:07.244937 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:07.483546 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:07.483507 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bklrd\" (UID: \"f82300d7-fb78-4295-b1a6-37e9f7ed8e18\") " pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:51:07.483546 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:07.483546 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bklrd\" (UID: \"f82300d7-fb78-4295-b1a6-37e9f7ed8e18\") " pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:51:07.484063 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:51:07.483693 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 21:51:07.484063 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:51:07.483778 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-insights-runtime-extractor-tls podName:f82300d7-fb78-4295-b1a6-37e9f7ed8e18 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:23.483756478 +0000 UTC m=+102.718883648 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bklrd" (UID: "f82300d7-fb78-4295-b1a6-37e9f7ed8e18") : secret "insights-runtime-extractor-tls" not found Jul 16 21:51:07.484193 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:07.484161 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bklrd\" (UID: \"f82300d7-fb78-4295-b1a6-37e9f7ed8e18\") " pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:51:07.652711 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:07.652624 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:08.054006 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:08.053972 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:08.254823 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:08.254792 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:08.303313 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:08.303289 2566 scope.go:117] "RemoveContainer" containerID="ef88c0c4bd4dfee3b92b1e600559e7f5eeaba81b5ac224060aaaf2b8bd0ce788" Jul 16 21:51:08.646585 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:08.646489 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:08.677892 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:08.677867 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kp9cp_964fa034-949b-4752-8390-dc010d28551a/console-operator/1.log" Jul 16 21:51:08.678047 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:08.677924 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-kp9cp" event={"ID":"964fa034-949b-4752-8390-dc010d28551a","Type":"ContainerStarted","Data":"8e4ba56b79bd513c1f6270f3b6d6543bdd44a6a1857361deaac307f967438cb9"} Jul 16 21:51:08.678254 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:08.678225 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-kp9cp" Jul 16 21:51:08.702637 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:08.702593 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-kp9cp" podStartSLOduration=21.98441448 podStartE2EDuration="25.702578479s" totalImagesPullingTime="3.718163999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:08.702341046 +0000 UTC m=+87.937468206" watchObservedRunningTime="2026-07-16 21:51:08.702578479 +0000 UTC m=+87.937705642" Jul 16 21:51:08.861229 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:08.861200 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-kp9cp" Jul 16 21:51:09.268295 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:09.268256 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:09.651461 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:09.651364 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:09.862290 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:09.862256 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:10.048842 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:10.048806 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:10.504454 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:10.504403 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:10.605533 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:10.605490 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:10.706431 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:10.706396 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:10.805952 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:10.805860 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:10.906537 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:10.906504 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:11.067407 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:11.067305 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:12.125628 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:12.125591 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:12.232115 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:12.229216 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:13.034398 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:13.034361 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:15.653266 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:15.653214 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/85d2de20-f664-4564-953e-e4b7ba798e2c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r4njh\" (UID: \"85d2de20-f664-4564-953e-e4b7ba798e2c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4njh" Jul 16 21:51:15.655636 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:15.655617 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/85d2de20-f664-4564-953e-e4b7ba798e2c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r4njh\" (UID: \"85d2de20-f664-4564-953e-e4b7ba798e2c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4njh" Jul 16 21:51:15.855144 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:15.855103 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75364348-7d2b-4320-82d5-7ae05b690a88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-vbdw5\" (UID: \"75364348-7d2b-4320-82d5-7ae05b690a88\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vbdw5" Jul 16 21:51:15.857456 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:15.857413 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75364348-7d2b-4320-82d5-7ae05b690a88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-vbdw5\" (UID: \"75364348-7d2b-4320-82d5-7ae05b690a88\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vbdw5" Jul 16 21:51:15.919525 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:15.919438 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4njh" Jul 16 21:51:16.053272 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:16.053233 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4njh"] Jul 16 21:51:16.111265 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:16.111241 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:16.128977 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:16.128954 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vbdw5" Jul 16 21:51:16.207918 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:16.207882 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:16.255376 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:16.255345 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vbdw5"] Jul 16 21:51:16.258221 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:51:16.258197 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75364348_7d2b_4320_82d5_7ae05b690a88.slice/crio-00b37cbffdbb75c1689dd31cc2027f6ce64f88ec3bd850961d5c87024ecf6761 WatchSource:0}: Error finding container 00b37cbffdbb75c1689dd31cc2027f6ce64f88ec3bd850961d5c87024ecf6761: Status 404 returned error can't find the container with id 00b37cbffdbb75c1689dd31cc2027f6ce64f88ec3bd850961d5c87024ecf6761 Jul 16 21:51:16.705571 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:16.705524 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vbdw5" event={"ID":"75364348-7d2b-4320-82d5-7ae05b690a88","Type":"ContainerStarted","Data":"00b37cbffdbb75c1689dd31cc2027f6ce64f88ec3bd850961d5c87024ecf6761"} Jul 16 21:51:16.707126 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:16.707093 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4njh" event={"ID":"85d2de20-f664-4564-953e-e4b7ba798e2c","Type":"ContainerStarted","Data":"dd88c3f89be3453ab0d8a28a5d3dd6312903b91f0e3d7469d4efe9286855af5e"} Jul 16 21:51:16.763645 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:16.763603 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-metrics-certs\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:51:16.763819 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:16.763663 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6213d8c-90b5-4823-ab32-24606edecb40-service-ca-bundle\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:51:16.764461 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:16.764399 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6213d8c-90b5-4823-ab32-24606edecb40-service-ca-bundle\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:51:16.766821 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:16.766792 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6213d8c-90b5-4823-ab32-24606edecb40-metrics-certs\") pod \"router-default-7b88cbdcf6-9t7wk\" (UID: \"e6213d8c-90b5-4823-ab32-24606edecb40\") " pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:51:16.951246 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:16.951209 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:51:17.116110 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:17.116074 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7b88cbdcf6-9t7wk"] Jul 16 21:51:17.267320 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:17.267228 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:17.542449 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:51:17.542367 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6213d8c_90b5_4823_ab32_24606edecb40.slice/crio-09ce00215a99f2279ba75c9a9d246af4e6388f7358fe92d1a0a7b815bb4cec11 WatchSource:0}: Error finding container 09ce00215a99f2279ba75c9a9d246af4e6388f7358fe92d1a0a7b815bb4cec11: Status 404 returned error can't find the container with id 09ce00215a99f2279ba75c9a9d246af4e6388f7358fe92d1a0a7b815bb4cec11 Jul 16 21:51:17.712200 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:17.712161 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" event={"ID":"e6213d8c-90b5-4823-ab32-24606edecb40","Type":"ContainerStarted","Data":"09ce00215a99f2279ba75c9a9d246af4e6388f7358fe92d1a0a7b815bb4cec11"} Jul 16 21:51:18.468257 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:18.468216 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:18.570356 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:18.570269 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:18.688820 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:18.688787 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:18.717071 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:18.717036 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vbdw5" event={"ID":"75364348-7d2b-4320-82d5-7ae05b690a88","Type":"ContainerStarted","Data":"b9d09de2812381048b5c9cf05bc72741dbdf7a99d3136ac774f89adb6dda47ce"} Jul 16 21:51:18.718968 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:18.718939 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4njh" event={"ID":"85d2de20-f664-4564-953e-e4b7ba798e2c","Type":"ContainerStarted","Data":"3adcd4646ce9763f0cc756fe34b783abcef4f32992702b00975ba044243e11c2"} Jul 16 21:51:18.719116 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:18.718994 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4njh" event={"ID":"85d2de20-f664-4564-953e-e4b7ba798e2c","Type":"ContainerStarted","Data":"aa75d8a5a8b2f34b6afb9beffe36477b4951092bcaaef8be7e95aa96d8688fe9"} Jul 16 21:51:18.720461 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:18.720408 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" event={"ID":"e6213d8c-90b5-4823-ab32-24606edecb40","Type":"ContainerStarted","Data":"341f7bcead6baee308c1b100dc62682cd308afc8e3638ac673382e7b4f3faf87"} Jul 16 21:51:18.735570 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:18.735524 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vbdw5" podStartSLOduration=33.915763795 podStartE2EDuration="35.735512561s" totalImagesPullingTime="1.819748766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:18.734693777 +0000 UTC m=+97.969820939" watchObservedRunningTime="2026-07-16 21:51:18.735512561 +0000 UTC m=+97.970639721" Jul 16 21:51:18.754189 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:18.754135 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" podStartSLOduration=35.754122933 podStartE2EDuration="35.754122933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:18.753206759 +0000 UTC m=+97.988333918" watchObservedRunningTime="2026-07-16 21:51:18.754122933 +0000 UTC m=+97.989250093" Jul 16 21:51:18.772242 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:18.772187 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4njh" podStartSLOduration=33.79018654 podStartE2EDuration="35.772169418s" totalImagesPullingTime="1.981982878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:18.770998609 +0000 UTC m=+98.006125770" watchObservedRunningTime="2026-07-16 21:51:18.772169418 +0000 UTC m=+98.007296581" Jul 16 21:51:18.904677 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:18.904585 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:18.951584 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:18.951553 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:51:18.954106 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:18.954085 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:51:19.536093 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:19.536065 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:19.598602 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:19.598567 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:19.724303 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:19.724260 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:51:19.725352 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:19.725330 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7b88cbdcf6-9t7wk" Jul 16 21:51:20.598982 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:20.598950 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-tls\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:51:20.599189 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:20.599057 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-metrics-tls\") pod \"dns-default-2bhgs\" (UID: \"1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40\") " pod="openshift-dns/dns-default-2bhgs" Jul 16 21:51:20.601390 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:20.601361 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40-metrics-tls\") pod \"dns-default-2bhgs\" (UID: \"1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40\") " pod="openshift-dns/dns-default-2bhgs" Jul 16 21:51:20.601520 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:20.601452 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-tls\") pod \"image-registry-864c69867d-j5k2t\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:51:20.829118 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:20.829085 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kmpcf\"" Jul 16 21:51:20.836452 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:20.836406 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:51:20.856660 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:20.856600 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q4vmw\"" Jul 16 21:51:20.863932 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:20.863908 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2bhgs" Jul 16 21:51:21.014805 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:21.014781 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-864c69867d-j5k2t"] Jul 16 21:51:21.017146 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:51:21.017116 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod846b555e_524b_4bfe_85e3_8782fd7c49ed.slice/crio-4b1af8dfb6753a3f82393f45c2cab74a101c735d8446fd2e6a011042edbfa8d3 WatchSource:0}: Error finding container 4b1af8dfb6753a3f82393f45c2cab74a101c735d8446fd2e6a011042edbfa8d3: Status 404 returned error can't find the container with id 4b1af8dfb6753a3f82393f45c2cab74a101c735d8446fd2e6a011042edbfa8d3 Jul 16 21:51:21.029912 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:21.029888 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2bhgs"] Jul 16 21:51:21.032699 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:51:21.032675 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dcdf84d_4f5e_40f2_a0b6_8e15b48eef40.slice/crio-3c09cf3127e66a4332af186db261dad4abc90b4f59d1ccf2027b7a404d418527 WatchSource:0}: Error finding container 3c09cf3127e66a4332af186db261dad4abc90b4f59d1ccf2027b7a404d418527: Status 404 returned error can't find the container with id 3c09cf3127e66a4332af186db261dad4abc90b4f59d1ccf2027b7a404d418527 Jul 16 21:51:21.733749 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:21.733706 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-864c69867d-j5k2t" event={"ID":"846b555e-524b-4bfe-85e3-8782fd7c49ed","Type":"ContainerStarted","Data":"30855fa26d7670c712345a12ad30a39ee74dd31966086e1076f359635f30c7a5"} Jul 16 21:51:21.733934 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:21.733804 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-864c69867d-j5k2t" event={"ID":"846b555e-524b-4bfe-85e3-8782fd7c49ed","Type":"ContainerStarted","Data":"4b1af8dfb6753a3f82393f45c2cab74a101c735d8446fd2e6a011042edbfa8d3"} Jul 16 21:51:21.734002 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:21.733944 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:51:21.735182 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:21.735145 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2bhgs" event={"ID":"1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40","Type":"ContainerStarted","Data":"3c09cf3127e66a4332af186db261dad4abc90b4f59d1ccf2027b7a404d418527"} Jul 16 21:51:21.774721 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:21.774670 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-864c69867d-j5k2t" podStartSLOduration=100.774654943 podStartE2EDuration="1m40.774654943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:49:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:21.773946804 +0000 UTC m=+101.009073970" watchObservedRunningTime="2026-07-16 21:51:21.774654943 +0000 UTC m=+101.009782122" Jul 16 21:51:22.140821 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:22.140737 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:22.629916 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:22.629886 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-c9f2s" Jul 16 21:51:23.522581 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:23.522548 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bklrd\" (UID: \"f82300d7-fb78-4295-b1a6-37e9f7ed8e18\") " pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:51:23.524851 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:23.524819 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f82300d7-fb78-4295-b1a6-37e9f7ed8e18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bklrd\" (UID: \"f82300d7-fb78-4295-b1a6-37e9f7ed8e18\") " pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:51:23.532744 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:23.532724 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bklrd" Jul 16 21:51:23.669135 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:23.669113 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bklrd"] Jul 16 21:51:23.671589 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:51:23.671551 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf82300d7_fb78_4295_b1a6_37e9f7ed8e18.slice/crio-80128cc73e3bb4df1df5a4b07a7132eab5d85800c76bc36996b3aca95100c1f0 WatchSource:0}: Error finding container 80128cc73e3bb4df1df5a4b07a7132eab5d85800c76bc36996b3aca95100c1f0: Status 404 returned error can't find the container with id 80128cc73e3bb4df1df5a4b07a7132eab5d85800c76bc36996b3aca95100c1f0 Jul 16 21:51:23.743791 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:23.743704 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bklrd" event={"ID":"f82300d7-fb78-4295-b1a6-37e9f7ed8e18","Type":"ContainerStarted","Data":"80128cc73e3bb4df1df5a4b07a7132eab5d85800c76bc36996b3aca95100c1f0"} Jul 16 21:51:23.745476 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:23.745452 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2bhgs" event={"ID":"1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40","Type":"ContainerStarted","Data":"e2056a7dc89d7a269b743f5b0b718a4433a160e0f92c165303fb2cbadc72d86d"} Jul 16 21:51:23.745599 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:23.745493 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2bhgs" event={"ID":"1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40","Type":"ContainerStarted","Data":"53b65d617d03c34f910a301fca8c4f3260f3a170b8799b2e229c452a8a97bde6"} Jul 16 21:51:23.745599 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:23.745559 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2bhgs" Jul 16 21:51:23.770721 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:23.770673 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2bhgs" podStartSLOduration=65.584461892 podStartE2EDuration="1m7.770658938s" totalImagesPullingTime="2.186197046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:23.770523347 +0000 UTC m=+103.005650506" watchObservedRunningTime="2026-07-16 21:51:23.770658938 +0000 UTC m=+103.005786097" Jul 16 21:51:23.896781 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:23.896749 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:23.990598 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:23.990569 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:25.346094 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:25.346006 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:25.487501 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:25.487463 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:25.615191 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:25.615078 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:25.702758 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:25.702712 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:27.695588 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:27.695494 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:27.756537 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:27.756487 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:29.769328 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:29.769285 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bklrd" event={"ID":"f82300d7-fb78-4295-b1a6-37e9f7ed8e18","Type":"ContainerStarted","Data":"50cbcdf88525b01a13ad38394685441488514b16f1233d4fc7a13abc02ad3370"} Jul 16 21:51:31.130603 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:31.130567 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:31.201228 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:31.201194 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:32.781825 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:32.781790 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bklrd" event={"ID":"f82300d7-fb78-4295-b1a6-37e9f7ed8e18","Type":"ContainerStarted","Data":"fc2c08611e1fb61e7f0d04b0e432554cb8f74807539060e2d78ee3af36994f33"} Jul 16 21:51:33.751863 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:33.751833 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2bhgs" Jul 16 21:51:33.920037 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:33.920001 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:34.019790 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:34.019698 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:34.912035 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:34.912000 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:35.006666 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:35.006628 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:35.668044 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:35.668002 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:35.736473 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:35.736442 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-v8gb7"] Jul 16 21:51:35.762022 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:35.761989 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-v8gb7" Jul 16 21:51:35.766630 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:35.766607 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 16 21:51:35.766899 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:35.766884 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-t4pgf\"" Jul 16 21:51:35.767560 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:35.767541 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 16 21:51:35.767667 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:35.767579 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 16 21:51:35.770753 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:35.770733 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-v8gb7"] Jul 16 21:51:35.778026 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:35.777995 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:35.817485 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:35.817444 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5d62db1-b711-4985-8327-58a638573faa-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-v8gb7\" (UID: \"a5d62db1-b711-4985-8327-58a638573faa\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-v8gb7" Jul 16 21:51:35.817658 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:35.817559 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5d62db1-b711-4985-8327-58a638573faa-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-v8gb7\" (UID: \"a5d62db1-b711-4985-8327-58a638573faa\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-v8gb7" Jul 16 21:51:35.817658 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:35.817606 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5d62db1-b711-4985-8327-58a638573faa-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-v8gb7\" (UID: \"a5d62db1-b711-4985-8327-58a638573faa\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-v8gb7" Jul 16 21:51:35.817658 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:35.817651 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsdg2\" (UniqueName: \"kubernetes.io/projected/a5d62db1-b711-4985-8327-58a638573faa-kube-api-access-wsdg2\") pod \"prometheus-operator-5945b5cfd-v8gb7\" (UID: \"a5d62db1-b711-4985-8327-58a638573faa\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-v8gb7" Jul 16 21:51:35.918348 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:35.918250 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsdg2\" (UniqueName: \"kubernetes.io/projected/a5d62db1-b711-4985-8327-58a638573faa-kube-api-access-wsdg2\") pod \"prometheus-operator-5945b5cfd-v8gb7\" (UID: \"a5d62db1-b711-4985-8327-58a638573faa\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-v8gb7" Jul 16 21:51:35.918348 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:35.918318 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5d62db1-b711-4985-8327-58a638573faa-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-v8gb7\" (UID: \"a5d62db1-b711-4985-8327-58a638573faa\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-v8gb7" Jul 16 21:51:35.918619 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:35.918389 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5d62db1-b711-4985-8327-58a638573faa-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-v8gb7\" (UID: \"a5d62db1-b711-4985-8327-58a638573faa\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-v8gb7" Jul 16 21:51:35.918619 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:35.918462 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5d62db1-b711-4985-8327-58a638573faa-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-v8gb7\" (UID: \"a5d62db1-b711-4985-8327-58a638573faa\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-v8gb7" Jul 16 21:51:35.918619 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:51:35.918540 2566 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 16 21:51:35.918619 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:51:35.918616 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5d62db1-b711-4985-8327-58a638573faa-prometheus-operator-tls podName:a5d62db1-b711-4985-8327-58a638573faa nodeName:}" failed. No retries permitted until 2026-07-16 21:51:36.418594521 +0000 UTC m=+115.653721674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/a5d62db1-b711-4985-8327-58a638573faa-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-v8gb7" (UID: "a5d62db1-b711-4985-8327-58a638573faa") : secret "prometheus-operator-tls" not found Jul 16 21:51:35.918972 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:35.918952 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5d62db1-b711-4985-8327-58a638573faa-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-v8gb7\" (UID: \"a5d62db1-b711-4985-8327-58a638573faa\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-v8gb7" Jul 16 21:51:35.920853 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:35.920831 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5d62db1-b711-4985-8327-58a638573faa-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-v8gb7\" (UID: \"a5d62db1-b711-4985-8327-58a638573faa\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-v8gb7" Jul 16 21:51:35.930097 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:35.930054 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsdg2\" (UniqueName: \"kubernetes.io/projected/a5d62db1-b711-4985-8327-58a638573faa-kube-api-access-wsdg2\") pod \"prometheus-operator-5945b5cfd-v8gb7\" (UID: \"a5d62db1-b711-4985-8327-58a638573faa\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-v8gb7" Jul 16 21:51:36.171806 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:36.171712 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:36.422869 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:36.422773 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5d62db1-b711-4985-8327-58a638573faa-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-v8gb7\" (UID: \"a5d62db1-b711-4985-8327-58a638573faa\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-v8gb7" Jul 16 21:51:36.425189 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:36.425156 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5d62db1-b711-4985-8327-58a638573faa-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-v8gb7\" (UID: \"a5d62db1-b711-4985-8327-58a638573faa\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-v8gb7" Jul 16 21:51:36.671913 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:36.671874 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-v8gb7" Jul 16 21:51:36.803004 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:36.802977 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-v8gb7"] Jul 16 21:51:36.803634 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:36.803611 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bklrd" event={"ID":"f82300d7-fb78-4295-b1a6-37e9f7ed8e18","Type":"ContainerStarted","Data":"8d457523a60a23d27a201a1d145a12f4999a80384fb8662db6053f5b3f9c5b89"} Jul 16 21:51:36.805239 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:51:36.805218 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5d62db1_b711_4985_8327_58a638573faa.slice/crio-3c946002ad21144839623240435343a22f9777c913cec3fdb74cfd81aee42a0c WatchSource:0}: Error finding container 3c946002ad21144839623240435343a22f9777c913cec3fdb74cfd81aee42a0c: Status 404 returned error can't find the container with id 3c946002ad21144839623240435343a22f9777c913cec3fdb74cfd81aee42a0c Jul 16 21:51:36.826914 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:36.826865 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bklrd" podStartSLOduration=33.79189438 podStartE2EDuration="45.82685078s" totalImagesPullingTime="12.0349564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:50:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:36.826127103 +0000 UTC m=+116.061254264" watchObservedRunningTime="2026-07-16 21:51:36.82685078 +0000 UTC m=+116.061977958" Jul 16 21:51:37.246117 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:37.246066 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:37.343828 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:37.343786 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:37.809600 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:37.809562 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-v8gb7" event={"ID":"a5d62db1-b711-4985-8327-58a638573faa","Type":"ContainerStarted","Data":"3c946002ad21144839623240435343a22f9777c913cec3fdb74cfd81aee42a0c"} Jul 16 21:51:38.257486 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:38.257438 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:38.814205 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:38.814166 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-v8gb7" event={"ID":"a5d62db1-b711-4985-8327-58a638573faa","Type":"ContainerStarted","Data":"6b4e565f0615eddf98fb6b9ee7e4180f47022fb7b99a20875e3a3bc20e3b8a6a"} Jul 16 21:51:38.814379 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:38.814218 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-v8gb7" event={"ID":"a5d62db1-b711-4985-8327-58a638573faa","Type":"ContainerStarted","Data":"31a84d60f2e72dcfb55e06a16f855991f5c8828038b59ed1703d9a5614d212b5"} Jul 16 21:51:38.834174 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:38.834124 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-v8gb7" podStartSLOduration=2.706505228 podStartE2EDuration="3.834108995s" totalImagesPullingTime="1.127603767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:51:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:38.832978085 +0000 UTC m=+118.068105250" watchObservedRunningTime="2026-07-16 21:51:38.834108995 +0000 UTC m=+118.069236154" Jul 16 21:51:40.953754 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:40.953717 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:41.042368 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.042330 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:41.325947 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.325888 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:41.467130 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.467096 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:41.480394 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.480362 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-scb2w"] Jul 16 21:51:41.483946 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.483928 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.487134 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.487113 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bkh4j\"" Jul 16 21:51:41.488120 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.488101 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 16 21:51:41.488213 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.488136 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 16 21:51:41.488213 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.488159 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 16 21:51:41.562600 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.562567 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87e486d7-77ee-4645-9dc5-1b46f730ed96-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-scb2w\" (UID: \"87e486d7-77ee-4645-9dc5-1b46f730ed96\") " pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.562757 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.562608 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87e486d7-77ee-4645-9dc5-1b46f730ed96-metrics-client-ca\") pod \"node-exporter-scb2w\" (UID: \"87e486d7-77ee-4645-9dc5-1b46f730ed96\") " pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.562757 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.562671 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/87e486d7-77ee-4645-9dc5-1b46f730ed96-node-exporter-accelerators-collector-config\") pod \"node-exporter-scb2w\" (UID: \"87e486d7-77ee-4645-9dc5-1b46f730ed96\") " pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.562757 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.562692 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/87e486d7-77ee-4645-9dc5-1b46f730ed96-root\") pod \"node-exporter-scb2w\" (UID: \"87e486d7-77ee-4645-9dc5-1b46f730ed96\") " pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.562757 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.562751 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqcfq\" (UniqueName: \"kubernetes.io/projected/87e486d7-77ee-4645-9dc5-1b46f730ed96-kube-api-access-lqcfq\") pod \"node-exporter-scb2w\" (UID: \"87e486d7-77ee-4645-9dc5-1b46f730ed96\") " pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.562887 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.562779 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87e486d7-77ee-4645-9dc5-1b46f730ed96-sys\") pod \"node-exporter-scb2w\" (UID: \"87e486d7-77ee-4645-9dc5-1b46f730ed96\") " pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.562887 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.562826 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/87e486d7-77ee-4645-9dc5-1b46f730ed96-node-exporter-textfile\") pod \"node-exporter-scb2w\" (UID: \"87e486d7-77ee-4645-9dc5-1b46f730ed96\") " pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.562887 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.562860 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/87e486d7-77ee-4645-9dc5-1b46f730ed96-node-exporter-tls\") pod \"node-exporter-scb2w\" (UID: \"87e486d7-77ee-4645-9dc5-1b46f730ed96\") " pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.562978 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.562885 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/87e486d7-77ee-4645-9dc5-1b46f730ed96-node-exporter-wtmp\") pod \"node-exporter-scb2w\" (UID: \"87e486d7-77ee-4645-9dc5-1b46f730ed96\") " pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.581123 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.581045 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:41.663724 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.663681 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/87e486d7-77ee-4645-9dc5-1b46f730ed96-node-exporter-accelerators-collector-config\") pod \"node-exporter-scb2w\" (UID: \"87e486d7-77ee-4645-9dc5-1b46f730ed96\") " pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.663724 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.663727 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/87e486d7-77ee-4645-9dc5-1b46f730ed96-root\") pod \"node-exporter-scb2w\" (UID: \"87e486d7-77ee-4645-9dc5-1b46f730ed96\") " pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.663931 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.663755 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqcfq\" (UniqueName: \"kubernetes.io/projected/87e486d7-77ee-4645-9dc5-1b46f730ed96-kube-api-access-lqcfq\") pod \"node-exporter-scb2w\" (UID: \"87e486d7-77ee-4645-9dc5-1b46f730ed96\") " pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.663931 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.663775 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87e486d7-77ee-4645-9dc5-1b46f730ed96-sys\") pod \"node-exporter-scb2w\" (UID: \"87e486d7-77ee-4645-9dc5-1b46f730ed96\") " pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.663931 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.663792 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/87e486d7-77ee-4645-9dc5-1b46f730ed96-node-exporter-textfile\") pod \"node-exporter-scb2w\" (UID: \"87e486d7-77ee-4645-9dc5-1b46f730ed96\") " pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.663931 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.663809 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/87e486d7-77ee-4645-9dc5-1b46f730ed96-node-exporter-tls\") pod \"node-exporter-scb2w\" (UID: \"87e486d7-77ee-4645-9dc5-1b46f730ed96\") " pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.663931 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.663834 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/87e486d7-77ee-4645-9dc5-1b46f730ed96-node-exporter-wtmp\") pod \"node-exporter-scb2w\" (UID: \"87e486d7-77ee-4645-9dc5-1b46f730ed96\") " pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.663931 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.663867 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87e486d7-77ee-4645-9dc5-1b46f730ed96-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-scb2w\" (UID: \"87e486d7-77ee-4645-9dc5-1b46f730ed96\") " pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.663931 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.663880 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87e486d7-77ee-4645-9dc5-1b46f730ed96-sys\") pod \"node-exporter-scb2w\" (UID: \"87e486d7-77ee-4645-9dc5-1b46f730ed96\") " pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.663931 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.663884 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/87e486d7-77ee-4645-9dc5-1b46f730ed96-root\") pod \"node-exporter-scb2w\" (UID: \"87e486d7-77ee-4645-9dc5-1b46f730ed96\") " pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.663931 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.663890 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87e486d7-77ee-4645-9dc5-1b46f730ed96-metrics-client-ca\") pod \"node-exporter-scb2w\" (UID: \"87e486d7-77ee-4645-9dc5-1b46f730ed96\") " pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.664354 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.664033 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/87e486d7-77ee-4645-9dc5-1b46f730ed96-node-exporter-wtmp\") pod \"node-exporter-scb2w\" (UID: \"87e486d7-77ee-4645-9dc5-1b46f730ed96\") " pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.664354 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.664176 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/87e486d7-77ee-4645-9dc5-1b46f730ed96-node-exporter-textfile\") pod \"node-exporter-scb2w\" (UID: \"87e486d7-77ee-4645-9dc5-1b46f730ed96\") " pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.664354 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.664276 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/87e486d7-77ee-4645-9dc5-1b46f730ed96-node-exporter-accelerators-collector-config\") pod \"node-exporter-scb2w\" (UID: \"87e486d7-77ee-4645-9dc5-1b46f730ed96\") " pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.664519 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.664496 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87e486d7-77ee-4645-9dc5-1b46f730ed96-metrics-client-ca\") pod \"node-exporter-scb2w\" (UID: \"87e486d7-77ee-4645-9dc5-1b46f730ed96\") " pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.666209 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.666184 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87e486d7-77ee-4645-9dc5-1b46f730ed96-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-scb2w\" (UID: \"87e486d7-77ee-4645-9dc5-1b46f730ed96\") " pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.666364 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.666347 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/87e486d7-77ee-4645-9dc5-1b46f730ed96-node-exporter-tls\") pod \"node-exporter-scb2w\" (UID: \"87e486d7-77ee-4645-9dc5-1b46f730ed96\") " pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.688247 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.688201 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:41.689726 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.689699 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqcfq\" (UniqueName: \"kubernetes.io/projected/87e486d7-77ee-4645-9dc5-1b46f730ed96-kube-api-access-lqcfq\") pod \"node-exporter-scb2w\" (UID: \"87e486d7-77ee-4645-9dc5-1b46f730ed96\") " pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.781432 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.781374 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:41.792888 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.792860 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-scb2w" Jul 16 21:51:41.804591 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:51:41.804562 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87e486d7_77ee_4645_9dc5_1b46f730ed96.slice/crio-00cf6affc04b1c086976aaa97f35caedeede549214b9b37ea255d589b59ba7df WatchSource:0}: Error finding container 00cf6affc04b1c086976aaa97f35caedeede549214b9b37ea255d589b59ba7df: Status 404 returned error can't find the container with id 00cf6affc04b1c086976aaa97f35caedeede549214b9b37ea255d589b59ba7df Jul 16 21:51:41.829636 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.829606 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-scb2w" event={"ID":"87e486d7-77ee-4645-9dc5-1b46f730ed96","Type":"ContainerStarted","Data":"00cf6affc04b1c086976aaa97f35caedeede549214b9b37ea255d589b59ba7df"} Jul 16 21:51:41.885579 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:41.885495 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:42.259029 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.258953 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:42.363518 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.363483 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 21:51:42.367227 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.367205 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.373117 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.373092 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 16 21:51:42.373250 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.373092 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 16 21:51:42.373250 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.373092 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 16 21:51:42.373250 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.373163 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 16 21:51:42.373747 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.373727 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 16 21:51:42.373857 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.373767 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ljqw4\"" Jul 16 21:51:42.373857 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.373831 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 16 21:51:42.374318 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.374302 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 16 21:51:42.374745 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.374624 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 16 21:51:42.374745 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.374661 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 16 21:51:42.377236 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.377199 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:42.401259 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.401169 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 21:51:42.465371 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.465323 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:42.470996 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.470972 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.471140 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.471013 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/883ceacd-c553-4d6d-af01-49918a90a5f8-config-out\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.471140 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.471036 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.471140 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.471100 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.471369 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.471158 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.471369 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.471193 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-web-config\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.471369 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.471255 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcfqc\" (UniqueName: \"kubernetes.io/projected/883ceacd-c553-4d6d-af01-49918a90a5f8-kube-api-access-tcfqc\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.471369 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.471289 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-config-volume\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.471369 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.471314 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/883ceacd-c553-4d6d-af01-49918a90a5f8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.471369 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.471360 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/883ceacd-c553-4d6d-af01-49918a90a5f8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.471646 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.471393 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.471646 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.471454 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/883ceacd-c553-4d6d-af01-49918a90a5f8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.471646 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.471500 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/883ceacd-c553-4d6d-af01-49918a90a5f8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.572468 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.572363 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.572468 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.572407 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.572468 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.572466 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.572738 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.572494 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-web-config\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.572738 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.572536 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcfqc\" (UniqueName: \"kubernetes.io/projected/883ceacd-c553-4d6d-af01-49918a90a5f8-kube-api-access-tcfqc\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.572738 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.572571 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-config-volume\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.572738 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.572590 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/883ceacd-c553-4d6d-af01-49918a90a5f8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.572738 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:51:42.572603 2566 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 16 21:51:42.572738 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.572633 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/883ceacd-c553-4d6d-af01-49918a90a5f8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.572738 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:51:42.572674 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-secret-alertmanager-main-tls podName:883ceacd-c553-4d6d-af01-49918a90a5f8 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:43.072655067 +0000 UTC m=+122.307782205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "883ceacd-c553-4d6d-af01-49918a90a5f8") : secret "alertmanager-main-tls" not found Jul 16 21:51:42.572738 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.572697 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.573140 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.572741 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/883ceacd-c553-4d6d-af01-49918a90a5f8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.573140 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.572781 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/883ceacd-c553-4d6d-af01-49918a90a5f8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.573140 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.572806 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.573140 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.572851 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/883ceacd-c553-4d6d-af01-49918a90a5f8-config-out\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.576121 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.575644 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.576121 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.575803 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/883ceacd-c553-4d6d-af01-49918a90a5f8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.576121 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.576008 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.578162 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.576882 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/883ceacd-c553-4d6d-af01-49918a90a5f8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.578162 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.576959 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/883ceacd-c553-4d6d-af01-49918a90a5f8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.578162 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.577506 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/883ceacd-c553-4d6d-af01-49918a90a5f8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.582206 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.581629 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-config-volume\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.582970 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.582930 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/883ceacd-c553-4d6d-af01-49918a90a5f8-config-out\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.583118 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.583096 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.583489 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.583467 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-web-config\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.584867 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.584844 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.594276 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.594251 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcfqc\" (UniqueName: \"kubernetes.io/projected/883ceacd-c553-4d6d-af01-49918a90a5f8-kube-api-access-tcfqc\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:42.744509 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.744484 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:51:42.799395 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.799354 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:42.835707 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.835625 2566 generic.go:356] "Generic (PLEG): container finished" podID="87e486d7-77ee-4645-9dc5-1b46f730ed96" containerID="f1559e5f2818d444154598addc243b04b98f49fc110ab823f4eb331b3acf07b3" exitCode=0 Jul 16 21:51:42.835707 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:42.835691 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-scb2w" event={"ID":"87e486d7-77ee-4645-9dc5-1b46f730ed96","Type":"ContainerDied","Data":"f1559e5f2818d444154598addc243b04b98f49fc110ab823f4eb331b3acf07b3"} Jul 16 21:51:43.077973 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.077934 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:43.080466 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.080436 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:43.277980 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.277940 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:51:43.285113 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.285086 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:43.361943 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.357101 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-77845f884-blc22"] Jul 16 21:51:43.364537 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.364486 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:43.372240 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.372204 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 16 21:51:43.372240 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.372235 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 16 21:51:43.373405 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.373306 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 16 21:51:43.373501 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.373490 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-qgp2h\"" Jul 16 21:51:43.375098 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.375045 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 16 21:51:43.375211 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.375196 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 16 21:51:43.376478 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.376457 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2243pk5mdf2qb\"" Jul 16 21:51:43.377789 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.377741 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-77845f884-blc22"] Jul 16 21:51:43.467096 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:51:43.467068 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod883ceacd_c553_4d6d_af01_49918a90a5f8.slice/crio-4e495632712ab9f3feaaae89ea8700065a7a6af61e5c1de43134c8982310d033 WatchSource:0}: Error finding container 4e495632712ab9f3feaaae89ea8700065a7a6af61e5c1de43134c8982310d033: Status 404 returned error can't find the container with id 4e495632712ab9f3feaaae89ea8700065a7a6af61e5c1de43134c8982310d033 Jul 16 21:51:43.470064 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.470036 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 21:51:43.482472 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.482448 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ba2d07d6-d82e-4d02-b226-a35a1f016a1a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77845f884-blc22\" (UID: \"ba2d07d6-d82e-4d02-b226-a35a1f016a1a\") " pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:43.482595 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.482580 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84cn4\" (UniqueName: \"kubernetes.io/projected/ba2d07d6-d82e-4d02-b226-a35a1f016a1a-kube-api-access-84cn4\") pod \"thanos-querier-77845f884-blc22\" (UID: \"ba2d07d6-d82e-4d02-b226-a35a1f016a1a\") " pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:43.482639 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.482608 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ba2d07d6-d82e-4d02-b226-a35a1f016a1a-secret-thanos-querier-tls\") pod \"thanos-querier-77845f884-blc22\" (UID: \"ba2d07d6-d82e-4d02-b226-a35a1f016a1a\") " pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:43.482683 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.482639 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba2d07d6-d82e-4d02-b226-a35a1f016a1a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77845f884-blc22\" (UID: \"ba2d07d6-d82e-4d02-b226-a35a1f016a1a\") " pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:43.482727 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.482689 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ba2d07d6-d82e-4d02-b226-a35a1f016a1a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77845f884-blc22\" (UID: \"ba2d07d6-d82e-4d02-b226-a35a1f016a1a\") " pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:43.482771 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.482730 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba2d07d6-d82e-4d02-b226-a35a1f016a1a-secret-grpc-tls\") pod \"thanos-querier-77845f884-blc22\" (UID: \"ba2d07d6-d82e-4d02-b226-a35a1f016a1a\") " pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:43.482771 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.482752 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba2d07d6-d82e-4d02-b226-a35a1f016a1a-metrics-client-ca\") pod \"thanos-querier-77845f884-blc22\" (UID: \"ba2d07d6-d82e-4d02-b226-a35a1f016a1a\") " pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:43.482834 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.482780 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba2d07d6-d82e-4d02-b226-a35a1f016a1a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77845f884-blc22\" (UID: \"ba2d07d6-d82e-4d02-b226-a35a1f016a1a\") " pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:43.552976 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.552897 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:43.584001 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.583967 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84cn4\" (UniqueName: \"kubernetes.io/projected/ba2d07d6-d82e-4d02-b226-a35a1f016a1a-kube-api-access-84cn4\") pod \"thanos-querier-77845f884-blc22\" (UID: \"ba2d07d6-d82e-4d02-b226-a35a1f016a1a\") " pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:43.584001 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.584002 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ba2d07d6-d82e-4d02-b226-a35a1f016a1a-secret-thanos-querier-tls\") pod \"thanos-querier-77845f884-blc22\" (UID: \"ba2d07d6-d82e-4d02-b226-a35a1f016a1a\") " pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:43.584232 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.584025 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba2d07d6-d82e-4d02-b226-a35a1f016a1a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77845f884-blc22\" (UID: \"ba2d07d6-d82e-4d02-b226-a35a1f016a1a\") " pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:43.584232 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.584055 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ba2d07d6-d82e-4d02-b226-a35a1f016a1a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77845f884-blc22\" (UID: \"ba2d07d6-d82e-4d02-b226-a35a1f016a1a\") " pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:43.584232 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.584085 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba2d07d6-d82e-4d02-b226-a35a1f016a1a-secret-grpc-tls\") pod \"thanos-querier-77845f884-blc22\" (UID: \"ba2d07d6-d82e-4d02-b226-a35a1f016a1a\") " pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:43.584232 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.584107 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba2d07d6-d82e-4d02-b226-a35a1f016a1a-metrics-client-ca\") pod \"thanos-querier-77845f884-blc22\" (UID: \"ba2d07d6-d82e-4d02-b226-a35a1f016a1a\") " pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:43.584232 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.584145 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba2d07d6-d82e-4d02-b226-a35a1f016a1a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77845f884-blc22\" (UID: \"ba2d07d6-d82e-4d02-b226-a35a1f016a1a\") " pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:43.584232 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.584195 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ba2d07d6-d82e-4d02-b226-a35a1f016a1a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77845f884-blc22\" (UID: \"ba2d07d6-d82e-4d02-b226-a35a1f016a1a\") " pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:43.585053 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.584949 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba2d07d6-d82e-4d02-b226-a35a1f016a1a-metrics-client-ca\") pod \"thanos-querier-77845f884-blc22\" (UID: \"ba2d07d6-d82e-4d02-b226-a35a1f016a1a\") " pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:43.586775 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.586745 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba2d07d6-d82e-4d02-b226-a35a1f016a1a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77845f884-blc22\" (UID: \"ba2d07d6-d82e-4d02-b226-a35a1f016a1a\") " pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:43.586885 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.586745 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba2d07d6-d82e-4d02-b226-a35a1f016a1a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77845f884-blc22\" (UID: \"ba2d07d6-d82e-4d02-b226-a35a1f016a1a\") " pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:43.587057 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.587039 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba2d07d6-d82e-4d02-b226-a35a1f016a1a-secret-grpc-tls\") pod \"thanos-querier-77845f884-blc22\" (UID: \"ba2d07d6-d82e-4d02-b226-a35a1f016a1a\") " pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:43.587281 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.587261 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ba2d07d6-d82e-4d02-b226-a35a1f016a1a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77845f884-blc22\" (UID: \"ba2d07d6-d82e-4d02-b226-a35a1f016a1a\") " pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:43.587370 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.587353 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ba2d07d6-d82e-4d02-b226-a35a1f016a1a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77845f884-blc22\" (UID: \"ba2d07d6-d82e-4d02-b226-a35a1f016a1a\") " pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:43.587484 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.587468 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ba2d07d6-d82e-4d02-b226-a35a1f016a1a-secret-thanos-querier-tls\") pod \"thanos-querier-77845f884-blc22\" (UID: \"ba2d07d6-d82e-4d02-b226-a35a1f016a1a\") " pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:43.596412 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.596395 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84cn4\" (UniqueName: \"kubernetes.io/projected/ba2d07d6-d82e-4d02-b226-a35a1f016a1a-kube-api-access-84cn4\") pod \"thanos-querier-77845f884-blc22\" (UID: \"ba2d07d6-d82e-4d02-b226-a35a1f016a1a\") " pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:43.676903 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.676874 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:43.814077 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.813992 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-77845f884-blc22"] Jul 16 21:51:43.816971 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:51:43.816942 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba2d07d6_d82e_4d02_b226_a35a1f016a1a.slice/crio-89ed4f811f0880baebb6800e988fe418df871ba164cfe2b18b2d26d72128fcc5 WatchSource:0}: Error finding container 89ed4f811f0880baebb6800e988fe418df871ba164cfe2b18b2d26d72128fcc5: Status 404 returned error can't find the container with id 89ed4f811f0880baebb6800e988fe418df871ba164cfe2b18b2d26d72128fcc5 Jul 16 21:51:43.840343 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.840313 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"883ceacd-c553-4d6d-af01-49918a90a5f8","Type":"ContainerStarted","Data":"4e495632712ab9f3feaaae89ea8700065a7a6af61e5c1de43134c8982310d033"} Jul 16 21:51:43.842405 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.842380 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-scb2w" event={"ID":"87e486d7-77ee-4645-9dc5-1b46f730ed96","Type":"ContainerStarted","Data":"56cf04e33f13a3c0c69fa1f14030a04af46e5e7eb7b84cf293e61501654eb0ae"} Jul 16 21:51:43.842540 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.842449 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-scb2w" event={"ID":"87e486d7-77ee-4645-9dc5-1b46f730ed96","Type":"ContainerStarted","Data":"f08d01b24eb09870f504a1a87777478c24168e6e878db868708e5381e5c67321"} Jul 16 21:51:43.843520 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.843500 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77845f884-blc22" event={"ID":"ba2d07d6-d82e-4d02-b226-a35a1f016a1a","Type":"ContainerStarted","Data":"89ed4f811f0880baebb6800e988fe418df871ba164cfe2b18b2d26d72128fcc5"} Jul 16 21:51:43.866955 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:43.866901 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-scb2w" podStartSLOduration=1.96240339 podStartE2EDuration="2.866888422s" totalImagesPullingTime="839.561429ms" totalInitContainerRuntime="64.923603ms" isStatefulPod=true podCreationTimestamp="2026-07-16 21:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:43.865589539 +0000 UTC m=+123.100716730" watchObservedRunningTime="2026-07-16 21:51:43.866888422 +0000 UTC m=+123.102015580" Jul 16 21:51:44.312630 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:44.312588 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:44.412095 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:44.412062 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:44.522743 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:44.522711 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:44.857860 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:44.857792 2566 generic.go:356] "Generic (PLEG): container finished" podID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerID="4417e1700af8b384a62255c30b3576b3b7e35d11afa278a27a7c44f64bd3d327" exitCode=0 Jul 16 21:51:44.858029 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:44.857851 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"883ceacd-c553-4d6d-af01-49918a90a5f8","Type":"ContainerDied","Data":"4417e1700af8b384a62255c30b3576b3b7e35d11afa278a27a7c44f64bd3d327"} Jul 16 21:51:44.872755 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:44.872728 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:45.077522 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:45.077487 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:45.188564 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:45.188447 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:45.872157 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:45.871939 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77845f884-blc22" event={"ID":"ba2d07d6-d82e-4d02-b226-a35a1f016a1a","Type":"ContainerStarted","Data":"4e59991009a6f8c56c1f396d6d2e1176268913ba0860fa72a7824a4b202fc92e"} Jul 16 21:51:45.872719 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:45.872222 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77845f884-blc22" event={"ID":"ba2d07d6-d82e-4d02-b226-a35a1f016a1a","Type":"ContainerStarted","Data":"6f97ae5e3055a93a337bd81ed5f424f6df62307fe566fe8be4543068697f9e8c"} Jul 16 21:51:46.062523 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:46.062486 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:46.157683 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:46.157654 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fjxl4"] Jul 16 21:51:46.162250 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:46.162231 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fjxl4" Jul 16 21:51:46.170045 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:46.170019 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 16 21:51:46.170378 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:46.170290 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-vzdn7\"" Jul 16 21:51:46.188616 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:46.188588 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fjxl4"] Jul 16 21:51:46.198728 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:46.198672 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:46.212714 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:46.212683 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4552d\" (UniqueName: \"kubernetes.io/projected/ea0bea5b-b42f-4318-be81-7cced73ec28c-kube-api-access-4552d\") pod \"monitoring-plugin-7b7b7bc8bf-fjxl4\" (UID: \"ea0bea5b-b42f-4318-be81-7cced73ec28c\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fjxl4" Jul 16 21:51:46.212879 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:46.212849 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea0bea5b-b42f-4318-be81-7cced73ec28c-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-fjxl4\" (UID: \"ea0bea5b-b42f-4318-be81-7cced73ec28c\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fjxl4" Jul 16 21:51:46.313876 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:46.313783 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea0bea5b-b42f-4318-be81-7cced73ec28c-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-fjxl4\" (UID: \"ea0bea5b-b42f-4318-be81-7cced73ec28c\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fjxl4" Jul 16 21:51:46.313876 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:46.313867 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4552d\" (UniqueName: \"kubernetes.io/projected/ea0bea5b-b42f-4318-be81-7cced73ec28c-kube-api-access-4552d\") pod \"monitoring-plugin-7b7b7bc8bf-fjxl4\" (UID: \"ea0bea5b-b42f-4318-be81-7cced73ec28c\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fjxl4" Jul 16 21:51:46.314093 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:51:46.313959 2566 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 16 21:51:46.314093 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:51:46.314037 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea0bea5b-b42f-4318-be81-7cced73ec28c-monitoring-plugin-cert podName:ea0bea5b-b42f-4318-be81-7cced73ec28c nodeName:}" failed. No retries permitted until 2026-07-16 21:51:46.814017099 +0000 UTC m=+126.049144245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/ea0bea5b-b42f-4318-be81-7cced73ec28c-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-fjxl4" (UID: "ea0bea5b-b42f-4318-be81-7cced73ec28c") : secret "monitoring-plugin-cert" not found Jul 16 21:51:46.330399 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:46.330364 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4552d\" (UniqueName: \"kubernetes.io/projected/ea0bea5b-b42f-4318-be81-7cced73ec28c-kube-api-access-4552d\") pod \"monitoring-plugin-7b7b7bc8bf-fjxl4\" (UID: \"ea0bea5b-b42f-4318-be81-7cced73ec28c\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fjxl4" Jul 16 21:51:46.334100 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:46.334058 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:46.431585 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:46.431548 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:46.646528 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:46.646489 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:46.820500 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:46.820389 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea0bea5b-b42f-4318-be81-7cced73ec28c-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-fjxl4\" (UID: \"ea0bea5b-b42f-4318-be81-7cced73ec28c\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fjxl4" Jul 16 21:51:46.823522 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:46.823494 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea0bea5b-b42f-4318-be81-7cced73ec28c-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-fjxl4\" (UID: \"ea0bea5b-b42f-4318-be81-7cced73ec28c\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fjxl4" Jul 16 21:51:46.877860 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:46.877822 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77845f884-blc22" event={"ID":"ba2d07d6-d82e-4d02-b226-a35a1f016a1a","Type":"ContainerStarted","Data":"8a1cac3b95e75976d11c1eb4f4bb75a8c2891f8ebd6dcaf7ab0111ea87df64e5"} Jul 16 21:51:46.880567 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:46.880543 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"883ceacd-c553-4d6d-af01-49918a90a5f8","Type":"ContainerStarted","Data":"c726efe1b3ad50967d5c0e8f3baafb0f2fe8ab20e16d3c55d1960389f157068c"} Jul 16 21:51:46.880676 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:46.880603 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"883ceacd-c553-4d6d-af01-49918a90a5f8","Type":"ContainerStarted","Data":"f7e33100513aa300d1f12a4ccf397e77ec75a14ef51fb8877230cb3a46895a46"} Jul 16 21:51:46.880676 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:46.880631 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"883ceacd-c553-4d6d-af01-49918a90a5f8","Type":"ContainerStarted","Data":"75f6273b1fb694a017d720e242828a432834814e54b8d93e774fac5912fde646"} Jul 16 21:51:47.074919 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:47.074896 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fjxl4" Jul 16 21:51:47.236762 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:47.236740 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fjxl4"] Jul 16 21:51:47.238787 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:51:47.238762 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea0bea5b_b42f_4318_be81_7cced73ec28c.slice/crio-b804468018ac94d00547c4ea2efe2a452ad47da7071270651f2a8d1746c37521 WatchSource:0}: Error finding container b804468018ac94d00547c4ea2efe2a452ad47da7071270651f2a8d1746c37521: Status 404 returned error can't find the container with id b804468018ac94d00547c4ea2efe2a452ad47da7071270651f2a8d1746c37521 Jul 16 21:51:47.664162 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:47.664127 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-864c69867d-j5k2t"] Jul 16 21:51:47.893359 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:47.893319 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:47.893875 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:47.893406 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"883ceacd-c553-4d6d-af01-49918a90a5f8","Type":"ContainerStarted","Data":"ee4fa055ad22e9a5d3b4927e797cf89a751f138355702929bd2bb928a8e55a20"} Jul 16 21:51:47.893875 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:47.893497 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"883ceacd-c553-4d6d-af01-49918a90a5f8","Type":"ContainerStarted","Data":"1ddc659db20a03d0e4bb63256ddbb16d12eafbf66870fd7b7f5e26a60e77afe7"} Jul 16 21:51:47.893875 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:47.893540 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"883ceacd-c553-4d6d-af01-49918a90a5f8","Type":"ContainerStarted","Data":"b6488533b90c8874ab3f6df7adba52df29dc271c4594a71d400863be413c438f"} Jul 16 21:51:47.897094 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:47.897065 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fjxl4" event={"ID":"ea0bea5b-b42f-4318-be81-7cced73ec28c","Type":"ContainerStarted","Data":"b804468018ac94d00547c4ea2efe2a452ad47da7071270651f2a8d1746c37521"} Jul 16 21:51:47.900864 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:47.900824 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77845f884-blc22" event={"ID":"ba2d07d6-d82e-4d02-b226-a35a1f016a1a","Type":"ContainerStarted","Data":"56ed8386cf2ef85352139a0a7125a2447f93d3386be984e6d7f3d36f46df3fe8"} Jul 16 21:51:47.900994 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:47.900898 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77845f884-blc22" event={"ID":"ba2d07d6-d82e-4d02-b226-a35a1f016a1a","Type":"ContainerStarted","Data":"5514c867be5358f07d3055a87ef35ab094f3aeac22b29f25db779e86dc903dce"} Jul 16 21:51:47.900994 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:47.900956 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77845f884-blc22" event={"ID":"ba2d07d6-d82e-4d02-b226-a35a1f016a1a","Type":"ContainerStarted","Data":"46308092c4ff6db7239e7144d229b81e3290ebc463126358cd9a6e1beb9c03e3"} Jul 16 21:51:47.901096 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:47.901086 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:47.963230 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:47.963171 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.354362733 podStartE2EDuration="5.963150467s" totalImagesPullingTime="2.589763987s" totalInitContainerRuntime="19.023747ms" isStatefulPod=false podCreationTimestamp="2026-07-16 21:51:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:47.961374927 +0000 UTC m=+127.196502090" watchObservedRunningTime="2026-07-16 21:51:47.963150467 +0000 UTC m=+127.198277642" Jul 16 21:51:48.003574 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:48.003523 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-77845f884-blc22" podStartSLOduration=2.157135664 podStartE2EDuration="5.003501445s" totalImagesPullingTime="2.846365781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:51:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:48.000820576 +0000 UTC m=+127.235947765" watchObservedRunningTime="2026-07-16 21:51:48.003501445 +0000 UTC m=+127.238628605" Jul 16 21:51:48.007953 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:48.007919 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:48.091326 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:48.091272 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:48.906491 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:48.906454 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fjxl4" event={"ID":"ea0bea5b-b42f-4318-be81-7cced73ec28c","Type":"ContainerStarted","Data":"4c32c8752fe29713fa2a45f010365be13e5eed24c1e13ebf3ca874239a62f9d7"} Jul 16 21:51:48.907214 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:48.907192 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fjxl4" Jul 16 21:51:48.911800 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:48.911779 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fjxl4" Jul 16 21:51:48.926513 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:48.926444 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-fjxl4" podStartSLOduration=1.407967137 podStartE2EDuration="2.926406758s" totalImagesPullingTime="1.518439621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:51:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:48.925213634 +0000 UTC m=+128.160340794" watchObservedRunningTime="2026-07-16 21:51:48.926406758 +0000 UTC m=+128.161533966" Jul 16 21:51:49.228705 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:49.228666 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:49.331305 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:49.331271 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:49.559677 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:49.559579 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:49.748368 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:49.748328 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:51.165019 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:51.164981 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b90276c-b68f-49a9-b571-13174fb91f20-metrics-certs\") pod \"network-metrics-daemon-j7587\" (UID: \"4b90276c-b68f-49a9-b571-13174fb91f20\") " pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:51:51.167272 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:51.167250 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b90276c-b68f-49a9-b571-13174fb91f20-metrics-certs\") pod \"network-metrics-daemon-j7587\" (UID: \"4b90276c-b68f-49a9-b571-13174fb91f20\") " pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:51:51.204827 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:51.204793 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:51.233386 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:51.233359 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5fdwm\"" Jul 16 21:51:51.240383 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:51.240365 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7587" Jul 16 21:51:51.295699 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:51.295652 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:51.383041 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:51.383013 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j7587"] Jul 16 21:51:51.383157 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:51:51.383008 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b90276c_b68f_49a9_b571_13174fb91f20.slice/crio-cc182cc6a0a8b3a3d2c3fc806e24872e59ae22368dbf2c2251bdf7ff7bf96613 WatchSource:0}: Error finding container cc182cc6a0a8b3a3d2c3fc806e24872e59ae22368dbf2c2251bdf7ff7bf96613: Status 404 returned error can't find the container with id cc182cc6a0a8b3a3d2c3fc806e24872e59ae22368dbf2c2251bdf7ff7bf96613 Jul 16 21:51:51.918686 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:51.918652 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j7587" event={"ID":"4b90276c-b68f-49a9-b571-13174fb91f20","Type":"ContainerStarted","Data":"cc182cc6a0a8b3a3d2c3fc806e24872e59ae22368dbf2c2251bdf7ff7bf96613"} Jul 16 21:51:53.913461 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:53.913411 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-77845f884-blc22" Jul 16 21:51:53.928471 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:53.928439 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j7587" event={"ID":"4b90276c-b68f-49a9-b571-13174fb91f20","Type":"ContainerStarted","Data":"5dd87599bc490124f782fd3094fb6f0d8198bf06ee351253ed50f2ca3e92f901"} Jul 16 21:51:53.928614 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:53.928516 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j7587" event={"ID":"4b90276c-b68f-49a9-b571-13174fb91f20","Type":"ContainerStarted","Data":"f2f623a9f403de0ceb26d7a5a77ed279fb8271c71d4ccf0f6c5bd1d108165907"} Jul 16 21:51:53.962570 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:53.962520 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-j7587" podStartSLOduration=131.449779274 podStartE2EDuration="2m12.962502656s" totalImagesPullingTime="1.512723382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:49:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:53.962242027 +0000 UTC m=+133.197369188" watchObservedRunningTime="2026-07-16 21:51:53.962502656 +0000 UTC m=+133.197629816" Jul 16 21:51:54.084993 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:54.084953 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:54.147481 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:54.147448 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:56.955328 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:56.955299 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:57.057443 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:57.057373 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:57.156656 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:57.156618 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:57.257224 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:57.257190 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:51:57.947662 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:57.947630 2566 generic.go:356] "Generic (PLEG): container finished" podID="396a51f2-d2b9-402a-8668-faa8c446171b" containerID="3be14b7b0cb91b63e88b012171211b1d61cd4890f9a9ecbcad68d1fbbbc8014d" exitCode=0 Jul 16 21:51:57.947829 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:57.947679 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9szth" event={"ID":"396a51f2-d2b9-402a-8668-faa8c446171b","Type":"ContainerDied","Data":"3be14b7b0cb91b63e88b012171211b1d61cd4890f9a9ecbcad68d1fbbbc8014d"} Jul 16 21:51:57.947980 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:57.947967 2566 scope.go:117] "RemoveContainer" containerID="3be14b7b0cb91b63e88b012171211b1d61cd4890f9a9ecbcad68d1fbbbc8014d" Jul 16 21:51:58.953794 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:51:58.953757 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9szth" event={"ID":"396a51f2-d2b9-402a-8668-faa8c446171b","Type":"ContainerStarted","Data":"0037eb7951332811e80584990cbb574012f0fa07a00c21dc999324c8040065ba"} Jul 16 21:52:01.802021 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:01.801987 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:52:01.858935 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:01.858904 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:52:07.990128 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:07.990092 2566 generic.go:356] "Generic (PLEG): container finished" podID="9bb29d49-8d26-4c2d-adac-4e149546517b" containerID="7888e751cc693fa07438d38cf7ed24867886ef30054bf6cde95a75e891a47ca0" exitCode=0 Jul 16 21:52:07.990509 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:07.990158 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9qm6q" event={"ID":"9bb29d49-8d26-4c2d-adac-4e149546517b","Type":"ContainerDied","Data":"7888e751cc693fa07438d38cf7ed24867886ef30054bf6cde95a75e891a47ca0"} Jul 16 21:52:07.990565 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:07.990546 2566 scope.go:117] "RemoveContainer" containerID="7888e751cc693fa07438d38cf7ed24867886ef30054bf6cde95a75e891a47ca0" Jul 16 21:52:08.996037 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:08.996000 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9qm6q" event={"ID":"9bb29d49-8d26-4c2d-adac-4e149546517b","Type":"ContainerStarted","Data":"4c2631fa73fe6ec13fda03bf83fce58cb36c22cdec29ab78ecf09689603d6d28"} Jul 16 21:52:12.684338 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:12.684291 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-864c69867d-j5k2t" podUID="846b555e-524b-4bfe-85e3-8782fd7c49ed" containerName="registry" containerID="cri-o://30855fa26d7670c712345a12ad30a39ee74dd31966086e1076f359635f30c7a5" gracePeriod=30 Jul 16 21:52:12.739926 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:12.739878 2566 patch_prober.go:28] interesting pod/image-registry-864c69867d-j5k2t container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" start-of-body= Jul 16 21:52:12.740079 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:12.739958 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-864c69867d-j5k2t" podUID="846b555e-524b-4bfe-85e3-8782fd7c49ed" containerName="registry" probeResult="failure" output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" Jul 16 21:52:12.917056 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:12.917026 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:52:13.013301 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.013263 2566 generic.go:356] "Generic (PLEG): container finished" podID="846b555e-524b-4bfe-85e3-8782fd7c49ed" containerID="30855fa26d7670c712345a12ad30a39ee74dd31966086e1076f359635f30c7a5" exitCode=0 Jul 16 21:52:13.013507 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.013311 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-864c69867d-j5k2t" Jul 16 21:52:13.013507 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.013350 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-864c69867d-j5k2t" event={"ID":"846b555e-524b-4bfe-85e3-8782fd7c49ed","Type":"ContainerDied","Data":"30855fa26d7670c712345a12ad30a39ee74dd31966086e1076f359635f30c7a5"} Jul 16 21:52:13.013507 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.013405 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-864c69867d-j5k2t" event={"ID":"846b555e-524b-4bfe-85e3-8782fd7c49ed","Type":"ContainerDied","Data":"4b1af8dfb6753a3f82393f45c2cab74a101c735d8446fd2e6a011042edbfa8d3"} Jul 16 21:52:13.013507 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.013452 2566 scope.go:117] "RemoveContainer" containerID="30855fa26d7670c712345a12ad30a39ee74dd31966086e1076f359635f30c7a5" Jul 16 21:52:13.021431 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.021400 2566 scope.go:117] "RemoveContainer" containerID="30855fa26d7670c712345a12ad30a39ee74dd31966086e1076f359635f30c7a5" Jul 16 21:52:13.021722 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:52:13.021689 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30855fa26d7670c712345a12ad30a39ee74dd31966086e1076f359635f30c7a5\": container with ID starting with 30855fa26d7670c712345a12ad30a39ee74dd31966086e1076f359635f30c7a5 not found: ID does not exist" containerID="30855fa26d7670c712345a12ad30a39ee74dd31966086e1076f359635f30c7a5" Jul 16 21:52:13.021777 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.021728 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30855fa26d7670c712345a12ad30a39ee74dd31966086e1076f359635f30c7a5"} err="failed to get container status \"30855fa26d7670c712345a12ad30a39ee74dd31966086e1076f359635f30c7a5\": rpc error: code = NotFound desc = could not find container \"30855fa26d7670c712345a12ad30a39ee74dd31966086e1076f359635f30c7a5\": container with ID starting with 30855fa26d7670c712345a12ad30a39ee74dd31966086e1076f359635f30c7a5 not found: ID does not exist" Jul 16 21:52:13.052956 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.052931 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/846b555e-524b-4bfe-85e3-8782fd7c49ed-installation-pull-secrets\") pod \"846b555e-524b-4bfe-85e3-8782fd7c49ed\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " Jul 16 21:52:13.053079 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.052974 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-certificates\") pod \"846b555e-524b-4bfe-85e3-8782fd7c49ed\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " Jul 16 21:52:13.053079 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.052998 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/846b555e-524b-4bfe-85e3-8782fd7c49ed-image-registry-private-configuration\") pod \"846b555e-524b-4bfe-85e3-8782fd7c49ed\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " Jul 16 21:52:13.053079 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.053030 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcqqq\" (UniqueName: \"kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-kube-api-access-qcqqq\") pod \"846b555e-524b-4bfe-85e3-8782fd7c49ed\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " Jul 16 21:52:13.053240 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.053202 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-tls\") pod \"846b555e-524b-4bfe-85e3-8782fd7c49ed\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " Jul 16 21:52:13.053240 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.053236 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/846b555e-524b-4bfe-85e3-8782fd7c49ed-ca-trust-extracted\") pod \"846b555e-524b-4bfe-85e3-8782fd7c49ed\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " Jul 16 21:52:13.053343 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.053308 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/846b555e-524b-4bfe-85e3-8782fd7c49ed-trusted-ca\") pod \"846b555e-524b-4bfe-85e3-8782fd7c49ed\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " Jul 16 21:52:13.053403 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.053364 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-bound-sa-token\") pod \"846b555e-524b-4bfe-85e3-8782fd7c49ed\" (UID: \"846b555e-524b-4bfe-85e3-8782fd7c49ed\") " Jul 16 21:52:13.053403 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.053372 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "846b555e-524b-4bfe-85e3-8782fd7c49ed" (UID: "846b555e-524b-4bfe-85e3-8782fd7c49ed"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:52:13.053671 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.053644 2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-certificates\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 21:52:13.053915 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.053891 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/846b555e-524b-4bfe-85e3-8782fd7c49ed-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "846b555e-524b-4bfe-85e3-8782fd7c49ed" (UID: "846b555e-524b-4bfe-85e3-8782fd7c49ed"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:52:13.055613 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.055589 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "846b555e-524b-4bfe-85e3-8782fd7c49ed" (UID: "846b555e-524b-4bfe-85e3-8782fd7c49ed"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 21:52:13.055717 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.055678 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/846b555e-524b-4bfe-85e3-8782fd7c49ed-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "846b555e-524b-4bfe-85e3-8782fd7c49ed" (UID: "846b555e-524b-4bfe-85e3-8782fd7c49ed"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:52:13.055778 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.055722 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/846b555e-524b-4bfe-85e3-8782fd7c49ed-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "846b555e-524b-4bfe-85e3-8782fd7c49ed" (UID: "846b555e-524b-4bfe-85e3-8782fd7c49ed"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:52:13.055778 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.055730 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-kube-api-access-qcqqq" (OuterVolumeSpecName: "kube-api-access-qcqqq") pod "846b555e-524b-4bfe-85e3-8782fd7c49ed" (UID: "846b555e-524b-4bfe-85e3-8782fd7c49ed"). InnerVolumeSpecName "kube-api-access-qcqqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 21:52:13.055899 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.055877 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "846b555e-524b-4bfe-85e3-8782fd7c49ed" (UID: "846b555e-524b-4bfe-85e3-8782fd7c49ed"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 21:52:13.061944 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.061922 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/846b555e-524b-4bfe-85e3-8782fd7c49ed-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "846b555e-524b-4bfe-85e3-8782fd7c49ed" (UID: "846b555e-524b-4bfe-85e3-8782fd7c49ed"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 21:52:13.154160 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.154123 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-registry-tls\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 21:52:13.154160 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.154153 2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/846b555e-524b-4bfe-85e3-8782fd7c49ed-ca-trust-extracted\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 21:52:13.154160 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.154164 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/846b555e-524b-4bfe-85e3-8782fd7c49ed-trusted-ca\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 21:52:13.154370 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.154172 2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-bound-sa-token\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 21:52:13.154370 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.154181 2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/846b555e-524b-4bfe-85e3-8782fd7c49ed-installation-pull-secrets\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 21:52:13.154370 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.154191 2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/846b555e-524b-4bfe-85e3-8782fd7c49ed-image-registry-private-configuration\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 21:52:13.154370 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.154200 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcqqq\" (UniqueName: \"kubernetes.io/projected/846b555e-524b-4bfe-85e3-8782fd7c49ed-kube-api-access-qcqqq\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 21:52:13.332001 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.331970 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-864c69867d-j5k2t"] Jul 16 21:52:13.338005 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:13.337981 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-864c69867d-j5k2t"] Jul 16 21:52:15.308236 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:15.308198 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="846b555e-524b-4bfe-85e3-8782fd7c49ed" path="/var/lib/kubelet/pods/846b555e-524b-4bfe-85e3-8782fd7c49ed/volumes" Jul 16 21:52:16.028087 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:16.028056 2566 generic.go:356] "Generic (PLEG): container finished" podID="44b07976-78f7-48e0-9168-869ddd954f1d" containerID="1f0679a06d68ee910847f75376f7ea13e70ebf6a755c0a5a20b37d0edc4e50ff" exitCode=0 Jul 16 21:52:16.028255 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:16.028131 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-khtbj" event={"ID":"44b07976-78f7-48e0-9168-869ddd954f1d","Type":"ContainerDied","Data":"1f0679a06d68ee910847f75376f7ea13e70ebf6a755c0a5a20b37d0edc4e50ff"} Jul 16 21:52:16.028541 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:16.028526 2566 scope.go:117] "RemoveContainer" containerID="1f0679a06d68ee910847f75376f7ea13e70ebf6a755c0a5a20b37d0edc4e50ff" Jul 16 21:52:17.033647 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:17.033611 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-khtbj" event={"ID":"44b07976-78f7-48e0-9168-869ddd954f1d","Type":"ContainerStarted","Data":"1b55e0ac29ae6701579306632db4f557cc117ac10b22ed07e0f3ff4aa43216c3"} Jul 16 21:52:19.540317 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:19.540273 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:52:19.602558 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:52:19.602526 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:53:00.788130 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:00.788090 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:53:01.086742 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:01.086655 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:53:01.859019 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:01.858989 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 21:53:01.859404 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:01.859258 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerName="alertmanager" containerID="cri-o://75f6273b1fb694a017d720e242828a432834814e54b8d93e774fac5912fde646" gracePeriod=120 Jul 16 21:53:01.859404 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:01.859327 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerName="kube-rbac-proxy-metric" containerID="cri-o://1ddc659db20a03d0e4bb63256ddbb16d12eafbf66870fd7b7f5e26a60e77afe7" gracePeriod=120 Jul 16 21:53:01.859404 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:01.859379 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerName="config-reloader" containerID="cri-o://f7e33100513aa300d1f12a4ccf397e77ec75a14ef51fb8877230cb3a46895a46" gracePeriod=120 Jul 16 21:53:01.859608 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:01.859455 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerName="prom-label-proxy" containerID="cri-o://ee4fa055ad22e9a5d3b4927e797cf89a751f138355702929bd2bb928a8e55a20" gracePeriod=120 Jul 16 21:53:01.859608 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:01.859364 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerName="kube-rbac-proxy-web" containerID="cri-o://c726efe1b3ad50967d5c0e8f3baafb0f2fe8ab20e16d3c55d1960389f157068c" gracePeriod=120 Jul 16 21:53:01.859608 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:01.859457 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerName="kube-rbac-proxy" containerID="cri-o://b6488533b90c8874ab3f6df7adba52df29dc271c4594a71d400863be413c438f" gracePeriod=120 Jul 16 21:53:02.217080 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:02.217037 2566 generic.go:356] "Generic (PLEG): container finished" podID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerID="ee4fa055ad22e9a5d3b4927e797cf89a751f138355702929bd2bb928a8e55a20" exitCode=0 Jul 16 21:53:02.217080 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:02.217077 2566 generic.go:356] "Generic (PLEG): container finished" podID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerID="b6488533b90c8874ab3f6df7adba52df29dc271c4594a71d400863be413c438f" exitCode=0 Jul 16 21:53:02.217272 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:02.217087 2566 generic.go:356] "Generic (PLEG): container finished" podID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerID="f7e33100513aa300d1f12a4ccf397e77ec75a14ef51fb8877230cb3a46895a46" exitCode=0 Jul 16 21:53:02.217272 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:02.217097 2566 generic.go:356] "Generic (PLEG): container finished" podID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerID="75f6273b1fb694a017d720e242828a432834814e54b8d93e774fac5912fde646" exitCode=0 Jul 16 21:53:02.217272 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:02.217109 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"883ceacd-c553-4d6d-af01-49918a90a5f8","Type":"ContainerDied","Data":"ee4fa055ad22e9a5d3b4927e797cf89a751f138355702929bd2bb928a8e55a20"} Jul 16 21:53:02.217272 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:02.217224 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"883ceacd-c553-4d6d-af01-49918a90a5f8","Type":"ContainerDied","Data":"b6488533b90c8874ab3f6df7adba52df29dc271c4594a71d400863be413c438f"} Jul 16 21:53:02.217272 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:02.217254 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"883ceacd-c553-4d6d-af01-49918a90a5f8","Type":"ContainerDied","Data":"f7e33100513aa300d1f12a4ccf397e77ec75a14ef51fb8877230cb3a46895a46"} Jul 16 21:53:02.217449 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:02.217278 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"883ceacd-c553-4d6d-af01-49918a90a5f8","Type":"ContainerDied","Data":"75f6273b1fb694a017d720e242828a432834814e54b8d93e774fac5912fde646"} Jul 16 21:53:03.114809 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.114785 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.224436 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.224390 2566 generic.go:356] "Generic (PLEG): container finished" podID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerID="1ddc659db20a03d0e4bb63256ddbb16d12eafbf66870fd7b7f5e26a60e77afe7" exitCode=0 Jul 16 21:53:03.224436 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.224428 2566 generic.go:356] "Generic (PLEG): container finished" podID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerID="c726efe1b3ad50967d5c0e8f3baafb0f2fe8ab20e16d3c55d1960389f157068c" exitCode=0 Jul 16 21:53:03.224691 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.224448 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"883ceacd-c553-4d6d-af01-49918a90a5f8","Type":"ContainerDied","Data":"1ddc659db20a03d0e4bb63256ddbb16d12eafbf66870fd7b7f5e26a60e77afe7"} Jul 16 21:53:03.224691 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.224509 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.224691 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.224519 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"883ceacd-c553-4d6d-af01-49918a90a5f8","Type":"ContainerDied","Data":"c726efe1b3ad50967d5c0e8f3baafb0f2fe8ab20e16d3c55d1960389f157068c"} Jul 16 21:53:03.224691 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.224546 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"883ceacd-c553-4d6d-af01-49918a90a5f8","Type":"ContainerDied","Data":"4e495632712ab9f3feaaae89ea8700065a7a6af61e5c1de43134c8982310d033"} Jul 16 21:53:03.224691 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.224578 2566 scope.go:117] "RemoveContainer" containerID="ee4fa055ad22e9a5d3b4927e797cf89a751f138355702929bd2bb928a8e55a20" Jul 16 21:53:03.232098 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.232078 2566 scope.go:117] "RemoveContainer" containerID="1ddc659db20a03d0e4bb63256ddbb16d12eafbf66870fd7b7f5e26a60e77afe7" Jul 16 21:53:03.239088 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.239069 2566 scope.go:117] "RemoveContainer" containerID="b6488533b90c8874ab3f6df7adba52df29dc271c4594a71d400863be413c438f" Jul 16 21:53:03.246083 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.246064 2566 scope.go:117] "RemoveContainer" containerID="c726efe1b3ad50967d5c0e8f3baafb0f2fe8ab20e16d3c55d1960389f157068c" Jul 16 21:53:03.252614 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.252599 2566 scope.go:117] "RemoveContainer" containerID="f7e33100513aa300d1f12a4ccf397e77ec75a14ef51fb8877230cb3a46895a46" Jul 16 21:53:03.260483 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.259597 2566 scope.go:117] "RemoveContainer" containerID="75f6273b1fb694a017d720e242828a432834814e54b8d93e774fac5912fde646" Jul 16 21:53:03.265139 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.265115 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-secret-alertmanager-kube-rbac-proxy\") pod \"883ceacd-c553-4d6d-af01-49918a90a5f8\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " Jul 16 21:53:03.265238 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.265149 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/883ceacd-c553-4d6d-af01-49918a90a5f8-config-out\") pod \"883ceacd-c553-4d6d-af01-49918a90a5f8\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " Jul 16 21:53:03.265238 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.265173 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/883ceacd-c553-4d6d-af01-49918a90a5f8-tls-assets\") pod \"883ceacd-c553-4d6d-af01-49918a90a5f8\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " Jul 16 21:53:03.265238 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.265196 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"883ceacd-c553-4d6d-af01-49918a90a5f8\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " Jul 16 21:53:03.265238 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.265218 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/883ceacd-c553-4d6d-af01-49918a90a5f8-metrics-client-ca\") pod \"883ceacd-c553-4d6d-af01-49918a90a5f8\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " Jul 16 21:53:03.265451 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.265244 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcfqc\" (UniqueName: \"kubernetes.io/projected/883ceacd-c553-4d6d-af01-49918a90a5f8-kube-api-access-tcfqc\") pod \"883ceacd-c553-4d6d-af01-49918a90a5f8\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " Jul 16 21:53:03.265451 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.265272 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/883ceacd-c553-4d6d-af01-49918a90a5f8-alertmanager-trusted-ca-bundle\") pod \"883ceacd-c553-4d6d-af01-49918a90a5f8\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " Jul 16 21:53:03.265451 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.265301 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/883ceacd-c553-4d6d-af01-49918a90a5f8-alertmanager-main-db\") pod \"883ceacd-c553-4d6d-af01-49918a90a5f8\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " Jul 16 21:53:03.265451 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.265332 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-secret-alertmanager-kube-rbac-proxy-web\") pod \"883ceacd-c553-4d6d-af01-49918a90a5f8\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " Jul 16 21:53:03.265451 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.265375 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-secret-alertmanager-main-tls\") pod \"883ceacd-c553-4d6d-af01-49918a90a5f8\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " Jul 16 21:53:03.265712 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.265478 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-web-config\") pod \"883ceacd-c553-4d6d-af01-49918a90a5f8\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " Jul 16 21:53:03.265712 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.265513 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-cluster-tls-config\") pod \"883ceacd-c553-4d6d-af01-49918a90a5f8\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " Jul 16 21:53:03.265712 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.265540 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-config-volume\") pod \"883ceacd-c553-4d6d-af01-49918a90a5f8\" (UID: \"883ceacd-c553-4d6d-af01-49918a90a5f8\") " Jul 16 21:53:03.265870 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.265842 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/883ceacd-c553-4d6d-af01-49918a90a5f8-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "883ceacd-c553-4d6d-af01-49918a90a5f8" (UID: "883ceacd-c553-4d6d-af01-49918a90a5f8"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:53:03.266747 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.266265 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/883ceacd-c553-4d6d-af01-49918a90a5f8-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "883ceacd-c553-4d6d-af01-49918a90a5f8" (UID: "883ceacd-c553-4d6d-af01-49918a90a5f8"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:53:03.266850 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.266754 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/883ceacd-c553-4d6d-af01-49918a90a5f8-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "883ceacd-c553-4d6d-af01-49918a90a5f8" (UID: "883ceacd-c553-4d6d-af01-49918a90a5f8"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 21:53:03.269290 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.269263 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "883ceacd-c553-4d6d-af01-49918a90a5f8" (UID: "883ceacd-c553-4d6d-af01-49918a90a5f8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:53:03.269557 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.269532 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/883ceacd-c553-4d6d-af01-49918a90a5f8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "883ceacd-c553-4d6d-af01-49918a90a5f8" (UID: "883ceacd-c553-4d6d-af01-49918a90a5f8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 21:53:03.269630 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.269579 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/883ceacd-c553-4d6d-af01-49918a90a5f8-config-out" (OuterVolumeSpecName: "config-out") pod "883ceacd-c553-4d6d-af01-49918a90a5f8" (UID: "883ceacd-c553-4d6d-af01-49918a90a5f8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 21:53:03.269722 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.269696 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "883ceacd-c553-4d6d-af01-49918a90a5f8" (UID: "883ceacd-c553-4d6d-af01-49918a90a5f8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:53:03.269791 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.269744 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "883ceacd-c553-4d6d-af01-49918a90a5f8" (UID: "883ceacd-c553-4d6d-af01-49918a90a5f8"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:53:03.269940 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.269911 2566 scope.go:117] "RemoveContainer" containerID="4417e1700af8b384a62255c30b3576b3b7e35d11afa278a27a7c44f64bd3d327" Jul 16 21:53:03.270040 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.269969 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/883ceacd-c553-4d6d-af01-49918a90a5f8-kube-api-access-tcfqc" (OuterVolumeSpecName: "kube-api-access-tcfqc") pod "883ceacd-c553-4d6d-af01-49918a90a5f8" (UID: "883ceacd-c553-4d6d-af01-49918a90a5f8"). InnerVolumeSpecName "kube-api-access-tcfqc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 21:53:03.270040 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.269993 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "883ceacd-c553-4d6d-af01-49918a90a5f8" (UID: "883ceacd-c553-4d6d-af01-49918a90a5f8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:53:03.270326 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.270301 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-config-volume" (OuterVolumeSpecName: "config-volume") pod "883ceacd-c553-4d6d-af01-49918a90a5f8" (UID: "883ceacd-c553-4d6d-af01-49918a90a5f8"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:53:03.274496 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.274466 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "883ceacd-c553-4d6d-af01-49918a90a5f8" (UID: "883ceacd-c553-4d6d-af01-49918a90a5f8"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:53:03.281260 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.281228 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-web-config" (OuterVolumeSpecName: "web-config") pod "883ceacd-c553-4d6d-af01-49918a90a5f8" (UID: "883ceacd-c553-4d6d-af01-49918a90a5f8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:53:03.282387 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.282371 2566 scope.go:117] "RemoveContainer" containerID="ee4fa055ad22e9a5d3b4927e797cf89a751f138355702929bd2bb928a8e55a20" Jul 16 21:53:03.282700 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:53:03.282677 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee4fa055ad22e9a5d3b4927e797cf89a751f138355702929bd2bb928a8e55a20\": container with ID starting with ee4fa055ad22e9a5d3b4927e797cf89a751f138355702929bd2bb928a8e55a20 not found: ID does not exist" containerID="ee4fa055ad22e9a5d3b4927e797cf89a751f138355702929bd2bb928a8e55a20" Jul 16 21:53:03.282771 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.282713 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee4fa055ad22e9a5d3b4927e797cf89a751f138355702929bd2bb928a8e55a20"} err="failed to get container status \"ee4fa055ad22e9a5d3b4927e797cf89a751f138355702929bd2bb928a8e55a20\": rpc error: code = NotFound desc = could not find container \"ee4fa055ad22e9a5d3b4927e797cf89a751f138355702929bd2bb928a8e55a20\": container with ID starting with ee4fa055ad22e9a5d3b4927e797cf89a751f138355702929bd2bb928a8e55a20 not found: ID does not exist" Jul 16 21:53:03.282771 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.282758 2566 scope.go:117] "RemoveContainer" containerID="1ddc659db20a03d0e4bb63256ddbb16d12eafbf66870fd7b7f5e26a60e77afe7" Jul 16 21:53:03.283049 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:53:03.283032 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ddc659db20a03d0e4bb63256ddbb16d12eafbf66870fd7b7f5e26a60e77afe7\": container with ID starting with 1ddc659db20a03d0e4bb63256ddbb16d12eafbf66870fd7b7f5e26a60e77afe7 not found: ID does not exist" containerID="1ddc659db20a03d0e4bb63256ddbb16d12eafbf66870fd7b7f5e26a60e77afe7" Jul 16 21:53:03.283087 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.283056 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ddc659db20a03d0e4bb63256ddbb16d12eafbf66870fd7b7f5e26a60e77afe7"} err="failed to get container status \"1ddc659db20a03d0e4bb63256ddbb16d12eafbf66870fd7b7f5e26a60e77afe7\": rpc error: code = NotFound desc = could not find container \"1ddc659db20a03d0e4bb63256ddbb16d12eafbf66870fd7b7f5e26a60e77afe7\": container with ID starting with 1ddc659db20a03d0e4bb63256ddbb16d12eafbf66870fd7b7f5e26a60e77afe7 not found: ID does not exist" Jul 16 21:53:03.283087 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.283073 2566 scope.go:117] "RemoveContainer" containerID="b6488533b90c8874ab3f6df7adba52df29dc271c4594a71d400863be413c438f" Jul 16 21:53:03.283268 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:53:03.283255 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6488533b90c8874ab3f6df7adba52df29dc271c4594a71d400863be413c438f\": container with ID starting with b6488533b90c8874ab3f6df7adba52df29dc271c4594a71d400863be413c438f not found: ID does not exist" containerID="b6488533b90c8874ab3f6df7adba52df29dc271c4594a71d400863be413c438f" Jul 16 21:53:03.283352 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.283271 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6488533b90c8874ab3f6df7adba52df29dc271c4594a71d400863be413c438f"} err="failed to get container status \"b6488533b90c8874ab3f6df7adba52df29dc271c4594a71d400863be413c438f\": rpc error: code = NotFound desc = could not find container \"b6488533b90c8874ab3f6df7adba52df29dc271c4594a71d400863be413c438f\": container with ID starting with b6488533b90c8874ab3f6df7adba52df29dc271c4594a71d400863be413c438f not found: ID does not exist" Jul 16 21:53:03.283352 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.283282 2566 scope.go:117] "RemoveContainer" containerID="c726efe1b3ad50967d5c0e8f3baafb0f2fe8ab20e16d3c55d1960389f157068c" Jul 16 21:53:03.283801 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:53:03.283785 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c726efe1b3ad50967d5c0e8f3baafb0f2fe8ab20e16d3c55d1960389f157068c\": container with ID starting with c726efe1b3ad50967d5c0e8f3baafb0f2fe8ab20e16d3c55d1960389f157068c not found: ID does not exist" containerID="c726efe1b3ad50967d5c0e8f3baafb0f2fe8ab20e16d3c55d1960389f157068c" Jul 16 21:53:03.283854 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.283806 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c726efe1b3ad50967d5c0e8f3baafb0f2fe8ab20e16d3c55d1960389f157068c"} err="failed to get container status \"c726efe1b3ad50967d5c0e8f3baafb0f2fe8ab20e16d3c55d1960389f157068c\": rpc error: code = NotFound desc = could not find container \"c726efe1b3ad50967d5c0e8f3baafb0f2fe8ab20e16d3c55d1960389f157068c\": container with ID starting with c726efe1b3ad50967d5c0e8f3baafb0f2fe8ab20e16d3c55d1960389f157068c not found: ID does not exist" Jul 16 21:53:03.283854 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.283821 2566 scope.go:117] "RemoveContainer" containerID="f7e33100513aa300d1f12a4ccf397e77ec75a14ef51fb8877230cb3a46895a46" Jul 16 21:53:03.284026 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:53:03.284012 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7e33100513aa300d1f12a4ccf397e77ec75a14ef51fb8877230cb3a46895a46\": container with ID starting with f7e33100513aa300d1f12a4ccf397e77ec75a14ef51fb8877230cb3a46895a46 not found: ID does not exist" containerID="f7e33100513aa300d1f12a4ccf397e77ec75a14ef51fb8877230cb3a46895a46" Jul 16 21:53:03.284060 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.284029 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7e33100513aa300d1f12a4ccf397e77ec75a14ef51fb8877230cb3a46895a46"} err="failed to get container status \"f7e33100513aa300d1f12a4ccf397e77ec75a14ef51fb8877230cb3a46895a46\": rpc error: code = NotFound desc = could not find container \"f7e33100513aa300d1f12a4ccf397e77ec75a14ef51fb8877230cb3a46895a46\": container with ID starting with f7e33100513aa300d1f12a4ccf397e77ec75a14ef51fb8877230cb3a46895a46 not found: ID does not exist" Jul 16 21:53:03.284060 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.284041 2566 scope.go:117] "RemoveContainer" containerID="75f6273b1fb694a017d720e242828a432834814e54b8d93e774fac5912fde646" Jul 16 21:53:03.284267 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:53:03.284248 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75f6273b1fb694a017d720e242828a432834814e54b8d93e774fac5912fde646\": container with ID starting with 75f6273b1fb694a017d720e242828a432834814e54b8d93e774fac5912fde646 not found: ID does not exist" containerID="75f6273b1fb694a017d720e242828a432834814e54b8d93e774fac5912fde646" Jul 16 21:53:03.284307 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.284273 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75f6273b1fb694a017d720e242828a432834814e54b8d93e774fac5912fde646"} err="failed to get container status \"75f6273b1fb694a017d720e242828a432834814e54b8d93e774fac5912fde646\": rpc error: code = NotFound desc = could not find container \"75f6273b1fb694a017d720e242828a432834814e54b8d93e774fac5912fde646\": container with ID starting with 75f6273b1fb694a017d720e242828a432834814e54b8d93e774fac5912fde646 not found: ID does not exist" Jul 16 21:53:03.284307 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.284288 2566 scope.go:117] "RemoveContainer" containerID="4417e1700af8b384a62255c30b3576b3b7e35d11afa278a27a7c44f64bd3d327" Jul 16 21:53:03.284484 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:53:03.284466 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4417e1700af8b384a62255c30b3576b3b7e35d11afa278a27a7c44f64bd3d327\": container with ID starting with 4417e1700af8b384a62255c30b3576b3b7e35d11afa278a27a7c44f64bd3d327 not found: ID does not exist" containerID="4417e1700af8b384a62255c30b3576b3b7e35d11afa278a27a7c44f64bd3d327" Jul 16 21:53:03.284531 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.284487 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4417e1700af8b384a62255c30b3576b3b7e35d11afa278a27a7c44f64bd3d327"} err="failed to get container status \"4417e1700af8b384a62255c30b3576b3b7e35d11afa278a27a7c44f64bd3d327\": rpc error: code = NotFound desc = could not find container \"4417e1700af8b384a62255c30b3576b3b7e35d11afa278a27a7c44f64bd3d327\": container with ID starting with 4417e1700af8b384a62255c30b3576b3b7e35d11afa278a27a7c44f64bd3d327 not found: ID does not exist" Jul 16 21:53:03.284531 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.284499 2566 scope.go:117] "RemoveContainer" containerID="ee4fa055ad22e9a5d3b4927e797cf89a751f138355702929bd2bb928a8e55a20" Jul 16 21:53:03.284728 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.284712 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee4fa055ad22e9a5d3b4927e797cf89a751f138355702929bd2bb928a8e55a20"} err="failed to get container status \"ee4fa055ad22e9a5d3b4927e797cf89a751f138355702929bd2bb928a8e55a20\": rpc error: code = NotFound desc = could not find container \"ee4fa055ad22e9a5d3b4927e797cf89a751f138355702929bd2bb928a8e55a20\": container with ID starting with ee4fa055ad22e9a5d3b4927e797cf89a751f138355702929bd2bb928a8e55a20 not found: ID does not exist" Jul 16 21:53:03.284728 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.284728 2566 scope.go:117] "RemoveContainer" containerID="1ddc659db20a03d0e4bb63256ddbb16d12eafbf66870fd7b7f5e26a60e77afe7" Jul 16 21:53:03.284909 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.284892 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ddc659db20a03d0e4bb63256ddbb16d12eafbf66870fd7b7f5e26a60e77afe7"} err="failed to get container status \"1ddc659db20a03d0e4bb63256ddbb16d12eafbf66870fd7b7f5e26a60e77afe7\": rpc error: code = NotFound desc = could not find container \"1ddc659db20a03d0e4bb63256ddbb16d12eafbf66870fd7b7f5e26a60e77afe7\": container with ID starting with 1ddc659db20a03d0e4bb63256ddbb16d12eafbf66870fd7b7f5e26a60e77afe7 not found: ID does not exist" Jul 16 21:53:03.284952 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.284909 2566 scope.go:117] "RemoveContainer" containerID="b6488533b90c8874ab3f6df7adba52df29dc271c4594a71d400863be413c438f" Jul 16 21:53:03.285101 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.285086 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6488533b90c8874ab3f6df7adba52df29dc271c4594a71d400863be413c438f"} err="failed to get container status \"b6488533b90c8874ab3f6df7adba52df29dc271c4594a71d400863be413c438f\": rpc error: code = NotFound desc = could not find container \"b6488533b90c8874ab3f6df7adba52df29dc271c4594a71d400863be413c438f\": container with ID starting with b6488533b90c8874ab3f6df7adba52df29dc271c4594a71d400863be413c438f not found: ID does not exist" Jul 16 21:53:03.285101 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.285100 2566 scope.go:117] "RemoveContainer" containerID="c726efe1b3ad50967d5c0e8f3baafb0f2fe8ab20e16d3c55d1960389f157068c" Jul 16 21:53:03.285277 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.285264 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c726efe1b3ad50967d5c0e8f3baafb0f2fe8ab20e16d3c55d1960389f157068c"} err="failed to get container status \"c726efe1b3ad50967d5c0e8f3baafb0f2fe8ab20e16d3c55d1960389f157068c\": rpc error: code = NotFound desc = could not find container \"c726efe1b3ad50967d5c0e8f3baafb0f2fe8ab20e16d3c55d1960389f157068c\": container with ID starting with c726efe1b3ad50967d5c0e8f3baafb0f2fe8ab20e16d3c55d1960389f157068c not found: ID does not exist" Jul 16 21:53:03.285320 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.285277 2566 scope.go:117] "RemoveContainer" containerID="f7e33100513aa300d1f12a4ccf397e77ec75a14ef51fb8877230cb3a46895a46" Jul 16 21:53:03.285492 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.285476 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7e33100513aa300d1f12a4ccf397e77ec75a14ef51fb8877230cb3a46895a46"} err="failed to get container status \"f7e33100513aa300d1f12a4ccf397e77ec75a14ef51fb8877230cb3a46895a46\": rpc error: code = NotFound desc = could not find container \"f7e33100513aa300d1f12a4ccf397e77ec75a14ef51fb8877230cb3a46895a46\": container with ID starting with f7e33100513aa300d1f12a4ccf397e77ec75a14ef51fb8877230cb3a46895a46 not found: ID does not exist" Jul 16 21:53:03.285539 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.285492 2566 scope.go:117] "RemoveContainer" containerID="75f6273b1fb694a017d720e242828a432834814e54b8d93e774fac5912fde646" Jul 16 21:53:03.285669 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.285653 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75f6273b1fb694a017d720e242828a432834814e54b8d93e774fac5912fde646"} err="failed to get container status \"75f6273b1fb694a017d720e242828a432834814e54b8d93e774fac5912fde646\": rpc error: code = NotFound desc = could not find container \"75f6273b1fb694a017d720e242828a432834814e54b8d93e774fac5912fde646\": container with ID starting with 75f6273b1fb694a017d720e242828a432834814e54b8d93e774fac5912fde646 not found: ID does not exist" Jul 16 21:53:03.285711 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.285669 2566 scope.go:117] "RemoveContainer" containerID="4417e1700af8b384a62255c30b3576b3b7e35d11afa278a27a7c44f64bd3d327" Jul 16 21:53:03.285891 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.285872 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4417e1700af8b384a62255c30b3576b3b7e35d11afa278a27a7c44f64bd3d327"} err="failed to get container status \"4417e1700af8b384a62255c30b3576b3b7e35d11afa278a27a7c44f64bd3d327\": rpc error: code = NotFound desc = could not find container \"4417e1700af8b384a62255c30b3576b3b7e35d11afa278a27a7c44f64bd3d327\": container with ID starting with 4417e1700af8b384a62255c30b3576b3b7e35d11afa278a27a7c44f64bd3d327 not found: ID does not exist" Jul 16 21:53:03.366930 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.366891 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-web-config\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 21:53:03.367129 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.367004 2566 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-cluster-tls-config\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 21:53:03.367129 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.367123 2566 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-config-volume\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 21:53:03.367217 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.367136 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 21:53:03.367217 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.367147 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/883ceacd-c553-4d6d-af01-49918a90a5f8-config-out\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 21:53:03.367217 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.367162 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/883ceacd-c553-4d6d-af01-49918a90a5f8-tls-assets\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 21:53:03.367217 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.367171 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 21:53:03.367217 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.367180 2566 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/883ceacd-c553-4d6d-af01-49918a90a5f8-metrics-client-ca\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 21:53:03.367217 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.367189 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcfqc\" (UniqueName: \"kubernetes.io/projected/883ceacd-c553-4d6d-af01-49918a90a5f8-kube-api-access-tcfqc\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 21:53:03.367217 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.367197 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/883ceacd-c553-4d6d-af01-49918a90a5f8-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 21:53:03.367217 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.367205 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/883ceacd-c553-4d6d-af01-49918a90a5f8-alertmanager-main-db\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 21:53:03.367217 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.367217 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 21:53:03.367525 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.367230 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/883ceacd-c553-4d6d-af01-49918a90a5f8-secret-alertmanager-main-tls\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 21:53:03.560811 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.560721 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 21:53:03.564056 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.564023 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 21:53:03.584285 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.584255 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 21:53:03.584579 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.584564 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerName="alertmanager" Jul 16 21:53:03.584630 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.584581 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerName="alertmanager" Jul 16 21:53:03.584630 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.584592 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerName="init-config-reloader" Jul 16 21:53:03.584630 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.584597 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerName="init-config-reloader" Jul 16 21:53:03.584630 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.584609 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerName="kube-rbac-proxy" Jul 16 21:53:03.584630 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.584615 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerName="kube-rbac-proxy" Jul 16 21:53:03.584630 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.584624 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerName="config-reloader" Jul 16 21:53:03.584630 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.584629 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerName="config-reloader" Jul 16 21:53:03.584884 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.584637 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerName="prom-label-proxy" Jul 16 21:53:03.584884 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.584642 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerName="prom-label-proxy" Jul 16 21:53:03.584884 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.584650 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="846b555e-524b-4bfe-85e3-8782fd7c49ed" containerName="registry" Jul 16 21:53:03.584884 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.584656 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="846b555e-524b-4bfe-85e3-8782fd7c49ed" containerName="registry" Jul 16 21:53:03.584884 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.584663 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerName="kube-rbac-proxy-web" Jul 16 21:53:03.584884 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.584668 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerName="kube-rbac-proxy-web" Jul 16 21:53:03.584884 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.584674 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerName="kube-rbac-proxy-metric" Jul 16 21:53:03.584884 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.584678 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerName="kube-rbac-proxy-metric" Jul 16 21:53:03.584884 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.584727 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerName="kube-rbac-proxy-metric" Jul 16 21:53:03.584884 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.584735 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerName="kube-rbac-proxy-web" Jul 16 21:53:03.584884 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.584741 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerName="config-reloader" Jul 16 21:53:03.584884 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.584747 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerName="alertmanager" Jul 16 21:53:03.584884 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.584753 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerName="kube-rbac-proxy" Jul 16 21:53:03.584884 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.584759 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="846b555e-524b-4bfe-85e3-8782fd7c49ed" containerName="registry" Jul 16 21:53:03.584884 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.584764 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="883ceacd-c553-4d6d-af01-49918a90a5f8" containerName="prom-label-proxy" Jul 16 21:53:03.589696 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.589678 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.592452 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.592413 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 16 21:53:03.592558 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.592480 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 16 21:53:03.592610 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.592408 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 16 21:53:03.593342 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.592771 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 16 21:53:03.593342 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.592839 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ljqw4\"" Jul 16 21:53:03.593342 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.593010 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 16 21:53:03.593342 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.593056 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 16 21:53:03.593342 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.593013 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 16 21:53:03.593342 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.593226 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 16 21:53:03.598944 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.598925 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 16 21:53:03.602807 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.602787 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 21:53:03.669668 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.669629 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61d0f2d5-33a1-44ac-a53a-21848a6633ef-web-config\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.669868 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.669689 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61d0f2d5-33a1-44ac-a53a-21848a6633ef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.669868 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.669714 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2k5x\" (UniqueName: \"kubernetes.io/projected/61d0f2d5-33a1-44ac-a53a-21848a6633ef-kube-api-access-c2k5x\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.669868 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.669742 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61d0f2d5-33a1-44ac-a53a-21848a6633ef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.669868 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.669797 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61d0f2d5-33a1-44ac-a53a-21848a6633ef-config-out\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.669868 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.669819 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61d0f2d5-33a1-44ac-a53a-21848a6633ef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.669868 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.669848 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61d0f2d5-33a1-44ac-a53a-21848a6633ef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.670117 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.669871 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61d0f2d5-33a1-44ac-a53a-21848a6633ef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.670117 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.669905 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61d0f2d5-33a1-44ac-a53a-21848a6633ef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.670117 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.669955 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61d0f2d5-33a1-44ac-a53a-21848a6633ef-config-volume\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.670117 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.670010 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61d0f2d5-33a1-44ac-a53a-21848a6633ef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.670117 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.670036 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61d0f2d5-33a1-44ac-a53a-21848a6633ef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.670117 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.670063 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61d0f2d5-33a1-44ac-a53a-21848a6633ef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.770741 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.770705 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61d0f2d5-33a1-44ac-a53a-21848a6633ef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.770741 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.770739 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61d0f2d5-33a1-44ac-a53a-21848a6633ef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.770982 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.770763 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61d0f2d5-33a1-44ac-a53a-21848a6633ef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.770982 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.770788 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61d0f2d5-33a1-44ac-a53a-21848a6633ef-config-volume\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.770982 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.770912 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61d0f2d5-33a1-44ac-a53a-21848a6633ef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.770982 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.770948 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61d0f2d5-33a1-44ac-a53a-21848a6633ef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.771191 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.770983 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61d0f2d5-33a1-44ac-a53a-21848a6633ef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.771191 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.771040 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61d0f2d5-33a1-44ac-a53a-21848a6633ef-web-config\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.771191 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.771087 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61d0f2d5-33a1-44ac-a53a-21848a6633ef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.771191 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.771115 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2k5x\" (UniqueName: \"kubernetes.io/projected/61d0f2d5-33a1-44ac-a53a-21848a6633ef-kube-api-access-c2k5x\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.771191 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.771151 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61d0f2d5-33a1-44ac-a53a-21848a6633ef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.771465 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.771210 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61d0f2d5-33a1-44ac-a53a-21848a6633ef-config-out\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.771465 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.771234 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61d0f2d5-33a1-44ac-a53a-21848a6633ef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.771465 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.771320 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61d0f2d5-33a1-44ac-a53a-21848a6633ef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.772125 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.772096 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61d0f2d5-33a1-44ac-a53a-21848a6633ef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.774522 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.774029 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61d0f2d5-33a1-44ac-a53a-21848a6633ef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.774522 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.774167 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61d0f2d5-33a1-44ac-a53a-21848a6633ef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.774522 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.774173 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61d0f2d5-33a1-44ac-a53a-21848a6633ef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.774522 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.774195 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61d0f2d5-33a1-44ac-a53a-21848a6633ef-config-volume\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.774522 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.774460 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61d0f2d5-33a1-44ac-a53a-21848a6633ef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.774522 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.774484 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61d0f2d5-33a1-44ac-a53a-21848a6633ef-web-config\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.774522 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.774467 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61d0f2d5-33a1-44ac-a53a-21848a6633ef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.774784 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.774584 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61d0f2d5-33a1-44ac-a53a-21848a6633ef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.775254 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.775236 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61d0f2d5-33a1-44ac-a53a-21848a6633ef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.775504 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.775486 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61d0f2d5-33a1-44ac-a53a-21848a6633ef-config-out\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.779714 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.779696 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2k5x\" (UniqueName: \"kubernetes.io/projected/61d0f2d5-33a1-44ac-a53a-21848a6633ef-kube-api-access-c2k5x\") pod \"alertmanager-main-0\" (UID: \"61d0f2d5-33a1-44ac-a53a-21848a6633ef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:03.900311 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:03.900218 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 21:53:04.041671 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:04.041645 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 21:53:04.043974 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:53:04.043945 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61d0f2d5_33a1_44ac_a53a_21848a6633ef.slice/crio-4bac8723b1ee19361b0275215d2c9f05113fd2f61736b4c05548f52de624cb5a WatchSource:0}: Error finding container 4bac8723b1ee19361b0275215d2c9f05113fd2f61736b4c05548f52de624cb5a: Status 404 returned error can't find the container with id 4bac8723b1ee19361b0275215d2c9f05113fd2f61736b4c05548f52de624cb5a Jul 16 21:53:04.230763 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:04.230734 2566 generic.go:356] "Generic (PLEG): container finished" podID="61d0f2d5-33a1-44ac-a53a-21848a6633ef" containerID="923d53c58570b6518b71faad816c3c60e01253bb5f799724434673575cb7b6ba" exitCode=0 Jul 16 21:53:04.231129 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:04.230769 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61d0f2d5-33a1-44ac-a53a-21848a6633ef","Type":"ContainerDied","Data":"923d53c58570b6518b71faad816c3c60e01253bb5f799724434673575cb7b6ba"} Jul 16 21:53:04.231129 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:04.230817 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61d0f2d5-33a1-44ac-a53a-21848a6633ef","Type":"ContainerStarted","Data":"4bac8723b1ee19361b0275215d2c9f05113fd2f61736b4c05548f52de624cb5a"} Jul 16 21:53:05.238518 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:05.238478 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61d0f2d5-33a1-44ac-a53a-21848a6633ef","Type":"ContainerStarted","Data":"87227894c126b17d7e2ceb924851e2f8bd3a1c55d797e56d7a732189f9dc14ae"} Jul 16 21:53:05.238862 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:05.238604 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61d0f2d5-33a1-44ac-a53a-21848a6633ef","Type":"ContainerStarted","Data":"6cd1bdb7d3bc6c8d8731f20f7d29c55982cd0a9fb8b19da5b088c26884fc48e0"} Jul 16 21:53:05.238862 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:05.238647 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61d0f2d5-33a1-44ac-a53a-21848a6633ef","Type":"ContainerStarted","Data":"9eb5aa1e9280a3ff0074aaf36f78bd7566d2f57d23fbb0578fdafc513bc85f35"} Jul 16 21:53:05.238862 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:05.238688 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61d0f2d5-33a1-44ac-a53a-21848a6633ef","Type":"ContainerStarted","Data":"f1e28afacb3b85be27d9fbb5a889ebf8c04006d39b3011a473d6c59f30fc40fe"} Jul 16 21:53:05.238862 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:05.238723 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61d0f2d5-33a1-44ac-a53a-21848a6633ef","Type":"ContainerStarted","Data":"c0e3e66a2e1a83593134ee56a609148883a392222b454feaa8ae6d47f848b8a0"} Jul 16 21:53:05.238862 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:05.238756 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61d0f2d5-33a1-44ac-a53a-21848a6633ef","Type":"ContainerStarted","Data":"09adfca4dc09c8c29373048333ff4cee23de4877ff97da462d842eb3965494f3"} Jul 16 21:53:05.277120 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:05.277063 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.257059556 podStartE2EDuration="2.277044303s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.984747ms" isStatefulPod=false podCreationTimestamp="2026-07-16 21:53:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:53:05.275830273 +0000 UTC m=+204.510957435" watchObservedRunningTime="2026-07-16 21:53:05.277044303 +0000 UTC m=+204.512171464" Jul 16 21:53:05.309268 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:05.309235 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="883ceacd-c553-4d6d-af01-49918a90a5f8" path="/var/lib/kubelet/pods/883ceacd-c553-4d6d-af01-49918a90a5f8/volumes" Jul 16 21:53:05.996383 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:05.996344 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5b9c78896d-j26ww"] Jul 16 21:53:06.000125 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.000106 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" Jul 16 21:53:06.003930 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.003901 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-cj7qz\"" Jul 16 21:53:06.004225 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.004207 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 16 21:53:06.004590 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.004573 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 16 21:53:06.009652 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.009634 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 16 21:53:06.009758 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.009639 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 16 21:53:06.037895 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.037861 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 16 21:53:06.041113 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.041086 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b9c78896d-j26ww"] Jul 16 21:53:06.046675 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.046647 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 16 21:53:06.089492 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.089452 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb5xb\" (UniqueName: \"kubernetes.io/projected/3b4d127f-d350-4d52-8eed-610c919df078-kube-api-access-mb5xb\") pod \"telemeter-client-5b9c78896d-j26ww\" (UID: \"3b4d127f-d350-4d52-8eed-610c919df078\") " pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" Jul 16 21:53:06.089684 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.089510 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3b4d127f-d350-4d52-8eed-610c919df078-federate-client-tls\") pod \"telemeter-client-5b9c78896d-j26ww\" (UID: \"3b4d127f-d350-4d52-8eed-610c919df078\") " pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" Jul 16 21:53:06.089684 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.089565 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b4d127f-d350-4d52-8eed-610c919df078-serving-certs-ca-bundle\") pod \"telemeter-client-5b9c78896d-j26ww\" (UID: \"3b4d127f-d350-4d52-8eed-610c919df078\") " pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" Jul 16 21:53:06.089684 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.089588 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b4d127f-d350-4d52-8eed-610c919df078-metrics-client-ca\") pod \"telemeter-client-5b9c78896d-j26ww\" (UID: \"3b4d127f-d350-4d52-8eed-610c919df078\") " pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" Jul 16 21:53:06.089857 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.089694 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3b4d127f-d350-4d52-8eed-610c919df078-secret-telemeter-client\") pod \"telemeter-client-5b9c78896d-j26ww\" (UID: \"3b4d127f-d350-4d52-8eed-610c919df078\") " pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" Jul 16 21:53:06.089857 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.089737 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3b4d127f-d350-4d52-8eed-610c919df078-telemeter-client-tls\") pod \"telemeter-client-5b9c78896d-j26ww\" (UID: \"3b4d127f-d350-4d52-8eed-610c919df078\") " pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" Jul 16 21:53:06.089857 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.089766 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b4d127f-d350-4d52-8eed-610c919df078-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b9c78896d-j26ww\" (UID: \"3b4d127f-d350-4d52-8eed-610c919df078\") " pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" Jul 16 21:53:06.089857 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.089795 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b4d127f-d350-4d52-8eed-610c919df078-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b9c78896d-j26ww\" (UID: \"3b4d127f-d350-4d52-8eed-610c919df078\") " pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" Jul 16 21:53:06.190958 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.190920 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3b4d127f-d350-4d52-8eed-610c919df078-federate-client-tls\") pod \"telemeter-client-5b9c78896d-j26ww\" (UID: \"3b4d127f-d350-4d52-8eed-610c919df078\") " pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" Jul 16 21:53:06.191140 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.190969 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b4d127f-d350-4d52-8eed-610c919df078-serving-certs-ca-bundle\") pod \"telemeter-client-5b9c78896d-j26ww\" (UID: \"3b4d127f-d350-4d52-8eed-610c919df078\") " pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" Jul 16 21:53:06.191140 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.190989 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b4d127f-d350-4d52-8eed-610c919df078-metrics-client-ca\") pod \"telemeter-client-5b9c78896d-j26ww\" (UID: \"3b4d127f-d350-4d52-8eed-610c919df078\") " pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" Jul 16 21:53:06.191140 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.191031 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3b4d127f-d350-4d52-8eed-610c919df078-secret-telemeter-client\") pod \"telemeter-client-5b9c78896d-j26ww\" (UID: \"3b4d127f-d350-4d52-8eed-610c919df078\") " pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" Jul 16 21:53:06.191140 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.191066 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3b4d127f-d350-4d52-8eed-610c919df078-telemeter-client-tls\") pod \"telemeter-client-5b9c78896d-j26ww\" (UID: \"3b4d127f-d350-4d52-8eed-610c919df078\") " pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" Jul 16 21:53:06.191140 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.191094 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b4d127f-d350-4d52-8eed-610c919df078-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b9c78896d-j26ww\" (UID: \"3b4d127f-d350-4d52-8eed-610c919df078\") " pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" Jul 16 21:53:06.191140 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.191123 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b4d127f-d350-4d52-8eed-610c919df078-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b9c78896d-j26ww\" (UID: \"3b4d127f-d350-4d52-8eed-610c919df078\") " pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" Jul 16 21:53:06.191482 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.191169 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb5xb\" (UniqueName: \"kubernetes.io/projected/3b4d127f-d350-4d52-8eed-610c919df078-kube-api-access-mb5xb\") pod \"telemeter-client-5b9c78896d-j26ww\" (UID: \"3b4d127f-d350-4d52-8eed-610c919df078\") " pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" Jul 16 21:53:06.191936 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.191907 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b4d127f-d350-4d52-8eed-610c919df078-metrics-client-ca\") pod \"telemeter-client-5b9c78896d-j26ww\" (UID: \"3b4d127f-d350-4d52-8eed-610c919df078\") " pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" Jul 16 21:53:06.192080 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.192013 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b4d127f-d350-4d52-8eed-610c919df078-serving-certs-ca-bundle\") pod \"telemeter-client-5b9c78896d-j26ww\" (UID: \"3b4d127f-d350-4d52-8eed-610c919df078\") " pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" Jul 16 21:53:06.192309 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.192277 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b4d127f-d350-4d52-8eed-610c919df078-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b9c78896d-j26ww\" (UID: \"3b4d127f-d350-4d52-8eed-610c919df078\") " pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" Jul 16 21:53:06.193935 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.193883 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3b4d127f-d350-4d52-8eed-610c919df078-federate-client-tls\") pod \"telemeter-client-5b9c78896d-j26ww\" (UID: \"3b4d127f-d350-4d52-8eed-610c919df078\") " pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" Jul 16 21:53:06.194048 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.193955 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b4d127f-d350-4d52-8eed-610c919df078-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b9c78896d-j26ww\" (UID: \"3b4d127f-d350-4d52-8eed-610c919df078\") " pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" Jul 16 21:53:06.194100 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.194047 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3b4d127f-d350-4d52-8eed-610c919df078-secret-telemeter-client\") pod \"telemeter-client-5b9c78896d-j26ww\" (UID: \"3b4d127f-d350-4d52-8eed-610c919df078\") " pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" Jul 16 21:53:06.194100 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.194059 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3b4d127f-d350-4d52-8eed-610c919df078-telemeter-client-tls\") pod \"telemeter-client-5b9c78896d-j26ww\" (UID: \"3b4d127f-d350-4d52-8eed-610c919df078\") " pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" Jul 16 21:53:06.202282 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.202264 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb5xb\" (UniqueName: \"kubernetes.io/projected/3b4d127f-d350-4d52-8eed-610c919df078-kube-api-access-mb5xb\") pod \"telemeter-client-5b9c78896d-j26ww\" (UID: \"3b4d127f-d350-4d52-8eed-610c919df078\") " pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" Jul 16 21:53:06.310097 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.310015 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" Jul 16 21:53:06.476846 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:06.476819 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b9c78896d-j26ww"] Jul 16 21:53:07.249007 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:07.248969 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" event={"ID":"3b4d127f-d350-4d52-8eed-610c919df078","Type":"ContainerStarted","Data":"6184a89ed87359ef9d5c493c58b1ef244acc45a7cf13461c8bc51094932708b7"} Jul 16 21:53:08.255491 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:08.255453 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" event={"ID":"3b4d127f-d350-4d52-8eed-610c919df078","Type":"ContainerStarted","Data":"a6e6e41c0b6f60750782e12d6d61793f9f97a5eb8971959f1b51f6dd5a0391e5"} Jul 16 21:53:08.255919 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:08.255514 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" event={"ID":"3b4d127f-d350-4d52-8eed-610c919df078","Type":"ContainerStarted","Data":"330bea5c50d906c73d864ae9b1e92c9b8c2c7ec10dc8bfdf557848d5eff2bc3f"} Jul 16 21:53:08.255919 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:08.255537 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" event={"ID":"3b4d127f-d350-4d52-8eed-610c919df078","Type":"ContainerStarted","Data":"ccecfbd7353fae6180a80287f11a6f2aa37f0f957807e6ba592ec74c10322e3b"} Jul 16 21:53:08.281759 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:08.281707 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5b9c78896d-j26ww" podStartSLOduration=1.848028277 podStartE2EDuration="3.281690644s" totalImagesPullingTime="1.433662367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:53:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:53:08.2813528 +0000 UTC m=+207.516479960" watchObservedRunningTime="2026-07-16 21:53:08.281690644 +0000 UTC m=+207.516817803" Jul 16 21:53:09.246147 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:09.246100 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:53:20.296361 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:20.296325 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:53:20.357990 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:20.357955 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:53:20.418194 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:20.418155 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:53:46.839493 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:46.839458 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:53:46.940195 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:46.940160 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:53:56.567536 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:53:56.567500 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:54:16.121317 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:54:16.121222 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:54:16.222475 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:54:16.222434 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:54:25.857888 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:54:25.857851 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:54:25.917534 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:54:25.917502 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:54:28.004431 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:54:28.004382 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:54:28.064582 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:54:28.064549 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:54:34.536722 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:54:34.536683 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:54:34.635368 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:54:34.635332 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:54:38.562610 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:54:38.562568 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:54:38.678698 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:54:38.678662 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:54:38.760352 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:54:38.760301 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:54:41.187092 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:54:41.187061 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kp9cp_964fa034-949b-4752-8390-dc010d28551a/console-operator/1.log" Jul 16 21:54:41.194094 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:54:41.194066 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kp9cp_964fa034-949b-4752-8390-dc010d28551a/console-operator/1.log" Jul 16 21:54:41.194534 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:54:41.194492 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hz2pt_75c7e977-7b28-42d0-a6e6-0532f2932368/ovn-acl-logging/0.log" Jul 16 21:54:41.200001 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:54:41.199981 2566 kubelet.go:1648] "Image garbage collection succeeded" Jul 16 21:54:41.201270 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:54:41.201251 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hz2pt_75c7e977-7b28-42d0-a6e6-0532f2932368/ovn-acl-logging/0.log" Jul 16 21:54:50.810565 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:54:50.810531 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:55:56.890602 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:55:56.890566 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:55:58.151198 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:55:58.151164 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:55:58.812116 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:55:58.812082 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh"] Jul 16 21:55:58.815701 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:55:58.815680 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh" Jul 16 21:55:58.819346 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:55:58.819326 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 16 21:55:58.820279 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:55:58.820260 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-djztm\"" Jul 16 21:55:58.820462 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:55:58.820447 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 16 21:55:58.827273 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:55:58.827252 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh"] Jul 16 21:55:58.901281 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:55:58.901246 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jmxx\" (UniqueName: \"kubernetes.io/projected/05b8bfb7-1a9c-46f2-b20f-098bb0c7d979-kube-api-access-8jmxx\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh\" (UID: \"05b8bfb7-1a9c-46f2-b20f-098bb0c7d979\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh" Jul 16 21:55:58.901487 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:55:58.901325 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05b8bfb7-1a9c-46f2-b20f-098bb0c7d979-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh\" (UID: \"05b8bfb7-1a9c-46f2-b20f-098bb0c7d979\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh" Jul 16 21:55:58.901487 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:55:58.901386 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05b8bfb7-1a9c-46f2-b20f-098bb0c7d979-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh\" (UID: \"05b8bfb7-1a9c-46f2-b20f-098bb0c7d979\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh" Jul 16 21:55:59.002633 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:55:59.002601 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05b8bfb7-1a9c-46f2-b20f-098bb0c7d979-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh\" (UID: \"05b8bfb7-1a9c-46f2-b20f-098bb0c7d979\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh" Jul 16 21:55:59.002779 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:55:59.002642 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jmxx\" (UniqueName: \"kubernetes.io/projected/05b8bfb7-1a9c-46f2-b20f-098bb0c7d979-kube-api-access-8jmxx\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh\" (UID: \"05b8bfb7-1a9c-46f2-b20f-098bb0c7d979\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh" Jul 16 21:55:59.002779 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:55:59.002708 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05b8bfb7-1a9c-46f2-b20f-098bb0c7d979-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh\" (UID: \"05b8bfb7-1a9c-46f2-b20f-098bb0c7d979\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh" Jul 16 21:55:59.003065 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:55:59.003044 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05b8bfb7-1a9c-46f2-b20f-098bb0c7d979-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh\" (UID: \"05b8bfb7-1a9c-46f2-b20f-098bb0c7d979\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh" Jul 16 21:55:59.003102 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:55:59.003064 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05b8bfb7-1a9c-46f2-b20f-098bb0c7d979-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh\" (UID: \"05b8bfb7-1a9c-46f2-b20f-098bb0c7d979\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh" Jul 16 21:55:59.014598 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:55:59.014571 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jmxx\" (UniqueName: \"kubernetes.io/projected/05b8bfb7-1a9c-46f2-b20f-098bb0c7d979-kube-api-access-8jmxx\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh\" (UID: \"05b8bfb7-1a9c-46f2-b20f-098bb0c7d979\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh" Jul 16 21:55:59.124388 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:55:59.124307 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh" Jul 16 21:55:59.255371 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:55:59.255343 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh"] Jul 16 21:55:59.257555 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:55:59.257528 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b8bfb7_1a9c_46f2_b20f_098bb0c7d979.slice/crio-c9425869bac7514c1a52da3b9e00de9c9c27b3e2f178a07ea7adfd7f1ca66645 WatchSource:0}: Error finding container c9425869bac7514c1a52da3b9e00de9c9c27b3e2f178a07ea7adfd7f1ca66645: Status 404 returned error can't find the container with id c9425869bac7514c1a52da3b9e00de9c9c27b3e2f178a07ea7adfd7f1ca66645 Jul 16 21:55:59.259527 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:55:59.259507 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 21:55:59.936138 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:55:59.936097 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh" event={"ID":"05b8bfb7-1a9c-46f2-b20f-098bb0c7d979","Type":"ContainerStarted","Data":"c9425869bac7514c1a52da3b9e00de9c9c27b3e2f178a07ea7adfd7f1ca66645"} Jul 16 21:56:04.959590 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:04.959553 2566 generic.go:356] "Generic (PLEG): container finished" podID="05b8bfb7-1a9c-46f2-b20f-098bb0c7d979" containerID="c299058824fda29bb5f613761f40992d3cd60e2ad7c698af2fac7a2e2e17471a" exitCode=0 Jul 16 21:56:04.959997 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:04.959633 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh" event={"ID":"05b8bfb7-1a9c-46f2-b20f-098bb0c7d979","Type":"ContainerDied","Data":"c299058824fda29bb5f613761f40992d3cd60e2ad7c698af2fac7a2e2e17471a"} Jul 16 21:56:06.970021 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:06.969995 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh" event={"ID":"05b8bfb7-1a9c-46f2-b20f-098bb0c7d979","Type":"ContainerStarted","Data":"c427cb03b2d66fd32957151d88a8299b7389ec57bef6117ea5327dd6a9490aa8"} Jul 16 21:56:07.976376 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:07.976337 2566 generic.go:356] "Generic (PLEG): container finished" podID="05b8bfb7-1a9c-46f2-b20f-098bb0c7d979" containerID="c427cb03b2d66fd32957151d88a8299b7389ec57bef6117ea5327dd6a9490aa8" exitCode=0 Jul 16 21:56:07.976827 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:07.976402 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh" event={"ID":"05b8bfb7-1a9c-46f2-b20f-098bb0c7d979","Type":"ContainerDied","Data":"c427cb03b2d66fd32957151d88a8299b7389ec57bef6117ea5327dd6a9490aa8"} Jul 16 21:56:15.010434 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:15.010385 2566 generic.go:356] "Generic (PLEG): container finished" podID="05b8bfb7-1a9c-46f2-b20f-098bb0c7d979" containerID="9279eead4a616fe174c53e37a3fa6d9d61668bd4db6550453d783f7b3e58426d" exitCode=0 Jul 16 21:56:15.010852 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:15.010449 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh" event={"ID":"05b8bfb7-1a9c-46f2-b20f-098bb0c7d979","Type":"ContainerDied","Data":"9279eead4a616fe174c53e37a3fa6d9d61668bd4db6550453d783f7b3e58426d"} Jul 16 21:56:16.138546 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:16.138521 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh" Jul 16 21:56:16.248701 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:16.248665 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jmxx\" (UniqueName: \"kubernetes.io/projected/05b8bfb7-1a9c-46f2-b20f-098bb0c7d979-kube-api-access-8jmxx\") pod \"05b8bfb7-1a9c-46f2-b20f-098bb0c7d979\" (UID: \"05b8bfb7-1a9c-46f2-b20f-098bb0c7d979\") " Jul 16 21:56:16.248701 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:16.248708 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05b8bfb7-1a9c-46f2-b20f-098bb0c7d979-util\") pod \"05b8bfb7-1a9c-46f2-b20f-098bb0c7d979\" (UID: \"05b8bfb7-1a9c-46f2-b20f-098bb0c7d979\") " Jul 16 21:56:16.248973 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:16.248773 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05b8bfb7-1a9c-46f2-b20f-098bb0c7d979-bundle\") pod \"05b8bfb7-1a9c-46f2-b20f-098bb0c7d979\" (UID: \"05b8bfb7-1a9c-46f2-b20f-098bb0c7d979\") " Jul 16 21:56:16.249459 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:16.249412 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05b8bfb7-1a9c-46f2-b20f-098bb0c7d979-bundle" (OuterVolumeSpecName: "bundle") pod "05b8bfb7-1a9c-46f2-b20f-098bb0c7d979" (UID: "05b8bfb7-1a9c-46f2-b20f-098bb0c7d979"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 21:56:16.250988 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:16.250966 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05b8bfb7-1a9c-46f2-b20f-098bb0c7d979-kube-api-access-8jmxx" (OuterVolumeSpecName: "kube-api-access-8jmxx") pod "05b8bfb7-1a9c-46f2-b20f-098bb0c7d979" (UID: "05b8bfb7-1a9c-46f2-b20f-098bb0c7d979"). InnerVolumeSpecName "kube-api-access-8jmxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 21:56:16.252844 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:16.252816 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05b8bfb7-1a9c-46f2-b20f-098bb0c7d979-util" (OuterVolumeSpecName: "util") pod "05b8bfb7-1a9c-46f2-b20f-098bb0c7d979" (UID: "05b8bfb7-1a9c-46f2-b20f-098bb0c7d979"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 21:56:16.349768 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:16.349677 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05b8bfb7-1a9c-46f2-b20f-098bb0c7d979-bundle\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 21:56:16.349768 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:16.349709 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jmxx\" (UniqueName: \"kubernetes.io/projected/05b8bfb7-1a9c-46f2-b20f-098bb0c7d979-kube-api-access-8jmxx\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 21:56:16.349768 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:16.349721 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05b8bfb7-1a9c-46f2-b20f-098bb0c7d979-util\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 21:56:17.020080 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:17.020055 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh" Jul 16 21:56:17.020248 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:17.020053 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xc7mh" event={"ID":"05b8bfb7-1a9c-46f2-b20f-098bb0c7d979","Type":"ContainerDied","Data":"c9425869bac7514c1a52da3b9e00de9c9c27b3e2f178a07ea7adfd7f1ca66645"} Jul 16 21:56:17.020248 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:17.020172 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9425869bac7514c1a52da3b9e00de9c9c27b3e2f178a07ea7adfd7f1ca66645" Jul 16 21:56:21.341844 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:21.341798 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:56:21.477998 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:21.477964 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:56:23.916056 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:23.916022 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rf8gs"] Jul 16 21:56:23.916440 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:23.916341 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05b8bfb7-1a9c-46f2-b20f-098bb0c7d979" containerName="pull" Jul 16 21:56:23.916440 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:23.916366 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="05b8bfb7-1a9c-46f2-b20f-098bb0c7d979" containerName="pull" Jul 16 21:56:23.916440 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:23.916376 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05b8bfb7-1a9c-46f2-b20f-098bb0c7d979" containerName="extract" Jul 16 21:56:23.916440 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:23.916382 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="05b8bfb7-1a9c-46f2-b20f-098bb0c7d979" containerName="extract" Jul 16 21:56:23.916440 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:23.916391 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05b8bfb7-1a9c-46f2-b20f-098bb0c7d979" containerName="util" Jul 16 21:56:23.916440 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:23.916396 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="05b8bfb7-1a9c-46f2-b20f-098bb0c7d979" containerName="util" Jul 16 21:56:23.916641 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:23.916473 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="05b8bfb7-1a9c-46f2-b20f-098bb0c7d979" containerName="extract" Jul 16 21:56:23.918380 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:23.918356 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rf8gs" Jul 16 21:56:23.926287 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:23.926269 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-5zjfw\"" Jul 16 21:56:23.926872 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:23.926858 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 16 21:56:23.926924 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:23.926896 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 16 21:56:23.927124 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:23.927109 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 16 21:56:23.938902 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:23.938879 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rf8gs"] Jul 16 21:56:24.011461 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:24.011409 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/672e9f01-4f4e-4db7-ac7a-195ed1564750-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-rf8gs\" (UID: \"672e9f01-4f4e-4db7-ac7a-195ed1564750\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rf8gs" Jul 16 21:56:24.011633 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:24.011514 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9dcl\" (UniqueName: \"kubernetes.io/projected/672e9f01-4f4e-4db7-ac7a-195ed1564750-kube-api-access-s9dcl\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-rf8gs\" (UID: \"672e9f01-4f4e-4db7-ac7a-195ed1564750\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rf8gs" Jul 16 21:56:24.113014 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:24.112972 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/672e9f01-4f4e-4db7-ac7a-195ed1564750-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-rf8gs\" (UID: \"672e9f01-4f4e-4db7-ac7a-195ed1564750\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rf8gs" Jul 16 21:56:24.113186 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:24.113031 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9dcl\" (UniqueName: \"kubernetes.io/projected/672e9f01-4f4e-4db7-ac7a-195ed1564750-kube-api-access-s9dcl\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-rf8gs\" (UID: \"672e9f01-4f4e-4db7-ac7a-195ed1564750\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rf8gs" Jul 16 21:56:24.115351 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:24.115330 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/672e9f01-4f4e-4db7-ac7a-195ed1564750-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-rf8gs\" (UID: \"672e9f01-4f4e-4db7-ac7a-195ed1564750\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rf8gs" Jul 16 21:56:24.124135 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:24.124112 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9dcl\" (UniqueName: \"kubernetes.io/projected/672e9f01-4f4e-4db7-ac7a-195ed1564750-kube-api-access-s9dcl\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-rf8gs\" (UID: \"672e9f01-4f4e-4db7-ac7a-195ed1564750\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rf8gs" Jul 16 21:56:24.228608 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:24.228577 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rf8gs" Jul 16 21:56:24.365027 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:24.364994 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rf8gs"] Jul 16 21:56:24.368474 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:56:24.368442 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod672e9f01_4f4e_4db7_ac7a_195ed1564750.slice/crio-90b9ece0aa75812917fa842f368f3dfd840c15bbb964671052aab35113da75c4 WatchSource:0}: Error finding container 90b9ece0aa75812917fa842f368f3dfd840c15bbb964671052aab35113da75c4: Status 404 returned error can't find the container with id 90b9ece0aa75812917fa842f368f3dfd840c15bbb964671052aab35113da75c4 Jul 16 21:56:25.053157 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:25.053124 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rf8gs" event={"ID":"672e9f01-4f4e-4db7-ac7a-195ed1564750","Type":"ContainerStarted","Data":"90b9ece0aa75812917fa842f368f3dfd840c15bbb964671052aab35113da75c4"} Jul 16 21:56:27.853284 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:27.853247 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:56:28.076951 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:28.076913 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rf8gs" event={"ID":"672e9f01-4f4e-4db7-ac7a-195ed1564750","Type":"ContainerStarted","Data":"06f325d7719adf10fe56ae1efbfb5cf8802684c14535c6acd04caedfefd20e83"} Jul 16 21:56:28.077119 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:28.076988 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rf8gs" Jul 16 21:56:28.126913 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:28.126810 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rf8gs" podStartSLOduration=2.253812738 podStartE2EDuration="5.126795925s" totalImagesPullingTime="2.872983187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:56:28.125755866 +0000 UTC m=+407.360883025" watchObservedRunningTime="2026-07-16 21:56:28.126795925 +0000 UTC m=+407.361923084" Jul 16 21:56:28.200110 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:28.200075 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:56:28.665655 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:28.665619 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:56:28.853216 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:28.853183 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:56:28.874738 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:28.874697 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-pvcxh"] Jul 16 21:56:28.877029 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:28.877006 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-pvcxh" Jul 16 21:56:28.879680 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:28.879651 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 16 21:56:28.879859 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:28.879662 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 16 21:56:28.879859 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:28.879854 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-vksfj\"" Jul 16 21:56:28.888121 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:28.888097 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-pvcxh"] Jul 16 21:56:28.972364 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:28.972331 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:56:29.062538 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.062505 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/686c6fa7-5241-4ff8-8798-b1e9ab5fcbb7-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-pvcxh\" (UID: \"686c6fa7-5241-4ff8-8798-b1e9ab5fcbb7\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-pvcxh" Jul 16 21:56:29.062706 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.062554 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/686c6fa7-5241-4ff8-8798-b1e9ab5fcbb7-certificates\") pod \"keda-metrics-apiserver-55557df8c-pvcxh\" (UID: \"686c6fa7-5241-4ff8-8798-b1e9ab5fcbb7\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-pvcxh" Jul 16 21:56:29.062706 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.062638 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksvfq\" (UniqueName: \"kubernetes.io/projected/686c6fa7-5241-4ff8-8798-b1e9ab5fcbb7-kube-api-access-ksvfq\") pod \"keda-metrics-apiserver-55557df8c-pvcxh\" (UID: \"686c6fa7-5241-4ff8-8798-b1e9ab5fcbb7\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-pvcxh" Jul 16 21:56:29.120729 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.120693 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:56:29.154066 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.154027 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-rjjn9"] Jul 16 21:56:29.156294 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.156272 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-rjjn9" Jul 16 21:56:29.162973 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.162951 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/686c6fa7-5241-4ff8-8798-b1e9ab5fcbb7-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-pvcxh\" (UID: \"686c6fa7-5241-4ff8-8798-b1e9ab5fcbb7\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-pvcxh" Jul 16 21:56:29.163096 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.163014 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/686c6fa7-5241-4ff8-8798-b1e9ab5fcbb7-certificates\") pod \"keda-metrics-apiserver-55557df8c-pvcxh\" (UID: \"686c6fa7-5241-4ff8-8798-b1e9ab5fcbb7\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-pvcxh" Jul 16 21:56:29.163177 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.163152 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk9z8\" (UniqueName: \"kubernetes.io/projected/d7dded1f-ee12-4cdf-ab07-98b793f22bea-kube-api-access-xk9z8\") pod \"keda-admission-56f9798bb4-rjjn9\" (UID: \"d7dded1f-ee12-4cdf-ab07-98b793f22bea\") " pod="openshift-keda/keda-admission-56f9798bb4-rjjn9" Jul 16 21:56:29.163232 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.163207 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d7dded1f-ee12-4cdf-ab07-98b793f22bea-certificates\") pod \"keda-admission-56f9798bb4-rjjn9\" (UID: \"d7dded1f-ee12-4cdf-ab07-98b793f22bea\") " pod="openshift-keda/keda-admission-56f9798bb4-rjjn9" Jul 16 21:56:29.163330 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.163310 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksvfq\" (UniqueName: \"kubernetes.io/projected/686c6fa7-5241-4ff8-8798-b1e9ab5fcbb7-kube-api-access-ksvfq\") pod \"keda-metrics-apiserver-55557df8c-pvcxh\" (UID: \"686c6fa7-5241-4ff8-8798-b1e9ab5fcbb7\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-pvcxh" Jul 16 21:56:29.163393 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.163343 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/686c6fa7-5241-4ff8-8798-b1e9ab5fcbb7-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-pvcxh\" (UID: \"686c6fa7-5241-4ff8-8798-b1e9ab5fcbb7\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-pvcxh" Jul 16 21:56:29.165582 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.165563 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/686c6fa7-5241-4ff8-8798-b1e9ab5fcbb7-certificates\") pod \"keda-metrics-apiserver-55557df8c-pvcxh\" (UID: \"686c6fa7-5241-4ff8-8798-b1e9ab5fcbb7\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-pvcxh" Jul 16 21:56:29.182106 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.182085 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 16 21:56:29.200233 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.200198 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-rjjn9"] Jul 16 21:56:29.214076 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.214044 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksvfq\" (UniqueName: \"kubernetes.io/projected/686c6fa7-5241-4ff8-8798-b1e9ab5fcbb7-kube-api-access-ksvfq\") pod \"keda-metrics-apiserver-55557df8c-pvcxh\" (UID: \"686c6fa7-5241-4ff8-8798-b1e9ab5fcbb7\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-pvcxh" Jul 16 21:56:29.243945 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.243827 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:56:29.263934 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.263898 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk9z8\" (UniqueName: \"kubernetes.io/projected/d7dded1f-ee12-4cdf-ab07-98b793f22bea-kube-api-access-xk9z8\") pod \"keda-admission-56f9798bb4-rjjn9\" (UID: \"d7dded1f-ee12-4cdf-ab07-98b793f22bea\") " pod="openshift-keda/keda-admission-56f9798bb4-rjjn9" Jul 16 21:56:29.264117 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.263947 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d7dded1f-ee12-4cdf-ab07-98b793f22bea-certificates\") pod \"keda-admission-56f9798bb4-rjjn9\" (UID: \"d7dded1f-ee12-4cdf-ab07-98b793f22bea\") " pod="openshift-keda/keda-admission-56f9798bb4-rjjn9" Jul 16 21:56:29.266682 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.266651 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d7dded1f-ee12-4cdf-ab07-98b793f22bea-certificates\") pod \"keda-admission-56f9798bb4-rjjn9\" (UID: \"d7dded1f-ee12-4cdf-ab07-98b793f22bea\") " pod="openshift-keda/keda-admission-56f9798bb4-rjjn9" Jul 16 21:56:29.275896 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.275863 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk9z8\" (UniqueName: \"kubernetes.io/projected/d7dded1f-ee12-4cdf-ab07-98b793f22bea-kube-api-access-xk9z8\") pod \"keda-admission-56f9798bb4-rjjn9\" (UID: \"d7dded1f-ee12-4cdf-ab07-98b793f22bea\") " pod="openshift-keda/keda-admission-56f9798bb4-rjjn9" Jul 16 21:56:29.352477 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.352401 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:56:29.466450 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.466401 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-rjjn9" Jul 16 21:56:29.487341 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.487308 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-pvcxh" Jul 16 21:56:29.637723 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.637690 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-rjjn9"] Jul 16 21:56:29.640450 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.640402 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:56:29.642086 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:56:29.642060 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7dded1f_ee12_4cdf_ab07_98b793f22bea.slice/crio-592c30a227ede3bd600fc44d58483200a54d524c4e4accf687555ddf6b35ba97 WatchSource:0}: Error finding container 592c30a227ede3bd600fc44d58483200a54d524c4e4accf687555ddf6b35ba97: Status 404 returned error can't find the container with id 592c30a227ede3bd600fc44d58483200a54d524c4e4accf687555ddf6b35ba97 Jul 16 21:56:29.669844 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.669810 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-pvcxh"] Jul 16 21:56:29.672012 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:56:29.671987 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod686c6fa7_5241_4ff8_8798_b1e9ab5fcbb7.slice/crio-fdae1b9df94a5ce77fb258be3671b501d35603d590e29b48c581b6bdc44b8351 WatchSource:0}: Error finding container fdae1b9df94a5ce77fb258be3671b501d35603d590e29b48c581b6bdc44b8351: Status 404 returned error can't find the container with id fdae1b9df94a5ce77fb258be3671b501d35603d590e29b48c581b6bdc44b8351 Jul 16 21:56:29.850020 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:29.849928 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:56:30.054398 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:30.054363 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:56:30.087903 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:30.087871 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-pvcxh" event={"ID":"686c6fa7-5241-4ff8-8798-b1e9ab5fcbb7","Type":"ContainerStarted","Data":"fdae1b9df94a5ce77fb258be3671b501d35603d590e29b48c581b6bdc44b8351"} Jul 16 21:56:30.088940 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:30.088916 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-rjjn9" event={"ID":"d7dded1f-ee12-4cdf-ab07-98b793f22bea","Type":"ContainerStarted","Data":"592c30a227ede3bd600fc44d58483200a54d524c4e4accf687555ddf6b35ba97"} Jul 16 21:56:30.152027 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:30.151955 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:56:32.106582 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:32.106544 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-rjjn9" event={"ID":"d7dded1f-ee12-4cdf-ab07-98b793f22bea","Type":"ContainerStarted","Data":"d2b56e4a4ef570c0487556545136966600f39a38dda173b287f5be6bc805ce25"} Jul 16 21:56:32.107039 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:32.106658 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-56f9798bb4-rjjn9" Jul 16 21:56:32.128141 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:32.128085 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-56f9798bb4-rjjn9" podStartSLOduration=1.700512899 podStartE2EDuration="3.128065828s" totalImagesPullingTime="1.427552929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:56:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:56:32.126849001 +0000 UTC m=+411.361976162" watchObservedRunningTime="2026-07-16 21:56:32.128065828 +0000 UTC m=+411.363192994" Jul 16 21:56:33.113038 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:33.113003 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-pvcxh" event={"ID":"686c6fa7-5241-4ff8-8798-b1e9ab5fcbb7","Type":"ContainerStarted","Data":"e77df556f6025c58200133546d482a55050bfb004c31f44ae5a5aabb7375c9dd"} Jul 16 21:56:33.113487 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:33.113278 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-pvcxh" Jul 16 21:56:33.131533 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:33.131480 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-pvcxh" podStartSLOduration=2.677277842 podStartE2EDuration="5.131462901s" totalImagesPullingTime="2.454185059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:56:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:56:33.130819655 +0000 UTC m=+412.365946817" watchObservedRunningTime="2026-07-16 21:56:33.131462901 +0000 UTC m=+412.366590060" Jul 16 21:56:44.122548 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:44.122519 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-pvcxh" Jul 16 21:56:49.085602 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:49.085565 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rf8gs" Jul 16 21:56:53.115794 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:56:53.115759 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-56f9798bb4-rjjn9" Jul 16 21:57:37.067627 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:37.067591 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:57:37.172740 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:37.172704 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:57:37.279285 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:37.279242 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:57:37.281889 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:37.281862 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-84cf6d888d-cgbkp"] Jul 16 21:57:37.285204 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:37.285188 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-84cf6d888d-cgbkp" Jul 16 21:57:37.289311 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:57:37.289284 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kserve-controller-manager-dockercfg-r957j\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kserve\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-r957j\"" type="*v1.Secret" Jul 16 21:57:37.289440 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:57:37.289308 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kserve-controller-manager-84cf6d888d-cgbkp\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kserve\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" podUID="1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8" pod="kserve/kserve-controller-manager-84cf6d888d-cgbkp" Jul 16 21:57:37.289440 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:57:37.289328 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kserve\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 16 21:57:37.289440 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:57:37.289339 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kserve-webhook-server-cert\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kserve\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" type="*v1.Secret" Jul 16 21:57:37.289720 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:57:37.289702 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-137-177.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kserve\": no relationship found between node 'ip-10-0-137-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 16 21:57:37.314699 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:37.314668 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-84cf6d888d-cgbkp"] Jul 16 21:57:37.399035 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:37.398938 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8-cert\") pod \"kserve-controller-manager-84cf6d888d-cgbkp\" (UID: \"1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8\") " pod="kserve/kserve-controller-manager-84cf6d888d-cgbkp" Jul 16 21:57:37.399035 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:37.398977 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctbkb\" (UniqueName: \"kubernetes.io/projected/1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8-kube-api-access-ctbkb\") pod \"kserve-controller-manager-84cf6d888d-cgbkp\" (UID: \"1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8\") " pod="kserve/kserve-controller-manager-84cf6d888d-cgbkp" Jul 16 21:57:37.453626 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:37.453587 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:57:37.499829 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:37.499794 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8-cert\") pod \"kserve-controller-manager-84cf6d888d-cgbkp\" (UID: \"1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8\") " pod="kserve/kserve-controller-manager-84cf6d888d-cgbkp" Jul 16 21:57:37.499948 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:37.499855 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctbkb\" (UniqueName: \"kubernetes.io/projected/1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8-kube-api-access-ctbkb\") pod \"kserve-controller-manager-84cf6d888d-cgbkp\" (UID: \"1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8\") " pod="kserve/kserve-controller-manager-84cf6d888d-cgbkp" Jul 16 21:57:37.695212 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:37.695116 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:57:37.866945 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:37.866906 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:57:38.483237 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:38.483201 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 16 21:57:38.500877 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:57:38.500845 2566 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: failed to sync secret cache: timed out waiting for the condition Jul 16 21:57:38.501029 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:57:38.500933 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8-cert podName:1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8 nodeName:}" failed. No retries permitted until 2026-07-16 21:57:39.000916225 +0000 UTC m=+478.236043366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8-cert") pod "kserve-controller-manager-84cf6d888d-cgbkp" (UID: "1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8") : failed to sync secret cache: timed out waiting for the condition Jul 16 21:57:38.507974 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:57:38.507946 2566 projected.go:291] Couldn't get configMap kserve/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jul 16 21:57:38.508064 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:57:38.507988 2566 projected.go:196] Error preparing data for projected volume kube-api-access-ctbkb for pod kserve/kserve-controller-manager-84cf6d888d-cgbkp: failed to sync configmap cache: timed out waiting for the condition Jul 16 21:57:38.508064 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:57:38.508047 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8-kube-api-access-ctbkb podName:1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8 nodeName:}" failed. No retries permitted until 2026-07-16 21:57:39.008032233 +0000 UTC m=+478.243159372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ctbkb" (UniqueName: "kubernetes.io/projected/1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8-kube-api-access-ctbkb") pod "kserve-controller-manager-84cf6d888d-cgbkp" (UID: "1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8") : failed to sync configmap cache: timed out waiting for the condition Jul 16 21:57:38.551800 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:38.551767 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-r957j\"" Jul 16 21:57:38.678071 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:38.678034 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:57:38.778154 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:38.778069 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:57:38.855119 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:38.855086 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 16 21:57:38.864980 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:38.864951 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 16 21:57:38.877769 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:38.877738 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:57:39.012640 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:39.012596 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8-cert\") pod \"kserve-controller-manager-84cf6d888d-cgbkp\" (UID: \"1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8\") " pod="kserve/kserve-controller-manager-84cf6d888d-cgbkp" Jul 16 21:57:39.012640 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:39.012643 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctbkb\" (UniqueName: \"kubernetes.io/projected/1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8-kube-api-access-ctbkb\") pod \"kserve-controller-manager-84cf6d888d-cgbkp\" (UID: \"1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8\") " pod="kserve/kserve-controller-manager-84cf6d888d-cgbkp" Jul 16 21:57:39.015210 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:39.015181 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8-cert\") pod \"kserve-controller-manager-84cf6d888d-cgbkp\" (UID: \"1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8\") " pod="kserve/kserve-controller-manager-84cf6d888d-cgbkp" Jul 16 21:57:39.015333 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:39.015195 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctbkb\" (UniqueName: \"kubernetes.io/projected/1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8-kube-api-access-ctbkb\") pod \"kserve-controller-manager-84cf6d888d-cgbkp\" (UID: \"1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8\") " pod="kserve/kserve-controller-manager-84cf6d888d-cgbkp" Jul 16 21:57:39.095632 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:39.095549 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-84cf6d888d-cgbkp" Jul 16 21:57:39.230152 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:39.230114 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-84cf6d888d-cgbkp"] Jul 16 21:57:39.233827 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:57:39.233788 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d3e70ae_f865_4a0c_bd1c_ca2dc63b5aa8.slice/crio-4da47bd183a171007364ba707172ea0a67a4eabcd27c0b8f7173d3f6d65bb147 WatchSource:0}: Error finding container 4da47bd183a171007364ba707172ea0a67a4eabcd27c0b8f7173d3f6d65bb147: Status 404 returned error can't find the container with id 4da47bd183a171007364ba707172ea0a67a4eabcd27c0b8f7173d3f6d65bb147 Jul 16 21:57:39.412038 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:39.411955 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-84cf6d888d-cgbkp" event={"ID":"1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8","Type":"ContainerStarted","Data":"4da47bd183a171007364ba707172ea0a67a4eabcd27c0b8f7173d3f6d65bb147"} Jul 16 21:57:42.429517 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:42.429478 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-84cf6d888d-cgbkp" event={"ID":"1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8","Type":"ContainerStarted","Data":"7840486ef72e6a661c441ac5d2922496177e45b87d292ce77276486f71489dd1"} Jul 16 21:57:42.429906 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:42.429545 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-84cf6d888d-cgbkp" Jul 16 21:57:42.450370 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:42.450321 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-84cf6d888d-cgbkp" podStartSLOduration=3.070453606 podStartE2EDuration="5.450304411s" totalImagesPullingTime="2.379850805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:57:42.449198635 +0000 UTC m=+481.684325795" watchObservedRunningTime="2026-07-16 21:57:42.450304411 +0000 UTC m=+481.685431570" Jul 16 21:57:59.205569 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:57:59.205527 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:58:11.286774 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:11.286742 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:58:11.345366 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:11.345330 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:58:13.440267 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:13.440232 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-84cf6d888d-cgbkp" Jul 16 21:58:20.638140 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:20.638099 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-84cf6d888d-cgbkp"] Jul 16 21:58:20.638598 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:20.638321 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-84cf6d888d-cgbkp" podUID="1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8" containerName="manager" containerID="cri-o://7840486ef72e6a661c441ac5d2922496177e45b87d292ce77276486f71489dd1" gracePeriod=10 Jul 16 21:58:20.668543 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:20.668510 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-84cf6d888d-srcg6"] Jul 16 21:58:20.671396 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:20.671378 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-84cf6d888d-srcg6" Jul 16 21:58:20.682610 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:20.682579 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-84cf6d888d-srcg6"] Jul 16 21:58:20.769388 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:20.769352 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/669746fb-4544-4d5d-9ef9-6b97b4de93da-cert\") pod \"kserve-controller-manager-84cf6d888d-srcg6\" (UID: \"669746fb-4544-4d5d-9ef9-6b97b4de93da\") " pod="kserve/kserve-controller-manager-84cf6d888d-srcg6" Jul 16 21:58:20.769552 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:20.769517 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqbgt\" (UniqueName: \"kubernetes.io/projected/669746fb-4544-4d5d-9ef9-6b97b4de93da-kube-api-access-jqbgt\") pod \"kserve-controller-manager-84cf6d888d-srcg6\" (UID: \"669746fb-4544-4d5d-9ef9-6b97b4de93da\") " pod="kserve/kserve-controller-manager-84cf6d888d-srcg6" Jul 16 21:58:20.870370 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:20.870344 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqbgt\" (UniqueName: \"kubernetes.io/projected/669746fb-4544-4d5d-9ef9-6b97b4de93da-kube-api-access-jqbgt\") pod \"kserve-controller-manager-84cf6d888d-srcg6\" (UID: \"669746fb-4544-4d5d-9ef9-6b97b4de93da\") " pod="kserve/kserve-controller-manager-84cf6d888d-srcg6" Jul 16 21:58:20.870506 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:20.870402 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/669746fb-4544-4d5d-9ef9-6b97b4de93da-cert\") pod \"kserve-controller-manager-84cf6d888d-srcg6\" (UID: \"669746fb-4544-4d5d-9ef9-6b97b4de93da\") " pod="kserve/kserve-controller-manager-84cf6d888d-srcg6" Jul 16 21:58:20.872596 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:20.872577 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/669746fb-4544-4d5d-9ef9-6b97b4de93da-cert\") pod \"kserve-controller-manager-84cf6d888d-srcg6\" (UID: \"669746fb-4544-4d5d-9ef9-6b97b4de93da\") " pod="kserve/kserve-controller-manager-84cf6d888d-srcg6" Jul 16 21:58:20.878871 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:20.878844 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqbgt\" (UniqueName: \"kubernetes.io/projected/669746fb-4544-4d5d-9ef9-6b97b4de93da-kube-api-access-jqbgt\") pod \"kserve-controller-manager-84cf6d888d-srcg6\" (UID: \"669746fb-4544-4d5d-9ef9-6b97b4de93da\") " pod="kserve/kserve-controller-manager-84cf6d888d-srcg6" Jul 16 21:58:20.895002 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:20.894955 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-84cf6d888d-cgbkp" Jul 16 21:58:20.971065 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:20.971030 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctbkb\" (UniqueName: \"kubernetes.io/projected/1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8-kube-api-access-ctbkb\") pod \"1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8\" (UID: \"1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8\") " Jul 16 21:58:20.971220 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:20.971114 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8-cert\") pod \"1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8\" (UID: \"1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8\") " Jul 16 21:58:20.973258 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:20.973225 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8-cert" (OuterVolumeSpecName: "cert") pod "1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8" (UID: "1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:58:20.973401 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:20.973332 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8-kube-api-access-ctbkb" (OuterVolumeSpecName: "kube-api-access-ctbkb") pod "1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8" (UID: "1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8"). InnerVolumeSpecName "kube-api-access-ctbkb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 21:58:21.021668 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:21.021632 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-84cf6d888d-srcg6" Jul 16 21:58:21.072853 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:21.072811 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctbkb\" (UniqueName: \"kubernetes.io/projected/1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8-kube-api-access-ctbkb\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 21:58:21.072853 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:21.072855 2566 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8-cert\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 21:58:21.153088 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:21.152947 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-84cf6d888d-srcg6"] Jul 16 21:58:21.155886 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:58:21.155862 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod669746fb_4544_4d5d_9ef9_6b97b4de93da.slice/crio-5cd9e807bd2c343703bfe74887ce8ee005ea0e77b53f7ee34916bd3a673e82bf WatchSource:0}: Error finding container 5cd9e807bd2c343703bfe74887ce8ee005ea0e77b53f7ee34916bd3a673e82bf: Status 404 returned error can't find the container with id 5cd9e807bd2c343703bfe74887ce8ee005ea0e77b53f7ee34916bd3a673e82bf Jul 16 21:58:21.604273 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:21.604232 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-84cf6d888d-srcg6" event={"ID":"669746fb-4544-4d5d-9ef9-6b97b4de93da","Type":"ContainerStarted","Data":"02e2cc30532658c2c9d2d7f3960a3d775e5e0ab2859f2c33e51af5e2f3876d95"} Jul 16 21:58:21.604488 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:21.604303 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-84cf6d888d-srcg6" Jul 16 21:58:21.604488 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:21.604330 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-84cf6d888d-srcg6" event={"ID":"669746fb-4544-4d5d-9ef9-6b97b4de93da","Type":"ContainerStarted","Data":"5cd9e807bd2c343703bfe74887ce8ee005ea0e77b53f7ee34916bd3a673e82bf"} Jul 16 21:58:21.605437 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:21.605390 2566 generic.go:356] "Generic (PLEG): container finished" podID="1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8" containerID="7840486ef72e6a661c441ac5d2922496177e45b87d292ce77276486f71489dd1" exitCode=0 Jul 16 21:58:21.605532 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:21.605450 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-84cf6d888d-cgbkp" Jul 16 21:58:21.605532 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:21.605459 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-84cf6d888d-cgbkp" event={"ID":"1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8","Type":"ContainerDied","Data":"7840486ef72e6a661c441ac5d2922496177e45b87d292ce77276486f71489dd1"} Jul 16 21:58:21.605532 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:21.605521 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-84cf6d888d-cgbkp" event={"ID":"1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8","Type":"ContainerDied","Data":"4da47bd183a171007364ba707172ea0a67a4eabcd27c0b8f7173d3f6d65bb147"} Jul 16 21:58:21.605631 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:21.605552 2566 scope.go:117] "RemoveContainer" containerID="7840486ef72e6a661c441ac5d2922496177e45b87d292ce77276486f71489dd1" Jul 16 21:58:21.614318 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:21.614294 2566 scope.go:117] "RemoveContainer" containerID="7840486ef72e6a661c441ac5d2922496177e45b87d292ce77276486f71489dd1" Jul 16 21:58:21.614639 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:58:21.614614 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7840486ef72e6a661c441ac5d2922496177e45b87d292ce77276486f71489dd1\": container with ID starting with 7840486ef72e6a661c441ac5d2922496177e45b87d292ce77276486f71489dd1 not found: ID does not exist" containerID="7840486ef72e6a661c441ac5d2922496177e45b87d292ce77276486f71489dd1" Jul 16 21:58:21.614737 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:21.614654 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7840486ef72e6a661c441ac5d2922496177e45b87d292ce77276486f71489dd1"} err="failed to get container status \"7840486ef72e6a661c441ac5d2922496177e45b87d292ce77276486f71489dd1\": rpc error: code = NotFound desc = could not find container \"7840486ef72e6a661c441ac5d2922496177e45b87d292ce77276486f71489dd1\": container with ID starting with 7840486ef72e6a661c441ac5d2922496177e45b87d292ce77276486f71489dd1 not found: ID does not exist" Jul 16 21:58:21.627164 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:21.627117 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-84cf6d888d-srcg6" podStartSLOduration=1.260893429 podStartE2EDuration="1.627099436s" totalImagesPullingTime="366.206007ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:58:21.62656883 +0000 UTC m=+520.861695989" watchObservedRunningTime="2026-07-16 21:58:21.627099436 +0000 UTC m=+520.862226595" Jul 16 21:58:21.648060 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:21.648030 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-84cf6d888d-cgbkp"] Jul 16 21:58:21.653449 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:21.653405 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-84cf6d888d-cgbkp"] Jul 16 21:58:22.427842 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:22.427802 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:58:22.496270 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:22.496233 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:58:23.309125 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:23.309092 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8" path="/var/lib/kubelet/pods/1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8/volumes" Jul 16 21:58:52.615510 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:52.615477 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-84cf6d888d-srcg6" Jul 16 21:58:53.746565 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:53.746525 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:58:53.814940 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:53.814902 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-fd65d7d6-jqxrj"] Jul 16 21:58:53.815306 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:53.815283 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8" containerName="manager" Jul 16 21:58:53.815306 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:53.815300 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8" containerName="manager" Jul 16 21:58:53.815470 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:53.815358 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d3e70ae-f865-4a0c-bd1c-ca2dc63b5aa8" containerName="manager" Jul 16 21:58:53.819481 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:53.819461 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-jqxrj" Jul 16 21:58:53.822503 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:53.822482 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Jul 16 21:58:53.822618 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:53.822516 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-8zjwb\"" Jul 16 21:58:53.835922 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:53.835894 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea444795-b9c7-460c-8249-47cd64e3957f-tls-certs\") pod \"model-serving-api-fd65d7d6-jqxrj\" (UID: \"ea444795-b9c7-460c-8249-47cd64e3957f\") " pod="kserve/model-serving-api-fd65d7d6-jqxrj" Jul 16 21:58:53.836045 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:53.835931 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kssb5\" (UniqueName: \"kubernetes.io/projected/ea444795-b9c7-460c-8249-47cd64e3957f-kube-api-access-kssb5\") pod \"model-serving-api-fd65d7d6-jqxrj\" (UID: \"ea444795-b9c7-460c-8249-47cd64e3957f\") " pod="kserve/model-serving-api-fd65d7d6-jqxrj" Jul 16 21:58:53.842209 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:53.842183 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-jqxrj"] Jul 16 21:58:53.851128 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:53.851086 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:58:53.851511 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:53.851489 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-84b54b7f97-zkvnp"] Jul 16 21:58:53.855405 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:53.855385 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-zkvnp" Jul 16 21:58:53.858609 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:53.858585 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-r5hpn\"" Jul 16 21:58:53.858720 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:53.858626 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" Jul 16 21:58:53.868336 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:53.868288 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-zkvnp"] Jul 16 21:58:53.937146 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:53.937113 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn9nc\" (UniqueName: \"kubernetes.io/projected/fe858831-9cf2-49e9-bf37-971593b7a3c1-kube-api-access-sn9nc\") pod \"odh-model-controller-84b54b7f97-zkvnp\" (UID: \"fe858831-9cf2-49e9-bf37-971593b7a3c1\") " pod="kserve/odh-model-controller-84b54b7f97-zkvnp" Jul 16 21:58:53.937323 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:53.937179 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea444795-b9c7-460c-8249-47cd64e3957f-tls-certs\") pod \"model-serving-api-fd65d7d6-jqxrj\" (UID: \"ea444795-b9c7-460c-8249-47cd64e3957f\") " pod="kserve/model-serving-api-fd65d7d6-jqxrj" Jul 16 21:58:53.937323 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:53.937204 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kssb5\" (UniqueName: \"kubernetes.io/projected/ea444795-b9c7-460c-8249-47cd64e3957f-kube-api-access-kssb5\") pod \"model-serving-api-fd65d7d6-jqxrj\" (UID: \"ea444795-b9c7-460c-8249-47cd64e3957f\") " pod="kserve/model-serving-api-fd65d7d6-jqxrj" Jul 16 21:58:53.937323 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:53.937220 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe858831-9cf2-49e9-bf37-971593b7a3c1-cert\") pod \"odh-model-controller-84b54b7f97-zkvnp\" (UID: \"fe858831-9cf2-49e9-bf37-971593b7a3c1\") " pod="kserve/odh-model-controller-84b54b7f97-zkvnp" Jul 16 21:58:53.937456 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:58:53.937336 2566 secret.go:189] Couldn't get secret kserve/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 16 21:58:53.937456 ip-10-0-137-177 kubenswrapper[2566]: E0716 21:58:53.937406 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea444795-b9c7-460c-8249-47cd64e3957f-tls-certs podName:ea444795-b9c7-460c-8249-47cd64e3957f nodeName:}" failed. No retries permitted until 2026-07-16 21:58:54.437387644 +0000 UTC m=+553.672514796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/ea444795-b9c7-460c-8249-47cd64e3957f-tls-certs") pod "model-serving-api-fd65d7d6-jqxrj" (UID: "ea444795-b9c7-460c-8249-47cd64e3957f") : secret "model-serving-api-tls" not found Jul 16 21:58:53.946260 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:53.946228 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:58:53.949302 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:53.949277 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kssb5\" (UniqueName: \"kubernetes.io/projected/ea444795-b9c7-460c-8249-47cd64e3957f-kube-api-access-kssb5\") pod \"model-serving-api-fd65d7d6-jqxrj\" (UID: \"ea444795-b9c7-460c-8249-47cd64e3957f\") " pod="kserve/model-serving-api-fd65d7d6-jqxrj" Jul 16 21:58:54.037868 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:54.037783 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn9nc\" (UniqueName: \"kubernetes.io/projected/fe858831-9cf2-49e9-bf37-971593b7a3c1-kube-api-access-sn9nc\") pod \"odh-model-controller-84b54b7f97-zkvnp\" (UID: \"fe858831-9cf2-49e9-bf37-971593b7a3c1\") " pod="kserve/odh-model-controller-84b54b7f97-zkvnp" Jul 16 21:58:54.038000 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:54.037871 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe858831-9cf2-49e9-bf37-971593b7a3c1-cert\") pod \"odh-model-controller-84b54b7f97-zkvnp\" (UID: \"fe858831-9cf2-49e9-bf37-971593b7a3c1\") " pod="kserve/odh-model-controller-84b54b7f97-zkvnp" Jul 16 21:58:54.040833 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:54.040803 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe858831-9cf2-49e9-bf37-971593b7a3c1-cert\") pod \"odh-model-controller-84b54b7f97-zkvnp\" (UID: \"fe858831-9cf2-49e9-bf37-971593b7a3c1\") " pod="kserve/odh-model-controller-84b54b7f97-zkvnp" Jul 16 21:58:54.047144 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:54.047120 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn9nc\" (UniqueName: \"kubernetes.io/projected/fe858831-9cf2-49e9-bf37-971593b7a3c1-kube-api-access-sn9nc\") pod \"odh-model-controller-84b54b7f97-zkvnp\" (UID: \"fe858831-9cf2-49e9-bf37-971593b7a3c1\") " pod="kserve/odh-model-controller-84b54b7f97-zkvnp" Jul 16 21:58:54.165277 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:54.165241 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-zkvnp" Jul 16 21:58:54.210636 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:54.210600 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:58:54.297181 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:54.297039 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-zkvnp"] Jul 16 21:58:54.299432 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:58:54.299393 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe858831_9cf2_49e9_bf37_971593b7a3c1.slice/crio-d0796ed01399c5b8562c444b73e0c5586501d6ff5e7ee7647c64530051914433 WatchSource:0}: Error finding container d0796ed01399c5b8562c444b73e0c5586501d6ff5e7ee7647c64530051914433: Status 404 returned error can't find the container with id d0796ed01399c5b8562c444b73e0c5586501d6ff5e7ee7647c64530051914433 Jul 16 21:58:54.440529 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:54.440491 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea444795-b9c7-460c-8249-47cd64e3957f-tls-certs\") pod \"model-serving-api-fd65d7d6-jqxrj\" (UID: \"ea444795-b9c7-460c-8249-47cd64e3957f\") " pod="kserve/model-serving-api-fd65d7d6-jqxrj" Jul 16 21:58:54.442825 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:54.442806 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea444795-b9c7-460c-8249-47cd64e3957f-tls-certs\") pod \"model-serving-api-fd65d7d6-jqxrj\" (UID: \"ea444795-b9c7-460c-8249-47cd64e3957f\") " pod="kserve/model-serving-api-fd65d7d6-jqxrj" Jul 16 21:58:54.728914 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:54.728875 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-jqxrj" Jul 16 21:58:54.766143 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:54.766108 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-zkvnp" event={"ID":"fe858831-9cf2-49e9-bf37-971593b7a3c1","Type":"ContainerStarted","Data":"d0796ed01399c5b8562c444b73e0c5586501d6ff5e7ee7647c64530051914433"} Jul 16 21:58:54.787805 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:54.787762 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:58:54.871310 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:54.871283 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-jqxrj"] Jul 16 21:58:54.872259 ip-10-0-137-177 kubenswrapper[2566]: W0716 21:58:54.872225 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea444795_b9c7_460c_8249_47cd64e3957f.slice/crio-cac8f851c627c8af4580e8e51379bebf7df6624436eb51f4f63c16ed9187b334 WatchSource:0}: Error finding container cac8f851c627c8af4580e8e51379bebf7df6624436eb51f4f63c16ed9187b334: Status 404 returned error can't find the container with id cac8f851c627c8af4580e8e51379bebf7df6624436eb51f4f63c16ed9187b334 Jul 16 21:58:54.878556 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:54.878523 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:58:55.781514 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:55.781464 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-jqxrj" event={"ID":"ea444795-b9c7-460c-8249-47cd64e3957f","Type":"ContainerStarted","Data":"cac8f851c627c8af4580e8e51379bebf7df6624436eb51f4f63c16ed9187b334"} Jul 16 21:58:58.798908 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:58.798871 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-zkvnp" event={"ID":"fe858831-9cf2-49e9-bf37-971593b7a3c1","Type":"ContainerStarted","Data":"08df09c94742a69a5afd2900adbbc60f61e3d9d3fa5a763b27841c8ce8635dbf"} Jul 16 21:58:58.799353 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:58.799025 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-84b54b7f97-zkvnp" Jul 16 21:58:58.800275 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:58.800251 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-jqxrj" event={"ID":"ea444795-b9c7-460c-8249-47cd64e3957f","Type":"ContainerStarted","Data":"ea71ff1258019582f04d351febfe804c292d753e9ec371ad3799a8fc0fb8ab18"} Jul 16 21:58:58.800389 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:58.800376 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-fd65d7d6-jqxrj" Jul 16 21:58:58.817376 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:58.817325 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-84b54b7f97-zkvnp" podStartSLOduration=2.109281914 podStartE2EDuration="5.817309689s" totalImagesPullingTime="3.708027775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:58:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:58:58.81604564 +0000 UTC m=+558.051172810" watchObservedRunningTime="2026-07-16 21:58:58.817309689 +0000 UTC m=+558.052436920" Jul 16 21:58:58.835286 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:58:58.835234 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-fd65d7d6-jqxrj" podStartSLOduration=2.741341299 podStartE2EDuration="5.835219731s" totalImagesPullingTime="3.093878432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:58:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:58:58.833480299 +0000 UTC m=+558.068607460" watchObservedRunningTime="2026-07-16 21:58:58.835219731 +0000 UTC m=+558.070346919" Jul 16 21:59:09.806871 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:59:09.806838 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-84b54b7f97-zkvnp" Jul 16 21:59:09.808920 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:59:09.808897 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-fd65d7d6-jqxrj" Jul 16 21:59:22.011527 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:59:22.011470 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 21:59:41.219788 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:59:41.219756 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kp9cp_964fa034-949b-4752-8390-dc010d28551a/console-operator/1.log" Jul 16 21:59:41.223623 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:59:41.223596 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kp9cp_964fa034-949b-4752-8390-dc010d28551a/console-operator/1.log" Jul 16 21:59:41.226243 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:59:41.226223 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hz2pt_75c7e977-7b28-42d0-a6e6-0532f2932368/ovn-acl-logging/0.log" Jul 16 21:59:41.230003 ip-10-0-137-177 kubenswrapper[2566]: I0716 21:59:41.229988 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hz2pt_75c7e977-7b28-42d0-a6e6-0532f2932368/ovn-acl-logging/0.log" Jul 16 22:00:04.463104 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:00:04.463016 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:00:29.248839 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:00:29.248800 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:00:29.351608 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:00:29.351565 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:00:40.341776 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:00:40.341728 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:00:42.180701 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:00:42.180660 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:00:50.585471 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:00:50.585396 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:01:02.659694 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:01:02.659656 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:02:25.552957 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:02:25.552920 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:02:25.650963 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:02:25.650900 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:02:25.738172 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:02:25.738129 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:02:26.036657 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:02:26.036624 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:02:26.407573 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:02:26.407491 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:02:41.504228 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:02:41.504182 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:02:41.606433 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:02:41.606389 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:03:29.227114 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:03:29.227066 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:04:05.643040 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:05.642999 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w"] Jul 16 22:04:05.643569 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:05.643115 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:04:05.646687 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:05.646667 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w" Jul 16 22:04:05.649033 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:05.649013 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-a32f7-kube-rbac-proxy-sar-config\"" Jul 16 22:04:05.649219 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:05.649206 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-a32f7-serving-cert\"" Jul 16 22:04:05.649275 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:05.649246 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-xdcsv\"" Jul 16 22:04:05.649881 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:05.649867 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 16 22:04:05.655736 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:05.655708 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w"] Jul 16 22:04:05.757698 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:05.757666 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2e8c232-aabe-4684-92d3-ffc7300ea36a-openshift-service-ca-bundle\") pod \"model-chainer-raw-a32f7-ff9c4f8f9-tjp8w\" (UID: \"c2e8c232-aabe-4684-92d3-ffc7300ea36a\") " pod="kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w" Jul 16 22:04:05.757878 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:05.757727 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c2e8c232-aabe-4684-92d3-ffc7300ea36a-proxy-tls\") pod \"model-chainer-raw-a32f7-ff9c4f8f9-tjp8w\" (UID: \"c2e8c232-aabe-4684-92d3-ffc7300ea36a\") " pod="kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w" Jul 16 22:04:05.858368 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:05.858328 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2e8c232-aabe-4684-92d3-ffc7300ea36a-openshift-service-ca-bundle\") pod \"model-chainer-raw-a32f7-ff9c4f8f9-tjp8w\" (UID: \"c2e8c232-aabe-4684-92d3-ffc7300ea36a\") " pod="kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w" Jul 16 22:04:05.858566 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:05.858391 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c2e8c232-aabe-4684-92d3-ffc7300ea36a-proxy-tls\") pod \"model-chainer-raw-a32f7-ff9c4f8f9-tjp8w\" (UID: \"c2e8c232-aabe-4684-92d3-ffc7300ea36a\") " pod="kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w" Jul 16 22:04:05.858982 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:05.858959 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2e8c232-aabe-4684-92d3-ffc7300ea36a-openshift-service-ca-bundle\") pod \"model-chainer-raw-a32f7-ff9c4f8f9-tjp8w\" (UID: \"c2e8c232-aabe-4684-92d3-ffc7300ea36a\") " pod="kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w" Jul 16 22:04:05.860751 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:05.860732 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c2e8c232-aabe-4684-92d3-ffc7300ea36a-proxy-tls\") pod \"model-chainer-raw-a32f7-ff9c4f8f9-tjp8w\" (UID: \"c2e8c232-aabe-4684-92d3-ffc7300ea36a\") " pod="kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w" Jul 16 22:04:05.872140 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:05.872097 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:04:05.958481 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:05.958378 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w" Jul 16 22:04:06.095862 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:06.095838 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w"] Jul 16 22:04:06.098476 ip-10-0-137-177 kubenswrapper[2566]: W0716 22:04:06.098448 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2e8c232_aabe_4684_92d3_ffc7300ea36a.slice/crio-5d4dc9b7e1aedeb80c56a6499a5b1fa1a4a3292bd669b4c73d6e2f233c63c4f0 WatchSource:0}: Error finding container 5d4dc9b7e1aedeb80c56a6499a5b1fa1a4a3292bd669b4c73d6e2f233c63c4f0: Status 404 returned error can't find the container with id 5d4dc9b7e1aedeb80c56a6499a5b1fa1a4a3292bd669b4c73d6e2f233c63c4f0 Jul 16 22:04:06.100856 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:06.100836 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 22:04:06.200796 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:06.200762 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w" event={"ID":"c2e8c232-aabe-4684-92d3-ffc7300ea36a","Type":"ContainerStarted","Data":"5d4dc9b7e1aedeb80c56a6499a5b1fa1a4a3292bd669b4c73d6e2f233c63c4f0"} Jul 16 22:04:09.217668 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:09.217616 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w" event={"ID":"c2e8c232-aabe-4684-92d3-ffc7300ea36a","Type":"ContainerStarted","Data":"92f2bdc65ad62c564cc1be40306951f1524619cd0af1aa85d2866e01edd18e9c"} Jul 16 22:04:09.218098 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:09.217786 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w" Jul 16 22:04:09.240845 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:09.240789 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w" podStartSLOduration=1.662117898 podStartE2EDuration="4.240773985s" totalImagesPullingTime="2.578656087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:04:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:04:09.239840649 +0000 UTC m=+868.474967809" watchObservedRunningTime="2026-07-16 22:04:09.240773985 +0000 UTC m=+868.475901168" Jul 16 22:04:15.228249 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:15.228217 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w" Jul 16 22:04:15.699496 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:15.699397 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w"] Jul 16 22:04:15.699692 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:15.699666 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w" podUID="c2e8c232-aabe-4684-92d3-ffc7300ea36a" containerName="model-chainer-raw-a32f7" containerID="cri-o://92f2bdc65ad62c564cc1be40306951f1524619cd0af1aa85d2866e01edd18e9c" gracePeriod=30 Jul 16 22:04:15.722609 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:15.722571 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:04:15.914551 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:15.914513 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:04:16.022926 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:16.022886 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:04:16.117699 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:16.117653 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:04:16.220693 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:16.220657 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:04:16.319949 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:16.319873 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:04:17.083395 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:17.083356 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:04:17.185593 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:17.185556 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:04:20.226382 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:20.226340 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w" podUID="c2e8c232-aabe-4684-92d3-ffc7300ea36a" containerName="model-chainer-raw-a32f7" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 22:04:25.226246 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:25.226205 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w" podUID="c2e8c232-aabe-4684-92d3-ffc7300ea36a" containerName="model-chainer-raw-a32f7" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 22:04:30.226275 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:30.226232 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w" podUID="c2e8c232-aabe-4684-92d3-ffc7300ea36a" containerName="model-chainer-raw-a32f7" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 22:04:30.226726 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:30.226372 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w" Jul 16 22:04:35.226260 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:35.226179 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w" podUID="c2e8c232-aabe-4684-92d3-ffc7300ea36a" containerName="model-chainer-raw-a32f7" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 22:04:40.226766 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:40.226728 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w" podUID="c2e8c232-aabe-4684-92d3-ffc7300ea36a" containerName="model-chainer-raw-a32f7" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 22:04:41.252973 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:41.252945 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kp9cp_964fa034-949b-4752-8390-dc010d28551a/console-operator/1.log" Jul 16 22:04:41.253410 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:41.252991 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kp9cp_964fa034-949b-4752-8390-dc010d28551a/console-operator/1.log" Jul 16 22:04:41.259303 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:41.259276 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hz2pt_75c7e977-7b28-42d0-a6e6-0532f2932368/ovn-acl-logging/0.log" Jul 16 22:04:41.259499 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:41.259364 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hz2pt_75c7e977-7b28-42d0-a6e6-0532f2932368/ovn-acl-logging/0.log" Jul 16 22:04:45.226976 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:45.226937 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w" podUID="c2e8c232-aabe-4684-92d3-ffc7300ea36a" containerName="model-chainer-raw-a32f7" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 22:04:45.863392 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:45.863365 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w" Jul 16 22:04:45.905179 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:45.905143 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c2e8c232-aabe-4684-92d3-ffc7300ea36a-proxy-tls\") pod \"c2e8c232-aabe-4684-92d3-ffc7300ea36a\" (UID: \"c2e8c232-aabe-4684-92d3-ffc7300ea36a\") " Jul 16 22:04:45.905179 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:45.905182 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2e8c232-aabe-4684-92d3-ffc7300ea36a-openshift-service-ca-bundle\") pod \"c2e8c232-aabe-4684-92d3-ffc7300ea36a\" (UID: \"c2e8c232-aabe-4684-92d3-ffc7300ea36a\") " Jul 16 22:04:45.905607 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:45.905582 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2e8c232-aabe-4684-92d3-ffc7300ea36a-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "c2e8c232-aabe-4684-92d3-ffc7300ea36a" (UID: "c2e8c232-aabe-4684-92d3-ffc7300ea36a"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 22:04:45.907346 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:45.907324 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2e8c232-aabe-4684-92d3-ffc7300ea36a-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c2e8c232-aabe-4684-92d3-ffc7300ea36a" (UID: "c2e8c232-aabe-4684-92d3-ffc7300ea36a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 22:04:46.005878 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:46.005840 2566 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c2e8c232-aabe-4684-92d3-ffc7300ea36a-proxy-tls\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 22:04:46.005878 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:46.005876 2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2e8c232-aabe-4684-92d3-ffc7300ea36a-openshift-service-ca-bundle\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 22:04:46.392826 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:46.392740 2566 generic.go:356] "Generic (PLEG): container finished" podID="c2e8c232-aabe-4684-92d3-ffc7300ea36a" containerID="92f2bdc65ad62c564cc1be40306951f1524619cd0af1aa85d2866e01edd18e9c" exitCode=0 Jul 16 22:04:46.392826 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:46.392788 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w" Jul 16 22:04:46.392826 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:46.392797 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w" event={"ID":"c2e8c232-aabe-4684-92d3-ffc7300ea36a","Type":"ContainerDied","Data":"92f2bdc65ad62c564cc1be40306951f1524619cd0af1aa85d2866e01edd18e9c"} Jul 16 22:04:46.393493 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:46.392840 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w" event={"ID":"c2e8c232-aabe-4684-92d3-ffc7300ea36a","Type":"ContainerDied","Data":"5d4dc9b7e1aedeb80c56a6499a5b1fa1a4a3292bd669b4c73d6e2f233c63c4f0"} Jul 16 22:04:46.393493 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:46.392863 2566 scope.go:117] "RemoveContainer" containerID="92f2bdc65ad62c564cc1be40306951f1524619cd0af1aa85d2866e01edd18e9c" Jul 16 22:04:46.403634 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:46.403615 2566 scope.go:117] "RemoveContainer" containerID="92f2bdc65ad62c564cc1be40306951f1524619cd0af1aa85d2866e01edd18e9c" Jul 16 22:04:46.403904 ip-10-0-137-177 kubenswrapper[2566]: E0716 22:04:46.403884 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92f2bdc65ad62c564cc1be40306951f1524619cd0af1aa85d2866e01edd18e9c\": container with ID starting with 92f2bdc65ad62c564cc1be40306951f1524619cd0af1aa85d2866e01edd18e9c not found: ID does not exist" containerID="92f2bdc65ad62c564cc1be40306951f1524619cd0af1aa85d2866e01edd18e9c" Jul 16 22:04:46.403974 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:46.403912 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92f2bdc65ad62c564cc1be40306951f1524619cd0af1aa85d2866e01edd18e9c"} err="failed to get container status \"92f2bdc65ad62c564cc1be40306951f1524619cd0af1aa85d2866e01edd18e9c\": rpc error: code = NotFound desc = could not find container \"92f2bdc65ad62c564cc1be40306951f1524619cd0af1aa85d2866e01edd18e9c\": container with ID starting with 92f2bdc65ad62c564cc1be40306951f1524619cd0af1aa85d2866e01edd18e9c not found: ID does not exist" Jul 16 22:04:46.417196 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:46.417168 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w"] Jul 16 22:04:46.420851 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:46.420828 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-a32f7-ff9c4f8f9-tjp8w"] Jul 16 22:04:47.308616 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:04:47.308584 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2e8c232-aabe-4684-92d3-ffc7300ea36a" path="/var/lib/kubelet/pods/c2e8c232-aabe-4684-92d3-ffc7300ea36a/volumes" Jul 16 22:05:55.996891 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:05:55.996855 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr"] Jul 16 22:05:55.997373 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:05:55.997246 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2e8c232-aabe-4684-92d3-ffc7300ea36a" containerName="model-chainer-raw-a32f7" Jul 16 22:05:55.997373 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:05:55.997257 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2e8c232-aabe-4684-92d3-ffc7300ea36a" containerName="model-chainer-raw-a32f7" Jul 16 22:05:55.997373 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:05:55.997316 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2e8c232-aabe-4684-92d3-ffc7300ea36a" containerName="model-chainer-raw-a32f7" Jul 16 22:05:56.003176 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:05:56.003151 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr" Jul 16 22:05:56.006551 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:05:56.006522 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 16 22:05:56.006679 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:05:56.006520 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-7f37f-serving-cert\"" Jul 16 22:05:56.006679 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:05:56.006535 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-xdcsv\"" Jul 16 22:05:56.007574 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:05:56.007550 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-7f37f-kube-rbac-proxy-sar-config\"" Jul 16 22:05:56.013454 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:05:56.013405 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr"] Jul 16 22:05:56.041897 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:05:56.041866 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:05:56.109131 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:05:56.109096 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a4213537-7f3b-4302-ab06-fa82314237bc-proxy-tls\") pod \"model-chainer-raw-hpa-7f37f-987485c9-gstnr\" (UID: \"a4213537-7f3b-4302-ab06-fa82314237bc\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr" Jul 16 22:05:56.109282 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:05:56.109144 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4213537-7f3b-4302-ab06-fa82314237bc-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-7f37f-987485c9-gstnr\" (UID: \"a4213537-7f3b-4302-ab06-fa82314237bc\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr" Jul 16 22:05:56.210601 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:05:56.210568 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a4213537-7f3b-4302-ab06-fa82314237bc-proxy-tls\") pod \"model-chainer-raw-hpa-7f37f-987485c9-gstnr\" (UID: \"a4213537-7f3b-4302-ab06-fa82314237bc\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr" Jul 16 22:05:56.210937 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:05:56.210630 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4213537-7f3b-4302-ab06-fa82314237bc-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-7f37f-987485c9-gstnr\" (UID: \"a4213537-7f3b-4302-ab06-fa82314237bc\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr" Jul 16 22:05:56.210937 ip-10-0-137-177 kubenswrapper[2566]: E0716 22:05:56.210730 2566 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-serving-cert: secret "model-chainer-raw-hpa-7f37f-serving-cert" not found Jul 16 22:05:56.210937 ip-10-0-137-177 kubenswrapper[2566]: E0716 22:05:56.210807 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4213537-7f3b-4302-ab06-fa82314237bc-proxy-tls podName:a4213537-7f3b-4302-ab06-fa82314237bc nodeName:}" failed. No retries permitted until 2026-07-16 22:05:56.710791233 +0000 UTC m=+975.945918371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/a4213537-7f3b-4302-ab06-fa82314237bc-proxy-tls") pod "model-chainer-raw-hpa-7f37f-987485c9-gstnr" (UID: "a4213537-7f3b-4302-ab06-fa82314237bc") : secret "model-chainer-raw-hpa-7f37f-serving-cert" not found Jul 16 22:05:56.211250 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:05:56.211232 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4213537-7f3b-4302-ab06-fa82314237bc-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-7f37f-987485c9-gstnr\" (UID: \"a4213537-7f3b-4302-ab06-fa82314237bc\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr" Jul 16 22:05:56.387984 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:05:56.387900 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:05:56.715033 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:05:56.715004 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a4213537-7f3b-4302-ab06-fa82314237bc-proxy-tls\") pod \"model-chainer-raw-hpa-7f37f-987485c9-gstnr\" (UID: \"a4213537-7f3b-4302-ab06-fa82314237bc\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr" Jul 16 22:05:56.717513 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:05:56.717493 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a4213537-7f3b-4302-ab06-fa82314237bc-proxy-tls\") pod \"model-chainer-raw-hpa-7f37f-987485c9-gstnr\" (UID: \"a4213537-7f3b-4302-ab06-fa82314237bc\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr" Jul 16 22:05:56.916012 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:05:56.915973 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr" Jul 16 22:05:57.050496 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:05:57.050448 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr"] Jul 16 22:05:57.052886 ip-10-0-137-177 kubenswrapper[2566]: W0716 22:05:57.052853 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4213537_7f3b_4302_ab06_fa82314237bc.slice/crio-cb0a630c39b0d778ee4d08e8f0e27db95705018de0b02529e764afd93b547154 WatchSource:0}: Error finding container cb0a630c39b0d778ee4d08e8f0e27db95705018de0b02529e764afd93b547154: Status 404 returned error can't find the container with id cb0a630c39b0d778ee4d08e8f0e27db95705018de0b02529e764afd93b547154 Jul 16 22:05:57.728842 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:05:57.728805 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr" event={"ID":"a4213537-7f3b-4302-ab06-fa82314237bc","Type":"ContainerStarted","Data":"308ca17f8952fae55e74a51be4e7d4c7434a859fade72c50cbb47e4bf950aa44"} Jul 16 22:05:57.729022 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:05:57.728860 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr" event={"ID":"a4213537-7f3b-4302-ab06-fa82314237bc","Type":"ContainerStarted","Data":"cb0a630c39b0d778ee4d08e8f0e27db95705018de0b02529e764afd93b547154"} Jul 16 22:05:57.729022 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:05:57.728889 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr" Jul 16 22:05:57.758411 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:05:57.758356 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr" podStartSLOduration=2.758340951 podStartE2EDuration="2.758340951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:05:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:05:57.75810795 +0000 UTC m=+976.993235110" watchObservedRunningTime="2026-07-16 22:05:57.758340951 +0000 UTC m=+976.993468111" Jul 16 22:06:03.739692 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:03.739609 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr" Jul 16 22:06:06.074818 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:06.074785 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr"] Jul 16 22:06:06.075250 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:06.074965 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr" podUID="a4213537-7f3b-4302-ab06-fa82314237bc" containerName="model-chainer-raw-hpa-7f37f" containerID="cri-o://308ca17f8952fae55e74a51be4e7d4c7434a859fade72c50cbb47e4bf950aa44" gracePeriod=30 Jul 16 22:06:06.103879 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:06.103843 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:06:08.039047 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:08.039002 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:06:08.737645 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:08.737606 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr" podUID="a4213537-7f3b-4302-ab06-fa82314237bc" containerName="model-chainer-raw-hpa-7f37f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 22:06:13.738525 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:13.738479 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr" podUID="a4213537-7f3b-4302-ab06-fa82314237bc" containerName="model-chainer-raw-hpa-7f37f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 22:06:18.738693 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:18.738651 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr" podUID="a4213537-7f3b-4302-ab06-fa82314237bc" containerName="model-chainer-raw-hpa-7f37f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 22:06:18.739087 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:18.738772 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr" Jul 16 22:06:23.738146 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:23.738104 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr" podUID="a4213537-7f3b-4302-ab06-fa82314237bc" containerName="model-chainer-raw-hpa-7f37f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 22:06:26.349677 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:26.349628 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:06:26.661119 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:26.661015 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:06:28.740269 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:28.740217 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr" podUID="a4213537-7f3b-4302-ab06-fa82314237bc" containerName="model-chainer-raw-hpa-7f37f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 22:06:33.738290 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:33.738239 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr" podUID="a4213537-7f3b-4302-ab06-fa82314237bc" containerName="model-chainer-raw-hpa-7f37f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 22:06:36.232874 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:36.232844 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr" Jul 16 22:06:36.358509 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:36.358386 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a4213537-7f3b-4302-ab06-fa82314237bc-proxy-tls\") pod \"a4213537-7f3b-4302-ab06-fa82314237bc\" (UID: \"a4213537-7f3b-4302-ab06-fa82314237bc\") " Jul 16 22:06:36.358509 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:36.358504 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4213537-7f3b-4302-ab06-fa82314237bc-openshift-service-ca-bundle\") pod \"a4213537-7f3b-4302-ab06-fa82314237bc\" (UID: \"a4213537-7f3b-4302-ab06-fa82314237bc\") " Jul 16 22:06:36.358853 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:36.358828 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4213537-7f3b-4302-ab06-fa82314237bc-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "a4213537-7f3b-4302-ab06-fa82314237bc" (UID: "a4213537-7f3b-4302-ab06-fa82314237bc"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 22:06:36.360602 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:36.360578 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4213537-7f3b-4302-ab06-fa82314237bc-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a4213537-7f3b-4302-ab06-fa82314237bc" (UID: "a4213537-7f3b-4302-ab06-fa82314237bc"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 22:06:36.460014 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:36.459966 2566 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a4213537-7f3b-4302-ab06-fa82314237bc-proxy-tls\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 22:06:36.460014 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:36.460011 2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4213537-7f3b-4302-ab06-fa82314237bc-openshift-service-ca-bundle\") on node \"ip-10-0-137-177.ec2.internal\" DevicePath \"\"" Jul 16 22:06:36.913432 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:36.913389 2566 generic.go:356] "Generic (PLEG): container finished" podID="a4213537-7f3b-4302-ab06-fa82314237bc" containerID="308ca17f8952fae55e74a51be4e7d4c7434a859fade72c50cbb47e4bf950aa44" exitCode=0 Jul 16 22:06:36.913600 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:36.913443 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr" Jul 16 22:06:36.913600 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:36.913452 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr" event={"ID":"a4213537-7f3b-4302-ab06-fa82314237bc","Type":"ContainerDied","Data":"308ca17f8952fae55e74a51be4e7d4c7434a859fade72c50cbb47e4bf950aa44"} Jul 16 22:06:36.913600 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:36.913509 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr" event={"ID":"a4213537-7f3b-4302-ab06-fa82314237bc","Type":"ContainerDied","Data":"cb0a630c39b0d778ee4d08e8f0e27db95705018de0b02529e764afd93b547154"} Jul 16 22:06:36.913600 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:36.913540 2566 scope.go:117] "RemoveContainer" containerID="308ca17f8952fae55e74a51be4e7d4c7434a859fade72c50cbb47e4bf950aa44" Jul 16 22:06:36.922477 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:36.922459 2566 scope.go:117] "RemoveContainer" containerID="308ca17f8952fae55e74a51be4e7d4c7434a859fade72c50cbb47e4bf950aa44" Jul 16 22:06:36.922780 ip-10-0-137-177 kubenswrapper[2566]: E0716 22:06:36.922759 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"308ca17f8952fae55e74a51be4e7d4c7434a859fade72c50cbb47e4bf950aa44\": container with ID starting with 308ca17f8952fae55e74a51be4e7d4c7434a859fade72c50cbb47e4bf950aa44 not found: ID does not exist" containerID="308ca17f8952fae55e74a51be4e7d4c7434a859fade72c50cbb47e4bf950aa44" Jul 16 22:06:36.922830 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:36.922789 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"308ca17f8952fae55e74a51be4e7d4c7434a859fade72c50cbb47e4bf950aa44"} err="failed to get container status \"308ca17f8952fae55e74a51be4e7d4c7434a859fade72c50cbb47e4bf950aa44\": rpc error: code = NotFound desc = could not find container \"308ca17f8952fae55e74a51be4e7d4c7434a859fade72c50cbb47e4bf950aa44\": container with ID starting with 308ca17f8952fae55e74a51be4e7d4c7434a859fade72c50cbb47e4bf950aa44 not found: ID does not exist" Jul 16 22:06:36.934973 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:36.934948 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr"] Jul 16 22:06:36.938973 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:36.938947 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-7f37f-987485c9-gstnr"] Jul 16 22:06:37.309433 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:06:37.309387 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4213537-7f3b-4302-ab06-fa82314237bc" path="/var/lib/kubelet/pods/a4213537-7f3b-4302-ab06-fa82314237bc/volumes" Jul 16 22:07:37.761412 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:07:37.761334 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:08:01.619811 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:08:01.619777 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:08:01.855339 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:08:01.855303 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:08:01.918628 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:08:01.918546 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:08:01.990566 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:08:01.990525 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:09:41.283368 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:09:41.283341 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kp9cp_964fa034-949b-4752-8390-dc010d28551a/console-operator/1.log" Jul 16 22:09:41.284034 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:09:41.284016 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kp9cp_964fa034-949b-4752-8390-dc010d28551a/console-operator/1.log" Jul 16 22:09:41.290020 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:09:41.290003 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hz2pt_75c7e977-7b28-42d0-a6e6-0532f2932368/ovn-acl-logging/0.log" Jul 16 22:09:41.290524 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:09:41.290507 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hz2pt_75c7e977-7b28-42d0-a6e6-0532f2932368/ovn-acl-logging/0.log" Jul 16 22:09:52.618439 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:09:52.618392 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:10:41.872749 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:10:41.872659 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:10:46.979864 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:10:46.979822 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:10:47.237790 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:10:47.237682 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:12:17.261243 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:12:17.261139 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:12:18.649155 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:12:18.649121 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:12:35.354803 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:12:35.354765 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:12:35.424641 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:12:35.424588 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:12:40.551329 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:12:40.551291 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:12:40.734570 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:12:40.734533 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:12:45.594434 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:12:45.594390 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:12:50.792479 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:12:50.792405 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:12:51.012904 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:12:51.012864 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:13:51.899436 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:13:51.899391 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:14:20.988683 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:14:20.988640 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:14:26.098494 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:14:26.098447 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:14:26.243893 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:14:26.243860 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:14:41.314561 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:14:41.314532 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kp9cp_964fa034-949b-4752-8390-dc010d28551a/console-operator/1.log" Jul 16 22:14:41.316302 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:14:41.316282 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kp9cp_964fa034-949b-4752-8390-dc010d28551a/console-operator/1.log" Jul 16 22:14:41.321321 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:14:41.321300 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hz2pt_75c7e977-7b28-42d0-a6e6-0532f2932368/ovn-acl-logging/0.log" Jul 16 22:14:41.322887 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:14:41.322865 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hz2pt_75c7e977-7b28-42d0-a6e6-0532f2932368/ovn-acl-logging/0.log" Jul 16 22:15:57.477762 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:15:57.477729 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:16:02.474772 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:02.474727 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:16:02.574510 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:02.574469 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:16:28.849238 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:28.849197 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:16:28.997791 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:28.997751 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:16:29.053401 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:29.053362 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:16:32.044071 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:32.044044 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-w9jn7_4509b338-7e48-41c0-b1ef-fe88c6165229/global-pull-secret-syncer/0.log" Jul 16 22:16:32.098170 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:32.098143 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" Jul 16 22:16:32.193150 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:32.193118 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-177.ec2.internal_7de9d8a70964726f44a2fadad5252519/haproxy/0.log" Jul 16 22:16:34.502491 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:34.502381 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:16:34.602068 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:34.602032 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7kxg4_83b40b54-0510-4714-b103-e35e3684f3a1/konnectivity-agent/0.log" limit=1024 Jul 16 22:16:36.413296 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:36.413268 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_61d0f2d5-33a1-44ac-a53a-21848a6633ef/alertmanager/0.log" Jul 16 22:16:36.460969 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:36.460936 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_61d0f2d5-33a1-44ac-a53a-21848a6633ef/config-reloader/0.log" Jul 16 22:16:36.505814 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:36.505789 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_61d0f2d5-33a1-44ac-a53a-21848a6633ef/kube-rbac-proxy-web/0.log" Jul 16 22:16:36.555731 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:36.555704 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_61d0f2d5-33a1-44ac-a53a-21848a6633ef/kube-rbac-proxy/0.log" Jul 16 22:16:36.603414 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:36.603381 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_61d0f2d5-33a1-44ac-a53a-21848a6633ef/kube-rbac-proxy-metric/0.log" Jul 16 22:16:36.640570 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:36.640541 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_61d0f2d5-33a1-44ac-a53a-21848a6633ef/prom-label-proxy/0.log" Jul 16 22:16:36.689850 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:36.689752 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_61d0f2d5-33a1-44ac-a53a-21848a6633ef/init-config-reloader/0.log" Jul 16 22:16:36.754337 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:36.754308 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-vbdw5_75364348-7d2b-4320-82d5-7ae05b690a88/cluster-monitoring-operator/0.log" Jul 16 22:16:36.980880 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:36.980850 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-fjxl4_ea0bea5b-b42f-4318-be81-7cced73ec28c/monitoring-plugin/0.log" Jul 16 22:16:37.325965 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:37.325884 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-scb2w_87e486d7-77ee-4645-9dc5-1b46f730ed96/node-exporter/0.log" Jul 16 22:16:37.369825 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:37.369798 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-scb2w_87e486d7-77ee-4645-9dc5-1b46f730ed96/kube-rbac-proxy/0.log" Jul 16 22:16:37.418550 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:37.418526 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-scb2w_87e486d7-77ee-4645-9dc5-1b46f730ed96/init-textfile/0.log" Jul 16 22:16:37.881209 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:37.881167 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-v8gb7_a5d62db1-b711-4985-8327-58a638573faa/prometheus-operator/0.log" Jul 16 22:16:37.925859 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:37.925830 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-v8gb7_a5d62db1-b711-4985-8327-58a638573faa/kube-rbac-proxy/0.log" Jul 16 22:16:38.019063 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:38.019030 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b9c78896d-j26ww_3b4d127f-d350-4d52-8eed-610c919df078/telemeter-client/0.log" Jul 16 22:16:38.064761 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:38.064729 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b9c78896d-j26ww_3b4d127f-d350-4d52-8eed-610c919df078/reload/0.log" Jul 16 22:16:38.112800 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:38.112770 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b9c78896d-j26ww_3b4d127f-d350-4d52-8eed-610c919df078/kube-rbac-proxy/0.log" Jul 16 22:16:38.160198 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:38.160118 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77845f884-blc22_ba2d07d6-d82e-4d02-b226-a35a1f016a1a/thanos-query/0.log" Jul 16 22:16:38.205164 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:38.205134 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77845f884-blc22_ba2d07d6-d82e-4d02-b226-a35a1f016a1a/kube-rbac-proxy-web/0.log" Jul 16 22:16:38.250868 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:38.250839 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77845f884-blc22_ba2d07d6-d82e-4d02-b226-a35a1f016a1a/kube-rbac-proxy/0.log" Jul 16 22:16:38.292672 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:38.292641 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77845f884-blc22_ba2d07d6-d82e-4d02-b226-a35a1f016a1a/prom-label-proxy/0.log" Jul 16 22:16:38.330143 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:38.330111 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77845f884-blc22_ba2d07d6-d82e-4d02-b226-a35a1f016a1a/kube-rbac-proxy-rules/0.log" Jul 16 22:16:38.353841 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:38.353815 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77845f884-blc22_ba2d07d6-d82e-4d02-b226-a35a1f016a1a/kube-rbac-proxy-metrics/0.log" Jul 16 22:16:39.506436 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.506383 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-k8wws/perf-node-gather-daemonset-77wq6"] Jul 16 22:16:39.506959 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.506938 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4213537-7f3b-4302-ab06-fa82314237bc" containerName="model-chainer-raw-hpa-7f37f" Jul 16 22:16:39.507039 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.506963 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4213537-7f3b-4302-ab06-fa82314237bc" containerName="model-chainer-raw-hpa-7f37f" Jul 16 22:16:39.507093 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.507071 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4213537-7f3b-4302-ab06-fa82314237bc" containerName="model-chainer-raw-hpa-7f37f" Jul 16 22:16:39.510208 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.510187 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-77wq6" Jul 16 22:16:39.512768 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.512749 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k8wws\"/\"openshift-service-ca.crt\"" Jul 16 22:16:39.512768 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.512753 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-k8wws\"/\"default-dockercfg-nqlp4\"" Jul 16 22:16:39.513452 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.513437 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k8wws\"/\"kube-root-ca.crt\"" Jul 16 22:16:39.519037 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.519007 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k8wws/perf-node-gather-daemonset-77wq6"] Jul 16 22:16:39.635722 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.635686 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40-podres\") pod \"perf-node-gather-daemonset-77wq6\" (UID: \"dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-77wq6" Jul 16 22:16:39.635722 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.635721 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40-proc\") pod \"perf-node-gather-daemonset-77wq6\" (UID: \"dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-77wq6" Jul 16 22:16:39.635953 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.635742 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40-lib-modules\") pod \"perf-node-gather-daemonset-77wq6\" (UID: \"dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-77wq6" Jul 16 22:16:39.635953 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.635829 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrnc8\" (UniqueName: \"kubernetes.io/projected/dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40-kube-api-access-lrnc8\") pod \"perf-node-gather-daemonset-77wq6\" (UID: \"dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-77wq6" Jul 16 22:16:39.635953 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.635859 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40-sys\") pod \"perf-node-gather-daemonset-77wq6\" (UID: \"dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-77wq6" Jul 16 22:16:39.736992 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.736960 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrnc8\" (UniqueName: \"kubernetes.io/projected/dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40-kube-api-access-lrnc8\") pod \"perf-node-gather-daemonset-77wq6\" (UID: \"dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-77wq6" Jul 16 22:16:39.737148 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.737007 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40-sys\") pod \"perf-node-gather-daemonset-77wq6\" (UID: \"dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-77wq6" Jul 16 22:16:39.737148 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.737079 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40-podres\") pod \"perf-node-gather-daemonset-77wq6\" (UID: \"dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-77wq6" Jul 16 22:16:39.737148 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.737105 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40-proc\") pod \"perf-node-gather-daemonset-77wq6\" (UID: \"dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-77wq6" Jul 16 22:16:39.737148 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.737125 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40-lib-modules\") pod \"perf-node-gather-daemonset-77wq6\" (UID: \"dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-77wq6" Jul 16 22:16:39.737328 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.737169 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40-sys\") pod \"perf-node-gather-daemonset-77wq6\" (UID: \"dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-77wq6" Jul 16 22:16:39.737328 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.737204 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40-proc\") pod \"perf-node-gather-daemonset-77wq6\" (UID: \"dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-77wq6" Jul 16 22:16:39.737328 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.737218 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40-podres\") pod \"perf-node-gather-daemonset-77wq6\" (UID: \"dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-77wq6" Jul 16 22:16:39.737328 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.737252 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40-lib-modules\") pod \"perf-node-gather-daemonset-77wq6\" (UID: \"dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-77wq6" Jul 16 22:16:39.747152 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.747128 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrnc8\" (UniqueName: \"kubernetes.io/projected/dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40-kube-api-access-lrnc8\") pod \"perf-node-gather-daemonset-77wq6\" (UID: \"dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-77wq6" Jul 16 22:16:39.777334 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.777277 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kp9cp_964fa034-949b-4752-8390-dc010d28551a/console-operator/1.log" Jul 16 22:16:39.785901 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.785880 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kp9cp_964fa034-949b-4752-8390-dc010d28551a/console-operator/2.log" Jul 16 22:16:39.820412 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.820388 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-77wq6" Jul 16 22:16:39.957470 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:39.957446 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k8wws/perf-node-gather-daemonset-77wq6"] Jul 16 22:16:39.959863 ip-10-0-137-177 kubenswrapper[2566]: W0716 22:16:39.959841 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddff9f3d4_b95d_41ae_8c1f_ecaee8c95d40.slice/crio-07a43a80bf47bf5410e3f11bd929dfd5917132138776387573ef2884e9304651 WatchSource:0}: Error finding container 07a43a80bf47bf5410e3f11bd929dfd5917132138776387573ef2884e9304651: Status 404 returned error can't find the container with id 07a43a80bf47bf5410e3f11bd929dfd5917132138776387573ef2884e9304651 Jul 16 22:16:40.756663 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:40.756628 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-77wq6" event={"ID":"dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40","Type":"ContainerStarted","Data":"a34965997738b7daf8048e357c100c224d0b2c5ab5b6e86e07e2e80d24245ab8"} Jul 16 22:16:40.757070 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:40.756705 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-77wq6" event={"ID":"dff9f3d4-b95d-41ae-8c1f-ecaee8c95d40","Type":"ContainerStarted","Data":"07a43a80bf47bf5410e3f11bd929dfd5917132138776387573ef2884e9304651"} Jul 16 22:16:40.757070 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:40.756783 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-77wq6" Jul 16 22:16:40.778682 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:40.778630 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-77wq6" podStartSLOduration=1.778616991 podStartE2EDuration="1.778616991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:16:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:16:40.777946303 +0000 UTC m=+1620.013073464" watchObservedRunningTime="2026-07-16 22:16:40.778616991 +0000 UTC m=+1620.013744204" Jul 16 22:16:40.792345 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:40.792319 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-sk546_2052aa05-a8ad-403f-9b7c-eb84f1e9ef44/volume-data-source-validator/0.log" Jul 16 22:16:41.684118 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:41.684088 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2bhgs_1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40/dns/0.log" Jul 16 22:16:41.704220 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:41.704180 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2bhgs_1dcdf84d-4f5e-40f2-a0b6-8e15b48eef40/kube-rbac-proxy/0.log" Jul 16 22:16:41.876527 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:41.876491 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t792r_3fd95e60-8961-41fc-a136-25b7b76fbc55/dns-node-resolver/0.log" Jul 16 22:16:42.401299 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:42.401269 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dxsz6_cc2270c6-d609-45af-be97-86e77cae77fa/node-ca/0.log" Jul 16 22:16:43.106613 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:43.106584 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b88cbdcf6-9t7wk_e6213d8c-90b5-4823-ab32-24606edecb40/router/0.log" Jul 16 22:16:43.467366 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:43.467337 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zkhpq_bd70582f-df8b-43c0-a20f-40dc0e0f7d94/serve-healthcheck-canary/0.log" Jul 16 22:16:43.847969 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:43.847880 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-khtbj_44b07976-78f7-48e0-9168-869ddd954f1d/insights-operator/0.log" Jul 16 22:16:43.848622 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:43.848593 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-khtbj_44b07976-78f7-48e0-9168-869ddd954f1d/insights-operator/1.log" Jul 16 22:16:43.870883 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:43.870856 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bklrd_f82300d7-fb78-4295-b1a6-37e9f7ed8e18/kube-rbac-proxy/0.log" Jul 16 22:16:43.892911 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:43.892884 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bklrd_f82300d7-fb78-4295-b1a6-37e9f7ed8e18/exporter/0.log" Jul 16 22:16:43.915892 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:43.915868 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bklrd_f82300d7-fb78-4295-b1a6-37e9f7ed8e18/extractor/0.log" Jul 16 22:16:46.196895 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:46.196858 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-84cf6d888d-srcg6_669746fb-4544-4d5d-9ef9-6b97b4de93da/manager/0.log" Jul 16 22:16:46.243830 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:46.243799 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-fd65d7d6-jqxrj_ea444795-b9c7-460c-8249-47cd64e3957f/server/0.log" Jul 16 22:16:46.373665 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:46.373613 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-84b54b7f97-zkvnp_fe858831-9cf2-49e9-bf37-971593b7a3c1/manager/0.log" Jul 16 22:16:46.771317 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:46.771292 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-77wq6" Jul 16 22:16:51.201571 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:51.201457 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-9szth_396a51f2-d2b9-402a-8668-faa8c446171b/kube-storage-version-migrator-operator/1.log" Jul 16 22:16:51.203001 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:51.202973 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-9szth_396a51f2-d2b9-402a-8668-faa8c446171b/kube-storage-version-migrator-operator/0.log" Jul 16 22:16:52.160688 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:52.160640 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4vjsw_27c6b349-4c75-4068-b041-c79c6ab52fcc/kube-multus/0.log" Jul 16 22:16:52.399775 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:52.399748 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n9km8_66c41459-8447-46fb-9701-03511287936d/kube-multus-additional-cni-plugins/0.log" Jul 16 22:16:52.422385 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:52.422307 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n9km8_66c41459-8447-46fb-9701-03511287936d/egress-router-binary-copy/0.log" Jul 16 22:16:52.444154 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:52.444119 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n9km8_66c41459-8447-46fb-9701-03511287936d/cni-plugins/0.log" Jul 16 22:16:52.465186 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:52.465157 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n9km8_66c41459-8447-46fb-9701-03511287936d/bond-cni-plugin/0.log" Jul 16 22:16:52.486123 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:52.486096 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n9km8_66c41459-8447-46fb-9701-03511287936d/routeoverride-cni/0.log" Jul 16 22:16:52.506696 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:52.506675 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n9km8_66c41459-8447-46fb-9701-03511287936d/whereabouts-cni-bincopy/0.log" Jul 16 22:16:52.529870 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:52.529844 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n9km8_66c41459-8447-46fb-9701-03511287936d/whereabouts-cni/0.log" Jul 16 22:16:52.857649 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:52.857617 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j7587_4b90276c-b68f-49a9-b571-13174fb91f20/network-metrics-daemon/0.log" Jul 16 22:16:52.879016 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:52.878972 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j7587_4b90276c-b68f-49a9-b571-13174fb91f20/kube-rbac-proxy/0.log" Jul 16 22:16:53.803694 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:53.803659 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hz2pt_75c7e977-7b28-42d0-a6e6-0532f2932368/ovn-controller/0.log" Jul 16 22:16:53.820618 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:53.820590 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hz2pt_75c7e977-7b28-42d0-a6e6-0532f2932368/ovn-acl-logging/1.log" Jul 16 22:16:53.820812 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:53.820679 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hz2pt_75c7e977-7b28-42d0-a6e6-0532f2932368/ovn-acl-logging/0.log" Jul 16 22:16:53.842158 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:53.842127 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hz2pt_75c7e977-7b28-42d0-a6e6-0532f2932368/kube-rbac-proxy-node/0.log" Jul 16 22:16:53.863298 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:53.863271 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hz2pt_75c7e977-7b28-42d0-a6e6-0532f2932368/kube-rbac-proxy-ovn-metrics/0.log" Jul 16 22:16:53.882141 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:53.882113 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hz2pt_75c7e977-7b28-42d0-a6e6-0532f2932368/northd/0.log" Jul 16 22:16:53.902895 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:53.902868 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hz2pt_75c7e977-7b28-42d0-a6e6-0532f2932368/nbdb/0.log" Jul 16 22:16:53.923807 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:53.923775 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hz2pt_75c7e977-7b28-42d0-a6e6-0532f2932368/sbdb/0.log" Jul 16 22:16:53.984437 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:53.984381 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hz2pt_75c7e977-7b28-42d0-a6e6-0532f2932368/ovnkube-controller/0.log" Jul 16 22:16:55.182357 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:55.182325 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7bc5b6bf85-sbs8l_cdc0b7f0-dd52-4e63-976f-84c68b6846bc/check-endpoints/0.log" Jul 16 22:16:55.207870 ip-10-0-137-177 kubenswrapper[2566]: I0716 22:16:55.207841 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-c9f2s_97c82c64-748f-4a8d-b4e3-3111b7d31cdc/network-check-target-container/0.log"