Jul 16 17:31:32.856011 ip-10-0-130-5 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 16 17:31:32.856025 ip-10-0-130-5 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 16 17:31:32.856036 ip-10-0-130-5 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 16 17:31:32.856387 ip-10-0-130-5 systemd[1]: Failed to start Kubernetes Kubelet. Jul 16 17:31:43.029385 ip-10-0-130-5 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 16 17:31:43.029401 ip-10-0-130-5 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 92ef54d5971f41b1982f3b130eb0537f -- Jul 16 17:33:47.960513 ip-10-0-130-5 systemd[1]: Starting Kubernetes Kubelet... Jul 16 17:33:48.354375 ip-10-0-130-5 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 17:33:48.354375 ip-10-0-130-5 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 16 17:33:48.354375 ip-10-0-130-5 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 17:33:48.354375 ip-10-0-130-5 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 16 17:33:48.354375 ip-10-0-130-5 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 17:33:48.354987 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.354376 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 16 17:33:48.361706 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361680 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 17:33:48.361706 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361701 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 17:33:48.361706 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361704 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 17:33:48.361706 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361708 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 16 17:33:48.361706 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361711 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 17:33:48.361706 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361714 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 17:33:48.361895 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361717 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 17:33:48.361895 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361720 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 17:33:48.361895 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361723 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 17:33:48.361895 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361726 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 17:33:48.361895 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361729 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 17:33:48.361895 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361732 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 17:33:48.361895 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361736 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 17:33:48.361895 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361741 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 17:33:48.361895 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361744 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 17:33:48.361895 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361747 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 17:33:48.361895 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361750 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 17:33:48.361895 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361754 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 17:33:48.361895 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361758 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 17:33:48.361895 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361761 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 17:33:48.361895 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361764 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 17:33:48.361895 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361766 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 17:33:48.361895 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361769 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 17:33:48.361895 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361772 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 17:33:48.361895 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361774 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 17:33:48.361895 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361780 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 17:33:48.362371 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361783 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 17:33:48.362371 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361785 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 17:33:48.362371 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361788 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 17:33:48.362371 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361791 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 17:33:48.362371 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361793 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 17:33:48.362371 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361796 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 17:33:48.362371 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361799 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 17:33:48.362371 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361801 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 17:33:48.362371 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361804 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 17:33:48.362371 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361806 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 17:33:48.362371 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361809 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 17:33:48.362371 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361811 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 17:33:48.362371 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361817 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 17:33:48.362371 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361820 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 17:33:48.362371 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361823 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 17:33:48.362371 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361826 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 17:33:48.362371 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361829 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 17:33:48.362371 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361831 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 17:33:48.362371 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361834 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 17:33:48.362371 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361837 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 17:33:48.362904 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361840 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 17:33:48.362904 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361842 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 17:33:48.362904 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361845 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 17:33:48.362904 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361849 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 17:33:48.362904 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361854 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 17:33:48.362904 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361856 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 17:33:48.362904 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361859 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 17:33:48.362904 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361862 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 17:33:48.362904 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361865 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 17:33:48.362904 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361867 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 17:33:48.362904 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361869 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 17:33:48.362904 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361872 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 17:33:48.362904 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361875 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 17:33:48.362904 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361878 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 17:33:48.362904 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361880 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 17:33:48.362904 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361883 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 17:33:48.362904 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361885 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 17:33:48.362904 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361890 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 17:33:48.362904 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361893 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 17:33:48.363379 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361897 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 17:33:48.363379 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361901 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 17:33:48.363379 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361904 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 17:33:48.363379 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361907 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 17:33:48.363379 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361910 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 17:33:48.363379 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361913 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 17:33:48.363379 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361917 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 17:33:48.363379 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361920 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 17:33:48.363379 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361924 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 17:33:48.363379 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361929 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 17:33:48.363379 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361932 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 17:33:48.363379 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361935 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 17:33:48.363379 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361938 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 17:33:48.363379 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361941 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 17:33:48.363379 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361943 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 17:33:48.363379 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361946 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 17:33:48.363379 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361949 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 17:33:48.363379 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361951 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 17:33:48.363379 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361954 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 17:33:48.363821 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361956 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 17:33:48.363821 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361959 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 17:33:48.363821 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361962 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 17:33:48.363821 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361968 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 17:33:48.363821 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361971 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 17:33:48.363821 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361974 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 17:33:48.363821 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361976 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 17:33:48.363821 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361979 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 17:33:48.363821 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361982 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 17:33:48.363821 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361984 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 17:33:48.363821 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361987 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 17:33:48.363821 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361990 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 17:33:48.363821 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361992 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 17:33:48.363821 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361995 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 17:33:48.363821 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.361997 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 17:33:48.363821 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363541 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 17:33:48.363821 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363552 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 17:33:48.363821 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363555 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 17:33:48.363821 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363559 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 17:33:48.363821 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363562 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 17:33:48.364294 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363564 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 17:33:48.364294 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363567 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 17:33:48.364294 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363569 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 17:33:48.364294 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363572 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 17:33:48.364294 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363575 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 17:33:48.364294 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363577 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 17:33:48.364294 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363580 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 17:33:48.364294 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363583 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 17:33:48.364294 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363586 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 17:33:48.364294 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363591 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 17:33:48.364294 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363594 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 17:33:48.364294 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363596 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 17:33:48.364294 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363599 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 17:33:48.364294 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363604 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 17:33:48.364294 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363607 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 17:33:48.364294 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363610 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 17:33:48.364294 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363613 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 17:33:48.364294 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363615 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 17:33:48.364294 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363618 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 17:33:48.364294 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363621 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 17:33:48.364802 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363624 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 17:33:48.364802 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363629 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 17:33:48.364802 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363632 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 17:33:48.364802 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363634 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 17:33:48.364802 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363637 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 17:33:48.364802 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363640 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 17:33:48.364802 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363642 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 17:33:48.364802 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363645 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 17:33:48.364802 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363648 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 17:33:48.364802 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363650 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 17:33:48.364802 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363653 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 17:33:48.364802 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363656 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 17:33:48.364802 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363660 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 17:33:48.364802 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363665 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 17:33:48.364802 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363667 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 17:33:48.364802 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363670 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 17:33:48.364802 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363673 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 16 17:33:48.364802 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363678 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 17:33:48.364802 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363682 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 17:33:48.364802 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363685 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 17:33:48.365330 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363689 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 17:33:48.365330 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363692 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 17:33:48.365330 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363694 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 17:33:48.365330 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363697 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 17:33:48.365330 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363700 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 17:33:48.365330 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363705 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 17:33:48.365330 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363708 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 17:33:48.365330 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363711 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 17:33:48.365330 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363714 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 17:33:48.365330 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363717 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 17:33:48.365330 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363719 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 17:33:48.365330 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363722 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 17:33:48.365330 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363724 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 17:33:48.365330 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363727 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 17:33:48.365330 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363730 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 17:33:48.365330 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363732 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 17:33:48.365330 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363735 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 17:33:48.365330 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363738 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 17:33:48.365330 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363743 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 17:33:48.365330 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363746 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 17:33:48.365800 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363749 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 17:33:48.365800 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363751 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 17:33:48.365800 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363755 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 17:33:48.365800 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363758 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 17:33:48.365800 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363760 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 17:33:48.365800 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363763 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 17:33:48.365800 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363766 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 17:33:48.365800 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363769 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 17:33:48.365800 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363771 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 17:33:48.365800 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363775 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 17:33:48.365800 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363780 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 17:33:48.365800 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363782 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 17:33:48.365800 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363785 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 17:33:48.365800 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363788 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 17:33:48.365800 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363791 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 17:33:48.365800 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363795 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 17:33:48.365800 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363799 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 17:33:48.365800 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363801 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 17:33:48.365800 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363804 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 17:33:48.366269 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363807 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 17:33:48.366269 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363810 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 17:33:48.366269 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363812 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 17:33:48.366269 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363817 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 17:33:48.366269 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363820 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 17:33:48.366269 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363822 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 17:33:48.366269 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363825 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 17:33:48.366269 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363828 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 17:33:48.366269 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363831 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 17:33:48.366269 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363834 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 17:33:48.366269 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363836 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 17:33:48.366269 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363839 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 17:33:48.366269 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363841 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 17:33:48.366269 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363845 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 17:33:48.366269 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.363849 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 17:33:48.366269 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364625 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 17:33:48.366269 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364636 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 17:33:48.366269 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364639 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 17:33:48.366269 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364642 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 17:33:48.366728 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364645 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 17:33:48.366728 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364648 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 17:33:48.366728 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364651 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 17:33:48.366728 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364653 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 17:33:48.366728 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364656 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 17:33:48.366728 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364659 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 17:33:48.366728 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364661 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 17:33:48.366728 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364664 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 17:33:48.366728 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364667 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 17:33:48.366728 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364669 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 17:33:48.366728 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364671 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 17:33:48.366728 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364674 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 17:33:48.366728 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364677 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 17:33:48.366728 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364679 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 17:33:48.366728 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364682 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 17:33:48.366728 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364684 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 17:33:48.366728 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364687 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 17:33:48.366728 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364689 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 17:33:48.366728 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364692 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 17:33:48.366728 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364694 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 17:33:48.367207 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364699 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 17:33:48.367207 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364702 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 17:33:48.367207 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364704 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 17:33:48.367207 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364707 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 17:33:48.367207 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364709 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 17:33:48.367207 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364712 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 17:33:48.367207 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364714 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 17:33:48.367207 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364716 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 17:33:48.367207 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364719 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 17:33:48.367207 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364722 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 17:33:48.367207 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364725 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 16 17:33:48.367207 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364727 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 17:33:48.367207 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364730 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 17:33:48.367207 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364732 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 17:33:48.367207 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364735 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 17:33:48.367207 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364737 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 17:33:48.367207 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364740 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 17:33:48.367207 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364742 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 17:33:48.367207 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364745 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 17:33:48.367207 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364748 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 17:33:48.367688 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364750 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 17:33:48.367688 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364753 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 17:33:48.367688 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364755 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 17:33:48.367688 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364759 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 17:33:48.367688 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364763 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 17:33:48.367688 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364765 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 17:33:48.367688 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364768 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 17:33:48.367688 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364770 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 17:33:48.367688 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364773 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 17:33:48.367688 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364776 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 17:33:48.367688 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364778 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 17:33:48.367688 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364781 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 17:33:48.367688 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364785 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 17:33:48.367688 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364788 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 17:33:48.367688 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364790 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 17:33:48.367688 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364793 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 17:33:48.367688 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364795 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 17:33:48.367688 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364798 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 17:33:48.367688 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364800 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 17:33:48.368131 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364803 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 17:33:48.368131 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364806 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 17:33:48.368131 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364809 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 17:33:48.368131 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364812 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 17:33:48.368131 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364814 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 17:33:48.368131 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364817 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 17:33:48.368131 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364821 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 17:33:48.368131 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364825 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 17:33:48.368131 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364828 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 17:33:48.368131 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364831 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 17:33:48.368131 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364834 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 17:33:48.368131 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364836 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 17:33:48.368131 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364839 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 17:33:48.368131 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364842 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 17:33:48.368131 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364844 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 17:33:48.368131 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364847 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 17:33:48.368131 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364850 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 17:33:48.368131 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364852 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 17:33:48.368131 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364856 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 17:33:48.368131 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364859 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 17:33:48.368625 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364862 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 17:33:48.368625 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364865 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 17:33:48.368625 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364867 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 17:33:48.368625 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364870 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 17:33:48.368625 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364872 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 17:33:48.368625 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364876 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 17:33:48.368625 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364878 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 17:33:48.368625 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364881 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 17:33:48.368625 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364883 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 17:33:48.368625 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364886 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 17:33:48.368625 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364889 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 17:33:48.368625 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364891 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 17:33:48.368625 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364894 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 17:33:48.368625 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364896 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 17:33:48.368625 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364900 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 17:33:48.368625 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.364904 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 17:33:48.368625 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.364978 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 16 17:33:48.368625 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.364988 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 16 17:33:48.368625 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.364997 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 16 17:33:48.368625 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365002 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 16 17:33:48.369099 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365008 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 16 17:33:48.369099 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365013 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 16 17:33:48.369099 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365017 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 16 17:33:48.369099 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365021 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 16 17:33:48.369099 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365025 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 16 17:33:48.369099 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365028 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 16 17:33:48.369099 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365031 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 16 17:33:48.369099 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365034 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 16 17:33:48.369099 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365037 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 16 17:33:48.369099 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365040 2578 flags.go:64] FLAG: --cgroup-root="" Jul 16 17:33:48.369099 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365043 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 16 17:33:48.369099 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365046 2578 flags.go:64] FLAG: --client-ca-file="" Jul 16 17:33:48.369099 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365050 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 16 17:33:48.369099 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365053 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 16 17:33:48.369099 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365057 2578 flags.go:64] FLAG: --cluster-domain="" Jul 16 17:33:48.369099 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365059 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 16 17:33:48.369099 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365062 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 16 17:33:48.369099 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365067 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 16 17:33:48.369099 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365070 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 16 17:33:48.369099 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365074 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 16 17:33:48.369099 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365076 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 16 17:33:48.369099 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365080 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 16 17:33:48.369099 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365083 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 16 17:33:48.369649 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365086 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 16 17:33:48.369649 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365089 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 16 17:33:48.369649 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365092 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 16 17:33:48.369649 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365095 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 16 17:33:48.369649 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365098 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 16 17:33:48.369649 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365102 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 16 17:33:48.369649 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365105 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 16 17:33:48.369649 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365108 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 16 17:33:48.369649 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365111 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 16 17:33:48.369649 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365114 2578 flags.go:64] FLAG: --enable-server="true" Jul 16 17:33:48.369649 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365116 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 16 17:33:48.369649 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365122 2578 flags.go:64] FLAG: --event-burst="100" Jul 16 17:33:48.369649 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365125 2578 flags.go:64] FLAG: --event-qps="50" Jul 16 17:33:48.369649 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365128 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 16 17:33:48.369649 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365131 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 16 17:33:48.369649 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365133 2578 flags.go:64] FLAG: --eviction-hard="" Jul 16 17:33:48.369649 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365137 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 16 17:33:48.369649 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365140 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 16 17:33:48.369649 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365143 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 16 17:33:48.369649 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365145 2578 flags.go:64] FLAG: --eviction-soft="" Jul 16 17:33:48.369649 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365148 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 16 17:33:48.369649 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365151 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 16 17:33:48.369649 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365154 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 16 17:33:48.369649 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365157 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 16 17:33:48.369649 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365160 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 16 17:33:48.370266 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365163 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 16 17:33:48.370266 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365168 2578 flags.go:64] FLAG: --feature-gates="" Jul 16 17:33:48.370266 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365171 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 16 17:33:48.370266 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365174 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 16 17:33:48.370266 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365177 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 16 17:33:48.370266 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365180 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 16 17:33:48.370266 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365183 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 16 17:33:48.370266 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365186 2578 flags.go:64] FLAG: --help="false" Jul 16 17:33:48.370266 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365189 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-130-5.ec2.internal" Jul 16 17:33:48.370266 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365192 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 16 17:33:48.370266 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365195 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 16 17:33:48.370266 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365220 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 16 17:33:48.370266 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365235 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 16 17:33:48.370266 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365238 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 16 17:33:48.370266 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365241 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 16 17:33:48.370266 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365244 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 16 17:33:48.370266 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365247 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 16 17:33:48.370266 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365250 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 16 17:33:48.370266 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365253 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 16 17:33:48.370266 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365256 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 16 17:33:48.370266 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365258 2578 flags.go:64] FLAG: --kube-reserved="" Jul 16 17:33:48.370266 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365261 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 16 17:33:48.370266 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365264 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 16 17:33:48.370266 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365267 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 16 17:33:48.370861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365270 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 16 17:33:48.370861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365272 2578 flags.go:64] FLAG: --lock-file="" Jul 16 17:33:48.370861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365275 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 16 17:33:48.370861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365278 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 16 17:33:48.370861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365281 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 16 17:33:48.370861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365286 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 16 17:33:48.370861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365290 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 16 17:33:48.370861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365292 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 16 17:33:48.370861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365295 2578 flags.go:64] FLAG: --logging-format="text" Jul 16 17:33:48.370861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365298 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 16 17:33:48.370861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365303 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 16 17:33:48.370861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365305 2578 flags.go:64] FLAG: --manifest-url="" Jul 16 17:33:48.370861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365308 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 16 17:33:48.370861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365315 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 16 17:33:48.370861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365319 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 16 17:33:48.370861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365322 2578 flags.go:64] FLAG: --max-pods="110" Jul 16 17:33:48.370861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365325 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 16 17:33:48.370861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365328 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 16 17:33:48.370861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365331 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 16 17:33:48.370861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365334 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 16 17:33:48.370861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365337 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 16 17:33:48.370861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365340 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 16 17:33:48.370861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365343 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 16 17:33:48.370861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365349 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 16 17:33:48.370861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365352 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 16 17:33:48.371515 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365355 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 16 17:33:48.371515 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365358 2578 flags.go:64] FLAG: --pod-cidr="" Jul 16 17:33:48.371515 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365361 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 16 17:33:48.371515 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365366 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 16 17:33:48.371515 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365369 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 16 17:33:48.371515 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365371 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 16 17:33:48.371515 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365374 2578 flags.go:64] FLAG: --port="10250" Jul 16 17:33:48.371515 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365377 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 16 17:33:48.371515 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365380 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-054f0149b246b69c2" Jul 16 17:33:48.371515 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365383 2578 flags.go:64] FLAG: --qos-reserved="" Jul 16 17:33:48.371515 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365386 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 16 17:33:48.371515 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365389 2578 flags.go:64] FLAG: --register-node="true" Jul 16 17:33:48.371515 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365392 2578 flags.go:64] FLAG: --register-with-taints="" Jul 16 17:33:48.371515 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365395 2578 flags.go:64] FLAG: --registry-burst="10" Jul 16 17:33:48.371515 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365399 2578 flags.go:64] FLAG: --registry-qps="5" Jul 16 17:33:48.371515 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365402 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 16 17:33:48.371515 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365404 2578 flags.go:64] FLAG: --reserved-memory="" Jul 16 17:33:48.371515 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365409 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 16 17:33:48.371515 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365412 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 16 17:33:48.371515 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365415 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 16 17:33:48.371515 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365418 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 16 17:33:48.371515 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365420 2578 flags.go:64] FLAG: --runonce="false" Jul 16 17:33:48.371515 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365423 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 16 17:33:48.371515 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365426 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 16 17:33:48.371515 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365429 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 16 17:33:48.372110 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365432 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 16 17:33:48.372110 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365435 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 16 17:33:48.372110 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365438 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 16 17:33:48.372110 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365441 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 16 17:33:48.372110 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365444 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 16 17:33:48.372110 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365446 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 16 17:33:48.372110 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365449 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 16 17:33:48.372110 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365452 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 16 17:33:48.372110 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365455 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 16 17:33:48.372110 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365458 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 16 17:33:48.372110 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365460 2578 flags.go:64] FLAG: --system-cgroups="" Jul 16 17:33:48.372110 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365463 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 16 17:33:48.372110 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365468 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 16 17:33:48.372110 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365471 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 16 17:33:48.372110 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365474 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 16 17:33:48.372110 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365478 2578 flags.go:64] FLAG: --tls-min-version="" Jul 16 17:33:48.372110 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365480 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 16 17:33:48.372110 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365483 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 16 17:33:48.372110 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365486 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 16 17:33:48.372110 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365490 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 16 17:33:48.372110 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365493 2578 flags.go:64] FLAG: --v="2" Jul 16 17:33:48.372110 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365497 2578 flags.go:64] FLAG: --version="false" Jul 16 17:33:48.372110 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365501 2578 flags.go:64] FLAG: --vmodule="" Jul 16 17:33:48.372110 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365505 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 16 17:33:48.372110 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.365509 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 16 17:33:48.372782 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365618 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 17:33:48.372782 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365623 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 17:33:48.372782 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365627 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 17:33:48.372782 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365630 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 17:33:48.372782 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365633 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 17:33:48.372782 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365635 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 17:33:48.372782 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365638 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 17:33:48.372782 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365641 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 17:33:48.372782 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365644 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 17:33:48.372782 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365646 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 17:33:48.372782 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365649 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 17:33:48.372782 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365651 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 17:33:48.372782 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365654 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 17:33:48.372782 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365656 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 17:33:48.372782 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365659 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 17:33:48.372782 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365661 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 17:33:48.372782 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365664 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 17:33:48.372782 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365666 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 17:33:48.372782 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365669 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 17:33:48.372782 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365672 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 17:33:48.373281 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365674 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 17:33:48.373281 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365676 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 17:33:48.373281 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365679 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 17:33:48.373281 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365681 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 17:33:48.373281 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365684 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 17:33:48.373281 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365686 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 17:33:48.373281 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365690 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 16 17:33:48.373281 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365693 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 17:33:48.373281 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365695 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 17:33:48.373281 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365698 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 17:33:48.373281 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365701 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 17:33:48.373281 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365704 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 17:33:48.373281 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365707 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 17:33:48.373281 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365709 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 17:33:48.373281 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365712 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 17:33:48.373281 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365714 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 17:33:48.373281 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365716 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 17:33:48.373281 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365719 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 17:33:48.373281 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365723 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 17:33:48.373281 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365726 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 17:33:48.373757 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365729 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 17:33:48.373757 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365731 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 17:33:48.373757 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365734 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 17:33:48.373757 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365737 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 17:33:48.373757 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365740 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 17:33:48.373757 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365742 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 17:33:48.373757 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365745 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 17:33:48.373757 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365747 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 17:33:48.373757 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365750 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 17:33:48.373757 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365752 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 17:33:48.373757 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365755 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 17:33:48.373757 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365757 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 17:33:48.373757 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365759 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 17:33:48.373757 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365762 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 17:33:48.373757 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365764 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 17:33:48.373757 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365767 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 17:33:48.373757 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365769 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 17:33:48.373757 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365773 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 17:33:48.373757 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365778 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 17:33:48.374248 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365781 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 17:33:48.374248 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365784 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 17:33:48.374248 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365786 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 17:33:48.374248 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365789 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 17:33:48.374248 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365792 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 17:33:48.374248 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365795 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 17:33:48.374248 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365797 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 17:33:48.374248 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365800 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 17:33:48.374248 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365803 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 17:33:48.374248 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365806 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 17:33:48.374248 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365809 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 17:33:48.374248 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365812 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 17:33:48.374248 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365815 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 17:33:48.374248 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365817 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 17:33:48.374248 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365820 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 17:33:48.374248 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365822 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 17:33:48.374248 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365826 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 17:33:48.374248 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365829 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 17:33:48.374248 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365831 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 17:33:48.374248 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365834 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 17:33:48.374742 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365836 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 17:33:48.374742 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365838 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 17:33:48.374742 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365841 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 17:33:48.374742 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365843 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 17:33:48.374742 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365846 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 17:33:48.374742 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365848 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 17:33:48.374742 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365851 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 17:33:48.374742 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365854 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 17:33:48.374742 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365856 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 17:33:48.374742 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365858 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 17:33:48.374742 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365861 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 17:33:48.374742 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365865 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 17:33:48.374742 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365867 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 17:33:48.374742 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365870 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 17:33:48.374742 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365872 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 17:33:48.374742 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365875 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 17:33:48.374742 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365879 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 17:33:48.374742 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365882 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 17:33:48.374742 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365885 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 17:33:48.374742 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.365887 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 17:33:48.375223 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.366415 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 17:33:48.375223 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.372869 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 16 17:33:48.375223 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.372885 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 16 17:33:48.375223 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.373769 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 16 17:33:48.375223 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.373779 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 16 17:33:48.375223 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373833 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 17:33:48.375223 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373839 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 17:33:48.375223 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373842 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 17:33:48.375223 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373845 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 17:33:48.375223 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373848 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 17:33:48.375223 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373851 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 17:33:48.375223 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373854 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 17:33:48.375223 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373857 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 17:33:48.375223 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373860 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 17:33:48.375223 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373863 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 17:33:48.375600 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373866 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 17:33:48.375600 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373868 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 17:33:48.375600 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373871 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 17:33:48.375600 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373873 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 17:33:48.375600 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373876 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 17:33:48.375600 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373878 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 17:33:48.375600 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373883 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 17:33:48.375600 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373887 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 17:33:48.375600 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373889 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 17:33:48.375600 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373892 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 17:33:48.375600 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373894 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 17:33:48.375600 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373898 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 17:33:48.375600 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373901 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 17:33:48.375600 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373903 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 17:33:48.375600 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373906 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 17:33:48.375600 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373908 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 17:33:48.375600 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373911 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 17:33:48.375600 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373914 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 17:33:48.375600 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373917 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 17:33:48.376058 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373921 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 17:33:48.376058 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373924 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 17:33:48.376058 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373927 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 17:33:48.376058 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373930 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 17:33:48.376058 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373934 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 17:33:48.376058 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373938 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 17:33:48.376058 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373941 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 17:33:48.376058 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373944 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 17:33:48.376058 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373947 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 17:33:48.376058 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373950 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 17:33:48.376058 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373954 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 17:33:48.376058 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373957 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 17:33:48.376058 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373960 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 17:33:48.376058 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373963 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 17:33:48.376058 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373966 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 17:33:48.376058 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373969 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 17:33:48.376058 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373971 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 17:33:48.376058 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373974 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 17:33:48.376058 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373976 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 17:33:48.376594 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373979 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 17:33:48.376594 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373981 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 17:33:48.376594 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373984 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 17:33:48.376594 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373986 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 17:33:48.376594 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373989 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 17:33:48.376594 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373992 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 17:33:48.376594 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373995 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 17:33:48.376594 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.373997 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 17:33:48.376594 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374000 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 17:33:48.376594 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374002 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 17:33:48.376594 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374005 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 17:33:48.376594 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374007 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 17:33:48.376594 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374010 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 17:33:48.376594 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374013 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 17:33:48.376594 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374016 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 17:33:48.376594 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374018 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 17:33:48.376594 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374021 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 17:33:48.376594 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374023 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 17:33:48.376594 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374026 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 17:33:48.377037 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374028 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 17:33:48.377037 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374030 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 17:33:48.377037 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374033 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 17:33:48.377037 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374035 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 17:33:48.377037 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374038 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 17:33:48.377037 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374040 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 17:33:48.377037 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374043 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 17:33:48.377037 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374045 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 17:33:48.377037 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374047 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 17:33:48.377037 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374050 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 17:33:48.377037 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374052 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 17:33:48.377037 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374054 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 17:33:48.377037 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374057 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 17:33:48.377037 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374059 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 17:33:48.377037 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374062 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 17:33:48.377037 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374064 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 17:33:48.377037 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374067 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 16 17:33:48.377037 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374069 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 17:33:48.377037 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374072 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 17:33:48.377037 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374074 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 17:33:48.377505 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374077 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 17:33:48.377505 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374079 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 17:33:48.377505 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374082 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 17:33:48.377505 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374085 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 17:33:48.377505 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374087 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 17:33:48.377505 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374090 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 17:33:48.377505 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374092 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 17:33:48.377505 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374094 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 17:33:48.377505 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374098 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 17:33:48.377505 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374100 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 17:33:48.377505 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374103 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 17:33:48.377505 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374105 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 17:33:48.377505 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.374110 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 17:33:48.377505 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374239 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 17:33:48.377505 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374245 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 17:33:48.377874 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374248 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 17:33:48.377874 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374251 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 17:33:48.377874 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374254 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 17:33:48.377874 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374257 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 17:33:48.377874 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374260 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 17:33:48.377874 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374263 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 17:33:48.377874 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374265 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 17:33:48.377874 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374268 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 17:33:48.377874 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374270 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 17:33:48.377874 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374273 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 17:33:48.377874 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374275 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 17:33:48.377874 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374278 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 17:33:48.377874 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374280 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 17:33:48.377874 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374283 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 17:33:48.377874 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374286 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 17:33:48.377874 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374288 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 17:33:48.377874 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374291 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 17:33:48.377874 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374293 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 17:33:48.377874 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374296 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 17:33:48.378331 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374298 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 17:33:48.378331 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374301 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 17:33:48.378331 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374303 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 17:33:48.378331 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374306 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 17:33:48.378331 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374308 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 17:33:48.378331 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374311 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 17:33:48.378331 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374313 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 17:33:48.378331 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374316 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 17:33:48.378331 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374319 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 17:33:48.378331 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374321 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 17:33:48.378331 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374324 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 17:33:48.378331 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374326 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 17:33:48.378331 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374329 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 17:33:48.378331 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374331 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 17:33:48.378331 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374334 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 17:33:48.378331 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374336 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 17:33:48.378331 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374338 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 17:33:48.378331 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374341 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 17:33:48.378331 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374343 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 17:33:48.378331 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374346 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 17:33:48.378331 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374348 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 17:33:48.378820 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374351 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 17:33:48.378820 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374353 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 17:33:48.378820 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374355 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 17:33:48.378820 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374358 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 17:33:48.378820 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374360 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 17:33:48.378820 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374363 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 17:33:48.378820 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374365 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 17:33:48.378820 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374368 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 17:33:48.378820 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374370 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 17:33:48.378820 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374372 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 17:33:48.378820 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374375 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 17:33:48.378820 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374379 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 17:33:48.378820 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374382 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 17:33:48.378820 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374385 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 17:33:48.378820 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374387 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 17:33:48.378820 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374391 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 17:33:48.378820 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374393 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 17:33:48.378820 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374396 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 17:33:48.378820 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374398 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 17:33:48.379276 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374402 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 17:33:48.379276 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374404 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 17:33:48.379276 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374407 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 17:33:48.379276 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374409 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 17:33:48.379276 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374412 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 17:33:48.379276 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374414 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 17:33:48.379276 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374417 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 17:33:48.379276 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374419 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 17:33:48.379276 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374422 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 17:33:48.379276 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374424 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 17:33:48.379276 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374427 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 17:33:48.379276 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374429 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 17:33:48.379276 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374431 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 17:33:48.379276 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374434 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 17:33:48.379276 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374436 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 17:33:48.379276 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374439 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 17:33:48.379276 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374441 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 17:33:48.379276 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374444 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 17:33:48.379276 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374447 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 17:33:48.379276 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374449 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 17:33:48.379737 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374451 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 16 17:33:48.379737 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374454 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 17:33:48.379737 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374458 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 17:33:48.379737 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374461 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 17:33:48.379737 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374464 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 17:33:48.379737 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374468 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 17:33:48.379737 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374471 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 17:33:48.379737 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374474 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 17:33:48.379737 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374477 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 17:33:48.379737 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374490 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 17:33:48.379737 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374493 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 17:33:48.379737 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374495 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 17:33:48.379737 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374498 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 17:33:48.379737 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374502 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 17:33:48.379737 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374505 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 17:33:48.379737 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374508 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 17:33:48.379737 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374510 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 17:33:48.379737 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:48.374512 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 17:33:48.380160 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.374518 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 17:33:48.380160 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.374616 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 16 17:33:48.380160 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.376622 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 16 17:33:48.380160 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.377863 2578 server.go:1019] "Starting client certificate rotation" Jul 16 17:33:48.380160 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.377966 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 17:33:48.380160 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.378003 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 17:33:48.380369 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.380256 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 17:33:48.381334 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.381321 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 17:33:48.392389 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.392376 2578 log.go:25] "Validated CRI v1 runtime API" Jul 16 17:33:48.394280 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.394266 2578 log.go:25] "Validated CRI v1 image API" Jul 16 17:33:48.397580 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.397564 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 16 17:33:48.400581 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.400553 2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a7b411bc-cd87-4f8c-9703-4d13ebd68519:/dev/nvme0n1p4 f8824328-f7d8-4b28-a1bc-e081ff7ad0df:/dev/nvme0n1p3] Jul 16 17:33:48.400656 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.400620 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 16 17:33:48.406313 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.406194 2578 manager.go:216] Machine: {Timestamp:2026-07-16 17:33:48.404861173 +0000 UTC m=+0.331499169 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100194 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27b82e802e83bcff606367409866a6 SystemUUID:ec27b82e-802e-83bc-ff60-6367409866a6 BootID:92ef54d5-971f-41b1-982f-3b130eb0537f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2b:c4:1a:3f:77 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2b:c4:1a:3f:77 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:0c:14:16:4c:a6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 16 17:33:48.406313 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.406305 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 16 17:33:48.406438 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.406373 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 16 17:33:48.409265 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.409237 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 16 17:33:48.409385 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.409267 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-5.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 16 17:33:48.410461 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.410452 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 16 17:33:48.410502 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.410464 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 16 17:33:48.410502 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.410471 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 17:33:48.411189 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.411179 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 17:33:48.411938 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.411929 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 16 17:33:48.415225 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.415213 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 16 17:33:48.415360 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.415350 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 16 17:33:48.415409 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.415379 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 16 17:33:48.415409 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.415388 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 16 17:33:48.415409 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.415402 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 16 17:33:48.415409 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.415410 2578 kubelet.go:398] "Adding apiserver pod source" Jul 16 17:33:48.415523 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.415427 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 16 17:33:48.415523 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.415429 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 17:33:48.415750 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.415740 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 17:33:48.415792 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.415758 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 17:33:48.418582 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.418565 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 16 17:33:48.420230 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.420216 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 16 17:33:48.420283 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.420245 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 16 17:33:48.420793 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.420780 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 16 17:33:48.420793 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.420795 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 16 17:33:48.420872 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.420801 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 16 17:33:48.420872 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.420806 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 16 17:33:48.420872 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.420813 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 16 17:33:48.420872 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.420818 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 16 17:33:48.421062 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.421054 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 16 17:33:48.421062 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.421062 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 16 17:33:48.421117 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.421068 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 16 17:33:48.421117 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.421074 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 16 17:33:48.421117 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.421083 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 16 17:33:48.421117 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.421090 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 16 17:33:48.421950 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.421941 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 16 17:33:48.421950 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.421950 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 16 17:33:48.424771 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.424757 2578 server.go:1268] "Started kubelet" Jul 16 17:33:48.424893 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.424845 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 16 17:33:48.424962 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.424920 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 16 17:33:48.425127 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.424970 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 16 17:33:48.425547 ip-10-0-130-5 systemd[1]: Started Kubernetes Kubelet. Jul 16 17:33:48.426760 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.426741 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 16 17:33:48.426987 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.426975 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 16 17:33:48.429180 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:48.429160 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 16 17:33:48.429493 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:48.429472 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-5.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 16 17:33:48.429747 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.429732 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-5.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 16 17:33:48.430643 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:48.429753 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-5.ec2.internal.18c2d592b241bec6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-5.ec2.internal,UID:ip-10-0-130-5.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-5.ec2.internal,},FirstTimestamp:2026-07-16 17:33:48.424732358 +0000 UTC m=+0.351370339,LastTimestamp:2026-07-16 17:33:48.424732358 +0000 UTC m=+0.351370339,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-5.ec2.internal,}" Jul 16 17:33:48.431572 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.431554 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 16 17:33:48.431725 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.431615 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 16 17:33:48.432454 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:48.432429 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-5.ec2.internal\" not found" Jul 16 17:33:48.432817 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.432798 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 16 17:33:48.432885 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.432820 2578 factory.go:55] Registering systemd factory Jul 16 17:33:48.432885 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.432828 2578 factory.go:223] Registration of the systemd container factory successfully Jul 16 17:33:48.432978 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:48.432957 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 16 17:33:48.433128 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.433112 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 16 17:33:48.433233 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.433216 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 16 17:33:48.433331 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.433237 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 16 17:33:48.433377 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.433367 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 16 17:33:48.433421 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.433378 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 16 17:33:48.433476 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.433460 2578 factory.go:153] Registering CRI-O factory Jul 16 17:33:48.433523 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.433483 2578 factory.go:223] Registration of the crio container factory successfully Jul 16 17:33:48.433523 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.433506 2578 factory.go:103] Registering Raw factory Jul 16 17:33:48.433523 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.433521 2578 manager.go:1196] Started watching for new ooms in manager Jul 16 17:33:48.434611 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.434595 2578 manager.go:349] Starting recovery of all containers Jul 16 17:33:48.434894 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:48.434865 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-5.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 16 17:33:48.444700 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:48.444663 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 16 17:33:48.446575 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.446554 2578 manager.go:354] Recovery completed Jul 16 17:33:48.450461 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.450449 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 17:33:48.452090 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.451990 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-z9wll" Jul 16 17:33:48.452156 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.452094 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-5.ec2.internal" event="NodeHasSufficientMemory" Jul 16 17:33:48.452156 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.452121 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 17:33:48.452156 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.452131 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-5.ec2.internal" event="NodeHasSufficientPID" Jul 16 17:33:48.452628 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.452614 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 16 17:33:48.452628 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.452626 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 16 17:33:48.452726 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.452639 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 16 17:33:48.452726 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.452682 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 17:33:48.453332 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.453318 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-5.ec2.internal" event="NodeHasSufficientMemory" Jul 16 17:33:48.453375 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.453345 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 17:33:48.453375 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.453359 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-5.ec2.internal" event="NodeHasSufficientPID" Jul 16 17:33:48.453969 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.453958 2578 policy_none.go:49] "None policy: Start" Jul 16 17:33:48.454006 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.453973 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 16 17:33:48.454006 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.453984 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 16 17:33:48.454665 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:48.454608 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-5.ec2.internal.18c2d592b3e37368 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-5.ec2.internal,UID:ip-10-0-130-5.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-5.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-5.ec2.internal,},FirstTimestamp:2026-07-16 17:33:48.452107112 +0000 UTC m=+0.378745099,LastTimestamp:2026-07-16 17:33:48.452107112 +0000 UTC m=+0.378745099,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-5.ec2.internal,}" Jul 16 17:33:48.454946 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.454933 2578 policy_none.go:47] "Start" Jul 16 17:33:48.462669 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.462650 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-z9wll" Jul 16 17:33:48.466619 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:48.466564 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-5.ec2.internal.18c2d592b3e3bd2c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-5.ec2.internal,UID:ip-10-0-130-5.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-5.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-5.ec2.internal,},FirstTimestamp:2026-07-16 17:33:48.452125996 +0000 UTC m=+0.378763979,LastTimestamp:2026-07-16 17:33:48.452125996 +0000 UTC m=+0.378763979,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-5.ec2.internal,}" Jul 16 17:33:48.494757 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.494744 2578 manager.go:337] "Starting Device Plugin manager" Jul 16 17:33:48.494821 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:48.494771 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 16 17:33:48.494821 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.494779 2578 server.go:87] "Starting device plugin registration server" Jul 16 17:33:48.495007 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.494994 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 16 17:33:48.495076 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.495008 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 16 17:33:48.495157 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.495124 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 16 17:33:48.495256 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.495217 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 16 17:33:48.495256 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.495225 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 16 17:33:48.495683 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:48.495616 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 16 17:33:48.495683 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:48.495666 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-5.ec2.internal\" not found" Jul 16 17:33:48.595625 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.595604 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 17:33:48.596631 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.596356 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-5.ec2.internal" event="NodeHasSufficientMemory" Jul 16 17:33:48.596631 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.596378 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 17:33:48.596631 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.596387 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-5.ec2.internal" event="NodeHasSufficientPID" Jul 16 17:33:48.596631 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.596414 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-5.ec2.internal" Jul 16 17:33:48.607624 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.607587 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-5.ec2.internal" Jul 16 17:33:48.607624 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:48.607605 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-5.ec2.internal\": node \"ip-10-0-130-5.ec2.internal\" not found" Jul 16 17:33:48.627738 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:48.627718 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-5.ec2.internal\" not found" Jul 16 17:33:48.629074 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.629055 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 16 17:33:48.630161 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.630148 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 16 17:33:48.630264 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.630180 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 16 17:33:48.630264 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.630216 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 16 17:33:48.630264 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:48.630243 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 16 17:33:48.632669 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:48.632649 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 17:33:50.125926 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:50.125904 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-5.ec2.internal\" not found" Jul 16 17:33:50.128051 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.128035 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-5.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-5.ec2.internal"] Jul 16 17:33:50.128105 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.128099 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 17:33:50.129487 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.129470 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-5.ec2.internal" event="NodeHasSufficientMemory" Jul 16 17:33:50.129552 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.129496 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 17:33:50.129552 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.129512 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-5.ec2.internal" event="NodeHasSufficientPID" Jul 16 17:33:50.130644 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.130613 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 17:33:50.130733 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.130719 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-5.ec2.internal" Jul 16 17:33:50.130780 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.130751 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 17:33:50.131092 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.131076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32d0c91cee1c323b9c86d433cacd6006-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-5.ec2.internal\" (UID: \"32d0c91cee1c323b9c86d433cacd6006\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-5.ec2.internal" Jul 16 17:33:50.131142 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.131099 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/32d0c91cee1c323b9c86d433cacd6006-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-5.ec2.internal\" (UID: \"32d0c91cee1c323b9c86d433cacd6006\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-5.ec2.internal" Jul 16 17:33:50.131295 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.131276 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-5.ec2.internal" event="NodeHasSufficientMemory" Jul 16 17:33:50.131295 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.131281 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-5.ec2.internal" event="NodeHasSufficientMemory" Jul 16 17:33:50.131433 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.131300 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 17:33:50.131433 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.131311 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-5.ec2.internal" event="NodeHasSufficientPID" Jul 16 17:33:50.131433 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.131322 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 17:33:50.131433 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.131335 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-5.ec2.internal" event="NodeHasSufficientPID" Jul 16 17:33:50.132789 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.132777 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-5.ec2.internal" Jul 16 17:33:50.132839 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.132800 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 17:33:50.133385 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.133371 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-5.ec2.internal" event="NodeHasSufficientMemory" Jul 16 17:33:50.133477 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.133395 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 17:33:50.133477 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.133407 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-5.ec2.internal" event="NodeHasSufficientPID" Jul 16 17:33:50.147934 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:50.147916 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-5.ec2.internal\" not found" node="ip-10-0-130-5.ec2.internal" Jul 16 17:33:50.151601 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:50.151587 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-5.ec2.internal\" not found" node="ip-10-0-130-5.ec2.internal" Jul 16 17:33:50.225999 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:50.225980 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-5.ec2.internal\" not found" Jul 16 17:33:50.231289 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.231268 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/32d0c91cee1c323b9c86d433cacd6006-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-5.ec2.internal\" (UID: \"32d0c91cee1c323b9c86d433cacd6006\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-5.ec2.internal" Jul 16 17:33:50.231386 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.231298 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32d0c91cee1c323b9c86d433cacd6006-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-5.ec2.internal\" (UID: \"32d0c91cee1c323b9c86d433cacd6006\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-5.ec2.internal" Jul 16 17:33:50.231386 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.231325 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32d0c91cee1c323b9c86d433cacd6006-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-5.ec2.internal\" (UID: \"32d0c91cee1c323b9c86d433cacd6006\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-5.ec2.internal" Jul 16 17:33:50.231386 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.231342 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/32d0c91cee1c323b9c86d433cacd6006-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-5.ec2.internal\" (UID: \"32d0c91cee1c323b9c86d433cacd6006\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-5.ec2.internal" Jul 16 17:33:50.326688 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:50.326642 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-5.ec2.internal\" not found" Jul 16 17:33:50.331960 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.331946 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d4c16c32a3c36fc19378959a9303c7f1-config\") pod \"kube-apiserver-proxy-ip-10-0-130-5.ec2.internal\" (UID: \"d4c16c32a3c36fc19378959a9303c7f1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-5.ec2.internal" Jul 16 17:33:50.427140 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:50.427119 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-5.ec2.internal\" not found" Jul 16 17:33:50.432444 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.432431 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d4c16c32a3c36fc19378959a9303c7f1-config\") pod \"kube-apiserver-proxy-ip-10-0-130-5.ec2.internal\" (UID: \"d4c16c32a3c36fc19378959a9303c7f1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-5.ec2.internal" Jul 16 17:33:50.432507 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.432459 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d4c16c32a3c36fc19378959a9303c7f1-config\") pod \"kube-apiserver-proxy-ip-10-0-130-5.ec2.internal\" (UID: \"d4c16c32a3c36fc19378959a9303c7f1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-5.ec2.internal" Jul 16 17:33:50.449562 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.449545 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-5.ec2.internal" Jul 16 17:33:50.454402 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.454380 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-5.ec2.internal" Jul 16 17:33:50.528111 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:50.528089 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-5.ec2.internal\" not found" Jul 16 17:33:50.628688 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:50.628642 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-5.ec2.internal\" not found" Jul 16 17:33:50.729162 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:50.729136 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-5.ec2.internal\" not found" Jul 16 17:33:50.772083 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.772065 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 17:33:50.774305 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.774291 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 16 17:33:50.774424 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.774399 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 17:33:50.787743 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.787729 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 17:33:50.791313 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.791300 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 17:33:50.813464 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.813447 2578 apiserver.go:52] "Watching apiserver" Jul 16 17:33:50.823940 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.823918 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 16 17:33:50.824242 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.824223 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-c5cwf","openshift-multus/multus-5jnzr","openshift-multus/multus-additional-cni-plugins-vg8xg","openshift-network-diagnostics/network-check-target-h8zgd","openshift-network-operator/iptables-alerter-9qckj","openshift-ovn-kubernetes/ovnkube-node-qvlwv","kube-system/global-pull-secret-syncer-lrj7t","kube-system/konnectivity-agent-7prpm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk","openshift-cluster-node-tuning-operator/tuned-4d257","openshift-dns/node-resolver-cxq75","openshift-multus/network-metrics-daemon-7xmt6"] Jul 16 17:33:50.825700 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.825686 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c5cwf" Jul 16 17:33:50.826745 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.826726 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.827871 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.827854 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vg8xg" Jul 16 17:33:50.829008 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.828992 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:33:50.829094 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:50.829055 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h8zgd" podUID="9ed27992-7654-4b37-9b2a-dc5aa5cb6dde" Jul 16 17:33:50.829226 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.829213 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-5.ec2.internal" Jul 16 17:33:50.829274 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.829237 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 16 17:33:50.831403 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.830609 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9qckj" Jul 16 17:33:50.831403 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.831315 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 16 17:33:50.831403 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.831342 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 16 17:33:50.832433 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.832168 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.833490 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.833475 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:33:50.833562 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:50.833524 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrj7t" podUID="fd1b005f-47c0-4006-abf5-b17419b94b2a" Jul 16 17:33:50.834571 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.834551 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-host-var-lib-kubelet\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.834625 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.834578 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-multus-conf-dir\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.834625 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.834590 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7prpm" Jul 16 17:33:50.834625 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.834595 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/122835d2-068b-4ef1-a09e-5f5dccd90a9f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vg8xg\" (UID: \"122835d2-068b-4ef1-a09e-5f5dccd90a9f\") " pod="openshift-multus/multus-additional-cni-plugins-vg8xg" Jul 16 17:33:50.834625 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.834612 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/122835d2-068b-4ef1-a09e-5f5dccd90a9f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vg8xg\" (UID: \"122835d2-068b-4ef1-a09e-5f5dccd90a9f\") " pod="openshift-multus/multus-additional-cni-plugins-vg8xg" Jul 16 17:33:50.834805 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.834627 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-node-log\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.834805 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.834641 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9ced5729-ce86-4189-90a5-161317525b5a-ovnkube-script-lib\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.834805 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.834654 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d9755014-b229-4b27-8e7c-a754e8729ed1-host\") pod \"node-ca-c5cwf\" (UID: \"d9755014-b229-4b27-8e7c-a754e8729ed1\") " pod="openshift-image-registry/node-ca-c5cwf" Jul 16 17:33:50.834805 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.834700 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-host-var-lib-cni-multus\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.834805 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.834737 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-host-run-multus-certs\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.834805 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.834765 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/122835d2-068b-4ef1-a09e-5f5dccd90a9f-system-cni-dir\") pod \"multus-additional-cni-plugins-vg8xg\" (UID: \"122835d2-068b-4ef1-a09e-5f5dccd90a9f\") " pod="openshift-multus/multus-additional-cni-plugins-vg8xg" Jul 16 17:33:50.834805 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.834791 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/122835d2-068b-4ef1-a09e-5f5dccd90a9f-cni-binary-copy\") pod \"multus-additional-cni-plugins-vg8xg\" (UID: \"122835d2-068b-4ef1-a09e-5f5dccd90a9f\") " pod="openshift-multus/multus-additional-cni-plugins-vg8xg" Jul 16 17:33:50.835090 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.834815 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-run-openvswitch\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.835090 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.834841 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-multus-cni-dir\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.835090 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.834864 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-cnibin\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.835090 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.834887 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-multus-socket-dir-parent\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.835090 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.834909 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-host-var-lib-cni-bin\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.835090 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.834931 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rlnv\" (UniqueName: \"kubernetes.io/projected/9ed27992-7654-4b37-9b2a-dc5aa5cb6dde-kube-api-access-2rlnv\") pod \"network-check-target-h8zgd\" (UID: \"9ed27992-7654-4b37-9b2a-dc5aa5cb6dde\") " pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:33:50.835090 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.834953 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-systemd-units\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.835090 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.834976 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-log-socket\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.835090 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835010 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-host-run-ovn-kubernetes\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.835090 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835042 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-os-release\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.835090 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835067 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-hostroot\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.835090 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835082 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f3ac9bba-8d89-4279-86fb-f26b11164aff-multus-daemon-config\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.835454 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835095 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/122835d2-068b-4ef1-a09e-5f5dccd90a9f-cnibin\") pod \"multus-additional-cni-plugins-vg8xg\" (UID: \"122835d2-068b-4ef1-a09e-5f5dccd90a9f\") " pod="openshift-multus/multus-additional-cni-plugins-vg8xg" Jul 16 17:33:50.835454 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835112 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-host-kubelet\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.835454 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835136 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.835454 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835151 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9ced5729-ce86-4189-90a5-161317525b5a-env-overrides\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.835454 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835164 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6szx\" (UniqueName: \"kubernetes.io/projected/9ced5729-ce86-4189-90a5-161317525b5a-kube-api-access-l6szx\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.835454 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835208 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f3ac9bba-8d89-4279-86fb-f26b11164aff-cni-binary-copy\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.835454 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835230 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-host-run-netns\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.835454 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835245 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf9qz\" (UniqueName: \"kubernetes.io/projected/f3ac9bba-8d89-4279-86fb-f26b11164aff-kube-api-access-xf9qz\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.835454 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835258 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-run-systemd\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.835454 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835284 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9ced5729-ce86-4189-90a5-161317525b5a-ovnkube-config\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.835454 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835304 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9ced5729-ce86-4189-90a5-161317525b5a-ovn-node-metrics-cert\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.835454 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835318 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-etc-kubernetes\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.835454 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835332 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-host-cni-bin\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.835454 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835373 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/122835d2-068b-4ef1-a09e-5f5dccd90a9f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vg8xg\" (UID: \"122835d2-068b-4ef1-a09e-5f5dccd90a9f\") " pod="openshift-multus/multus-additional-cni-plugins-vg8xg" Jul 16 17:33:50.835454 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835392 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9508dc3-c294-4959-bce4-6697f0ed0f0b-host-slash\") pod \"iptables-alerter-9qckj\" (UID: \"a9508dc3-c294-4959-bce4-6697f0ed0f0b\") " pod="openshift-network-operator/iptables-alerter-9qckj" Jul 16 17:33:50.835454 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835406 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-host-run-netns\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.836093 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835441 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-var-lib-openvswitch\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.836093 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835462 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d9755014-b229-4b27-8e7c-a754e8729ed1-serviceca\") pod \"node-ca-c5cwf\" (UID: \"d9755014-b229-4b27-8e7c-a754e8729ed1\") " pod="openshift-image-registry/node-ca-c5cwf" Jul 16 17:33:50.836093 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835476 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d2d7\" (UniqueName: \"kubernetes.io/projected/d9755014-b229-4b27-8e7c-a754e8729ed1-kube-api-access-8d2d7\") pod \"node-ca-c5cwf\" (UID: \"d9755014-b229-4b27-8e7c-a754e8729ed1\") " pod="openshift-image-registry/node-ca-c5cwf" Jul 16 17:33:50.836093 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835489 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-system-cni-dir\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.836093 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835519 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dddz8\" (UniqueName: \"kubernetes.io/projected/122835d2-068b-4ef1-a09e-5f5dccd90a9f-kube-api-access-dddz8\") pod \"multus-additional-cni-plugins-vg8xg\" (UID: \"122835d2-068b-4ef1-a09e-5f5dccd90a9f\") " pod="openshift-multus/multus-additional-cni-plugins-vg8xg" Jul 16 17:33:50.836093 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835538 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a9508dc3-c294-4959-bce4-6697f0ed0f0b-iptables-alerter-script\") pod \"iptables-alerter-9qckj\" (UID: \"a9508dc3-c294-4959-bce4-6697f0ed0f0b\") " pod="openshift-network-operator/iptables-alerter-9qckj" Jul 16 17:33:50.836093 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835552 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7577\" (UniqueName: \"kubernetes.io/projected/a9508dc3-c294-4959-bce4-6697f0ed0f0b-kube-api-access-q7577\") pod \"iptables-alerter-9qckj\" (UID: \"a9508dc3-c294-4959-bce4-6697f0ed0f0b\") " pod="openshift-network-operator/iptables-alerter-9qckj" Jul 16 17:33:50.836093 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835570 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-host-slash\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.836093 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835590 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-etc-openvswitch\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.836093 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835607 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-host-run-k8s-cni-cncf-io\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.836093 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835620 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/122835d2-068b-4ef1-a09e-5f5dccd90a9f-os-release\") pod \"multus-additional-cni-plugins-vg8xg\" (UID: \"122835d2-068b-4ef1-a09e-5f5dccd90a9f\") " pod="openshift-multus/multus-additional-cni-plugins-vg8xg" Jul 16 17:33:50.836093 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835635 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-run-ovn\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.836093 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835653 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-host-cni-netd\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.836093 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.835794 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" Jul 16 17:33:50.836585 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.836568 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 16 17:33:50.836647 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.836616 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6cv4n\"" Jul 16 17:33:50.836702 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.836617 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 16 17:33:50.836829 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.836796 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 16 17:33:50.836930 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.836848 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 16 17:33:50.836930 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.836805 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 16 17:33:50.836930 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.836882 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 16 17:33:50.836930 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.836912 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 16 17:33:50.837130 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.836957 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 16 17:33:50.837207 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.837192 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 16 17:33:50.837307 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.837295 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 16 17:33:50.837461 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.837443 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:50.838087 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.838071 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 16 17:33:50.838347 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.838323 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 16 17:33:50.838347 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.838326 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 16 17:33:50.838518 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.838326 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 16 17:33:50.838518 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.838330 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 16 17:33:50.838623 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.838541 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 16 17:33:50.838623 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.838583 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-scdbc\"" Jul 16 17:33:50.838623 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.838604 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bjpk6\"" Jul 16 17:33:50.838751 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.838663 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-t8s6w\"" Jul 16 17:33:50.838751 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.838717 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bx5hb\"" Jul 16 17:33:50.838848 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.838784 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 16 17:33:50.838848 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.838833 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cxq75" Jul 16 17:33:50.838940 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.838897 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 16 17:33:50.838940 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.838912 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 16 17:33:50.838940 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.838918 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hjxg2\"" Jul 16 17:33:50.839504 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.839482 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-54fnn\"" Jul 16 17:33:50.839561 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.839505 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 16 17:33:50.839561 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.839516 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 16 17:33:50.839945 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.839931 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:33:50.839986 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:50.839977 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xmt6" podUID="a4e3a253-031e-47d3-9ca3-18c97f49e614" Jul 16 17:33:50.848624 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.848607 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 16 17:33:50.848725 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.848607 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 16 17:33:50.848791 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.848783 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 16 17:33:50.848940 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.848895 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-5.ec2.internal"] Jul 16 17:33:50.848940 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.848943 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fqqxp\"" Jul 16 17:33:50.848940 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.848922 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 17:33:50.849133 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.849002 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-5.ec2.internal" Jul 16 17:33:50.849133 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.849023 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7fs69\"" Jul 16 17:33:50.849906 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.849867 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 16 17:33:50.863374 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.863331 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 17:28:49 +0000 UTC" deadline="2028-04-11 21:03:15.69943838 +0000 UTC" Jul 16 17:33:50.863374 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.863373 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15243h29m24.836067894s" Jul 16 17:33:50.864558 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.864544 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 17:33:50.876405 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.876387 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-5.ec2.internal"] Jul 16 17:33:50.876769 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.876758 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 17:33:50.894963 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.894947 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7tqrf" Jul 16 17:33:50.904110 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.904086 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7tqrf" Jul 16 17:33:50.931299 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.931278 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 16 17:33:50.936319 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.936302 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5e2940b7-973e-4343-82d8-2d720f2bb8ff-device-dir\") pod \"aws-ebs-csi-driver-node-v2ttk\" (UID: \"5e2940b7-973e-4343-82d8-2d720f2bb8ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" Jul 16 17:33:50.936396 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.936329 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-run-ovn\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.936396 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.936346 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-host-cni-netd\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.936396 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.936361 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8dbc1f99-f360-4ae6-8200-45ad3de61e8e-tmp-dir\") pod \"node-resolver-cxq75\" (UID: \"8dbc1f99-f360-4ae6-8200-45ad3de61e8e\") " pod="openshift-dns/node-resolver-cxq75" Jul 16 17:33:50.936520 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.936395 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fd1b005f-47c0-4006-abf5-b17419b94b2a-kubelet-config\") pod \"global-pull-secret-syncer-lrj7t\" (UID: \"fd1b005f-47c0-4006-abf5-b17419b94b2a\") " pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:33:50.936520 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.936407 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-host-cni-netd\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.936520 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.936437 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-node-log\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.936520 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.936454 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-run-ovn\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.936520 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.936463 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-etc-sysctl-d\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:50.936520 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.936485 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skv62\" (UniqueName: \"kubernetes.io/projected/a4e3a253-031e-47d3-9ca3-18c97f49e614-kube-api-access-skv62\") pod \"network-metrics-daemon-7xmt6\" (UID: \"a4e3a253-031e-47d3-9ca3-18c97f49e614\") " pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:33:50.936520 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.936500 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd1b005f-47c0-4006-abf5-b17419b94b2a-original-pull-secret\") pod \"global-pull-secret-syncer-lrj7t\" (UID: \"fd1b005f-47c0-4006-abf5-b17419b94b2a\") " pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:33:50.936520 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.936465 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-node-log\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.936520 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.936514 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvlhs\" (UniqueName: \"kubernetes.io/projected/5e2940b7-973e-4343-82d8-2d720f2bb8ff-kube-api-access-lvlhs\") pod \"aws-ebs-csi-driver-node-v2ttk\" (UID: \"5e2940b7-973e-4343-82d8-2d720f2bb8ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" Jul 16 17:33:50.936936 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.936533 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-cnibin\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.936936 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.936556 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-host-var-lib-cni-bin\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.936936 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.936620 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-hostroot\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.936936 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.936635 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f3ac9bba-8d89-4279-86fb-f26b11164aff-multus-daemon-config\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.936936 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.936660 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/17a0dfb8-ff8f-4f01-bde7-e1b177543374-konnectivity-ca\") pod \"konnectivity-agent-7prpm\" (UID: \"17a0dfb8-ff8f-4f01-bde7-e1b177543374\") " pod="kube-system/konnectivity-agent-7prpm" Jul 16 17:33:50.936936 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.936665 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-host-var-lib-cni-bin\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.936936 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.936676 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-etc-sysctl-conf\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:50.936936 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.936629 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-cnibin\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.936936 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.936711 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fd1b005f-47c0-4006-abf5-b17419b94b2a-dbus\") pod \"global-pull-secret-syncer-lrj7t\" (UID: \"fd1b005f-47c0-4006-abf5-b17419b94b2a\") " pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:33:50.936936 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.936723 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-hostroot\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.936936 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.936738 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5e2940b7-973e-4343-82d8-2d720f2bb8ff-etc-selinux\") pod \"aws-ebs-csi-driver-node-v2ttk\" (UID: \"5e2940b7-973e-4343-82d8-2d720f2bb8ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" Jul 16 17:33:50.936936 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.936854 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rlnv\" (UniqueName: \"kubernetes.io/projected/9ed27992-7654-4b37-9b2a-dc5aa5cb6dde-kube-api-access-2rlnv\") pod \"network-check-target-h8zgd\" (UID: \"9ed27992-7654-4b37-9b2a-dc5aa5cb6dde\") " pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:33:50.936936 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.936888 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-host-run-ovn-kubernetes\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.937602 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.936984 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-os-release\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.937602 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937004 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/122835d2-068b-4ef1-a09e-5f5dccd90a9f-cnibin\") pod \"multus-additional-cni-plugins-vg8xg\" (UID: \"122835d2-068b-4ef1-a09e-5f5dccd90a9f\") " pod="openshift-multus/multus-additional-cni-plugins-vg8xg" Jul 16 17:33:50.937602 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937019 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-host-kubelet\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.937602 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937021 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-host-run-ovn-kubernetes\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.937602 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937034 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6szx\" (UniqueName: \"kubernetes.io/projected/9ced5729-ce86-4189-90a5-161317525b5a-kube-api-access-l6szx\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.937602 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937049 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f3ac9bba-8d89-4279-86fb-f26b11164aff-cni-binary-copy\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.937602 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937061 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-run-systemd\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.937602 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937074 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/122835d2-068b-4ef1-a09e-5f5dccd90a9f-cnibin\") pod \"multus-additional-cni-plugins-vg8xg\" (UID: \"122835d2-068b-4ef1-a09e-5f5dccd90a9f\") " pod="openshift-multus/multus-additional-cni-plugins-vg8xg" Jul 16 17:33:50.937602 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937085 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-etc-sysconfig\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:50.937602 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937113 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-host-kubelet\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.937602 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937145 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-run-systemd\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.937602 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937186 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-var-lib-kubelet\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:50.937602 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937217 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-host-cni-bin\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.937602 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937238 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-os-release\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.937602 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937242 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-host-run-netns\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.937602 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937267 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-host-run-netns\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.937602 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937253 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-host-cni-bin\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.937602 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937279 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d2d7\" (UniqueName: \"kubernetes.io/projected/d9755014-b229-4b27-8e7c-a754e8729ed1-kube-api-access-8d2d7\") pod \"node-ca-c5cwf\" (UID: \"d9755014-b229-4b27-8e7c-a754e8729ed1\") " pod="openshift-image-registry/node-ca-c5cwf" Jul 16 17:33:50.938456 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937307 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-system-cni-dir\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.938456 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937332 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-etc-kubernetes\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:50.938456 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937364 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7577\" (UniqueName: \"kubernetes.io/projected/a9508dc3-c294-4959-bce4-6697f0ed0f0b-kube-api-access-q7577\") pod \"iptables-alerter-9qckj\" (UID: \"a9508dc3-c294-4959-bce4-6697f0ed0f0b\") " pod="openshift-network-operator/iptables-alerter-9qckj" Jul 16 17:33:50.938456 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937396 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-etc-openvswitch\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.938456 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937398 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-system-cni-dir\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.938456 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937444 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-host-run-k8s-cni-cncf-io\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.938456 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937453 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-etc-openvswitch\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.938456 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937473 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-host-var-lib-kubelet\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.938456 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937493 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-host-run-k8s-cni-cncf-io\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.938456 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937499 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-multus-conf-dir\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.938456 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937518 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-host-var-lib-kubelet\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.938456 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937524 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5e2940b7-973e-4343-82d8-2d720f2bb8ff-registration-dir\") pod \"aws-ebs-csi-driver-node-v2ttk\" (UID: \"5e2940b7-973e-4343-82d8-2d720f2bb8ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" Jul 16 17:33:50.938456 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937540 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-multus-conf-dir\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.938456 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937548 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5e2940b7-973e-4343-82d8-2d720f2bb8ff-sys-fs\") pod \"aws-ebs-csi-driver-node-v2ttk\" (UID: \"5e2940b7-973e-4343-82d8-2d720f2bb8ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" Jul 16 17:33:50.938456 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937573 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/122835d2-068b-4ef1-a09e-5f5dccd90a9f-os-release\") pod \"multus-additional-cni-plugins-vg8xg\" (UID: \"122835d2-068b-4ef1-a09e-5f5dccd90a9f\") " pod="openshift-multus/multus-additional-cni-plugins-vg8xg" Jul 16 17:33:50.938456 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937596 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8dbc1f99-f360-4ae6-8200-45ad3de61e8e-hosts-file\") pod \"node-resolver-cxq75\" (UID: \"8dbc1f99-f360-4ae6-8200-45ad3de61e8e\") " pod="openshift-dns/node-resolver-cxq75" Jul 16 17:33:50.938456 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937619 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/122835d2-068b-4ef1-a09e-5f5dccd90a9f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vg8xg\" (UID: \"122835d2-068b-4ef1-a09e-5f5dccd90a9f\") " pod="openshift-multus/multus-additional-cni-plugins-vg8xg" Jul 16 17:33:50.939256 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937633 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/122835d2-068b-4ef1-a09e-5f5dccd90a9f-os-release\") pod \"multus-additional-cni-plugins-vg8xg\" (UID: \"122835d2-068b-4ef1-a09e-5f5dccd90a9f\") " pod="openshift-multus/multus-additional-cni-plugins-vg8xg" Jul 16 17:33:50.939256 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937642 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/122835d2-068b-4ef1-a09e-5f5dccd90a9f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vg8xg\" (UID: \"122835d2-068b-4ef1-a09e-5f5dccd90a9f\") " pod="openshift-multus/multus-additional-cni-plugins-vg8xg" Jul 16 17:33:50.939256 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937679 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9ced5729-ce86-4189-90a5-161317525b5a-ovnkube-script-lib\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.939256 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937707 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d9755014-b229-4b27-8e7c-a754e8729ed1-host\") pod \"node-ca-c5cwf\" (UID: \"d9755014-b229-4b27-8e7c-a754e8729ed1\") " pod="openshift-image-registry/node-ca-c5cwf" Jul 16 17:33:50.939256 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937733 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/17a0dfb8-ff8f-4f01-bde7-e1b177543374-agent-certs\") pod \"konnectivity-agent-7prpm\" (UID: \"17a0dfb8-ff8f-4f01-bde7-e1b177543374\") " pod="kube-system/konnectivity-agent-7prpm" Jul 16 17:33:50.939256 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937758 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-lib-modules\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:50.939256 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937780 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-host\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:50.939256 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937806 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/122835d2-068b-4ef1-a09e-5f5dccd90a9f-system-cni-dir\") pod \"multus-additional-cni-plugins-vg8xg\" (UID: \"122835d2-068b-4ef1-a09e-5f5dccd90a9f\") " pod="openshift-multus/multus-additional-cni-plugins-vg8xg" Jul 16 17:33:50.939256 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937761 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d9755014-b229-4b27-8e7c-a754e8729ed1-host\") pod \"node-ca-c5cwf\" (UID: \"d9755014-b229-4b27-8e7c-a754e8729ed1\") " pod="openshift-image-registry/node-ca-c5cwf" Jul 16 17:33:50.939256 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937833 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/122835d2-068b-4ef1-a09e-5f5dccd90a9f-cni-binary-copy\") pod \"multus-additional-cni-plugins-vg8xg\" (UID: \"122835d2-068b-4ef1-a09e-5f5dccd90a9f\") " pod="openshift-multus/multus-additional-cni-plugins-vg8xg" Jul 16 17:33:50.939256 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937859 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-run-openvswitch\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.939256 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937874 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/122835d2-068b-4ef1-a09e-5f5dccd90a9f-system-cni-dir\") pod \"multus-additional-cni-plugins-vg8xg\" (UID: \"122835d2-068b-4ef1-a09e-5f5dccd90a9f\") " pod="openshift-multus/multus-additional-cni-plugins-vg8xg" Jul 16 17:33:50.939256 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937882 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-multus-cni-dir\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.939256 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937922 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-multus-socket-dir-parent\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.939256 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937948 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-systemd-units\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.939256 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937972 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-log-socket\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.939256 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937996 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-multus-socket-dir-parent\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.939926 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938024 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-systemd-units\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.939926 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938036 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-log-socket\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.939926 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.937997 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-sys\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:50.939926 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938069 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-etc-tuned\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:50.939926 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938082 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-run-openvswitch\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.939926 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938103 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5e2940b7-973e-4343-82d8-2d720f2bb8ff-socket-dir\") pod \"aws-ebs-csi-driver-node-v2ttk\" (UID: \"5e2940b7-973e-4343-82d8-2d720f2bb8ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" Jul 16 17:33:50.939926 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938032 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-multus-cni-dir\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.939926 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938131 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.939926 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938159 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9ced5729-ce86-4189-90a5-161317525b5a-env-overrides\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.939926 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938160 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9ced5729-ce86-4189-90a5-161317525b5a-ovnkube-script-lib\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.939926 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938182 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-host-run-netns\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.939926 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938199 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.939926 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938231 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf9qz\" (UniqueName: \"kubernetes.io/projected/f3ac9bba-8d89-4279-86fb-f26b11164aff-kube-api-access-xf9qz\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.939926 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938262 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-etc-systemd\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:50.939926 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938233 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-host-run-netns\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.939926 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938290 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-run\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:50.939926 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938316 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9ced5729-ce86-4189-90a5-161317525b5a-ovnkube-config\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.940579 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938431 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9ced5729-ce86-4189-90a5-161317525b5a-ovn-node-metrics-cert\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.940579 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938463 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-etc-kubernetes\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.940579 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938492 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-tmp\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:50.940579 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938519 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/122835d2-068b-4ef1-a09e-5f5dccd90a9f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vg8xg\" (UID: \"122835d2-068b-4ef1-a09e-5f5dccd90a9f\") " pod="openshift-multus/multus-additional-cni-plugins-vg8xg" Jul 16 17:33:50.940579 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938535 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-etc-kubernetes\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.940579 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938547 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9508dc3-c294-4959-bce4-6697f0ed0f0b-host-slash\") pod \"iptables-alerter-9qckj\" (UID: \"a9508dc3-c294-4959-bce4-6697f0ed0f0b\") " pod="openshift-network-operator/iptables-alerter-9qckj" Jul 16 17:33:50.940579 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938574 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-var-lib-openvswitch\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.940579 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938600 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d9755014-b229-4b27-8e7c-a754e8729ed1-serviceca\") pod \"node-ca-c5cwf\" (UID: \"d9755014-b229-4b27-8e7c-a754e8729ed1\") " pod="openshift-image-registry/node-ca-c5cwf" Jul 16 17:33:50.940579 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938620 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9508dc3-c294-4959-bce4-6697f0ed0f0b-host-slash\") pod \"iptables-alerter-9qckj\" (UID: \"a9508dc3-c294-4959-bce4-6697f0ed0f0b\") " pod="openshift-network-operator/iptables-alerter-9qckj" Jul 16 17:33:50.940579 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938631 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-host-var-lib-cni-multus\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.940579 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938657 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-host-run-multus-certs\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.940579 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938662 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-var-lib-openvswitch\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.940579 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938682 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbrdt\" (UniqueName: \"kubernetes.io/projected/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-kube-api-access-dbrdt\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:50.940579 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938702 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-host-var-lib-cni-multus\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.940579 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938708 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j52dq\" (UniqueName: \"kubernetes.io/projected/8dbc1f99-f360-4ae6-8200-45ad3de61e8e-kube-api-access-j52dq\") pod \"node-resolver-cxq75\" (UID: \"8dbc1f99-f360-4ae6-8200-45ad3de61e8e\") " pod="openshift-dns/node-resolver-cxq75" Jul 16 17:33:50.940579 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938713 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/122835d2-068b-4ef1-a09e-5f5dccd90a9f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vg8xg\" (UID: \"122835d2-068b-4ef1-a09e-5f5dccd90a9f\") " pod="openshift-multus/multus-additional-cni-plugins-vg8xg" Jul 16 17:33:50.940579 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938735 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dddz8\" (UniqueName: \"kubernetes.io/projected/122835d2-068b-4ef1-a09e-5f5dccd90a9f-kube-api-access-dddz8\") pod \"multus-additional-cni-plugins-vg8xg\" (UID: \"122835d2-068b-4ef1-a09e-5f5dccd90a9f\") " pod="openshift-multus/multus-additional-cni-plugins-vg8xg" Jul 16 17:33:50.941064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938759 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a9508dc3-c294-4959-bce4-6697f0ed0f0b-iptables-alerter-script\") pod \"iptables-alerter-9qckj\" (UID: \"a9508dc3-c294-4959-bce4-6697f0ed0f0b\") " pod="openshift-network-operator/iptables-alerter-9qckj" Jul 16 17:33:50.941064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938769 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f3ac9bba-8d89-4279-86fb-f26b11164aff-host-run-multus-certs\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.941064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938577 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9ced5729-ce86-4189-90a5-161317525b5a-env-overrides\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.941064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938825 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-host-slash\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.941064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938786 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9ced5729-ce86-4189-90a5-161317525b5a-host-slash\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.941064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938870 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-etc-modprobe-d\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:50.941064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938867 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 16 17:33:50.941064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938896 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4e3a253-031e-47d3-9ca3-18c97f49e614-metrics-certs\") pod \"network-metrics-daemon-7xmt6\" (UID: \"a4e3a253-031e-47d3-9ca3-18c97f49e614\") " pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:33:50.941064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938919 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5e2940b7-973e-4343-82d8-2d720f2bb8ff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v2ttk\" (UID: \"5e2940b7-973e-4343-82d8-2d720f2bb8ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" Jul 16 17:33:50.941064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.938919 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9ced5729-ce86-4189-90a5-161317525b5a-ovnkube-config\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.941064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.939050 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f3ac9bba-8d89-4279-86fb-f26b11164aff-cni-binary-copy\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.941064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.939079 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d9755014-b229-4b27-8e7c-a754e8729ed1-serviceca\") pod \"node-ca-c5cwf\" (UID: \"d9755014-b229-4b27-8e7c-a754e8729ed1\") " pod="openshift-image-registry/node-ca-c5cwf" Jul 16 17:33:50.941064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.939451 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a9508dc3-c294-4959-bce4-6697f0ed0f0b-iptables-alerter-script\") pod \"iptables-alerter-9qckj\" (UID: \"a9508dc3-c294-4959-bce4-6697f0ed0f0b\") " pod="openshift-network-operator/iptables-alerter-9qckj" Jul 16 17:33:50.941064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.939515 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f3ac9bba-8d89-4279-86fb-f26b11164aff-multus-daemon-config\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.941064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.939537 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/122835d2-068b-4ef1-a09e-5f5dccd90a9f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vg8xg\" (UID: \"122835d2-068b-4ef1-a09e-5f5dccd90a9f\") " pod="openshift-multus/multus-additional-cni-plugins-vg8xg" Jul 16 17:33:50.941064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.939622 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/122835d2-068b-4ef1-a09e-5f5dccd90a9f-cni-binary-copy\") pod \"multus-additional-cni-plugins-vg8xg\" (UID: \"122835d2-068b-4ef1-a09e-5f5dccd90a9f\") " pod="openshift-multus/multus-additional-cni-plugins-vg8xg" Jul 16 17:33:50.941064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.939644 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/122835d2-068b-4ef1-a09e-5f5dccd90a9f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vg8xg\" (UID: \"122835d2-068b-4ef1-a09e-5f5dccd90a9f\") " pod="openshift-multus/multus-additional-cni-plugins-vg8xg" Jul 16 17:33:50.941793 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.941776 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9ced5729-ce86-4189-90a5-161317525b5a-ovn-node-metrics-cert\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.949214 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.949191 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7577\" (UniqueName: \"kubernetes.io/projected/a9508dc3-c294-4959-bce4-6697f0ed0f0b-kube-api-access-q7577\") pod \"iptables-alerter-9qckj\" (UID: \"a9508dc3-c294-4959-bce4-6697f0ed0f0b\") " pod="openshift-network-operator/iptables-alerter-9qckj" Jul 16 17:33:50.951502 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.951481 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d2d7\" (UniqueName: \"kubernetes.io/projected/d9755014-b229-4b27-8e7c-a754e8729ed1-kube-api-access-8d2d7\") pod \"node-ca-c5cwf\" (UID: \"d9755014-b229-4b27-8e7c-a754e8729ed1\") " pod="openshift-image-registry/node-ca-c5cwf" Jul 16 17:33:50.951982 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:50.951966 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 17:33:50.952061 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:50.951986 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 17:33:50.952061 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:50.951997 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2rlnv for pod openshift-network-diagnostics/network-check-target-h8zgd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:33:50.952146 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:50.952062 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ed27992-7654-4b37-9b2a-dc5aa5cb6dde-kube-api-access-2rlnv podName:9ed27992-7654-4b37-9b2a-dc5aa5cb6dde nodeName:}" failed. No retries permitted until 2026-07-16 17:33:51.45204799 +0000 UTC m=+1.981472234 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2rlnv" (UniqueName: "kubernetes.io/projected/9ed27992-7654-4b37-9b2a-dc5aa5cb6dde-kube-api-access-2rlnv") pod "network-check-target-h8zgd" (UID: "9ed27992-7654-4b37-9b2a-dc5aa5cb6dde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:33:50.952398 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.952383 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf9qz\" (UniqueName: \"kubernetes.io/projected/f3ac9bba-8d89-4279-86fb-f26b11164aff-kube-api-access-xf9qz\") pod \"multus-5jnzr\" (UID: \"f3ac9bba-8d89-4279-86fb-f26b11164aff\") " pod="openshift-multus/multus-5jnzr" Jul 16 17:33:50.953695 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.953678 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6szx\" (UniqueName: \"kubernetes.io/projected/9ced5729-ce86-4189-90a5-161317525b5a-kube-api-access-l6szx\") pod \"ovnkube-node-qvlwv\" (UID: \"9ced5729-ce86-4189-90a5-161317525b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:50.957031 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:50.957013 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dddz8\" (UniqueName: \"kubernetes.io/projected/122835d2-068b-4ef1-a09e-5f5dccd90a9f-kube-api-access-dddz8\") pod \"multus-additional-cni-plugins-vg8xg\" (UID: \"122835d2-068b-4ef1-a09e-5f5dccd90a9f\") " pod="openshift-multus/multus-additional-cni-plugins-vg8xg" Jul 16 17:33:51.040167 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040147 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8dbc1f99-f360-4ae6-8200-45ad3de61e8e-tmp-dir\") pod \"node-resolver-cxq75\" (UID: \"8dbc1f99-f360-4ae6-8200-45ad3de61e8e\") " pod="openshift-dns/node-resolver-cxq75" Jul 16 17:33:51.040376 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040173 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fd1b005f-47c0-4006-abf5-b17419b94b2a-kubelet-config\") pod \"global-pull-secret-syncer-lrj7t\" (UID: \"fd1b005f-47c0-4006-abf5-b17419b94b2a\") " pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:33:51.040376 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040188 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-etc-sysctl-d\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.040376 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040206 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skv62\" (UniqueName: \"kubernetes.io/projected/a4e3a253-031e-47d3-9ca3-18c97f49e614-kube-api-access-skv62\") pod \"network-metrics-daemon-7xmt6\" (UID: \"a4e3a253-031e-47d3-9ca3-18c97f49e614\") " pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:33:51.040376 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040229 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd1b005f-47c0-4006-abf5-b17419b94b2a-original-pull-secret\") pod \"global-pull-secret-syncer-lrj7t\" (UID: \"fd1b005f-47c0-4006-abf5-b17419b94b2a\") " pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:33:51.040376 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040251 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvlhs\" (UniqueName: \"kubernetes.io/projected/5e2940b7-973e-4343-82d8-2d720f2bb8ff-kube-api-access-lvlhs\") pod \"aws-ebs-csi-driver-node-v2ttk\" (UID: \"5e2940b7-973e-4343-82d8-2d720f2bb8ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" Jul 16 17:33:51.040376 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040275 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/17a0dfb8-ff8f-4f01-bde7-e1b177543374-konnectivity-ca\") pod \"konnectivity-agent-7prpm\" (UID: \"17a0dfb8-ff8f-4f01-bde7-e1b177543374\") " pod="kube-system/konnectivity-agent-7prpm" Jul 16 17:33:51.040376 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040297 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-etc-sysctl-conf\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.040376 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040319 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fd1b005f-47c0-4006-abf5-b17419b94b2a-dbus\") pod \"global-pull-secret-syncer-lrj7t\" (UID: \"fd1b005f-47c0-4006-abf5-b17419b94b2a\") " pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:33:51.040376 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040329 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fd1b005f-47c0-4006-abf5-b17419b94b2a-kubelet-config\") pod \"global-pull-secret-syncer-lrj7t\" (UID: \"fd1b005f-47c0-4006-abf5-b17419b94b2a\") " pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:33:51.040376 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040340 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5e2940b7-973e-4343-82d8-2d720f2bb8ff-etc-selinux\") pod \"aws-ebs-csi-driver-node-v2ttk\" (UID: \"5e2940b7-973e-4343-82d8-2d720f2bb8ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" Jul 16 17:33:51.040376 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040331 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-etc-sysctl-d\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.040376 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:51.040375 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 17:33:51.041049 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040390 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-etc-sysconfig\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.041049 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040396 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fd1b005f-47c0-4006-abf5-b17419b94b2a-dbus\") pod \"global-pull-secret-syncer-lrj7t\" (UID: \"fd1b005f-47c0-4006-abf5-b17419b94b2a\") " pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:33:51.041049 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040430 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-var-lib-kubelet\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.041049 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040448 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-etc-sysctl-conf\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.041049 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:51.040455 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1b005f-47c0-4006-abf5-b17419b94b2a-original-pull-secret podName:fd1b005f-47c0-4006-abf5-b17419b94b2a nodeName:}" failed. No retries permitted until 2026-07-16 17:33:51.540436724 +0000 UTC m=+2.069860993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd1b005f-47c0-4006-abf5-b17419b94b2a-original-pull-secret") pod "global-pull-secret-syncer-lrj7t" (UID: "fd1b005f-47c0-4006-abf5-b17419b94b2a") : object "kube-system"/"original-pull-secret" not registered Jul 16 17:33:51.041049 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040476 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-var-lib-kubelet\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.041049 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040526 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-etc-kubernetes\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.041049 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040563 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5e2940b7-973e-4343-82d8-2d720f2bb8ff-registration-dir\") pod \"aws-ebs-csi-driver-node-v2ttk\" (UID: \"5e2940b7-973e-4343-82d8-2d720f2bb8ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" Jul 16 17:33:51.041049 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040571 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5e2940b7-973e-4343-82d8-2d720f2bb8ff-etc-selinux\") pod \"aws-ebs-csi-driver-node-v2ttk\" (UID: \"5e2940b7-973e-4343-82d8-2d720f2bb8ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" Jul 16 17:33:51.041049 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040574 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-etc-sysconfig\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.041049 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040591 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5e2940b7-973e-4343-82d8-2d720f2bb8ff-sys-fs\") pod \"aws-ebs-csi-driver-node-v2ttk\" (UID: \"5e2940b7-973e-4343-82d8-2d720f2bb8ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" Jul 16 17:33:51.041049 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040576 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8dbc1f99-f360-4ae6-8200-45ad3de61e8e-tmp-dir\") pod \"node-resolver-cxq75\" (UID: \"8dbc1f99-f360-4ae6-8200-45ad3de61e8e\") " pod="openshift-dns/node-resolver-cxq75" Jul 16 17:33:51.041049 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040612 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-etc-kubernetes\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.041049 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040630 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5e2940b7-973e-4343-82d8-2d720f2bb8ff-registration-dir\") pod \"aws-ebs-csi-driver-node-v2ttk\" (UID: \"5e2940b7-973e-4343-82d8-2d720f2bb8ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" Jul 16 17:33:51.041049 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040652 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5e2940b7-973e-4343-82d8-2d720f2bb8ff-sys-fs\") pod \"aws-ebs-csi-driver-node-v2ttk\" (UID: \"5e2940b7-973e-4343-82d8-2d720f2bb8ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" Jul 16 17:33:51.041049 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040680 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8dbc1f99-f360-4ae6-8200-45ad3de61e8e-hosts-file\") pod \"node-resolver-cxq75\" (UID: \"8dbc1f99-f360-4ae6-8200-45ad3de61e8e\") " pod="openshift-dns/node-resolver-cxq75" Jul 16 17:33:51.041049 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040705 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/17a0dfb8-ff8f-4f01-bde7-e1b177543374-agent-certs\") pod \"konnectivity-agent-7prpm\" (UID: \"17a0dfb8-ff8f-4f01-bde7-e1b177543374\") " pod="kube-system/konnectivity-agent-7prpm" Jul 16 17:33:51.041724 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040726 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8dbc1f99-f360-4ae6-8200-45ad3de61e8e-hosts-file\") pod \"node-resolver-cxq75\" (UID: \"8dbc1f99-f360-4ae6-8200-45ad3de61e8e\") " pod="openshift-dns/node-resolver-cxq75" Jul 16 17:33:51.041724 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040725 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-lib-modules\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.041724 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040755 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-host\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.041724 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040778 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-sys\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.041724 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040792 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-etc-tuned\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.041724 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040805 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5e2940b7-973e-4343-82d8-2d720f2bb8ff-socket-dir\") pod \"aws-ebs-csi-driver-node-v2ttk\" (UID: \"5e2940b7-973e-4343-82d8-2d720f2bb8ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" Jul 16 17:33:51.041724 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040825 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-etc-systemd\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.041724 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040846 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-lib-modules\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.041724 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040870 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-sys\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.041724 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040847 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-run\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.041724 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040909 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-tmp\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.041724 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040922 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-host\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.041724 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040925 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-etc-systemd\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.041724 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040937 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbrdt\" (UniqueName: \"kubernetes.io/projected/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-kube-api-access-dbrdt\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.041724 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040953 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5e2940b7-973e-4343-82d8-2d720f2bb8ff-socket-dir\") pod \"aws-ebs-csi-driver-node-v2ttk\" (UID: \"5e2940b7-973e-4343-82d8-2d720f2bb8ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" Jul 16 17:33:51.041724 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040944 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/17a0dfb8-ff8f-4f01-bde7-e1b177543374-konnectivity-ca\") pod \"konnectivity-agent-7prpm\" (UID: \"17a0dfb8-ff8f-4f01-bde7-e1b177543374\") " pod="kube-system/konnectivity-agent-7prpm" Jul 16 17:33:51.041724 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040970 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-run\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.041724 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.040964 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j52dq\" (UniqueName: \"kubernetes.io/projected/8dbc1f99-f360-4ae6-8200-45ad3de61e8e-kube-api-access-j52dq\") pod \"node-resolver-cxq75\" (UID: \"8dbc1f99-f360-4ae6-8200-45ad3de61e8e\") " pod="openshift-dns/node-resolver-cxq75" Jul 16 17:33:51.042291 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.041021 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-etc-modprobe-d\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.042291 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.041048 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4e3a253-031e-47d3-9ca3-18c97f49e614-metrics-certs\") pod \"network-metrics-daemon-7xmt6\" (UID: \"a4e3a253-031e-47d3-9ca3-18c97f49e614\") " pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:33:51.042291 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.041106 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5e2940b7-973e-4343-82d8-2d720f2bb8ff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v2ttk\" (UID: \"5e2940b7-973e-4343-82d8-2d720f2bb8ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" Jul 16 17:33:51.042291 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.041129 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5e2940b7-973e-4343-82d8-2d720f2bb8ff-device-dir\") pod \"aws-ebs-csi-driver-node-v2ttk\" (UID: \"5e2940b7-973e-4343-82d8-2d720f2bb8ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" Jul 16 17:33:51.042291 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.041164 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-etc-modprobe-d\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.042291 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.041203 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5e2940b7-973e-4343-82d8-2d720f2bb8ff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v2ttk\" (UID: \"5e2940b7-973e-4343-82d8-2d720f2bb8ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" Jul 16 17:33:51.042291 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:51.041210 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:33:51.042291 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.041257 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5e2940b7-973e-4343-82d8-2d720f2bb8ff-device-dir\") pod \"aws-ebs-csi-driver-node-v2ttk\" (UID: \"5e2940b7-973e-4343-82d8-2d720f2bb8ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" Jul 16 17:33:51.042291 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:51.041352 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e3a253-031e-47d3-9ca3-18c97f49e614-metrics-certs podName:a4e3a253-031e-47d3-9ca3-18c97f49e614 nodeName:}" failed. No retries permitted until 2026-07-16 17:33:51.541334527 +0000 UTC m=+2.070758771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4e3a253-031e-47d3-9ca3-18c97f49e614-metrics-certs") pod "network-metrics-daemon-7xmt6" (UID: "a4e3a253-031e-47d3-9ca3-18c97f49e614") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:33:51.042869 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.042854 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-etc-tuned\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.043304 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.043272 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-tmp\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.043505 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.043490 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/17a0dfb8-ff8f-4f01-bde7-e1b177543374-agent-certs\") pod \"konnectivity-agent-7prpm\" (UID: \"17a0dfb8-ff8f-4f01-bde7-e1b177543374\") " pod="kube-system/konnectivity-agent-7prpm" Jul 16 17:33:51.057439 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.057362 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbrdt\" (UniqueName: \"kubernetes.io/projected/c11bb9f3-bb53-4f79-974a-7c3ceff0db72-kube-api-access-dbrdt\") pod \"tuned-4d257\" (UID: \"c11bb9f3-bb53-4f79-974a-7c3ceff0db72\") " pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.059562 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.058031 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvlhs\" (UniqueName: \"kubernetes.io/projected/5e2940b7-973e-4343-82d8-2d720f2bb8ff-kube-api-access-lvlhs\") pod \"aws-ebs-csi-driver-node-v2ttk\" (UID: \"5e2940b7-973e-4343-82d8-2d720f2bb8ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" Jul 16 17:33:51.060237 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.060216 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j52dq\" (UniqueName: \"kubernetes.io/projected/8dbc1f99-f360-4ae6-8200-45ad3de61e8e-kube-api-access-j52dq\") pod \"node-resolver-cxq75\" (UID: \"8dbc1f99-f360-4ae6-8200-45ad3de61e8e\") " pod="openshift-dns/node-resolver-cxq75" Jul 16 17:33:51.061156 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.061129 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skv62\" (UniqueName: \"kubernetes.io/projected/a4e3a253-031e-47d3-9ca3-18c97f49e614-kube-api-access-skv62\") pod \"network-metrics-daemon-7xmt6\" (UID: \"a4e3a253-031e-47d3-9ca3-18c97f49e614\") " pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:33:51.082989 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:51.082951 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4c16c32a3c36fc19378959a9303c7f1.slice/crio-d4ead6146b15dfbb496618e7868a1051caa4053f834c71d86c1eb4d26917be05 WatchSource:0}: Error finding container d4ead6146b15dfbb496618e7868a1051caa4053f834c71d86c1eb4d26917be05: Status 404 returned error can't find the container with id d4ead6146b15dfbb496618e7868a1051caa4053f834c71d86c1eb4d26917be05 Jul 16 17:33:51.083723 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:51.083705 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32d0c91cee1c323b9c86d433cacd6006.slice/crio-eb6f02f470e31de31f9fd76b9376cea68e0b3add50a18388635b85fa5d654b79 WatchSource:0}: Error finding container eb6f02f470e31de31f9fd76b9376cea68e0b3add50a18388635b85fa5d654b79: Status 404 returned error can't find the container with id eb6f02f470e31de31f9fd76b9376cea68e0b3add50a18388635b85fa5d654b79 Jul 16 17:33:51.088589 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.088554 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 17:33:51.169815 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.169769 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c5cwf" Jul 16 17:33:51.174543 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.174527 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5jnzr" Jul 16 17:33:51.177696 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:51.177675 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9755014_b229_4b27_8e7c_a754e8729ed1.slice/crio-c8cf63a7f61c41a24e18a8f5670486b9d9d317d35bfbb8f76aa09bd4728135f1 WatchSource:0}: Error finding container c8cf63a7f61c41a24e18a8f5670486b9d9d317d35bfbb8f76aa09bd4728135f1: Status 404 returned error can't find the container with id c8cf63a7f61c41a24e18a8f5670486b9d9d317d35bfbb8f76aa09bd4728135f1 Jul 16 17:33:51.181180 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:51.181163 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3ac9bba_8d89_4279_86fb_f26b11164aff.slice/crio-916972a9cb40ab74673ca55f4c21434690f3f5e4f760876c72534d7eafa07076 WatchSource:0}: Error finding container 916972a9cb40ab74673ca55f4c21434690f3f5e4f760876c72534d7eafa07076: Status 404 returned error can't find the container with id 916972a9cb40ab74673ca55f4c21434690f3f5e4f760876c72534d7eafa07076 Jul 16 17:33:51.189584 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.189567 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vg8xg" Jul 16 17:33:51.197395 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:51.197377 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod122835d2_068b_4ef1_a09e_5f5dccd90a9f.slice/crio-21b1fe7c53c5df8eab4cf9f8109c5f9b738f4751e7f27f4e382e3c674288fe2a WatchSource:0}: Error finding container 21b1fe7c53c5df8eab4cf9f8109c5f9b738f4751e7f27f4e382e3c674288fe2a: Status 404 returned error can't find the container with id 21b1fe7c53c5df8eab4cf9f8109c5f9b738f4751e7f27f4e382e3c674288fe2a Jul 16 17:33:51.204293 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.204275 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9qckj" Jul 16 17:33:51.210507 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:51.210489 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9508dc3_c294_4959_bce4_6697f0ed0f0b.slice/crio-4548c6ea9792720199272e286fcbd50f6ec2dc92ccef6e0a8e398cdb19c33a23 WatchSource:0}: Error finding container 4548c6ea9792720199272e286fcbd50f6ec2dc92ccef6e0a8e398cdb19c33a23: Status 404 returned error can't find the container with id 4548c6ea9792720199272e286fcbd50f6ec2dc92ccef6e0a8e398cdb19c33a23 Jul 16 17:33:51.213251 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.213236 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:33:51.219707 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:51.219682 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ced5729_ce86_4189_90a5_161317525b5a.slice/crio-25334662e79d87b930fb08c1f8d2ec204c593ae57aa2719ef11889985d8632ba WatchSource:0}: Error finding container 25334662e79d87b930fb08c1f8d2ec204c593ae57aa2719ef11889985d8632ba: Status 404 returned error can't find the container with id 25334662e79d87b930fb08c1f8d2ec204c593ae57aa2719ef11889985d8632ba Jul 16 17:33:51.239352 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.239336 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7prpm" Jul 16 17:33:51.245517 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:51.245495 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17a0dfb8_ff8f_4f01_bde7_e1b177543374.slice/crio-82c52cdf5c6fd2e4253a0042294ab548da890ebb825678bdc08d51f72223ffa6 WatchSource:0}: Error finding container 82c52cdf5c6fd2e4253a0042294ab548da890ebb825678bdc08d51f72223ffa6: Status 404 returned error can't find the container with id 82c52cdf5c6fd2e4253a0042294ab548da890ebb825678bdc08d51f72223ffa6 Jul 16 17:33:51.263072 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.263055 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" Jul 16 17:33:51.268987 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:51.268970 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e2940b7_973e_4343_82d8_2d720f2bb8ff.slice/crio-460837d889114a23623ad57d52bd2b5feccfa45ef468c0d9ecffa3b8a2a72da4 WatchSource:0}: Error finding container 460837d889114a23623ad57d52bd2b5feccfa45ef468c0d9ecffa3b8a2a72da4: Status 404 returned error can't find the container with id 460837d889114a23623ad57d52bd2b5feccfa45ef468c0d9ecffa3b8a2a72da4 Jul 16 17:33:51.271732 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.271632 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4d257" Jul 16 17:33:51.275735 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.275721 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cxq75" Jul 16 17:33:51.278241 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:51.278222 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc11bb9f3_bb53_4f79_974a_7c3ceff0db72.slice/crio-0215ec08e9d9fe33182bf851fe015dba71309586356cee7f930c7a3d8f01c309 WatchSource:0}: Error finding container 0215ec08e9d9fe33182bf851fe015dba71309586356cee7f930c7a3d8f01c309: Status 404 returned error can't find the container with id 0215ec08e9d9fe33182bf851fe015dba71309586356cee7f930c7a3d8f01c309 Jul 16 17:33:51.282302 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:33:51.282283 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dbc1f99_f360_4ae6_8200_45ad3de61e8e.slice/crio-5979b27dcbbebdd8918324d72ca8a8fd0896d784bc547634b0f5c72b1c0f7e6d WatchSource:0}: Error finding container 5979b27dcbbebdd8918324d72ca8a8fd0896d784bc547634b0f5c72b1c0f7e6d: Status 404 returned error can't find the container with id 5979b27dcbbebdd8918324d72ca8a8fd0896d784bc547634b0f5c72b1c0f7e6d Jul 16 17:33:51.283791 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:51.283775 2578 kuberuntime_manager.go:1459] "Unhandled Error" err="container dns-node-resolver start failed in pod node-resolver-cxq75_openshift-dns(8dbc1f99-f360-4ae6-8200-45ad3de61e8e): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Jul 16 17:33:51.283841 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:51.283803 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-dns/node-resolver-cxq75" podUID="8dbc1f99-f360-4ae6-8200-45ad3de61e8e" Jul 16 17:33:51.545127 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.545022 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4e3a253-031e-47d3-9ca3-18c97f49e614-metrics-certs\") pod \"network-metrics-daemon-7xmt6\" (UID: \"a4e3a253-031e-47d3-9ca3-18c97f49e614\") " pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:33:51.545127 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.545115 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd1b005f-47c0-4006-abf5-b17419b94b2a-original-pull-secret\") pod \"global-pull-secret-syncer-lrj7t\" (UID: \"fd1b005f-47c0-4006-abf5-b17419b94b2a\") " pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:33:51.545389 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.545156 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rlnv\" (UniqueName: \"kubernetes.io/projected/9ed27992-7654-4b37-9b2a-dc5aa5cb6dde-kube-api-access-2rlnv\") pod \"network-check-target-h8zgd\" (UID: \"9ed27992-7654-4b37-9b2a-dc5aa5cb6dde\") " pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:33:51.545389 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:51.545329 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 17:33:51.545389 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:51.545351 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 17:33:51.545389 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:51.545363 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2rlnv for pod openshift-network-diagnostics/network-check-target-h8zgd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:33:51.545616 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:51.545460 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ed27992-7654-4b37-9b2a-dc5aa5cb6dde-kube-api-access-2rlnv podName:9ed27992-7654-4b37-9b2a-dc5aa5cb6dde nodeName:}" failed. No retries permitted until 2026-07-16 17:33:52.545439719 +0000 UTC m=+3.074863968 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2rlnv" (UniqueName: "kubernetes.io/projected/9ed27992-7654-4b37-9b2a-dc5aa5cb6dde-kube-api-access-2rlnv") pod "network-check-target-h8zgd" (UID: "9ed27992-7654-4b37-9b2a-dc5aa5cb6dde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:33:51.545942 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:51.545847 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 17:33:51.545942 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:51.545877 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:33:51.545942 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:51.545910 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1b005f-47c0-4006-abf5-b17419b94b2a-original-pull-secret podName:fd1b005f-47c0-4006-abf5-b17419b94b2a nodeName:}" failed. No retries permitted until 2026-07-16 17:33:52.545891203 +0000 UTC m=+3.075315478 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd1b005f-47c0-4006-abf5-b17419b94b2a-original-pull-secret") pod "global-pull-secret-syncer-lrj7t" (UID: "fd1b005f-47c0-4006-abf5-b17419b94b2a") : object "kube-system"/"original-pull-secret" not registered Jul 16 17:33:51.545942 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:51.545928 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e3a253-031e-47d3-9ca3-18c97f49e614-metrics-certs podName:a4e3a253-031e-47d3-9ca3-18c97f49e614 nodeName:}" failed. No retries permitted until 2026-07-16 17:33:52.545919244 +0000 UTC m=+3.075343484 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4e3a253-031e-47d3-9ca3-18c97f49e614-metrics-certs") pod "network-metrics-daemon-7xmt6" (UID: "a4e3a253-031e-47d3-9ca3-18c97f49e614") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:33:51.906841 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.906750 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 17:28:50 +0000 UTC" deadline="2027-12-15 13:37:27.622461886 +0000 UTC" Jul 16 17:33:51.906841 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:51.906789 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12404h3m35.71567705s" Jul 16 17:33:52.028228 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:52.028197 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:33:52.028369 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:52.028336 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h8zgd" podUID="9ed27992-7654-4b37-9b2a-dc5aa5cb6dde" Jul 16 17:33:52.044896 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:52.044800 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" event={"ID":"5e2940b7-973e-4343-82d8-2d720f2bb8ff","Type":"ContainerStarted","Data":"460837d889114a23623ad57d52bd2b5feccfa45ef468c0d9ecffa3b8a2a72da4"} Jul 16 17:33:52.047047 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:52.047019 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" event={"ID":"9ced5729-ce86-4189-90a5-161317525b5a","Type":"ContainerStarted","Data":"25334662e79d87b930fb08c1f8d2ec204c593ae57aa2719ef11889985d8632ba"} Jul 16 17:33:52.050534 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:52.050508 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9qckj" event={"ID":"a9508dc3-c294-4959-bce4-6697f0ed0f0b","Type":"ContainerStarted","Data":"4548c6ea9792720199272e286fcbd50f6ec2dc92ccef6e0a8e398cdb19c33a23"} Jul 16 17:33:52.056540 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:52.056515 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vg8xg" event={"ID":"122835d2-068b-4ef1-a09e-5f5dccd90a9f","Type":"ContainerStarted","Data":"21b1fe7c53c5df8eab4cf9f8109c5f9b738f4751e7f27f4e382e3c674288fe2a"} Jul 16 17:33:52.064567 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:52.064543 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c5cwf" event={"ID":"d9755014-b229-4b27-8e7c-a754e8729ed1","Type":"ContainerStarted","Data":"c8cf63a7f61c41a24e18a8f5670486b9d9d317d35bfbb8f76aa09bd4728135f1"} Jul 16 17:33:52.067489 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:52.067466 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-5.ec2.internal" event={"ID":"32d0c91cee1c323b9c86d433cacd6006","Type":"ContainerStarted","Data":"eb6f02f470e31de31f9fd76b9376cea68e0b3add50a18388635b85fa5d654b79"} Jul 16 17:33:52.071089 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:52.070993 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cxq75" event={"ID":"8dbc1f99-f360-4ae6-8200-45ad3de61e8e","Type":"ContainerStarted","Data":"5979b27dcbbebdd8918324d72ca8a8fd0896d784bc547634b0f5c72b1c0f7e6d"} Jul 16 17:33:52.076227 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:52.076200 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:81e3f2576c5145aebf33f0a2d300aef8b70217b00c31101b55ed112e7e2d0087\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-dns/node-resolver-cxq75" podUID="8dbc1f99-f360-4ae6-8200-45ad3de61e8e" Jul 16 17:33:52.079721 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:52.079688 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4d257" event={"ID":"c11bb9f3-bb53-4f79-974a-7c3ceff0db72","Type":"ContainerStarted","Data":"0215ec08e9d9fe33182bf851fe015dba71309586356cee7f930c7a3d8f01c309"} Jul 16 17:33:52.085737 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:52.085714 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7prpm" event={"ID":"17a0dfb8-ff8f-4f01-bde7-e1b177543374","Type":"ContainerStarted","Data":"82c52cdf5c6fd2e4253a0042294ab548da890ebb825678bdc08d51f72223ffa6"} Jul 16 17:33:52.092622 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:52.092599 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5jnzr" event={"ID":"f3ac9bba-8d89-4279-86fb-f26b11164aff","Type":"ContainerStarted","Data":"916972a9cb40ab74673ca55f4c21434690f3f5e4f760876c72534d7eafa07076"} Jul 16 17:33:52.096821 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:52.096776 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-5.ec2.internal" event={"ID":"d4c16c32a3c36fc19378959a9303c7f1","Type":"ContainerStarted","Data":"d4ead6146b15dfbb496618e7868a1051caa4053f834c71d86c1eb4d26917be05"} Jul 16 17:33:52.331732 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:52.331461 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 17:33:52.553623 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:52.553585 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4e3a253-031e-47d3-9ca3-18c97f49e614-metrics-certs\") pod \"network-metrics-daemon-7xmt6\" (UID: \"a4e3a253-031e-47d3-9ca3-18c97f49e614\") " pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:33:52.553801 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:52.553643 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd1b005f-47c0-4006-abf5-b17419b94b2a-original-pull-secret\") pod \"global-pull-secret-syncer-lrj7t\" (UID: \"fd1b005f-47c0-4006-abf5-b17419b94b2a\") " pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:33:52.553801 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:52.553680 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rlnv\" (UniqueName: \"kubernetes.io/projected/9ed27992-7654-4b37-9b2a-dc5aa5cb6dde-kube-api-access-2rlnv\") pod \"network-check-target-h8zgd\" (UID: \"9ed27992-7654-4b37-9b2a-dc5aa5cb6dde\") " pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:33:52.553910 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:52.553834 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 17:33:52.553910 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:52.553852 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 17:33:52.553910 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:52.553865 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2rlnv for pod openshift-network-diagnostics/network-check-target-h8zgd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:33:52.554055 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:52.553919 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ed27992-7654-4b37-9b2a-dc5aa5cb6dde-kube-api-access-2rlnv podName:9ed27992-7654-4b37-9b2a-dc5aa5cb6dde nodeName:}" failed. No retries permitted until 2026-07-16 17:33:54.553901638 +0000 UTC m=+5.083325898 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2rlnv" (UniqueName: "kubernetes.io/projected/9ed27992-7654-4b37-9b2a-dc5aa5cb6dde-kube-api-access-2rlnv") pod "network-check-target-h8zgd" (UID: "9ed27992-7654-4b37-9b2a-dc5aa5cb6dde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:33:52.554313 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:52.554294 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:33:52.554378 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:52.554347 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e3a253-031e-47d3-9ca3-18c97f49e614-metrics-certs podName:a4e3a253-031e-47d3-9ca3-18c97f49e614 nodeName:}" failed. No retries permitted until 2026-07-16 17:33:54.554332249 +0000 UTC m=+5.083756495 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4e3a253-031e-47d3-9ca3-18c97f49e614-metrics-certs") pod "network-metrics-daemon-7xmt6" (UID: "a4e3a253-031e-47d3-9ca3-18c97f49e614") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:33:52.554503 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:52.554398 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 17:33:52.554503 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:52.554444 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1b005f-47c0-4006-abf5-b17419b94b2a-original-pull-secret podName:fd1b005f-47c0-4006-abf5-b17419b94b2a nodeName:}" failed. No retries permitted until 2026-07-16 17:33:54.554433235 +0000 UTC m=+5.083857479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd1b005f-47c0-4006-abf5-b17419b94b2a-original-pull-secret") pod "global-pull-secret-syncer-lrj7t" (UID: "fd1b005f-47c0-4006-abf5-b17419b94b2a") : object "kube-system"/"original-pull-secret" not registered Jul 16 17:33:52.906967 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:52.906907 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 17:28:50 +0000 UTC" deadline="2027-12-19 11:01:18.918034256 +0000 UTC" Jul 16 17:33:52.906967 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:52.906967 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12497h27m26.011070941s" Jul 16 17:33:53.028320 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:53.028290 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:33:53.028511 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:53.028441 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xmt6" podUID="a4e3a253-031e-47d3-9ca3-18c97f49e614" Jul 16 17:33:53.028837 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:53.028819 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:33:53.028936 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:53.028917 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrj7t" podUID="fd1b005f-47c0-4006-abf5-b17419b94b2a" Jul 16 17:33:54.030222 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:54.030192 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:33:54.030667 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:54.030343 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h8zgd" podUID="9ed27992-7654-4b37-9b2a-dc5aa5cb6dde" Jul 16 17:33:54.570217 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:54.570132 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4e3a253-031e-47d3-9ca3-18c97f49e614-metrics-certs\") pod \"network-metrics-daemon-7xmt6\" (UID: \"a4e3a253-031e-47d3-9ca3-18c97f49e614\") " pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:33:54.570217 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:54.570195 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd1b005f-47c0-4006-abf5-b17419b94b2a-original-pull-secret\") pod \"global-pull-secret-syncer-lrj7t\" (UID: \"fd1b005f-47c0-4006-abf5-b17419b94b2a\") " pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:33:54.570443 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:54.570258 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rlnv\" (UniqueName: \"kubernetes.io/projected/9ed27992-7654-4b37-9b2a-dc5aa5cb6dde-kube-api-access-2rlnv\") pod \"network-check-target-h8zgd\" (UID: \"9ed27992-7654-4b37-9b2a-dc5aa5cb6dde\") " pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:33:54.570510 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:54.570476 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 17:33:54.570510 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:54.570496 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 17:33:54.570510 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:54.570508 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2rlnv for pod openshift-network-diagnostics/network-check-target-h8zgd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:33:54.570668 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:54.570569 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ed27992-7654-4b37-9b2a-dc5aa5cb6dde-kube-api-access-2rlnv podName:9ed27992-7654-4b37-9b2a-dc5aa5cb6dde nodeName:}" failed. No retries permitted until 2026-07-16 17:33:58.570550031 +0000 UTC m=+9.099974295 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2rlnv" (UniqueName: "kubernetes.io/projected/9ed27992-7654-4b37-9b2a-dc5aa5cb6dde-kube-api-access-2rlnv") pod "network-check-target-h8zgd" (UID: "9ed27992-7654-4b37-9b2a-dc5aa5cb6dde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:33:54.571055 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:54.570971 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:33:54.571055 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:54.571034 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e3a253-031e-47d3-9ca3-18c97f49e614-metrics-certs podName:a4e3a253-031e-47d3-9ca3-18c97f49e614 nodeName:}" failed. No retries permitted until 2026-07-16 17:33:58.571015441 +0000 UTC m=+9.100439680 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4e3a253-031e-47d3-9ca3-18c97f49e614-metrics-certs") pod "network-metrics-daemon-7xmt6" (UID: "a4e3a253-031e-47d3-9ca3-18c97f49e614") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:33:54.571242 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:54.571109 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 17:33:54.571242 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:54.571158 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1b005f-47c0-4006-abf5-b17419b94b2a-original-pull-secret podName:fd1b005f-47c0-4006-abf5-b17419b94b2a nodeName:}" failed. No retries permitted until 2026-07-16 17:33:58.571144371 +0000 UTC m=+9.100568614 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd1b005f-47c0-4006-abf5-b17419b94b2a-original-pull-secret") pod "global-pull-secret-syncer-lrj7t" (UID: "fd1b005f-47c0-4006-abf5-b17419b94b2a") : object "kube-system"/"original-pull-secret" not registered Jul 16 17:33:55.028726 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:55.028659 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:33:55.028858 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:55.028659 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:33:55.028858 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:55.028801 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrj7t" podUID="fd1b005f-47c0-4006-abf5-b17419b94b2a" Jul 16 17:33:55.028966 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:55.028909 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xmt6" podUID="a4e3a253-031e-47d3-9ca3-18c97f49e614" Jul 16 17:33:56.028035 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:56.028001 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:33:56.028517 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:56.028144 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h8zgd" podUID="9ed27992-7654-4b37-9b2a-dc5aa5cb6dde" Jul 16 17:33:57.028733 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:57.028229 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:33:57.028733 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:57.028360 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xmt6" podUID="a4e3a253-031e-47d3-9ca3-18c97f49e614" Jul 16 17:33:57.029236 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:57.028755 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:33:57.029236 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:57.028854 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrj7t" podUID="fd1b005f-47c0-4006-abf5-b17419b94b2a" Jul 16 17:33:58.028230 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:58.028202 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:33:58.028396 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:58.028321 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h8zgd" podUID="9ed27992-7654-4b37-9b2a-dc5aa5cb6dde" Jul 16 17:33:58.603998 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:58.603072 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4e3a253-031e-47d3-9ca3-18c97f49e614-metrics-certs\") pod \"network-metrics-daemon-7xmt6\" (UID: \"a4e3a253-031e-47d3-9ca3-18c97f49e614\") " pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:33:58.603998 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:58.603132 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd1b005f-47c0-4006-abf5-b17419b94b2a-original-pull-secret\") pod \"global-pull-secret-syncer-lrj7t\" (UID: \"fd1b005f-47c0-4006-abf5-b17419b94b2a\") " pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:33:58.603998 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:58.603168 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rlnv\" (UniqueName: \"kubernetes.io/projected/9ed27992-7654-4b37-9b2a-dc5aa5cb6dde-kube-api-access-2rlnv\") pod \"network-check-target-h8zgd\" (UID: \"9ed27992-7654-4b37-9b2a-dc5aa5cb6dde\") " pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:33:58.603998 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:58.603326 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 17:33:58.603998 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:58.603343 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 17:33:58.603998 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:58.603356 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2rlnv for pod openshift-network-diagnostics/network-check-target-h8zgd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:33:58.603998 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:58.603411 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ed27992-7654-4b37-9b2a-dc5aa5cb6dde-kube-api-access-2rlnv podName:9ed27992-7654-4b37-9b2a-dc5aa5cb6dde nodeName:}" failed. No retries permitted until 2026-07-16 17:34:06.603392816 +0000 UTC m=+17.132817073 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2rlnv" (UniqueName: "kubernetes.io/projected/9ed27992-7654-4b37-9b2a-dc5aa5cb6dde-kube-api-access-2rlnv") pod "network-check-target-h8zgd" (UID: "9ed27992-7654-4b37-9b2a-dc5aa5cb6dde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:33:58.603998 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:58.603823 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:33:58.603998 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:58.603871 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e3a253-031e-47d3-9ca3-18c97f49e614-metrics-certs podName:a4e3a253-031e-47d3-9ca3-18c97f49e614 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:06.603855709 +0000 UTC m=+17.133279958 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4e3a253-031e-47d3-9ca3-18c97f49e614-metrics-certs") pod "network-metrics-daemon-7xmt6" (UID: "a4e3a253-031e-47d3-9ca3-18c97f49e614") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:33:58.603998 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:58.603929 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 17:33:58.603998 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:58.603963 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1b005f-47c0-4006-abf5-b17419b94b2a-original-pull-secret podName:fd1b005f-47c0-4006-abf5-b17419b94b2a nodeName:}" failed. No retries permitted until 2026-07-16 17:34:06.60395204 +0000 UTC m=+17.133376295 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd1b005f-47c0-4006-abf5-b17419b94b2a-original-pull-secret") pod "global-pull-secret-syncer-lrj7t" (UID: "fd1b005f-47c0-4006-abf5-b17419b94b2a") : object "kube-system"/"original-pull-secret" not registered Jul 16 17:33:59.028296 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:59.028148 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:33:59.028296 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:33:59.028199 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:33:59.028555 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:59.028297 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xmt6" podUID="a4e3a253-031e-47d3-9ca3-18c97f49e614" Jul 16 17:33:59.028625 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:33:59.028557 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrj7t" podUID="fd1b005f-47c0-4006-abf5-b17419b94b2a" Jul 16 17:34:00.029776 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:00.029314 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:34:00.029776 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:00.029434 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h8zgd" podUID="9ed27992-7654-4b37-9b2a-dc5aa5cb6dde" Jul 16 17:34:01.028067 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:01.027867 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:34:01.028245 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:01.027903 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:34:01.028245 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:01.028137 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrj7t" podUID="fd1b005f-47c0-4006-abf5-b17419b94b2a" Jul 16 17:34:01.028344 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:01.028251 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xmt6" podUID="a4e3a253-031e-47d3-9ca3-18c97f49e614" Jul 16 17:34:02.028580 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:02.028514 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:34:02.028980 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:02.028646 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h8zgd" podUID="9ed27992-7654-4b37-9b2a-dc5aa5cb6dde" Jul 16 17:34:03.028321 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:03.028291 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:34:03.028512 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:03.028336 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:34:03.028512 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:03.028483 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xmt6" podUID="a4e3a253-031e-47d3-9ca3-18c97f49e614" Jul 16 17:34:03.028640 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:03.028586 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrj7t" podUID="fd1b005f-47c0-4006-abf5-b17419b94b2a" Jul 16 17:34:04.028523 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:04.028489 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:34:04.028694 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:04.028621 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h8zgd" podUID="9ed27992-7654-4b37-9b2a-dc5aa5cb6dde" Jul 16 17:34:05.028657 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:05.028620 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:34:05.028846 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:05.028624 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:34:05.028846 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:05.028748 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrj7t" podUID="fd1b005f-47c0-4006-abf5-b17419b94b2a" Jul 16 17:34:05.029260 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:05.028841 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xmt6" podUID="a4e3a253-031e-47d3-9ca3-18c97f49e614" Jul 16 17:34:06.028196 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:06.028155 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:34:06.028400 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:06.028294 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h8zgd" podUID="9ed27992-7654-4b37-9b2a-dc5aa5cb6dde" Jul 16 17:34:06.668621 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:06.668542 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rlnv\" (UniqueName: \"kubernetes.io/projected/9ed27992-7654-4b37-9b2a-dc5aa5cb6dde-kube-api-access-2rlnv\") pod \"network-check-target-h8zgd\" (UID: \"9ed27992-7654-4b37-9b2a-dc5aa5cb6dde\") " pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:34:06.668621 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:06.668612 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4e3a253-031e-47d3-9ca3-18c97f49e614-metrics-certs\") pod \"network-metrics-daemon-7xmt6\" (UID: \"a4e3a253-031e-47d3-9ca3-18c97f49e614\") " pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:34:06.668979 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:06.668642 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd1b005f-47c0-4006-abf5-b17419b94b2a-original-pull-secret\") pod \"global-pull-secret-syncer-lrj7t\" (UID: \"fd1b005f-47c0-4006-abf5-b17419b94b2a\") " pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:34:06.668979 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:06.668714 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 17:34:06.668979 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:06.668754 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:34:06.668979 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:06.668771 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1b005f-47c0-4006-abf5-b17419b94b2a-original-pull-secret podName:fd1b005f-47c0-4006-abf5-b17419b94b2a nodeName:}" failed. No retries permitted until 2026-07-16 17:34:22.668757082 +0000 UTC m=+33.198181326 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd1b005f-47c0-4006-abf5-b17419b94b2a-original-pull-secret") pod "global-pull-secret-syncer-lrj7t" (UID: "fd1b005f-47c0-4006-abf5-b17419b94b2a") : object "kube-system"/"original-pull-secret" not registered Jul 16 17:34:06.668979 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:06.668715 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 17:34:06.668979 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:06.668818 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e3a253-031e-47d3-9ca3-18c97f49e614-metrics-certs podName:a4e3a253-031e-47d3-9ca3-18c97f49e614 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:22.668803623 +0000 UTC m=+33.198227867 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4e3a253-031e-47d3-9ca3-18c97f49e614-metrics-certs") pod "network-metrics-daemon-7xmt6" (UID: "a4e3a253-031e-47d3-9ca3-18c97f49e614") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:34:06.668979 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:06.668822 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 17:34:06.668979 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:06.668836 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2rlnv for pod openshift-network-diagnostics/network-check-target-h8zgd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:34:06.668979 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:06.668874 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ed27992-7654-4b37-9b2a-dc5aa5cb6dde-kube-api-access-2rlnv podName:9ed27992-7654-4b37-9b2a-dc5aa5cb6dde nodeName:}" failed. No retries permitted until 2026-07-16 17:34:22.668862444 +0000 UTC m=+33.198286700 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2rlnv" (UniqueName: "kubernetes.io/projected/9ed27992-7654-4b37-9b2a-dc5aa5cb6dde-kube-api-access-2rlnv") pod "network-check-target-h8zgd" (UID: "9ed27992-7654-4b37-9b2a-dc5aa5cb6dde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:34:07.028156 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:07.028081 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:34:07.028311 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:07.028212 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xmt6" podUID="a4e3a253-031e-47d3-9ca3-18c97f49e614" Jul 16 17:34:07.028311 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:07.028271 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:34:07.028452 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:07.028385 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrj7t" podUID="fd1b005f-47c0-4006-abf5-b17419b94b2a" Jul 16 17:34:08.028562 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:08.028532 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:34:08.029031 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:08.028653 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h8zgd" podUID="9ed27992-7654-4b37-9b2a-dc5aa5cb6dde" Jul 16 17:34:09.028128 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:09.028100 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:34:09.028312 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:09.028100 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:34:09.028312 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:09.028234 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xmt6" podUID="a4e3a253-031e-47d3-9ca3-18c97f49e614" Jul 16 17:34:09.028312 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:09.028293 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrj7t" podUID="fd1b005f-47c0-4006-abf5-b17419b94b2a" Jul 16 17:34:10.028592 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:10.028555 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:34:10.028985 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:10.028671 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h8zgd" podUID="9ed27992-7654-4b37-9b2a-dc5aa5cb6dde" Jul 16 17:34:11.027815 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:11.027776 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:34:11.027947 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:11.027899 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrj7t" podUID="fd1b005f-47c0-4006-abf5-b17419b94b2a" Jul 16 17:34:11.028276 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:11.028249 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:34:11.028391 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:11.028369 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xmt6" podUID="a4e3a253-031e-47d3-9ca3-18c97f49e614" Jul 16 17:34:11.133435 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:11.133151 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4d257" event={"ID":"c11bb9f3-bb53-4f79-974a-7c3ceff0db72","Type":"ContainerStarted","Data":"04a33d30a7dd85784c47eb2566fed78caa421c14eae901473272fc2327d44690"} Jul 16 17:34:11.138713 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:11.138358 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5jnzr" event={"ID":"f3ac9bba-8d89-4279-86fb-f26b11164aff","Type":"ContainerStarted","Data":"7a499638ec6351b95b68979a2440d2561c96c6b5e75e963a7e14e3a844764efc"} Jul 16 17:34:11.141109 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:11.140730 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-5.ec2.internal" event={"ID":"d4c16c32a3c36fc19378959a9303c7f1","Type":"ContainerStarted","Data":"6b305bf2a6fc7708e90950263dc9eead8b7f03810976e04e6c7493b3911e9dd0"} Jul 16 17:34:11.143009 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:11.142984 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" event={"ID":"9ced5729-ce86-4189-90a5-161317525b5a","Type":"ContainerStarted","Data":"b8817b94dc37673a08f707fc7b6dad37d3c2d6c0bf39c7e10a1bfb27b66905fd"} Jul 16 17:34:11.143084 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:11.143064 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" event={"ID":"9ced5729-ce86-4189-90a5-161317525b5a","Type":"ContainerStarted","Data":"c1321c4dc7a5822455466f7f3a8a507f3df8edc67be976f1de4301383c2af3ab"} Jul 16 17:34:11.161431 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:11.161375 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4d257" podStartSLOduration=1.626749204 podStartE2EDuration="21.161360115s" totalImagesPullingTime="19.534610911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:11.161251461 +0000 UTC m=+21.690675824" watchObservedRunningTime="2026-07-16 17:34:11.161360115 +0000 UTC m=+21.690784376" Jul 16 17:34:11.203058 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:11.202972 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5jnzr" podStartSLOduration=1.566159723 podStartE2EDuration="21.202952071s" totalImagesPullingTime="19.636792348s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:11.202952309 +0000 UTC m=+21.732376573" watchObservedRunningTime="2026-07-16 17:34:11.202952071 +0000 UTC m=+21.732376333" Jul 16 17:34:11.243282 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:11.243240 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-5.ec2.internal" podStartSLOduration=21.243225319 podStartE2EDuration="21.243225319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:33:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:11.243216627 +0000 UTC m=+21.772640889" watchObservedRunningTime="2026-07-16 17:34:11.243225319 +0000 UTC m=+21.772649581" Jul 16 17:34:12.028479 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:12.028297 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:34:12.028629 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:12.028565 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h8zgd" podUID="9ed27992-7654-4b37-9b2a-dc5aa5cb6dde" Jul 16 17:34:12.145690 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:12.145666 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" event={"ID":"5e2940b7-973e-4343-82d8-2d720f2bb8ff","Type":"ContainerStarted","Data":"f8bdef049df8b23e2a22146d647818a254edeb3b8a32e50b8df1852e857b2d24"} Jul 16 17:34:12.148244 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:12.148225 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" event={"ID":"9ced5729-ce86-4189-90a5-161317525b5a","Type":"ContainerStarted","Data":"0d26b53a171e1133b3bdb57b3c6c381b4879e4129eb8615faa0a064b632d2d80"} Jul 16 17:34:12.148323 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:12.148293 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" event={"ID":"9ced5729-ce86-4189-90a5-161317525b5a","Type":"ContainerStarted","Data":"f6c3df1e4177daa101e12c7fd857efb4d46ea14d186911df5fa73b48ebefda9e"} Jul 16 17:34:12.148378 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:12.148342 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" event={"ID":"9ced5729-ce86-4189-90a5-161317525b5a","Type":"ContainerStarted","Data":"286e59a8b30b8408ac611e751cfc5d68aba28456146515f401e6b364d29a8c78"} Jul 16 17:34:12.148431 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:12.148390 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" event={"ID":"9ced5729-ce86-4189-90a5-161317525b5a","Type":"ContainerStarted","Data":"8f0424f69cd6f520bb3af28f8e2e8b9e9f235cfe61512ec3cb6762860727acf5"} Jul 16 17:34:12.149546 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:12.149524 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9qckj" event={"ID":"a9508dc3-c294-4959-bce4-6697f0ed0f0b","Type":"ContainerStarted","Data":"84f3565459dcb55251d7ef80ae6a5d08d7bf4f776ff001524387a6b6d7af8cc1"} Jul 16 17:34:12.150728 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:12.150709 2578 generic.go:356] "Generic (PLEG): container finished" podID="122835d2-068b-4ef1-a09e-5f5dccd90a9f" containerID="bf8634d06d7ad558f4743cfda29fe955a4ed6e585411d562eae0fdbe735be490" exitCode=0 Jul 16 17:34:12.150803 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:12.150734 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vg8xg" event={"ID":"122835d2-068b-4ef1-a09e-5f5dccd90a9f","Type":"ContainerDied","Data":"bf8634d06d7ad558f4743cfda29fe955a4ed6e585411d562eae0fdbe735be490"} Jul 16 17:34:12.152104 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:12.152072 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c5cwf" event={"ID":"d9755014-b229-4b27-8e7c-a754e8729ed1","Type":"ContainerStarted","Data":"c3d87306cd961bd47930d93fb8917ecb95509764b69c82c1fb5a4204d1178f26"} Jul 16 17:34:12.153461 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:12.153442 2578 generic.go:356] "Generic (PLEG): container finished" podID="32d0c91cee1c323b9c86d433cacd6006" containerID="f590e1fe6bbe234bf504674024af9d500118a1fb9c671f81a97435df69ffd9f9" exitCode=0 Jul 16 17:34:12.153547 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:12.153506 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-5.ec2.internal" event={"ID":"32d0c91cee1c323b9c86d433cacd6006","Type":"ContainerDied","Data":"f590e1fe6bbe234bf504674024af9d500118a1fb9c671f81a97435df69ffd9f9"} Jul 16 17:34:12.155037 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:12.155014 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cxq75" event={"ID":"8dbc1f99-f360-4ae6-8200-45ad3de61e8e","Type":"ContainerStarted","Data":"a496e2af931ba7c9ebb9beb52297787daef4d8f23b8e4a38a552cc6102d9aab1"} Jul 16 17:34:12.156528 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:12.156508 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7prpm" event={"ID":"17a0dfb8-ff8f-4f01-bde7-e1b177543374","Type":"ContainerStarted","Data":"3f8ed99ccd52ebf69cbd4f7855668cc58d6b8dedc2998c1c17daba12931f18e3"} Jul 16 17:34:12.171565 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:12.171515 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9qckj" podStartSLOduration=2.571681345 podStartE2EDuration="22.171503378s" totalImagesPullingTime="19.599822033s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:12.171088402 +0000 UTC m=+22.700512664" watchObservedRunningTime="2026-07-16 17:34:12.171503378 +0000 UTC m=+22.700927638" Jul 16 17:34:12.250815 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:12.249241 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cxq75" podStartSLOduration=22.249220783 podStartE2EDuration="22.249220783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:33:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-16 17:34:12.213853674 +0000 UTC m=+22.743277935" watchObservedRunningTime="2026-07-16 17:34:12.249220783 +0000 UTC m=+22.778645046" Jul 16 17:34:12.328789 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:12.328741 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-c5cwf" podStartSLOduration=7.163619907 podStartE2EDuration="22.328726284s" totalImagesPullingTime="15.165106377s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:12.280690179 +0000 UTC m=+22.810114440" watchObservedRunningTime="2026-07-16 17:34:12.328726284 +0000 UTC m=+22.858150527" Jul 16 17:34:12.505829 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:12.505759 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:12.643715 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:12.643675 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:13.028562 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:13.028533 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:34:13.028857 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:13.028540 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:34:13.028857 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:13.028657 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xmt6" podUID="a4e3a253-031e-47d3-9ca3-18c97f49e614" Jul 16 17:34:13.028857 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:13.028694 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrj7t" podUID="fd1b005f-47c0-4006-abf5-b17419b94b2a" Jul 16 17:34:13.160064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:13.160027 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-5.ec2.internal" event={"ID":"32d0c91cee1c323b9c86d433cacd6006","Type":"ContainerStarted","Data":"f524420ce1efce0a5269a05938fbc56e9995ff2d4bac941536c508bd87f83c68"} Jul 16 17:34:13.192055 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:13.192015 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7prpm" podStartSLOduration=3.697721854 podStartE2EDuration="23.192001769s" totalImagesPullingTime="19.494279915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:12.365449776 +0000 UTC m=+22.894874056" watchObservedRunningTime="2026-07-16 17:34:13.192001769 +0000 UTC m=+23.721426030" Jul 16 17:34:13.192302 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:13.192284 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-5.ec2.internal" podStartSLOduration=23.192277148 podStartE2EDuration="23.192277148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:33:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:13.191832626 +0000 UTC m=+23.721256888" watchObservedRunningTime="2026-07-16 17:34:13.192277148 +0000 UTC m=+23.721701409" Jul 16 17:34:13.475337 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:13.475266 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:13.546007 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:13.545980 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:14.028394 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:14.028370 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:34:14.028557 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:14.028479 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h8zgd" podUID="9ed27992-7654-4b37-9b2a-dc5aa5cb6dde" Jul 16 17:34:14.166129 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:14.166089 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" event={"ID":"9ced5729-ce86-4189-90a5-161317525b5a","Type":"ContainerStarted","Data":"ac4cb6d88eac95aa8fd15fee97073fb1b9020ca67c0de289008defdf2e85a7a2"} Jul 16 17:34:14.606251 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:14.606217 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7prpm" Jul 16 17:34:14.606935 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:14.606908 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7prpm" Jul 16 17:34:15.027862 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:15.027776 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:34:15.027862 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:15.027808 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:34:15.028052 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:15.027932 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrj7t" podUID="fd1b005f-47c0-4006-abf5-b17419b94b2a" Jul 16 17:34:15.028052 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:15.028019 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xmt6" podUID="a4e3a253-031e-47d3-9ca3-18c97f49e614" Jul 16 17:34:15.169167 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:15.169081 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7prpm" Jul 16 17:34:15.169615 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:15.169562 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7prpm" Jul 16 17:34:15.254435 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:15.254387 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:15.422393 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:15.422373 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 16 17:34:15.907483 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:15.906895 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T17:34:15.422388747Z","UUID":"84590711-6747-4877-be39-010d4b885df6","Handler":null,"Name":"","Endpoint":""} Jul 16 17:34:15.909063 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:15.908875 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 16 17:34:15.909063 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:15.908921 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 16 17:34:16.028586 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:16.028515 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:34:16.028735 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:16.028642 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h8zgd" podUID="9ed27992-7654-4b37-9b2a-dc5aa5cb6dde" Jul 16 17:34:16.173461 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:16.173406 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" event={"ID":"5e2940b7-973e-4343-82d8-2d720f2bb8ff","Type":"ContainerStarted","Data":"cab2e5fdb5bff3621fbf8a9ab5be0d036aa4cca37dc158fc06488d94faf567a8"} Jul 16 17:34:16.177639 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:16.177608 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" event={"ID":"9ced5729-ce86-4189-90a5-161317525b5a","Type":"ContainerStarted","Data":"ea6f16c4bda1bc7bc3889a8ab48fd66b9748602881eaee8ea942776800b460c6"} Jul 16 17:34:16.217208 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:16.217165 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" podStartSLOduration=6.559890656 podStartE2EDuration="26.217145615s" totalImagesPullingTime="19.657254959s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:16.21428817 +0000 UTC m=+26.743712453" watchObservedRunningTime="2026-07-16 17:34:16.217145615 +0000 UTC m=+26.746569868" Jul 16 17:34:17.029211 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:17.028644 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:34:17.029211 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:17.028843 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xmt6" podUID="a4e3a253-031e-47d3-9ca3-18c97f49e614" Jul 16 17:34:17.029211 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:17.028905 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:34:17.029211 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:17.029018 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrj7t" podUID="fd1b005f-47c0-4006-abf5-b17419b94b2a" Jul 16 17:34:17.179780 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:17.179745 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:34:17.180240 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:17.180131 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:34:17.180240 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:17.180222 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:34:17.197214 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:17.197190 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:34:17.197351 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:17.197318 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:34:18.013435 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:18.013244 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:18.028026 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:18.027998 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:34:18.028167 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:18.028139 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h8zgd" podUID="9ed27992-7654-4b37-9b2a-dc5aa5cb6dde" Jul 16 17:34:18.184057 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:18.184024 2578 generic.go:356] "Generic (PLEG): container finished" podID="122835d2-068b-4ef1-a09e-5f5dccd90a9f" containerID="fc3e2cf5fb49153db16d66c46ff0d90f73f9e61f6b4f541369be5bbfd61d9c91" exitCode=0 Jul 16 17:34:18.184485 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:18.184096 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vg8xg" event={"ID":"122835d2-068b-4ef1-a09e-5f5dccd90a9f","Type":"ContainerDied","Data":"fc3e2cf5fb49153db16d66c46ff0d90f73f9e61f6b4f541369be5bbfd61d9c91"} Jul 16 17:34:18.373272 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:18.373235 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lrj7t"] Jul 16 17:34:18.373436 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:18.373331 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:34:18.373516 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:18.373427 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrj7t" podUID="fd1b005f-47c0-4006-abf5-b17419b94b2a" Jul 16 17:34:18.376962 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:18.376936 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h8zgd"] Jul 16 17:34:18.377063 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:18.377015 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:34:18.377117 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:18.377089 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h8zgd" podUID="9ed27992-7654-4b37-9b2a-dc5aa5cb6dde" Jul 16 17:34:18.391170 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:18.391150 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7xmt6"] Jul 16 17:34:18.391262 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:18.391240 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:34:18.391343 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:18.391331 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xmt6" podUID="a4e3a253-031e-47d3-9ca3-18c97f49e614" Jul 16 17:34:18.650140 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:18.650115 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:19.188357 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:19.188327 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" event={"ID":"5e2940b7-973e-4343-82d8-2d720f2bb8ff","Type":"ContainerStarted","Data":"763c865272b2d89496cf4e6072f831f885bd85bdd2a306b5ab84709a105e76f7"} Jul 16 17:34:19.190349 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:19.190330 2578 generic.go:356] "Generic (PLEG): container finished" podID="122835d2-068b-4ef1-a09e-5f5dccd90a9f" containerID="79e2d2ae780546595d56f9ecbeafedd47c9e5602aebf5eb4d480da9986514325" exitCode=0 Jul 16 17:34:19.190445 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:19.190405 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vg8xg" event={"ID":"122835d2-068b-4ef1-a09e-5f5dccd90a9f","Type":"ContainerDied","Data":"79e2d2ae780546595d56f9ecbeafedd47c9e5602aebf5eb4d480da9986514325"} Jul 16 17:34:19.217667 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:19.217622 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2ttk" podStartSLOduration=2.572806614 podStartE2EDuration="29.217608787s" totalImagesPullingTime="26.644802173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:33:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:19.214615965 +0000 UTC m=+29.744040232" watchObservedRunningTime="2026-07-16 17:34:19.217608787 +0000 UTC m=+29.747033050" Jul 16 17:34:20.029410 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:20.029378 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:34:20.029538 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:20.029489 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:34:20.029538 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:20.029535 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:34:20.029628 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:20.029525 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h8zgd" podUID="9ed27992-7654-4b37-9b2a-dc5aa5cb6dde" Jul 16 17:34:20.029750 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:20.029654 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrj7t" podUID="fd1b005f-47c0-4006-abf5-b17419b94b2a" Jul 16 17:34:20.029821 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:20.029772 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xmt6" podUID="a4e3a253-031e-47d3-9ca3-18c97f49e614" Jul 16 17:34:20.195381 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:20.195309 2578 generic.go:356] "Generic (PLEG): container finished" podID="122835d2-068b-4ef1-a09e-5f5dccd90a9f" containerID="7091800f234655b12ab6cb51873383cf31c5f789409c9035b15aa849fa79cafe" exitCode=0 Jul 16 17:34:20.195802 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:20.195381 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vg8xg" event={"ID":"122835d2-068b-4ef1-a09e-5f5dccd90a9f","Type":"ContainerDied","Data":"7091800f234655b12ab6cb51873383cf31c5f789409c9035b15aa849fa79cafe"} Jul 16 17:34:22.027966 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:22.027932 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:34:22.028327 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:22.027967 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:34:22.028327 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:22.027937 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:34:22.028327 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:22.028035 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h8zgd" podUID="9ed27992-7654-4b37-9b2a-dc5aa5cb6dde" Jul 16 17:34:22.028327 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:22.028133 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrj7t" podUID="fd1b005f-47c0-4006-abf5-b17419b94b2a" Jul 16 17:34:22.028327 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:22.028227 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xmt6" podUID="a4e3a253-031e-47d3-9ca3-18c97f49e614" Jul 16 17:34:22.468541 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:22.468262 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:22.553874 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:22.553839 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:22.693941 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:22.693909 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4e3a253-031e-47d3-9ca3-18c97f49e614-metrics-certs\") pod \"network-metrics-daemon-7xmt6\" (UID: \"a4e3a253-031e-47d3-9ca3-18c97f49e614\") " pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:34:22.694104 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:22.693947 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd1b005f-47c0-4006-abf5-b17419b94b2a-original-pull-secret\") pod \"global-pull-secret-syncer-lrj7t\" (UID: \"fd1b005f-47c0-4006-abf5-b17419b94b2a\") " pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:34:22.694104 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:22.693975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rlnv\" (UniqueName: \"kubernetes.io/projected/9ed27992-7654-4b37-9b2a-dc5aa5cb6dde-kube-api-access-2rlnv\") pod \"network-check-target-h8zgd\" (UID: \"9ed27992-7654-4b37-9b2a-dc5aa5cb6dde\") " pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:34:22.694104 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:22.694036 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:34:22.694104 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:22.694097 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 17:34:22.694314 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:22.694107 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 17:34:22.694314 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:22.694115 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e3a253-031e-47d3-9ca3-18c97f49e614-metrics-certs podName:a4e3a253-031e-47d3-9ca3-18c97f49e614 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:54.694094818 +0000 UTC m=+65.223519063 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4e3a253-031e-47d3-9ca3-18c97f49e614-metrics-certs") pod "network-metrics-daemon-7xmt6" (UID: "a4e3a253-031e-47d3-9ca3-18c97f49e614") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:34:22.694314 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:22.694126 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 17:34:22.694314 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:22.694135 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1b005f-47c0-4006-abf5-b17419b94b2a-original-pull-secret podName:fd1b005f-47c0-4006-abf5-b17419b94b2a nodeName:}" failed. No retries permitted until 2026-07-16 17:34:54.694123653 +0000 UTC m=+65.223547901 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd1b005f-47c0-4006-abf5-b17419b94b2a-original-pull-secret") pod "global-pull-secret-syncer-lrj7t" (UID: "fd1b005f-47c0-4006-abf5-b17419b94b2a") : object "kube-system"/"original-pull-secret" not registered Jul 16 17:34:22.694314 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:22.694140 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2rlnv for pod openshift-network-diagnostics/network-check-target-h8zgd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:34:22.694314 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:22.694188 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ed27992-7654-4b37-9b2a-dc5aa5cb6dde-kube-api-access-2rlnv podName:9ed27992-7654-4b37-9b2a-dc5aa5cb6dde nodeName:}" failed. No retries permitted until 2026-07-16 17:34:54.69417218 +0000 UTC m=+65.223596435 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2rlnv" (UniqueName: "kubernetes.io/projected/9ed27992-7654-4b37-9b2a-dc5aa5cb6dde-kube-api-access-2rlnv") pod "network-check-target-h8zgd" (UID: "9ed27992-7654-4b37-9b2a-dc5aa5cb6dde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:34:23.834391 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:23.834365 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-5.ec2.internal" event="NodeReady" Jul 16 17:34:23.834835 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:23.834522 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 16 17:34:23.836521 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:23.836483 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:23.897132 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:23.897109 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fk9lj"] Jul 16 17:34:23.920801 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:23.920769 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5bb9j"] Jul 16 17:34:23.920925 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:23.920882 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fk9lj" Jul 16 17:34:23.925288 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:23.924102 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 16 17:34:23.925288 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:23.924124 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-24sj8\"" Jul 16 17:34:23.927344 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:23.927146 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 16 17:34:23.939016 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:23.938998 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fk9lj"] Jul 16 17:34:23.939103 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:23.939027 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5bb9j"] Jul 16 17:34:23.939103 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:23.939087 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5bb9j" Jul 16 17:34:23.943903 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:23.943882 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 16 17:34:23.944027 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:23.943902 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 16 17:34:23.944027 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:23.943939 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ndv45\"" Jul 16 17:34:23.944027 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:23.943974 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 16 17:34:24.005024 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.004990 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmlbp\" (UniqueName: \"kubernetes.io/projected/bb1fa25e-7b06-453d-8064-237d8cf6dd85-kube-api-access-xmlbp\") pod \"dns-default-fk9lj\" (UID: \"bb1fa25e-7b06-453d-8064-237d8cf6dd85\") " pod="openshift-dns/dns-default-fk9lj" Jul 16 17:34:24.005159 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.005030 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb1fa25e-7b06-453d-8064-237d8cf6dd85-metrics-tls\") pod \"dns-default-fk9lj\" (UID: \"bb1fa25e-7b06-453d-8064-237d8cf6dd85\") " pod="openshift-dns/dns-default-fk9lj" Jul 16 17:34:24.005159 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.005076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bb1fa25e-7b06-453d-8064-237d8cf6dd85-config-volume\") pod \"dns-default-fk9lj\" (UID: \"bb1fa25e-7b06-453d-8064-237d8cf6dd85\") " pod="openshift-dns/dns-default-fk9lj" Jul 16 17:34:24.005272 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.005153 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb1fa25e-7b06-453d-8064-237d8cf6dd85-tmp-dir\") pod \"dns-default-fk9lj\" (UID: \"bb1fa25e-7b06-453d-8064-237d8cf6dd85\") " pod="openshift-dns/dns-default-fk9lj" Jul 16 17:34:24.027661 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.027636 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:34:24.027794 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.027774 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:34:24.027867 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.027807 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:34:24.039708 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.039536 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 17:34:24.039708 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.039562 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 17:34:24.039708 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.039584 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 17:34:24.039708 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.039605 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 17:34:24.039964 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.039769 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2qkbl\"" Jul 16 17:34:24.039964 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.039771 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xfj9z\"" Jul 16 17:34:24.105772 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.105723 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bb1fa25e-7b06-453d-8064-237d8cf6dd85-config-volume\") pod \"dns-default-fk9lj\" (UID: \"bb1fa25e-7b06-453d-8064-237d8cf6dd85\") " pod="openshift-dns/dns-default-fk9lj" Jul 16 17:34:24.105772 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.105760 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb1fa25e-7b06-453d-8064-237d8cf6dd85-tmp-dir\") pod \"dns-default-fk9lj\" (UID: \"bb1fa25e-7b06-453d-8064-237d8cf6dd85\") " pod="openshift-dns/dns-default-fk9lj" Jul 16 17:34:24.105926 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.105794 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8e9f9c3-67f6-43f0-8fc3-03a69ec68c4f-cert\") pod \"ingress-canary-5bb9j\" (UID: \"c8e9f9c3-67f6-43f0-8fc3-03a69ec68c4f\") " pod="openshift-ingress-canary/ingress-canary-5bb9j" Jul 16 17:34:24.105926 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.105825 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmlbp\" (UniqueName: \"kubernetes.io/projected/bb1fa25e-7b06-453d-8064-237d8cf6dd85-kube-api-access-xmlbp\") pod \"dns-default-fk9lj\" (UID: \"bb1fa25e-7b06-453d-8064-237d8cf6dd85\") " pod="openshift-dns/dns-default-fk9lj" Jul 16 17:34:24.105926 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.105850 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb1fa25e-7b06-453d-8064-237d8cf6dd85-metrics-tls\") pod \"dns-default-fk9lj\" (UID: \"bb1fa25e-7b06-453d-8064-237d8cf6dd85\") " pod="openshift-dns/dns-default-fk9lj" Jul 16 17:34:24.105926 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.105873 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6s6w\" (UniqueName: \"kubernetes.io/projected/c8e9f9c3-67f6-43f0-8fc3-03a69ec68c4f-kube-api-access-c6s6w\") pod \"ingress-canary-5bb9j\" (UID: \"c8e9f9c3-67f6-43f0-8fc3-03a69ec68c4f\") " pod="openshift-ingress-canary/ingress-canary-5bb9j" Jul 16 17:34:24.106084 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:24.105997 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 17:34:24.106084 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:24.106061 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb1fa25e-7b06-453d-8064-237d8cf6dd85-metrics-tls podName:bb1fa25e-7b06-453d-8064-237d8cf6dd85 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:24.606042909 +0000 UTC m=+35.135467150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb1fa25e-7b06-453d-8064-237d8cf6dd85-metrics-tls") pod "dns-default-fk9lj" (UID: "bb1fa25e-7b06-453d-8064-237d8cf6dd85") : secret "dns-default-metrics-tls" not found Jul 16 17:34:24.106169 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.106110 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb1fa25e-7b06-453d-8064-237d8cf6dd85-tmp-dir\") pod \"dns-default-fk9lj\" (UID: \"bb1fa25e-7b06-453d-8064-237d8cf6dd85\") " pod="openshift-dns/dns-default-fk9lj" Jul 16 17:34:24.106355 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.106338 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bb1fa25e-7b06-453d-8064-237d8cf6dd85-config-volume\") pod \"dns-default-fk9lj\" (UID: \"bb1fa25e-7b06-453d-8064-237d8cf6dd85\") " pod="openshift-dns/dns-default-fk9lj" Jul 16 17:34:24.120130 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.120109 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmlbp\" (UniqueName: \"kubernetes.io/projected/bb1fa25e-7b06-453d-8064-237d8cf6dd85-kube-api-access-xmlbp\") pod \"dns-default-fk9lj\" (UID: \"bb1fa25e-7b06-453d-8064-237d8cf6dd85\") " pod="openshift-dns/dns-default-fk9lj" Jul 16 17:34:24.206335 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.206299 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8e9f9c3-67f6-43f0-8fc3-03a69ec68c4f-cert\") pod \"ingress-canary-5bb9j\" (UID: \"c8e9f9c3-67f6-43f0-8fc3-03a69ec68c4f\") " pod="openshift-ingress-canary/ingress-canary-5bb9j" Jul 16 17:34:24.206484 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.206369 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6s6w\" (UniqueName: \"kubernetes.io/projected/c8e9f9c3-67f6-43f0-8fc3-03a69ec68c4f-kube-api-access-c6s6w\") pod \"ingress-canary-5bb9j\" (UID: \"c8e9f9c3-67f6-43f0-8fc3-03a69ec68c4f\") " pod="openshift-ingress-canary/ingress-canary-5bb9j" Jul 16 17:34:24.209196 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.209172 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8e9f9c3-67f6-43f0-8fc3-03a69ec68c4f-cert\") pod \"ingress-canary-5bb9j\" (UID: \"c8e9f9c3-67f6-43f0-8fc3-03a69ec68c4f\") " pod="openshift-ingress-canary/ingress-canary-5bb9j" Jul 16 17:34:24.217507 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.217485 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6s6w\" (UniqueName: \"kubernetes.io/projected/c8e9f9c3-67f6-43f0-8fc3-03a69ec68c4f-kube-api-access-c6s6w\") pod \"ingress-canary-5bb9j\" (UID: \"c8e9f9c3-67f6-43f0-8fc3-03a69ec68c4f\") " pod="openshift-ingress-canary/ingress-canary-5bb9j" Jul 16 17:34:24.248381 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.248350 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5bb9j" Jul 16 17:34:24.374455 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.374351 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:24.430505 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.430472 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5bb9j"] Jul 16 17:34:24.610336 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:24.610301 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb1fa25e-7b06-453d-8064-237d8cf6dd85-metrics-tls\") pod \"dns-default-fk9lj\" (UID: \"bb1fa25e-7b06-453d-8064-237d8cf6dd85\") " pod="openshift-dns/dns-default-fk9lj" Jul 16 17:34:24.610509 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:24.610463 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 17:34:24.610562 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:24.610542 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb1fa25e-7b06-453d-8064-237d8cf6dd85-metrics-tls podName:bb1fa25e-7b06-453d-8064-237d8cf6dd85 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:25.610519973 +0000 UTC m=+36.139944214 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb1fa25e-7b06-453d-8064-237d8cf6dd85-metrics-tls") pod "dns-default-fk9lj" (UID: "bb1fa25e-7b06-453d-8064-237d8cf6dd85") : secret "dns-default-metrics-tls" not found Jul 16 17:34:25.617209 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:25.617172 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb1fa25e-7b06-453d-8064-237d8cf6dd85-metrics-tls\") pod \"dns-default-fk9lj\" (UID: \"bb1fa25e-7b06-453d-8064-237d8cf6dd85\") " pod="openshift-dns/dns-default-fk9lj" Jul 16 17:34:25.618000 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:25.617353 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 17:34:25.618000 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:25.617438 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb1fa25e-7b06-453d-8064-237d8cf6dd85-metrics-tls podName:bb1fa25e-7b06-453d-8064-237d8cf6dd85 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:27.617405165 +0000 UTC m=+38.146829405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb1fa25e-7b06-453d-8064-237d8cf6dd85-metrics-tls") pod "dns-default-fk9lj" (UID: "bb1fa25e-7b06-453d-8064-237d8cf6dd85") : secret "dns-default-metrics-tls" not found Jul 16 17:34:25.892098 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:34:25.892027 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8e9f9c3_67f6_43f0_8fc3_03a69ec68c4f.slice/crio-698c2b20388aaf5c376d518c1cea9db42d04f99adce62fd2cfc987717c351350 WatchSource:0}: Error finding container 698c2b20388aaf5c376d518c1cea9db42d04f99adce62fd2cfc987717c351350: Status 404 returned error can't find the container with id 698c2b20388aaf5c376d518c1cea9db42d04f99adce62fd2cfc987717c351350 Jul 16 17:34:26.044504 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:26.044477 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:26.210124 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:26.210097 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5bb9j" event={"ID":"c8e9f9c3-67f6-43f0-8fc3-03a69ec68c4f","Type":"ContainerStarted","Data":"698c2b20388aaf5c376d518c1cea9db42d04f99adce62fd2cfc987717c351350"} Jul 16 17:34:27.219223 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:27.218994 2578 generic.go:356] "Generic (PLEG): container finished" podID="122835d2-068b-4ef1-a09e-5f5dccd90a9f" containerID="7e3dbe89cf8ee71636e4614951e933fcac6e6f420389486b5be78d30958038c7" exitCode=0 Jul 16 17:34:27.219223 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:27.219078 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vg8xg" event={"ID":"122835d2-068b-4ef1-a09e-5f5dccd90a9f","Type":"ContainerDied","Data":"7e3dbe89cf8ee71636e4614951e933fcac6e6f420389486b5be78d30958038c7"} Jul 16 17:34:27.631951 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:27.631916 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb1fa25e-7b06-453d-8064-237d8cf6dd85-metrics-tls\") pod \"dns-default-fk9lj\" (UID: \"bb1fa25e-7b06-453d-8064-237d8cf6dd85\") " pod="openshift-dns/dns-default-fk9lj" Jul 16 17:34:27.632157 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:27.632066 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 17:34:27.632157 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:27.632136 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb1fa25e-7b06-453d-8064-237d8cf6dd85-metrics-tls podName:bb1fa25e-7b06-453d-8064-237d8cf6dd85 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:31.632116125 +0000 UTC m=+42.161540367 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb1fa25e-7b06-453d-8064-237d8cf6dd85-metrics-tls") pod "dns-default-fk9lj" (UID: "bb1fa25e-7b06-453d-8064-237d8cf6dd85") : secret "dns-default-metrics-tls" not found Jul 16 17:34:27.674978 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:27.674947 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:28.224906 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:28.224877 2578 generic.go:356] "Generic (PLEG): container finished" podID="122835d2-068b-4ef1-a09e-5f5dccd90a9f" containerID="514736419b40f406f9999636fc8c6259e22e09283d14f5fc01e022a3ac6857d8" exitCode=0 Jul 16 17:34:28.225300 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:28.224932 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vg8xg" event={"ID":"122835d2-068b-4ef1-a09e-5f5dccd90a9f","Type":"ContainerDied","Data":"514736419b40f406f9999636fc8c6259e22e09283d14f5fc01e022a3ac6857d8"} Jul 16 17:34:29.229270 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:29.229231 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5bb9j" event={"ID":"c8e9f9c3-67f6-43f0-8fc3-03a69ec68c4f","Type":"ContainerStarted","Data":"ec748d5e39bb716b9d298b75ed3cf6842e9c41977cab6c3be2a1c1cbe176eb09"} Jul 16 17:34:29.232552 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:29.232519 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vg8xg" event={"ID":"122835d2-068b-4ef1-a09e-5f5dccd90a9f","Type":"ContainerStarted","Data":"0135e153ee511610ed12cdb1a4454592fe07b8bed8aa17d20421182e4e834c86"} Jul 16 17:34:29.253428 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:29.253360 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5bb9j" podStartSLOduration=3.106696007 podStartE2EDuration="6.253341033s" totalImagesPullingTime="3.146645026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:29.252635974 +0000 UTC m=+39.782060255" watchObservedRunningTime="2026-07-16 17:34:29.253341033 +0000 UTC m=+39.782765297" Jul 16 17:34:29.285206 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:29.285149 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vg8xg" podStartSLOduration=6.506082933 podStartE2EDuration="39.285128391s" totalImagesPullingTime="32.779045458s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:33:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:29.283489187 +0000 UTC m=+39.812913470" watchObservedRunningTime="2026-07-16 17:34:29.285128391 +0000 UTC m=+39.814552654" Jul 16 17:34:29.410222 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:29.410193 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:29.466817 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:29.466673 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:29.548821 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:29.548792 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:29.615646 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:29.615619 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:31.658032 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:31.657998 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb1fa25e-7b06-453d-8064-237d8cf6dd85-metrics-tls\") pod \"dns-default-fk9lj\" (UID: \"bb1fa25e-7b06-453d-8064-237d8cf6dd85\") " pod="openshift-dns/dns-default-fk9lj" Jul 16 17:34:31.658392 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:31.658153 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 17:34:31.658392 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:31.658218 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb1fa25e-7b06-453d-8064-237d8cf6dd85-metrics-tls podName:bb1fa25e-7b06-453d-8064-237d8cf6dd85 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:39.65820162 +0000 UTC m=+50.187625860 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb1fa25e-7b06-453d-8064-237d8cf6dd85-metrics-tls") pod "dns-default-fk9lj" (UID: "bb1fa25e-7b06-453d-8064-237d8cf6dd85") : secret "dns-default-metrics-tls" not found Jul 16 17:34:39.707888 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:39.707853 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb1fa25e-7b06-453d-8064-237d8cf6dd85-metrics-tls\") pod \"dns-default-fk9lj\" (UID: \"bb1fa25e-7b06-453d-8064-237d8cf6dd85\") " pod="openshift-dns/dns-default-fk9lj" Jul 16 17:34:39.708343 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:39.707956 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 17:34:39.708343 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:39.708046 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb1fa25e-7b06-453d-8064-237d8cf6dd85-metrics-tls podName:bb1fa25e-7b06-453d-8064-237d8cf6dd85 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:55.708031953 +0000 UTC m=+66.237456194 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb1fa25e-7b06-453d-8064-237d8cf6dd85-metrics-tls") pod "dns-default-fk9lj" (UID: "bb1fa25e-7b06-453d-8064-237d8cf6dd85") : secret "dns-default-metrics-tls" not found Jul 16 17:34:43.011429 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:43.011390 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:45.147142 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:45.147094 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:49.208157 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:49.208125 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvlwv" Jul 16 17:34:49.346726 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:49.346649 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:49.446093 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:49.446067 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:49.503098 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:49.503040 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:54.702260 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:54.702206 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4e3a253-031e-47d3-9ca3-18c97f49e614-metrics-certs\") pod \"network-metrics-daemon-7xmt6\" (UID: \"a4e3a253-031e-47d3-9ca3-18c97f49e614\") " pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:34:54.702260 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:54.702265 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd1b005f-47c0-4006-abf5-b17419b94b2a-original-pull-secret\") pod \"global-pull-secret-syncer-lrj7t\" (UID: \"fd1b005f-47c0-4006-abf5-b17419b94b2a\") " pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:34:54.702789 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:54.702298 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rlnv\" (UniqueName: \"kubernetes.io/projected/9ed27992-7654-4b37-9b2a-dc5aa5cb6dde-kube-api-access-2rlnv\") pod \"network-check-target-h8zgd\" (UID: \"9ed27992-7654-4b37-9b2a-dc5aa5cb6dde\") " pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:34:54.705520 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:54.705493 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 17:34:54.705597 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:54.705579 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 17:34:54.705641 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:54.705599 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 17:34:54.713101 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:54.713074 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 16 17:34:54.713237 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:54.713148 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e3a253-031e-47d3-9ca3-18c97f49e614-metrics-certs podName:a4e3a253-031e-47d3-9ca3-18c97f49e614 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:58.713131298 +0000 UTC m=+129.242555538 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4e3a253-031e-47d3-9ca3-18c97f49e614-metrics-certs") pod "network-metrics-daemon-7xmt6" (UID: "a4e3a253-031e-47d3-9ca3-18c97f49e614") : secret "metrics-daemon-secret" not found Jul 16 17:34:54.716108 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:54.716089 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 17:34:54.717410 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:54.717388 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd1b005f-47c0-4006-abf5-b17419b94b2a-original-pull-secret\") pod \"global-pull-secret-syncer-lrj7t\" (UID: \"fd1b005f-47c0-4006-abf5-b17419b94b2a\") " pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:34:54.725326 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:54.725301 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rlnv\" (UniqueName: \"kubernetes.io/projected/9ed27992-7654-4b37-9b2a-dc5aa5cb6dde-kube-api-access-2rlnv\") pod \"network-check-target-h8zgd\" (UID: \"9ed27992-7654-4b37-9b2a-dc5aa5cb6dde\") " pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:34:54.938821 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:54.938778 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrj7t" Jul 16 17:34:54.953949 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:54.953896 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xfj9z\"" Jul 16 17:34:54.961554 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:54.961531 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:34:55.073948 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:55.073921 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lrj7t"] Jul 16 17:34:55.077140 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:34:55.077111 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd1b005f_47c0_4006_abf5_b17419b94b2a.slice/crio-66276928fb23ee591d632950bb6d9cc16df51329ab76be1c8937feddf06185e9 WatchSource:0}: Error finding container 66276928fb23ee591d632950bb6d9cc16df51329ab76be1c8937feddf06185e9: Status 404 returned error can't find the container with id 66276928fb23ee591d632950bb6d9cc16df51329ab76be1c8937feddf06185e9 Jul 16 17:34:55.087581 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:55.087556 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h8zgd"] Jul 16 17:34:55.090408 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:34:55.090388 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ed27992_7654_4b37_9b2a_dc5aa5cb6dde.slice/crio-bd82b7525df0a080dab780eef2972830eb3e85059f0f1f12376a108bfff92377 WatchSource:0}: Error finding container bd82b7525df0a080dab780eef2972830eb3e85059f0f1f12376a108bfff92377: Status 404 returned error can't find the container with id bd82b7525df0a080dab780eef2972830eb3e85059f0f1f12376a108bfff92377 Jul 16 17:34:55.290989 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:55.290929 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lrj7t" event={"ID":"fd1b005f-47c0-4006-abf5-b17419b94b2a","Type":"ContainerStarted","Data":"66276928fb23ee591d632950bb6d9cc16df51329ab76be1c8937feddf06185e9"} Jul 16 17:34:55.291893 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:55.291870 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h8zgd" event={"ID":"9ed27992-7654-4b37-9b2a-dc5aa5cb6dde","Type":"ContainerStarted","Data":"bd82b7525df0a080dab780eef2972830eb3e85059f0f1f12376a108bfff92377"} Jul 16 17:34:55.708108 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:55.708082 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb1fa25e-7b06-453d-8064-237d8cf6dd85-metrics-tls\") pod \"dns-default-fk9lj\" (UID: \"bb1fa25e-7b06-453d-8064-237d8cf6dd85\") " pod="openshift-dns/dns-default-fk9lj" Jul 16 17:34:55.708474 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:55.708189 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 17:34:55.708474 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:34:55.708241 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb1fa25e-7b06-453d-8064-237d8cf6dd85-metrics-tls podName:bb1fa25e-7b06-453d-8064-237d8cf6dd85 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:27.708225388 +0000 UTC m=+98.237649628 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb1fa25e-7b06-453d-8064-237d8cf6dd85-metrics-tls") pod "dns-default-fk9lj" (UID: "bb1fa25e-7b06-453d-8064-237d8cf6dd85") : secret "dns-default-metrics-tls" not found Jul 16 17:34:59.304643 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:59.304596 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h8zgd" event={"ID":"9ed27992-7654-4b37-9b2a-dc5aa5cb6dde","Type":"ContainerStarted","Data":"e451428a226fabadab5981c27fd022a312bc892a81f63fd93b5e49edb591359b"} Jul 16 17:34:59.305117 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:59.304749 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:34:59.325026 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:34:59.324801 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-h8zgd" podStartSLOduration=66.03631316 podStartE2EDuration="1m9.324783447s" totalImagesPullingTime="3.288470287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:59.3238666 +0000 UTC m=+69.853290862" watchObservedRunningTime="2026-07-16 17:34:59.324783447 +0000 UTC m=+69.854207709" Jul 16 17:35:00.308591 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:00.308507 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lrj7t" event={"ID":"fd1b005f-47c0-4006-abf5-b17419b94b2a","Type":"ContainerStarted","Data":"78f99c4b198e2dae1e1e4feba7c94e878958a7c218187c8d5e83ea1e3490dccf"} Jul 16 17:35:00.327175 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:00.327129 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lrj7t" podStartSLOduration=65.540733292 podStartE2EDuration="1m10.327115306s" totalImagesPullingTime="4.786382014s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:00.325687067 +0000 UTC m=+70.855111329" watchObservedRunningTime="2026-07-16 17:35:00.327115306 +0000 UTC m=+70.856539568" Jul 16 17:35:21.940999 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:21.940889 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-h7w8t"] Jul 16 17:35:21.944927 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:21.944907 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-h7w8t" Jul 16 17:35:21.949515 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:21.949495 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 16 17:35:21.949621 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:21.949560 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 16 17:35:21.949948 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:21.949909 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 16 17:35:21.950031 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:21.949944 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 16 17:35:21.956209 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:21.956194 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-vzjgd\"" Jul 16 17:35:21.969805 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:21.969787 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83bc0281-2e18-403e-a681-d356367d8355-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-h7w8t\" (UID: \"83bc0281-2e18-403e-a681-d356367d8355\") " pod="openshift-insights/insights-operator-68d9dd94cf-h7w8t" Jul 16 17:35:21.969876 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:21.969815 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83bc0281-2e18-403e-a681-d356367d8355-tmp\") pod \"insights-operator-68d9dd94cf-h7w8t\" (UID: \"83bc0281-2e18-403e-a681-d356367d8355\") " pod="openshift-insights/insights-operator-68d9dd94cf-h7w8t" Jul 16 17:35:21.969876 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:21.969833 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/83bc0281-2e18-403e-a681-d356367d8355-serving-cert\") pod \"insights-operator-68d9dd94cf-h7w8t\" (UID: \"83bc0281-2e18-403e-a681-d356367d8355\") " pod="openshift-insights/insights-operator-68d9dd94cf-h7w8t" Jul 16 17:35:21.969939 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:21.969876 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83bc0281-2e18-403e-a681-d356367d8355-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-h7w8t\" (UID: \"83bc0281-2e18-403e-a681-d356367d8355\") " pod="openshift-insights/insights-operator-68d9dd94cf-h7w8t" Jul 16 17:35:21.969939 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:21.969900 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/83bc0281-2e18-403e-a681-d356367d8355-snapshots\") pod \"insights-operator-68d9dd94cf-h7w8t\" (UID: \"83bc0281-2e18-403e-a681-d356367d8355\") " pod="openshift-insights/insights-operator-68d9dd94cf-h7w8t" Jul 16 17:35:21.969939 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:21.969917 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6j8k\" (UniqueName: \"kubernetes.io/projected/83bc0281-2e18-403e-a681-d356367d8355-kube-api-access-p6j8k\") pod \"insights-operator-68d9dd94cf-h7w8t\" (UID: \"83bc0281-2e18-403e-a681-d356367d8355\") " pod="openshift-insights/insights-operator-68d9dd94cf-h7w8t" Jul 16 17:35:21.972033 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:21.972010 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-h7w8t"] Jul 16 17:35:21.980442 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:21.980404 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 16 17:35:22.070675 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.070652 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83bc0281-2e18-403e-a681-d356367d8355-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-h7w8t\" (UID: \"83bc0281-2e18-403e-a681-d356367d8355\") " pod="openshift-insights/insights-operator-68d9dd94cf-h7w8t" Jul 16 17:35:22.070777 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.070686 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/83bc0281-2e18-403e-a681-d356367d8355-snapshots\") pod \"insights-operator-68d9dd94cf-h7w8t\" (UID: \"83bc0281-2e18-403e-a681-d356367d8355\") " pod="openshift-insights/insights-operator-68d9dd94cf-h7w8t" Jul 16 17:35:22.070777 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.070706 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6j8k\" (UniqueName: \"kubernetes.io/projected/83bc0281-2e18-403e-a681-d356367d8355-kube-api-access-p6j8k\") pod \"insights-operator-68d9dd94cf-h7w8t\" (UID: \"83bc0281-2e18-403e-a681-d356367d8355\") " pod="openshift-insights/insights-operator-68d9dd94cf-h7w8t" Jul 16 17:35:22.070887 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.070859 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83bc0281-2e18-403e-a681-d356367d8355-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-h7w8t\" (UID: \"83bc0281-2e18-403e-a681-d356367d8355\") " pod="openshift-insights/insights-operator-68d9dd94cf-h7w8t" Jul 16 17:35:22.070954 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.070891 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83bc0281-2e18-403e-a681-d356367d8355-tmp\") pod \"insights-operator-68d9dd94cf-h7w8t\" (UID: \"83bc0281-2e18-403e-a681-d356367d8355\") " pod="openshift-insights/insights-operator-68d9dd94cf-h7w8t" Jul 16 17:35:22.070954 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.070911 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/83bc0281-2e18-403e-a681-d356367d8355-serving-cert\") pod \"insights-operator-68d9dd94cf-h7w8t\" (UID: \"83bc0281-2e18-403e-a681-d356367d8355\") " pod="openshift-insights/insights-operator-68d9dd94cf-h7w8t" Jul 16 17:35:22.071308 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.071280 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83bc0281-2e18-403e-a681-d356367d8355-tmp\") pod \"insights-operator-68d9dd94cf-h7w8t\" (UID: \"83bc0281-2e18-403e-a681-d356367d8355\") " pod="openshift-insights/insights-operator-68d9dd94cf-h7w8t" Jul 16 17:35:22.071378 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.071291 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83bc0281-2e18-403e-a681-d356367d8355-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-h7w8t\" (UID: \"83bc0281-2e18-403e-a681-d356367d8355\") " pod="openshift-insights/insights-operator-68d9dd94cf-h7w8t" Jul 16 17:35:22.071378 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.071331 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/83bc0281-2e18-403e-a681-d356367d8355-snapshots\") pod \"insights-operator-68d9dd94cf-h7w8t\" (UID: \"83bc0281-2e18-403e-a681-d356367d8355\") " pod="openshift-insights/insights-operator-68d9dd94cf-h7w8t" Jul 16 17:35:22.071718 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.071702 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83bc0281-2e18-403e-a681-d356367d8355-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-h7w8t\" (UID: \"83bc0281-2e18-403e-a681-d356367d8355\") " pod="openshift-insights/insights-operator-68d9dd94cf-h7w8t" Jul 16 17:35:22.073158 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.073140 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/83bc0281-2e18-403e-a681-d356367d8355-serving-cert\") pod \"insights-operator-68d9dd94cf-h7w8t\" (UID: \"83bc0281-2e18-403e-a681-d356367d8355\") " pod="openshift-insights/insights-operator-68d9dd94cf-h7w8t" Jul 16 17:35:22.080735 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.080714 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6j8k\" (UniqueName: \"kubernetes.io/projected/83bc0281-2e18-403e-a681-d356367d8355-kube-api-access-p6j8k\") pod \"insights-operator-68d9dd94cf-h7w8t\" (UID: \"83bc0281-2e18-403e-a681-d356367d8355\") " pod="openshift-insights/insights-operator-68d9dd94cf-h7w8t" Jul 16 17:35:22.169827 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.169805 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bnspx"] Jul 16 17:35:22.172745 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.172728 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tnqr8"] Jul 16 17:35:22.172857 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.172840 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bnspx" Jul 16 17:35:22.175227 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.175210 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tnqr8" Jul 16 17:35:22.176713 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.176695 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 16 17:35:22.176829 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.176811 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 16 17:35:22.176890 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.176816 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 16 17:35:22.177125 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.177108 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 16 17:35:22.177475 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.177463 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2b5nf\"" Jul 16 17:35:22.177870 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.177852 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 16 17:35:22.177961 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.177905 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 16 17:35:22.177961 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.177955 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-474ph\"" Jul 16 17:35:22.189657 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.189640 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9w6q6"] Jul 16 17:35:22.192184 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.192151 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9w6q6" Jul 16 17:35:22.198579 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.198489 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 16 17:35:22.198670 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.198554 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 16 17:35:22.198734 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.198713 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 16 17:35:22.198796 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.198781 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tnqr8"] Jul 16 17:35:22.199252 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.199235 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 16 17:35:22.199500 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.199483 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bnspx"] Jul 16 17:35:22.203090 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.203073 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-4zvhw\"" Jul 16 17:35:22.212016 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.211996 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9w6q6"] Jul 16 17:35:22.252657 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.252637 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:22.253494 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.253480 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-h7w8t" Jul 16 17:35:22.267261 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.267238 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d8d76dd8d-fztrr"] Jul 16 17:35:22.270911 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.270886 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:22.272365 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.272327 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d188b6b9-c314-4df0-bf39-e62ece5b1c32-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-bnspx\" (UID: \"d188b6b9-c314-4df0-bf39-e62ece5b1c32\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bnspx" Jul 16 17:35:22.272495 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.272370 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d188b6b9-c314-4df0-bf39-e62ece5b1c32-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-bnspx\" (UID: \"d188b6b9-c314-4df0-bf39-e62ece5b1c32\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bnspx" Jul 16 17:35:22.272495 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.272463 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnkhg\" (UniqueName: \"kubernetes.io/projected/f1beb1db-48e4-4b9f-a6b1-7c7f89761ba7-kube-api-access-jnkhg\") pod \"volume-data-source-validator-78495597f6-tnqr8\" (UID: \"f1beb1db-48e4-4b9f-a6b1-7c7f89761ba7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tnqr8" Jul 16 17:35:22.272663 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.272640 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/02c4f876-b486-4820-b057-13bce5df4b54-serving-cert\") pod \"service-ca-operator-7695fc6c8c-9w6q6\" (UID: \"02c4f876-b486-4820-b057-13bce5df4b54\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9w6q6" Jul 16 17:35:22.272722 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.272678 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/02c4f876-b486-4820-b057-13bce5df4b54-config\") pod \"service-ca-operator-7695fc6c8c-9w6q6\" (UID: \"02c4f876-b486-4820-b057-13bce5df4b54\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9w6q6" Jul 16 17:35:22.272795 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.272777 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdqvc\" (UniqueName: \"kubernetes.io/projected/02c4f876-b486-4820-b057-13bce5df4b54-kube-api-access-gdqvc\") pod \"service-ca-operator-7695fc6c8c-9w6q6\" (UID: \"02c4f876-b486-4820-b057-13bce5df4b54\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9w6q6" Jul 16 17:35:22.272849 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.272820 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hkfb\" (UniqueName: \"kubernetes.io/projected/d188b6b9-c314-4df0-bf39-e62ece5b1c32-kube-api-access-9hkfb\") pod \"kube-storage-version-migrator-operator-799cb7f958-bnspx\" (UID: \"d188b6b9-c314-4df0-bf39-e62ece5b1c32\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bnspx" Jul 16 17:35:22.274039 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.274021 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-59kcl\"" Jul 16 17:35:22.274133 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.274115 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 16 17:35:22.274219 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.274027 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 16 17:35:22.274442 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.274425 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 16 17:35:22.279349 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.279330 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 16 17:35:22.284393 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.284368 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d8d76dd8d-fztrr"] Jul 16 17:35:22.316599 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.316568 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:22.373657 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.373628 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-registry-tls\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:22.373784 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.373673 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9595d508-5f2b-4421-a272-9f6b7a348cbc-registry-certificates\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:22.373784 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.373693 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9595d508-5f2b-4421-a272-9f6b7a348cbc-installation-pull-secrets\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:22.373784 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.373735 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d188b6b9-c314-4df0-bf39-e62ece5b1c32-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-bnspx\" (UID: \"d188b6b9-c314-4df0-bf39-e62ece5b1c32\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bnspx" Jul 16 17:35:22.373916 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.373790 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d188b6b9-c314-4df0-bf39-e62ece5b1c32-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-bnspx\" (UID: \"d188b6b9-c314-4df0-bf39-e62ece5b1c32\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bnspx" Jul 16 17:35:22.373916 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.373900 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/02c4f876-b486-4820-b057-13bce5df4b54-config\") pod \"service-ca-operator-7695fc6c8c-9w6q6\" (UID: \"02c4f876-b486-4820-b057-13bce5df4b54\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9w6q6" Jul 16 17:35:22.374020 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.373936 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdqvc\" (UniqueName: \"kubernetes.io/projected/02c4f876-b486-4820-b057-13bce5df4b54-kube-api-access-gdqvc\") pod \"service-ca-operator-7695fc6c8c-9w6q6\" (UID: \"02c4f876-b486-4820-b057-13bce5df4b54\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9w6q6" Jul 16 17:35:22.374020 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.373970 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9595d508-5f2b-4421-a272-9f6b7a348cbc-image-registry-private-configuration\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:22.374020 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.374009 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hkfb\" (UniqueName: \"kubernetes.io/projected/d188b6b9-c314-4df0-bf39-e62ece5b1c32-kube-api-access-9hkfb\") pod \"kube-storage-version-migrator-operator-799cb7f958-bnspx\" (UID: \"d188b6b9-c314-4df0-bf39-e62ece5b1c32\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bnspx" Jul 16 17:35:22.374163 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.374046 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-bound-sa-token\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:22.374163 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.374105 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnkhg\" (UniqueName: \"kubernetes.io/projected/f1beb1db-48e4-4b9f-a6b1-7c7f89761ba7-kube-api-access-jnkhg\") pod \"volume-data-source-validator-78495597f6-tnqr8\" (UID: \"f1beb1db-48e4-4b9f-a6b1-7c7f89761ba7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tnqr8" Jul 16 17:35:22.374163 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.374133 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/02c4f876-b486-4820-b057-13bce5df4b54-serving-cert\") pod \"service-ca-operator-7695fc6c8c-9w6q6\" (UID: \"02c4f876-b486-4820-b057-13bce5df4b54\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9w6q6" Jul 16 17:35:22.374163 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.374159 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9595d508-5f2b-4421-a272-9f6b7a348cbc-ca-trust-extracted\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:22.374364 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.374181 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9595d508-5f2b-4421-a272-9f6b7a348cbc-trusted-ca\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:22.374364 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.374220 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv7lc\" (UniqueName: \"kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-kube-api-access-sv7lc\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:22.374364 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.374332 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d188b6b9-c314-4df0-bf39-e62ece5b1c32-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-bnspx\" (UID: \"d188b6b9-c314-4df0-bf39-e62ece5b1c32\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bnspx" Jul 16 17:35:22.374544 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.374528 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/02c4f876-b486-4820-b057-13bce5df4b54-config\") pod \"service-ca-operator-7695fc6c8c-9w6q6\" (UID: \"02c4f876-b486-4820-b057-13bce5df4b54\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9w6q6" Jul 16 17:35:22.376161 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.376140 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/02c4f876-b486-4820-b057-13bce5df4b54-serving-cert\") pod \"service-ca-operator-7695fc6c8c-9w6q6\" (UID: \"02c4f876-b486-4820-b057-13bce5df4b54\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9w6q6" Jul 16 17:35:22.376248 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.376143 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d188b6b9-c314-4df0-bf39-e62ece5b1c32-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-bnspx\" (UID: \"d188b6b9-c314-4df0-bf39-e62ece5b1c32\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bnspx" Jul 16 17:35:22.386035 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.386017 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-h7w8t"] Jul 16 17:35:22.388108 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:35:22.388085 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83bc0281_2e18_403e_a681_d356367d8355.slice/crio-3ef24f02d3aa3e991de4258972ec9067062bc9300b7f8532a5158352618b90ca WatchSource:0}: Error finding container 3ef24f02d3aa3e991de4258972ec9067062bc9300b7f8532a5158352618b90ca: Status 404 returned error can't find the container with id 3ef24f02d3aa3e991de4258972ec9067062bc9300b7f8532a5158352618b90ca Jul 16 17:35:22.389093 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.389068 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnkhg\" (UniqueName: \"kubernetes.io/projected/f1beb1db-48e4-4b9f-a6b1-7c7f89761ba7-kube-api-access-jnkhg\") pod \"volume-data-source-validator-78495597f6-tnqr8\" (UID: \"f1beb1db-48e4-4b9f-a6b1-7c7f89761ba7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tnqr8" Jul 16 17:35:22.389462 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.389445 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hkfb\" (UniqueName: \"kubernetes.io/projected/d188b6b9-c314-4df0-bf39-e62ece5b1c32-kube-api-access-9hkfb\") pod \"kube-storage-version-migrator-operator-799cb7f958-bnspx\" (UID: \"d188b6b9-c314-4df0-bf39-e62ece5b1c32\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bnspx" Jul 16 17:35:22.390151 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.390130 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdqvc\" (UniqueName: \"kubernetes.io/projected/02c4f876-b486-4820-b057-13bce5df4b54-kube-api-access-gdqvc\") pod \"service-ca-operator-7695fc6c8c-9w6q6\" (UID: \"02c4f876-b486-4820-b057-13bce5df4b54\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9w6q6" Jul 16 17:35:22.475477 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.475410 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv7lc\" (UniqueName: \"kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-kube-api-access-sv7lc\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:22.475477 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.475457 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-registry-tls\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:22.475631 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.475488 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9595d508-5f2b-4421-a272-9f6b7a348cbc-registry-certificates\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:22.475631 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:22.475571 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 17:35:22.475631 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:22.475589 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d8d76dd8d-fztrr: secret "image-registry-tls" not found Jul 16 17:35:22.475631 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.475593 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9595d508-5f2b-4421-a272-9f6b7a348cbc-installation-pull-secrets\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:22.475823 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.475642 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9595d508-5f2b-4421-a272-9f6b7a348cbc-image-registry-private-configuration\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:22.475823 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:22.475687 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-registry-tls podName:9595d508-5f2b-4421-a272-9f6b7a348cbc nodeName:}" failed. No retries permitted until 2026-07-16 17:35:22.975663844 +0000 UTC m=+93.505088090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-registry-tls") pod "image-registry-7d8d76dd8d-fztrr" (UID: "9595d508-5f2b-4421-a272-9f6b7a348cbc") : secret "image-registry-tls" not found Jul 16 17:35:22.475823 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.475756 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-bound-sa-token\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:22.475823 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.475799 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9595d508-5f2b-4421-a272-9f6b7a348cbc-ca-trust-extracted\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:22.475823 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.475820 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9595d508-5f2b-4421-a272-9f6b7a348cbc-trusted-ca\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:22.476065 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.475999 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9595d508-5f2b-4421-a272-9f6b7a348cbc-registry-certificates\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:22.476174 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.476156 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9595d508-5f2b-4421-a272-9f6b7a348cbc-ca-trust-extracted\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:22.476594 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.476577 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9595d508-5f2b-4421-a272-9f6b7a348cbc-trusted-ca\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:22.477517 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.477500 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9595d508-5f2b-4421-a272-9f6b7a348cbc-installation-pull-secrets\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:22.477673 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.477656 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9595d508-5f2b-4421-a272-9f6b7a348cbc-image-registry-private-configuration\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:22.482603 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.482589 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bnspx" Jul 16 17:35:22.487190 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.487171 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tnqr8" Jul 16 17:35:22.487505 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.487481 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-bound-sa-token\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:22.487779 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.487764 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv7lc\" (UniqueName: \"kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-kube-api-access-sv7lc\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:22.500951 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.500931 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9w6q6" Jul 16 17:35:22.636431 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.636389 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bnspx"] Jul 16 17:35:22.639141 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:35:22.639117 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd188b6b9_c314_4df0_bf39_e62ece5b1c32.slice/crio-62210009570f131a602a0c94c4a14ab03955a82cd0acf1e35d42eb35fad4014d WatchSource:0}: Error finding container 62210009570f131a602a0c94c4a14ab03955a82cd0acf1e35d42eb35fad4014d: Status 404 returned error can't find the container with id 62210009570f131a602a0c94c4a14ab03955a82cd0acf1e35d42eb35fad4014d Jul 16 17:35:22.848947 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.848908 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tnqr8"] Jul 16 17:35:22.850882 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:35:22.850855 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1beb1db_48e4_4b9f_a6b1_7c7f89761ba7.slice/crio-3265c3ce92f89f740c334608ff0e8dea10a793f86e0a79771fed35873d6172bc WatchSource:0}: Error finding container 3265c3ce92f89f740c334608ff0e8dea10a793f86e0a79771fed35873d6172bc: Status 404 returned error can't find the container with id 3265c3ce92f89f740c334608ff0e8dea10a793f86e0a79771fed35873d6172bc Jul 16 17:35:22.853790 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.853645 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9w6q6"] Jul 16 17:35:22.856148 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:35:22.856126 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02c4f876_b486_4820_b057_13bce5df4b54.slice/crio-6d37ae4df0c4be568707954e98ee788bbcef40214644b292c2f359dae765fc5a WatchSource:0}: Error finding container 6d37ae4df0c4be568707954e98ee788bbcef40214644b292c2f359dae765fc5a: Status 404 returned error can't find the container with id 6d37ae4df0c4be568707954e98ee788bbcef40214644b292c2f359dae765fc5a Jul 16 17:35:22.980307 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:22.980283 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-registry-tls\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:22.980673 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:22.980474 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 17:35:22.980673 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:22.980494 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d8d76dd8d-fztrr: secret "image-registry-tls" not found Jul 16 17:35:22.980673 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:22.980549 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-registry-tls podName:9595d508-5f2b-4421-a272-9f6b7a348cbc nodeName:}" failed. No retries permitted until 2026-07-16 17:35:23.980531058 +0000 UTC m=+94.509955299 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-registry-tls") pod "image-registry-7d8d76dd8d-fztrr" (UID: "9595d508-5f2b-4421-a272-9f6b7a348cbc") : secret "image-registry-tls" not found Jul 16 17:35:23.365258 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:23.365223 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bnspx" event={"ID":"d188b6b9-c314-4df0-bf39-e62ece5b1c32","Type":"ContainerStarted","Data":"62210009570f131a602a0c94c4a14ab03955a82cd0acf1e35d42eb35fad4014d"} Jul 16 17:35:23.366586 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:23.366551 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9w6q6" event={"ID":"02c4f876-b486-4820-b057-13bce5df4b54","Type":"ContainerStarted","Data":"6d37ae4df0c4be568707954e98ee788bbcef40214644b292c2f359dae765fc5a"} Jul 16 17:35:23.367878 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:23.367846 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tnqr8" event={"ID":"f1beb1db-48e4-4b9f-a6b1-7c7f89761ba7","Type":"ContainerStarted","Data":"3265c3ce92f89f740c334608ff0e8dea10a793f86e0a79771fed35873d6172bc"} Jul 16 17:35:23.369069 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:23.369044 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-h7w8t" event={"ID":"83bc0281-2e18-403e-a681-d356367d8355","Type":"ContainerStarted","Data":"3ef24f02d3aa3e991de4258972ec9067062bc9300b7f8532a5158352618b90ca"} Jul 16 17:35:23.989389 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:23.989354 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-registry-tls\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:23.989761 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:23.989510 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 17:35:23.989761 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:23.989527 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d8d76dd8d-fztrr: secret "image-registry-tls" not found Jul 16 17:35:23.989761 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:23.989582 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-registry-tls podName:9595d508-5f2b-4421-a272-9f6b7a348cbc nodeName:}" failed. No retries permitted until 2026-07-16 17:35:25.98956531 +0000 UTC m=+96.518989553 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-registry-tls") pod "image-registry-7d8d76dd8d-fztrr" (UID: "9595d508-5f2b-4421-a272-9f6b7a348cbc") : secret "image-registry-tls" not found Jul 16 17:35:24.373908 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:24.373878 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-h7w8t" event={"ID":"83bc0281-2e18-403e-a681-d356367d8355","Type":"ContainerStarted","Data":"aa4a541c130e0c7f5e78d825b07ed45bc24ee99ab768472aa9662d0010e87c54"} Jul 16 17:35:24.405211 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:24.405154 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-h7w8t" podStartSLOduration=1.752272889 podStartE2EDuration="3.40513545s" totalImagesPullingTime="1.652862561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:35:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:24.404541679 +0000 UTC m=+94.933965970" watchObservedRunningTime="2026-07-16 17:35:24.40513545 +0000 UTC m=+94.934559715" Jul 16 17:35:25.378775 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:25.378743 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9w6q6" event={"ID":"02c4f876-b486-4820-b057-13bce5df4b54","Type":"ContainerStarted","Data":"1fe2ccbe7dc5c1b0582e3958c652a2c1e5287c11da50cf5897591c5dfcbca8dc"} Jul 16 17:35:25.403599 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:25.403558 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9w6q6" podStartSLOduration=1.594114551 podStartE2EDuration="3.403542126s" totalImagesPullingTime="1.809427575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:35:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:25.401991387 +0000 UTC m=+95.931415649" watchObservedRunningTime="2026-07-16 17:35:25.403542126 +0000 UTC m=+95.932966388" Jul 16 17:35:25.822856 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:25.822775 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qwntv"] Jul 16 17:35:25.827095 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:25.827071 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:25.830312 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:25.830279 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 16 17:35:25.830475 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:25.830285 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 16 17:35:25.830788 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:25.830758 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nsb9l\"" Jul 16 17:35:25.842651 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:25.842626 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qwntv"] Jul 16 17:35:25.848446 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:25.848402 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:25.906546 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:25.906516 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7615346-ccf4-44a6-9393-007ccf5351d3-data-volume\") pod \"insights-runtime-extractor-qwntv\" (UID: \"e7615346-ccf4-44a6-9393-007ccf5351d3\") " pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:25.906735 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:25.906572 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e7615346-ccf4-44a6-9393-007ccf5351d3-crio-socket\") pod \"insights-runtime-extractor-qwntv\" (UID: \"e7615346-ccf4-44a6-9393-007ccf5351d3\") " pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:25.906735 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:25.906667 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn5h4\" (UniqueName: \"kubernetes.io/projected/e7615346-ccf4-44a6-9393-007ccf5351d3-kube-api-access-sn5h4\") pod \"insights-runtime-extractor-qwntv\" (UID: \"e7615346-ccf4-44a6-9393-007ccf5351d3\") " pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:25.906735 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:25.906703 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7615346-ccf4-44a6-9393-007ccf5351d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qwntv\" (UID: \"e7615346-ccf4-44a6-9393-007ccf5351d3\") " pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:25.906889 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:25.906773 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e7615346-ccf4-44a6-9393-007ccf5351d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qwntv\" (UID: \"e7615346-ccf4-44a6-9393-007ccf5351d3\") " pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:25.973249 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:25.973217 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:26.007616 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:26.007584 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e7615346-ccf4-44a6-9393-007ccf5351d3-crio-socket\") pod \"insights-runtime-extractor-qwntv\" (UID: \"e7615346-ccf4-44a6-9393-007ccf5351d3\") " pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:26.007772 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:26.007629 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-registry-tls\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:26.007772 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:26.007681 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn5h4\" (UniqueName: \"kubernetes.io/projected/e7615346-ccf4-44a6-9393-007ccf5351d3-kube-api-access-sn5h4\") pod \"insights-runtime-extractor-qwntv\" (UID: \"e7615346-ccf4-44a6-9393-007ccf5351d3\") " pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:26.007772 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:26.007702 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e7615346-ccf4-44a6-9393-007ccf5351d3-crio-socket\") pod \"insights-runtime-extractor-qwntv\" (UID: \"e7615346-ccf4-44a6-9393-007ccf5351d3\") " pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:26.007772 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:26.007713 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7615346-ccf4-44a6-9393-007ccf5351d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qwntv\" (UID: \"e7615346-ccf4-44a6-9393-007ccf5351d3\") " pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:26.007772 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:26.007765 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e7615346-ccf4-44a6-9393-007ccf5351d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qwntv\" (UID: \"e7615346-ccf4-44a6-9393-007ccf5351d3\") " pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:26.008020 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:26.007807 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 17:35:26.008020 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:26.007824 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7615346-ccf4-44a6-9393-007ccf5351d3-data-volume\") pod \"insights-runtime-extractor-qwntv\" (UID: \"e7615346-ccf4-44a6-9393-007ccf5351d3\") " pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:26.008020 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:26.007850 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 17:35:26.008020 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:26.007863 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7615346-ccf4-44a6-9393-007ccf5351d3-insights-runtime-extractor-tls podName:e7615346-ccf4-44a6-9393-007ccf5351d3 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:26.507845504 +0000 UTC m=+97.037269744 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e7615346-ccf4-44a6-9393-007ccf5351d3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qwntv" (UID: "e7615346-ccf4-44a6-9393-007ccf5351d3") : secret "insights-runtime-extractor-tls" not found Jul 16 17:35:26.008020 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:26.007808 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 17:35:26.008020 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:26.007910 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7615346-ccf4-44a6-9393-007ccf5351d3-kube-rbac-proxy-cm podName:e7615346-ccf4-44a6-9393-007ccf5351d3 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:26.507891529 +0000 UTC m=+97.037315769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e7615346-ccf4-44a6-9393-007ccf5351d3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qwntv" (UID: "e7615346-ccf4-44a6-9393-007ccf5351d3") : configmap "kube-rbac-proxy" not found Jul 16 17:35:26.008020 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:26.007910 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d8d76dd8d-fztrr: secret "image-registry-tls" not found Jul 16 17:35:26.008020 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:26.007953 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-registry-tls podName:9595d508-5f2b-4421-a272-9f6b7a348cbc nodeName:}" failed. No retries permitted until 2026-07-16 17:35:30.007940197 +0000 UTC m=+100.537364468 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-registry-tls") pod "image-registry-7d8d76dd8d-fztrr" (UID: "9595d508-5f2b-4421-a272-9f6b7a348cbc") : secret "image-registry-tls" not found Jul 16 17:35:26.008311 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:26.008101 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7615346-ccf4-44a6-9393-007ccf5351d3-data-volume\") pod \"insights-runtime-extractor-qwntv\" (UID: \"e7615346-ccf4-44a6-9393-007ccf5351d3\") " pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:26.021234 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:26.021210 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn5h4\" (UniqueName: \"kubernetes.io/projected/e7615346-ccf4-44a6-9393-007ccf5351d3-kube-api-access-sn5h4\") pod \"insights-runtime-extractor-qwntv\" (UID: \"e7615346-ccf4-44a6-9393-007ccf5351d3\") " pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:26.384535 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:26.384450 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tnqr8" event={"ID":"f1beb1db-48e4-4b9f-a6b1-7c7f89761ba7","Type":"ContainerStarted","Data":"2d2dca490b9c614a6ba64efd2499102c6af58eba56de39e516ffa1096524c202"} Jul 16 17:35:26.386049 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:26.386021 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bnspx" event={"ID":"d188b6b9-c314-4df0-bf39-e62ece5b1c32","Type":"ContainerStarted","Data":"33d01ba6df3dc64c7d917488dffd2bdfa8de8d7d3dae0e7e08f5057aa97ebbb4"} Jul 16 17:35:26.405905 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:26.405869 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tnqr8" podStartSLOduration=1.927076559 podStartE2EDuration="4.405854318s" totalImagesPullingTime="2.478777759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:35:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:26.404895958 +0000 UTC m=+96.934320220" watchObservedRunningTime="2026-07-16 17:35:26.405854318 +0000 UTC m=+96.935278580" Jul 16 17:35:26.435970 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:26.435928 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bnspx" podStartSLOduration=1.025417296 podStartE2EDuration="4.435910562s" totalImagesPullingTime="3.410493266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:35:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:26.435310045 +0000 UTC m=+96.964734312" watchObservedRunningTime="2026-07-16 17:35:26.435910562 +0000 UTC m=+96.965334825" Jul 16 17:35:26.513238 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:26.512893 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7615346-ccf4-44a6-9393-007ccf5351d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qwntv\" (UID: \"e7615346-ccf4-44a6-9393-007ccf5351d3\") " pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:26.513238 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:26.512959 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e7615346-ccf4-44a6-9393-007ccf5351d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qwntv\" (UID: \"e7615346-ccf4-44a6-9393-007ccf5351d3\") " pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:26.513238 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:26.513046 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 17:35:26.513238 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:26.513100 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7615346-ccf4-44a6-9393-007ccf5351d3-kube-rbac-proxy-cm podName:e7615346-ccf4-44a6-9393-007ccf5351d3 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:27.513082818 +0000 UTC m=+98.042507064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e7615346-ccf4-44a6-9393-007ccf5351d3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qwntv" (UID: "e7615346-ccf4-44a6-9393-007ccf5351d3") : configmap "kube-rbac-proxy" not found Jul 16 17:35:26.513238 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:26.513146 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 17:35:26.513238 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:26.513195 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7615346-ccf4-44a6-9393-007ccf5351d3-insights-runtime-extractor-tls podName:e7615346-ccf4-44a6-9393-007ccf5351d3 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:27.513177066 +0000 UTC m=+98.042601315 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e7615346-ccf4-44a6-9393-007ccf5351d3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qwntv" (UID: "e7615346-ccf4-44a6-9393-007ccf5351d3") : secret "insights-runtime-extractor-tls" not found Jul 16 17:35:26.941036 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:26.941004 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:27.047767 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:27.047731 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:27.367468 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:27.367437 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:27.464651 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:27.464627 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:27.518838 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:27.518814 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e7615346-ccf4-44a6-9393-007ccf5351d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qwntv\" (UID: \"e7615346-ccf4-44a6-9393-007ccf5351d3\") " pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:27.518942 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:27.518927 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 17:35:27.518989 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:27.518959 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7615346-ccf4-44a6-9393-007ccf5351d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qwntv\" (UID: \"e7615346-ccf4-44a6-9393-007ccf5351d3\") " pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:27.518989 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:27.518979 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7615346-ccf4-44a6-9393-007ccf5351d3-kube-rbac-proxy-cm podName:e7615346-ccf4-44a6-9393-007ccf5351d3 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:29.518965744 +0000 UTC m=+100.048389983 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e7615346-ccf4-44a6-9393-007ccf5351d3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qwntv" (UID: "e7615346-ccf4-44a6-9393-007ccf5351d3") : configmap "kube-rbac-proxy" not found Jul 16 17:35:27.519103 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:27.519035 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 17:35:27.519103 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:27.519097 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7615346-ccf4-44a6-9393-007ccf5351d3-insights-runtime-extractor-tls podName:e7615346-ccf4-44a6-9393-007ccf5351d3 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:29.519077714 +0000 UTC m=+100.048501960 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e7615346-ccf4-44a6-9393-007ccf5351d3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qwntv" (UID: "e7615346-ccf4-44a6-9393-007ccf5351d3") : secret "insights-runtime-extractor-tls" not found Jul 16 17:35:27.625911 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:27.625852 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:27.716121 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:27.716096 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:27.721336 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:27.721320 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb1fa25e-7b06-453d-8064-237d8cf6dd85-metrics-tls\") pod \"dns-default-fk9lj\" (UID: \"bb1fa25e-7b06-453d-8064-237d8cf6dd85\") " pod="openshift-dns/dns-default-fk9lj" Jul 16 17:35:27.721475 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:27.721462 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 17:35:27.721525 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:27.721515 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb1fa25e-7b06-453d-8064-237d8cf6dd85-metrics-tls podName:bb1fa25e-7b06-453d-8064-237d8cf6dd85 nodeName:}" failed. No retries permitted until 2026-07-16 17:36:31.721498913 +0000 UTC m=+162.250923164 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb1fa25e-7b06-453d-8064-237d8cf6dd85-metrics-tls") pod "dns-default-fk9lj" (UID: "bb1fa25e-7b06-453d-8064-237d8cf6dd85") : secret "dns-default-metrics-tls" not found Jul 16 17:35:27.766044 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:27.766023 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cxq75_8dbc1f99-f360-4ae6-8200-45ad3de61e8e/dns-node-resolver/0.log" Jul 16 17:35:28.562268 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:28.562244 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c5cwf_d9755014-b229-4b27-8e7c-a754e8729ed1/node-ca/0.log" Jul 16 17:35:28.659377 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:28.659351 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:28.758474 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:28.758435 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:29.059805 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:29.059782 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:29.164913 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:29.164887 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:29.367339 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:29.367314 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5bb9j_c8e9f9c3-67f6-43f0-8fc3-03a69ec68c4f/serve-healthcheck-canary/0.log" Jul 16 17:35:29.534982 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:29.534960 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7615346-ccf4-44a6-9393-007ccf5351d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qwntv\" (UID: \"e7615346-ccf4-44a6-9393-007ccf5351d3\") " pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:29.535102 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:29.534990 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e7615346-ccf4-44a6-9393-007ccf5351d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qwntv\" (UID: \"e7615346-ccf4-44a6-9393-007ccf5351d3\") " pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:29.535102 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:29.535057 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 17:35:29.535174 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:29.535104 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7615346-ccf4-44a6-9393-007ccf5351d3-kube-rbac-proxy-cm podName:e7615346-ccf4-44a6-9393-007ccf5351d3 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:33.535092089 +0000 UTC m=+104.064516329 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e7615346-ccf4-44a6-9393-007ccf5351d3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qwntv" (UID: "e7615346-ccf4-44a6-9393-007ccf5351d3") : configmap "kube-rbac-proxy" not found Jul 16 17:35:29.535174 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:29.535109 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 17:35:29.535174 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:29.535160 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7615346-ccf4-44a6-9393-007ccf5351d3-insights-runtime-extractor-tls podName:e7615346-ccf4-44a6-9393-007ccf5351d3 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:33.535143596 +0000 UTC m=+104.064567836 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e7615346-ccf4-44a6-9393-007ccf5351d3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qwntv" (UID: "e7615346-ccf4-44a6-9393-007ccf5351d3") : secret "insights-runtime-extractor-tls" not found Jul 16 17:35:30.039423 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:30.039386 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-registry-tls\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:30.039773 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:30.039518 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 17:35:30.039773 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:30.039533 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d8d76dd8d-fztrr: secret "image-registry-tls" not found Jul 16 17:35:30.039773 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:30.039582 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-registry-tls podName:9595d508-5f2b-4421-a272-9f6b7a348cbc nodeName:}" failed. No retries permitted until 2026-07-16 17:35:38.039567574 +0000 UTC m=+108.568991814 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-registry-tls") pod "image-registry-7d8d76dd8d-fztrr" (UID: "9595d508-5f2b-4421-a272-9f6b7a348cbc") : secret "image-registry-tls" not found Jul 16 17:35:30.311794 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:30.311716 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-h8zgd" Jul 16 17:35:30.588935 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:30.588874 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:33.506223 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:33.506190 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:33.564122 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:33.564095 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7615346-ccf4-44a6-9393-007ccf5351d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qwntv\" (UID: \"e7615346-ccf4-44a6-9393-007ccf5351d3\") " pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:33.564250 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:33.564127 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e7615346-ccf4-44a6-9393-007ccf5351d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qwntv\" (UID: \"e7615346-ccf4-44a6-9393-007ccf5351d3\") " pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:33.564250 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:33.564202 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 17:35:33.564250 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:33.564228 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 17:35:33.564360 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:33.564252 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7615346-ccf4-44a6-9393-007ccf5351d3-kube-rbac-proxy-cm podName:e7615346-ccf4-44a6-9393-007ccf5351d3 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:41.564237431 +0000 UTC m=+112.093661672 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e7615346-ccf4-44a6-9393-007ccf5351d3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qwntv" (UID: "e7615346-ccf4-44a6-9393-007ccf5351d3") : configmap "kube-rbac-proxy" not found Jul 16 17:35:33.564360 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:33.564275 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7615346-ccf4-44a6-9393-007ccf5351d3-insights-runtime-extractor-tls podName:e7615346-ccf4-44a6-9393-007ccf5351d3 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:41.56426174 +0000 UTC m=+112.093685981 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e7615346-ccf4-44a6-9393-007ccf5351d3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qwntv" (UID: "e7615346-ccf4-44a6-9393-007ccf5351d3") : secret "insights-runtime-extractor-tls" not found Jul 16 17:35:33.606375 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:33.606346 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:33.706020 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:33.705994 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:33.928074 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:33.928035 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:34.278977 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:34.278865 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:34.343130 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:34.343104 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:34.626821 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:34.626776 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:35.213814 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:35.213775 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:35.654181 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:35.654152 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:35.801280 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:35.801260 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:36.001600 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:36.001535 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:36.394679 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:36.394650 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:36.798347 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:36.798276 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:37.200762 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:37.200739 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:37.254711 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:37.254671 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:37.433520 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:37.433493 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:37.996818 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:37.996790 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:38.066760 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:38.066733 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:38.098902 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:38.098881 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-registry-tls\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:38.101144 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:38.101128 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-registry-tls\") pod \"image-registry-7d8d76dd8d-fztrr\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:38.181061 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:38.181037 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:38.198135 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:38.198113 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:38.309343 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:38.309323 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d8d76dd8d-fztrr"] Jul 16 17:35:38.311611 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:35:38.311586 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9595d508_5f2b_4421_a272_9f6b7a348cbc.slice/crio-e4e2d810c87828ebc74a2d0976bbb2320f3ff09f2017d75c20326a28d9e6c253 WatchSource:0}: Error finding container e4e2d810c87828ebc74a2d0976bbb2320f3ff09f2017d75c20326a28d9e6c253: Status 404 returned error can't find the container with id e4e2d810c87828ebc74a2d0976bbb2320f3ff09f2017d75c20326a28d9e6c253 Jul 16 17:35:38.423411 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:38.423381 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" event={"ID":"9595d508-5f2b-4421-a272-9f6b7a348cbc","Type":"ContainerStarted","Data":"45b58bd992655092a680631daff9bcd3675c86d96e51d98e18f0463b3e972b89"} Jul 16 17:35:38.423542 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:38.423445 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" event={"ID":"9595d508-5f2b-4421-a272-9f6b7a348cbc","Type":"ContainerStarted","Data":"e4e2d810c87828ebc74a2d0976bbb2320f3ff09f2017d75c20326a28d9e6c253"} Jul 16 17:35:38.423542 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:38.423472 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:35:38.453433 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:38.453321 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" podStartSLOduration=16.453303306 podStartE2EDuration="16.453303306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:35:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:38.453072986 +0000 UTC m=+108.982497249" watchObservedRunningTime="2026-07-16 17:35:38.453303306 +0000 UTC m=+108.982727569" Jul 16 17:35:38.526311 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:38.526243 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:38.797132 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:38.797064 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:39.012105 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:39.012076 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:39.589382 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:39.589350 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:39.806429 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:39.806387 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:40.002065 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:40.001986 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:40.199140 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:40.199112 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:40.393652 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:40.393622 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:40.643614 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:40.643587 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:41.599838 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:41.599804 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:41.626868 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:41.626844 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7615346-ccf4-44a6-9393-007ccf5351d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qwntv\" (UID: \"e7615346-ccf4-44a6-9393-007ccf5351d3\") " pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:41.626944 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:41.626878 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e7615346-ccf4-44a6-9393-007ccf5351d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qwntv\" (UID: \"e7615346-ccf4-44a6-9393-007ccf5351d3\") " pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:41.627010 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:41.626996 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 17:35:41.627068 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:35:41.627058 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7615346-ccf4-44a6-9393-007ccf5351d3-insights-runtime-extractor-tls podName:e7615346-ccf4-44a6-9393-007ccf5351d3 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:57.627042205 +0000 UTC m=+128.156466456 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e7615346-ccf4-44a6-9393-007ccf5351d3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qwntv" (UID: "e7615346-ccf4-44a6-9393-007ccf5351d3") : secret "insights-runtime-extractor-tls" not found Jul 16 17:35:41.627460 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:41.627444 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e7615346-ccf4-44a6-9393-007ccf5351d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qwntv\" (UID: \"e7615346-ccf4-44a6-9393-007ccf5351d3\") " pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:41.798089 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:41.798067 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:41.916247 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:41.916190 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:42.194626 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:42.194576 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:42.398156 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:42.398135 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:42.797860 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:42.797801 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:43.465787 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:43.465763 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:43.525703 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:43.525679 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:44.126936 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:44.126906 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:44.226453 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:44.226407 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:44.289776 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:44.289752 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:45.553379 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:45.553349 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:45.654317 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:45.654285 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:45.714092 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:45.714067 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:45.853571 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:45.853545 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:46.027812 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:46.027787 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:46.228376 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:46.228321 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:46.283865 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:46.283839 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:46.855982 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:46.855957 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:46.913656 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:46.913629 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:47.093506 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:47.093480 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:47.265333 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:47.265259 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:47.461821 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:47.461793 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:48.485602 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:48.485571 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:49.298635 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:49.298606 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:52.598433 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.598383 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-rj7vd"] Jul 16 17:35:52.601399 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.601376 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf6559499-sgbb9"] Jul 16 17:35:52.601550 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.601491 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-rj7vd" Jul 16 17:35:52.603144 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.603124 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf6559499-sgbb9" Jul 16 17:35:52.605037 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.605017 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hj6sn\"" Jul 16 17:35:52.605150 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.605102 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 16 17:35:52.605528 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.605515 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 16 17:35:52.607214 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.607194 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 16 17:35:52.607338 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.607257 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 16 17:35:52.607542 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.607521 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 16 17:35:52.607940 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.607920 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 16 17:35:52.617117 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.617098 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-rj7vd"] Jul 16 17:35:52.618043 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.618024 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf6559499-sgbb9"] Jul 16 17:35:52.624336 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.624316 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d8d76dd8d-fztrr"] Jul 16 17:35:52.696186 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.696155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8dd12cb4-6e1a-4100-a38b-34968b67a86d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rj7vd\" (UID: \"8dd12cb4-6e1a-4100-a38b-34968b67a86d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rj7vd" Jul 16 17:35:52.696322 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.696222 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5e1e6058-a3e1-4523-bea3-c6fb36b63b80-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bf6559499-sgbb9\" (UID: \"5e1e6058-a3e1-4523-bea3-c6fb36b63b80\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf6559499-sgbb9" Jul 16 17:35:52.696322 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.696276 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8dd12cb4-6e1a-4100-a38b-34968b67a86d-nginx-conf\") pod \"networking-console-plugin-6cf856758c-rj7vd\" (UID: \"8dd12cb4-6e1a-4100-a38b-34968b67a86d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rj7vd" Jul 16 17:35:52.696401 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.696319 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6kxt\" (UniqueName: \"kubernetes.io/projected/5e1e6058-a3e1-4523-bea3-c6fb36b63b80-kube-api-access-n6kxt\") pod \"klusterlet-addon-workmgr-6bf6559499-sgbb9\" (UID: \"5e1e6058-a3e1-4523-bea3-c6fb36b63b80\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf6559499-sgbb9" Jul 16 17:35:52.696401 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.696345 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e1e6058-a3e1-4523-bea3-c6fb36b63b80-tmp\") pod \"klusterlet-addon-workmgr-6bf6559499-sgbb9\" (UID: \"5e1e6058-a3e1-4523-bea3-c6fb36b63b80\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf6559499-sgbb9" Jul 16 17:35:52.717603 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.717580 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:52.797119 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.797094 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5e1e6058-a3e1-4523-bea3-c6fb36b63b80-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bf6559499-sgbb9\" (UID: \"5e1e6058-a3e1-4523-bea3-c6fb36b63b80\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf6559499-sgbb9" Jul 16 17:35:52.797225 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.797124 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8dd12cb4-6e1a-4100-a38b-34968b67a86d-nginx-conf\") pod \"networking-console-plugin-6cf856758c-rj7vd\" (UID: \"8dd12cb4-6e1a-4100-a38b-34968b67a86d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rj7vd" Jul 16 17:35:52.797225 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.797157 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6kxt\" (UniqueName: \"kubernetes.io/projected/5e1e6058-a3e1-4523-bea3-c6fb36b63b80-kube-api-access-n6kxt\") pod \"klusterlet-addon-workmgr-6bf6559499-sgbb9\" (UID: \"5e1e6058-a3e1-4523-bea3-c6fb36b63b80\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf6559499-sgbb9" Jul 16 17:35:52.797225 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.797182 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e1e6058-a3e1-4523-bea3-c6fb36b63b80-tmp\") pod \"klusterlet-addon-workmgr-6bf6559499-sgbb9\" (UID: \"5e1e6058-a3e1-4523-bea3-c6fb36b63b80\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf6559499-sgbb9" Jul 16 17:35:52.797225 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.797220 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8dd12cb4-6e1a-4100-a38b-34968b67a86d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rj7vd\" (UID: \"8dd12cb4-6e1a-4100-a38b-34968b67a86d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rj7vd" Jul 16 17:35:52.797574 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.797550 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e1e6058-a3e1-4523-bea3-c6fb36b63b80-tmp\") pod \"klusterlet-addon-workmgr-6bf6559499-sgbb9\" (UID: \"5e1e6058-a3e1-4523-bea3-c6fb36b63b80\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf6559499-sgbb9" Jul 16 17:35:52.797803 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.797784 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8dd12cb4-6e1a-4100-a38b-34968b67a86d-nginx-conf\") pod \"networking-console-plugin-6cf856758c-rj7vd\" (UID: \"8dd12cb4-6e1a-4100-a38b-34968b67a86d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rj7vd" Jul 16 17:35:52.799645 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.799627 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5e1e6058-a3e1-4523-bea3-c6fb36b63b80-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bf6559499-sgbb9\" (UID: \"5e1e6058-a3e1-4523-bea3-c6fb36b63b80\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf6559499-sgbb9" Jul 16 17:35:52.799701 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.799630 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8dd12cb4-6e1a-4100-a38b-34968b67a86d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rj7vd\" (UID: \"8dd12cb4-6e1a-4100-a38b-34968b67a86d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rj7vd" Jul 16 17:35:52.801329 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.801312 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:52.815264 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.815238 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6kxt\" (UniqueName: \"kubernetes.io/projected/5e1e6058-a3e1-4523-bea3-c6fb36b63b80-kube-api-access-n6kxt\") pod \"klusterlet-addon-workmgr-6bf6559499-sgbb9\" (UID: \"5e1e6058-a3e1-4523-bea3-c6fb36b63b80\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf6559499-sgbb9" Jul 16 17:35:52.911619 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.911568 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-rj7vd" Jul 16 17:35:52.916828 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:52.916797 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf6559499-sgbb9" Jul 16 17:35:53.056274 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:53.056136 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-rj7vd"] Jul 16 17:35:53.058626 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:35:53.058601 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dd12cb4_6e1a_4100_a38b_34968b67a86d.slice/crio-0358775287b32e33222ff8d74600b48386b1b6b956c3f036e61fe926025fc7f5 WatchSource:0}: Error finding container 0358775287b32e33222ff8d74600b48386b1b6b956c3f036e61fe926025fc7f5: Status 404 returned error can't find the container with id 0358775287b32e33222ff8d74600b48386b1b6b956c3f036e61fe926025fc7f5 Jul 16 17:35:53.066024 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:53.065999 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf6559499-sgbb9"] Jul 16 17:35:53.068628 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:35:53.068606 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e1e6058_a3e1_4523_bea3_c6fb36b63b80.slice/crio-7e0c49589f297f90174c3371166789e8d79bc785627e2fc23a936208613333f6 WatchSource:0}: Error finding container 7e0c49589f297f90174c3371166789e8d79bc785627e2fc23a936208613333f6: Status 404 returned error can't find the container with id 7e0c49589f297f90174c3371166789e8d79bc785627e2fc23a936208613333f6 Jul 16 17:35:53.467595 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:53.467559 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf6559499-sgbb9" event={"ID":"5e1e6058-a3e1-4523-bea3-c6fb36b63b80","Type":"ContainerStarted","Data":"7e0c49589f297f90174c3371166789e8d79bc785627e2fc23a936208613333f6"} Jul 16 17:35:53.468802 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:53.468777 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-rj7vd" event={"ID":"8dd12cb4-6e1a-4100-a38b-34968b67a86d","Type":"ContainerStarted","Data":"0358775287b32e33222ff8d74600b48386b1b6b956c3f036e61fe926025fc7f5"} Jul 16 17:35:55.268511 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:55.268475 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:55.334159 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:55.334132 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:57.402999 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:57.402969 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:57.484137 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:57.484110 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf6559499-sgbb9" event={"ID":"5e1e6058-a3e1-4523-bea3-c6fb36b63b80","Type":"ContainerStarted","Data":"315bcc4e9277c19789cd98cb788a92538b0c928e57352e113573311de101a07f"} Jul 16 17:35:57.484320 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:57.484297 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf6559499-sgbb9" Jul 16 17:35:57.485697 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:57.485671 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-rj7vd" event={"ID":"8dd12cb4-6e1a-4100-a38b-34968b67a86d","Type":"ContainerStarted","Data":"ed952f204accfd6458a1df7112baff3862faa183752d42fde1024ab59eba53ae"} Jul 16 17:35:57.486031 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:57.486017 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf6559499-sgbb9" Jul 16 17:35:57.502782 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:57.502733 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf6559499-sgbb9" podStartSLOduration=2.1055827049999998 podStartE2EDuration="5.502682684s" totalImagesPullingTime="3.397099979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:35:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:57.502130374 +0000 UTC m=+128.031554633" watchObservedRunningTime="2026-07-16 17:35:57.502682684 +0000 UTC m=+128.032106947" Jul 16 17:35:57.507086 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:57.507068 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:57.529826 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:57.529783 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-rj7vd" podStartSLOduration=2.139145488 podStartE2EDuration="5.529771439s" totalImagesPullingTime="3.390625951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:35:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:57.529219445 +0000 UTC m=+128.058643754" watchObservedRunningTime="2026-07-16 17:35:57.529771439 +0000 UTC m=+128.059195707" Jul 16 17:35:57.593178 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:57.593157 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:57.597528 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:57.597508 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-546mt"] Jul 16 17:35:57.601512 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:57.601496 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-546mt" Jul 16 17:35:57.604846 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:57.604831 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 16 17:35:57.605306 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:57.605292 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-sllv2\"" Jul 16 17:35:57.611396 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:57.611376 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-546mt"] Jul 16 17:35:57.637145 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:57.637119 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7615346-ccf4-44a6-9393-007ccf5351d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qwntv\" (UID: \"e7615346-ccf4-44a6-9393-007ccf5351d3\") " pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:57.639283 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:57.639266 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7615346-ccf4-44a6-9393-007ccf5351d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qwntv\" (UID: \"e7615346-ccf4-44a6-9393-007ccf5351d3\") " pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:57.669819 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:57.669763 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:57.737987 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:57.737962 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/745de2af-ab69-4819-bcc4-9857e8566442-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-546mt\" (UID: \"745de2af-ab69-4819-bcc4-9857e8566442\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-546mt" Jul 16 17:35:57.770761 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:57.770735 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:57.838264 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:57.838243 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/745de2af-ab69-4819-bcc4-9857e8566442-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-546mt\" (UID: \"745de2af-ab69-4819-bcc4-9857e8566442\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-546mt" Jul 16 17:35:57.840358 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:57.840343 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/745de2af-ab69-4819-bcc4-9857e8566442-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-546mt\" (UID: \"745de2af-ab69-4819-bcc4-9857e8566442\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-546mt" Jul 16 17:35:57.873658 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:57.873637 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:57.909805 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:57.909790 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-546mt" Jul 16 17:35:57.940287 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:57.940238 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nsb9l\"" Jul 16 17:35:57.948687 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:57.948664 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qwntv" Jul 16 17:35:58.045311 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:58.045239 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-546mt"] Jul 16 17:35:58.049434 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:35:58.049398 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745de2af_ab69_4819_bcc4_9857e8566442.slice/crio-2807ef5e3d508dae3be0b9c83bf6ab1fbf509677fa56489c12174f09762ebf9b WatchSource:0}: Error finding container 2807ef5e3d508dae3be0b9c83bf6ab1fbf509677fa56489c12174f09762ebf9b: Status 404 returned error can't find the container with id 2807ef5e3d508dae3be0b9c83bf6ab1fbf509677fa56489c12174f09762ebf9b Jul 16 17:35:58.090099 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:58.090076 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qwntv"] Jul 16 17:35:58.092816 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:35:58.092788 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7615346_ccf4_44a6_9393_007ccf5351d3.slice/crio-2c0d6b947f52ec6190a8e17f4858935b6e48820d0a6fbc6329c5196c0e1ae1ff WatchSource:0}: Error finding container 2c0d6b947f52ec6190a8e17f4858935b6e48820d0a6fbc6329c5196c0e1ae1ff: Status 404 returned error can't find the container with id 2c0d6b947f52ec6190a8e17f4858935b6e48820d0a6fbc6329c5196c0e1ae1ff Jul 16 17:35:58.489982 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:58.489954 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-546mt" event={"ID":"745de2af-ab69-4819-bcc4-9857e8566442","Type":"ContainerStarted","Data":"2807ef5e3d508dae3be0b9c83bf6ab1fbf509677fa56489c12174f09762ebf9b"} Jul 16 17:35:58.490987 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:58.490966 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qwntv" event={"ID":"e7615346-ccf4-44a6-9393-007ccf5351d3","Type":"ContainerStarted","Data":"2c0d6b947f52ec6190a8e17f4858935b6e48820d0a6fbc6329c5196c0e1ae1ff"} Jul 16 17:35:58.747304 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:58.746834 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4e3a253-031e-47d3-9ca3-18c97f49e614-metrics-certs\") pod \"network-metrics-daemon-7xmt6\" (UID: \"a4e3a253-031e-47d3-9ca3-18c97f49e614\") " pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:35:58.750187 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:58.750098 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4e3a253-031e-47d3-9ca3-18c97f49e614-metrics-certs\") pod \"network-metrics-daemon-7xmt6\" (UID: \"a4e3a253-031e-47d3-9ca3-18c97f49e614\") " pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:35:58.848403 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:58.848376 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2qkbl\"" Jul 16 17:35:58.856208 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:58.856183 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xmt6" Jul 16 17:35:58.910891 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:58.909742 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f9f7cd54d-6zf4d"] Jul 16 17:35:58.914073 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:58.913095 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9f7cd54d-6zf4d" Jul 16 17:35:58.918789 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:58.918764 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 16 17:35:58.919011 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:58.918994 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 16 17:35:58.919213 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:58.919188 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-f8xvd\"" Jul 16 17:35:58.919452 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:58.919395 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 16 17:35:58.947567 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:58.938147 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 16 17:35:58.947567 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:58.938359 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 16 17:35:58.947567 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:58.938585 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 16 17:35:58.947567 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:58.938816 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 16 17:35:58.947567 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:58.941199 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f9f7cd54d-6zf4d"] Jul 16 17:35:59.049466 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.049406 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30583ecb-417c-46c0-8c1f-3a2d61679bc8-oauth-serving-cert\") pod \"console-6f9f7cd54d-6zf4d\" (UID: \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\") " pod="openshift-console/console-6f9f7cd54d-6zf4d" Jul 16 17:35:59.049617 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.049493 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30583ecb-417c-46c0-8c1f-3a2d61679bc8-console-serving-cert\") pod \"console-6f9f7cd54d-6zf4d\" (UID: \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\") " pod="openshift-console/console-6f9f7cd54d-6zf4d" Jul 16 17:35:59.049617 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.049547 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30583ecb-417c-46c0-8c1f-3a2d61679bc8-console-config\") pod \"console-6f9f7cd54d-6zf4d\" (UID: \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\") " pod="openshift-console/console-6f9f7cd54d-6zf4d" Jul 16 17:35:59.049617 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.049576 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30583ecb-417c-46c0-8c1f-3a2d61679bc8-console-oauth-config\") pod \"console-6f9f7cd54d-6zf4d\" (UID: \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\") " pod="openshift-console/console-6f9f7cd54d-6zf4d" Jul 16 17:35:59.049778 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.049627 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30583ecb-417c-46c0-8c1f-3a2d61679bc8-service-ca\") pod \"console-6f9f7cd54d-6zf4d\" (UID: \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\") " pod="openshift-console/console-6f9f7cd54d-6zf4d" Jul 16 17:35:59.049778 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.049675 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnmfb\" (UniqueName: \"kubernetes.io/projected/30583ecb-417c-46c0-8c1f-3a2d61679bc8-kube-api-access-bnmfb\") pod \"console-6f9f7cd54d-6zf4d\" (UID: \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\") " pod="openshift-console/console-6f9f7cd54d-6zf4d" Jul 16 17:35:59.064207 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.063768 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7xmt6"] Jul 16 17:35:59.150990 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.150958 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30583ecb-417c-46c0-8c1f-3a2d61679bc8-console-config\") pod \"console-6f9f7cd54d-6zf4d\" (UID: \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\") " pod="openshift-console/console-6f9f7cd54d-6zf4d" Jul 16 17:35:59.151132 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.151003 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30583ecb-417c-46c0-8c1f-3a2d61679bc8-console-oauth-config\") pod \"console-6f9f7cd54d-6zf4d\" (UID: \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\") " pod="openshift-console/console-6f9f7cd54d-6zf4d" Jul 16 17:35:59.151132 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.151048 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30583ecb-417c-46c0-8c1f-3a2d61679bc8-service-ca\") pod \"console-6f9f7cd54d-6zf4d\" (UID: \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\") " pod="openshift-console/console-6f9f7cd54d-6zf4d" Jul 16 17:35:59.151132 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.151099 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnmfb\" (UniqueName: \"kubernetes.io/projected/30583ecb-417c-46c0-8c1f-3a2d61679bc8-kube-api-access-bnmfb\") pod \"console-6f9f7cd54d-6zf4d\" (UID: \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\") " pod="openshift-console/console-6f9f7cd54d-6zf4d" Jul 16 17:35:59.151303 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.151137 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30583ecb-417c-46c0-8c1f-3a2d61679bc8-oauth-serving-cert\") pod \"console-6f9f7cd54d-6zf4d\" (UID: \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\") " pod="openshift-console/console-6f9f7cd54d-6zf4d" Jul 16 17:35:59.151303 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.151172 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30583ecb-417c-46c0-8c1f-3a2d61679bc8-console-serving-cert\") pod \"console-6f9f7cd54d-6zf4d\" (UID: \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\") " pod="openshift-console/console-6f9f7cd54d-6zf4d" Jul 16 17:35:59.152148 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.151969 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30583ecb-417c-46c0-8c1f-3a2d61679bc8-service-ca\") pod \"console-6f9f7cd54d-6zf4d\" (UID: \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\") " pod="openshift-console/console-6f9f7cd54d-6zf4d" Jul 16 17:35:59.152148 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.152097 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30583ecb-417c-46c0-8c1f-3a2d61679bc8-oauth-serving-cert\") pod \"console-6f9f7cd54d-6zf4d\" (UID: \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\") " pod="openshift-console/console-6f9f7cd54d-6zf4d" Jul 16 17:35:59.152559 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.152537 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30583ecb-417c-46c0-8c1f-3a2d61679bc8-console-config\") pod \"console-6f9f7cd54d-6zf4d\" (UID: \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\") " pod="openshift-console/console-6f9f7cd54d-6zf4d" Jul 16 17:35:59.155037 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.154999 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30583ecb-417c-46c0-8c1f-3a2d61679bc8-console-serving-cert\") pod \"console-6f9f7cd54d-6zf4d\" (UID: \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\") " pod="openshift-console/console-6f9f7cd54d-6zf4d" Jul 16 17:35:59.155804 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.155754 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30583ecb-417c-46c0-8c1f-3a2d61679bc8-console-oauth-config\") pod \"console-6f9f7cd54d-6zf4d\" (UID: \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\") " pod="openshift-console/console-6f9f7cd54d-6zf4d" Jul 16 17:35:59.166086 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.166060 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnmfb\" (UniqueName: \"kubernetes.io/projected/30583ecb-417c-46c0-8c1f-3a2d61679bc8-kube-api-access-bnmfb\") pod \"console-6f9f7cd54d-6zf4d\" (UID: \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\") " pod="openshift-console/console-6f9f7cd54d-6zf4d" Jul 16 17:35:59.231140 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.231097 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9f7cd54d-6zf4d" Jul 16 17:35:59.309983 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:35:59.309918 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4e3a253_031e_47d3_9ca3_18c97f49e614.slice/crio-e1671e752a523d58eefa52857505dbae5347801003428d878da821a5ffb8b6b6 WatchSource:0}: Error finding container e1671e752a523d58eefa52857505dbae5347801003428d878da821a5ffb8b6b6: Status 404 returned error can't find the container with id e1671e752a523d58eefa52857505dbae5347801003428d878da821a5ffb8b6b6 Jul 16 17:35:59.451629 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.451592 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f9f7cd54d-6zf4d"] Jul 16 17:35:59.454825 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:35:59.454800 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30583ecb_417c_46c0_8c1f_3a2d61679bc8.slice/crio-cc366b1aaac0e61e9135402f6b23b819dcd3387ef6ac2beaa2b76fa01c41a3f9 WatchSource:0}: Error finding container cc366b1aaac0e61e9135402f6b23b819dcd3387ef6ac2beaa2b76fa01c41a3f9: Status 404 returned error can't find the container with id cc366b1aaac0e61e9135402f6b23b819dcd3387ef6ac2beaa2b76fa01c41a3f9 Jul 16 17:35:59.496365 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.496331 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-546mt" event={"ID":"745de2af-ab69-4819-bcc4-9857e8566442","Type":"ContainerStarted","Data":"3b9b55e622a67cc4ed8b59a646694efe39214caa2e0f5b911fde971a0e9c28ee"} Jul 16 17:35:59.496772 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.496395 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-546mt" Jul 16 17:35:59.497775 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.497720 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7xmt6" event={"ID":"a4e3a253-031e-47d3-9ca3-18c97f49e614","Type":"ContainerStarted","Data":"e1671e752a523d58eefa52857505dbae5347801003428d878da821a5ffb8b6b6"} Jul 16 17:35:59.499209 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.499184 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9f7cd54d-6zf4d" event={"ID":"30583ecb-417c-46c0-8c1f-3a2d61679bc8","Type":"ContainerStarted","Data":"cc366b1aaac0e61e9135402f6b23b819dcd3387ef6ac2beaa2b76fa01c41a3f9"} Jul 16 17:35:59.502188 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.502168 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-546mt" Jul 16 17:35:59.515521 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.515474 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-546mt" podStartSLOduration=1.191681355 podStartE2EDuration="2.515456671s" totalImagesPullingTime="1.323775316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:35:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:59.515198941 +0000 UTC m=+130.044623204" watchObservedRunningTime="2026-07-16 17:35:59.515456671 +0000 UTC m=+130.044880932" Jul 16 17:35:59.632901 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.632862 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:59.706724 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.706694 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:59.963189 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:35:59.963117 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:00.469738 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:00.469702 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:00.540467 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:00.540432 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:02.493292 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.493258 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f79dc7b55-c4cvc"] Jul 16 17:36:02.516818 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.516791 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f79dc7b55-c4cvc"] Jul 16 17:36:02.516978 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.516889 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:36:02.526618 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.526596 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 16 17:36:02.529813 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.529794 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:02.585586 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.585561 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:02.629646 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.629614 2578 patch_prober.go:28] interesting pod/image-registry-7d8d76dd8d-fztrr container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 16 17:36:02.629782 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.629667 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" podUID="9595d508-5f2b-4421-a272-9f6b7a348cbc" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 17:36:02.680453 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.680396 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11b1f41a-26b5-431d-996f-817f9a88f599-console-oauth-config\") pod \"console-f79dc7b55-c4cvc\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:36:02.680581 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.680469 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b1f41a-26b5-431d-996f-817f9a88f599-trusted-ca-bundle\") pod \"console-f79dc7b55-c4cvc\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:36:02.680581 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.680550 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11b1f41a-26b5-431d-996f-817f9a88f599-service-ca\") pod \"console-f79dc7b55-c4cvc\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:36:02.680730 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.680589 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11b1f41a-26b5-431d-996f-817f9a88f599-oauth-serving-cert\") pod \"console-f79dc7b55-c4cvc\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:36:02.680730 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.680650 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11b1f41a-26b5-431d-996f-817f9a88f599-console-serving-cert\") pod \"console-f79dc7b55-c4cvc\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:36:02.680730 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.680669 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11b1f41a-26b5-431d-996f-817f9a88f599-console-config\") pod \"console-f79dc7b55-c4cvc\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:36:02.680730 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.680702 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp2sq\" (UniqueName: \"kubernetes.io/projected/11b1f41a-26b5-431d-996f-817f9a88f599-kube-api-access-sp2sq\") pod \"console-f79dc7b55-c4cvc\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:36:02.781966 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.781893 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11b1f41a-26b5-431d-996f-817f9a88f599-console-oauth-config\") pod \"console-f79dc7b55-c4cvc\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:36:02.781966 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.781936 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b1f41a-26b5-431d-996f-817f9a88f599-trusted-ca-bundle\") pod \"console-f79dc7b55-c4cvc\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:36:02.782143 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.782000 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11b1f41a-26b5-431d-996f-817f9a88f599-service-ca\") pod \"console-f79dc7b55-c4cvc\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:36:02.782143 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.782043 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11b1f41a-26b5-431d-996f-817f9a88f599-oauth-serving-cert\") pod \"console-f79dc7b55-c4cvc\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:36:02.782143 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.782103 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11b1f41a-26b5-431d-996f-817f9a88f599-console-serving-cert\") pod \"console-f79dc7b55-c4cvc\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:36:02.782288 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.782127 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11b1f41a-26b5-431d-996f-817f9a88f599-console-config\") pod \"console-f79dc7b55-c4cvc\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:36:02.782288 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.782180 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp2sq\" (UniqueName: \"kubernetes.io/projected/11b1f41a-26b5-431d-996f-817f9a88f599-kube-api-access-sp2sq\") pod \"console-f79dc7b55-c4cvc\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:36:02.783566 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.783053 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11b1f41a-26b5-431d-996f-817f9a88f599-oauth-serving-cert\") pod \"console-f79dc7b55-c4cvc\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:36:02.783566 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.783119 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11b1f41a-26b5-431d-996f-817f9a88f599-console-config\") pod \"console-f79dc7b55-c4cvc\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:36:02.783566 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.783493 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b1f41a-26b5-431d-996f-817f9a88f599-trusted-ca-bundle\") pod \"console-f79dc7b55-c4cvc\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:36:02.783779 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.783637 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11b1f41a-26b5-431d-996f-817f9a88f599-service-ca\") pod \"console-f79dc7b55-c4cvc\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:36:02.785517 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.785459 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11b1f41a-26b5-431d-996f-817f9a88f599-console-serving-cert\") pod \"console-f79dc7b55-c4cvc\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:36:02.785610 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.785518 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11b1f41a-26b5-431d-996f-817f9a88f599-console-oauth-config\") pod \"console-f79dc7b55-c4cvc\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:36:02.793178 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.793155 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp2sq\" (UniqueName: \"kubernetes.io/projected/11b1f41a-26b5-431d-996f-817f9a88f599-kube-api-access-sp2sq\") pod \"console-f79dc7b55-c4cvc\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:36:02.826252 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:02.826223 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:36:03.452627 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:03.452598 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f79dc7b55-c4cvc"] Jul 16 17:36:03.517708 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:03.517647 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qwntv" event={"ID":"e7615346-ccf4-44a6-9393-007ccf5351d3","Type":"ContainerStarted","Data":"7639e86f64158ab27829c1e29cb6da962934d7c59e64e3076bd27ea84fbe5b7b"} Jul 16 17:36:03.519404 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:03.519378 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7xmt6" event={"ID":"a4e3a253-031e-47d3-9ca3-18c97f49e614","Type":"ContainerStarted","Data":"96f3c58f261d39b65360ac22c5b939a8fac35ef8903224e0677613a01a6ce8ab"} Jul 16 17:36:03.519533 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:03.519446 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7xmt6" event={"ID":"a4e3a253-031e-47d3-9ca3-18c97f49e614","Type":"ContainerStarted","Data":"635ec033e32d55d84cc47ecfa3027273b8349141dfa01efb88ffec6e8f489bd9"} Jul 16 17:36:03.520904 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:03.520879 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f79dc7b55-c4cvc" event={"ID":"11b1f41a-26b5-431d-996f-817f9a88f599","Type":"ContainerStarted","Data":"8859627fd12e34326b9fb0638842d3637954459c169dd97772a31fe3292353f1"} Jul 16 17:36:03.543279 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:03.543201 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7xmt6" podStartSLOduration=129.571028786 podStartE2EDuration="2m13.543185253s" totalImagesPullingTime="3.972156467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:03.543013903 +0000 UTC m=+134.072438166" watchObservedRunningTime="2026-07-16 17:36:03.543185253 +0000 UTC m=+134.072609515" Jul 16 17:36:03.653626 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:03.653592 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:03.712204 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:03.712167 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:07.539430 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:07.539328 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9f7cd54d-6zf4d" event={"ID":"30583ecb-417c-46c0-8c1f-3a2d61679bc8","Type":"ContainerStarted","Data":"fe389aff80f5e1c8216b95e62e3ca505b6c16b9e6f5dcda953493a09a7664024"} Jul 16 17:36:08.544840 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:08.544805 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qwntv" event={"ID":"e7615346-ccf4-44a6-9393-007ccf5351d3","Type":"ContainerStarted","Data":"8b9fe94f46a229bdc8a1a1e95124871dbf0ebd799b1fe8be3f646ae2ac184ccb"} Jul 16 17:36:08.546661 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:08.546631 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f79dc7b55-c4cvc" event={"ID":"11b1f41a-26b5-431d-996f-817f9a88f599","Type":"ContainerStarted","Data":"eec789dc688d1b734fa37b455ba3a7632dac107e61e67de7f43ccb00d033d3bf"} Jul 16 17:36:08.571094 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:08.570994 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f9f7cd54d-6zf4d" podStartSLOduration=2.594186809 podStartE2EDuration="10.570976763s" totalImagesPullingTime="7.976789954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:07.569271312 +0000 UTC m=+138.098695577" watchObservedRunningTime="2026-07-16 17:36:08.570976763 +0000 UTC m=+139.100401021" Jul 16 17:36:08.571704 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:08.571667 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f79dc7b55-c4cvc" podStartSLOduration=2.585340019 podStartE2EDuration="6.571654648s" totalImagesPullingTime="3.986314629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:08.569881135 +0000 UTC m=+139.099305396" watchObservedRunningTime="2026-07-16 17:36:08.571654648 +0000 UTC m=+139.101078911" Jul 16 17:36:09.232176 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:09.232136 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f9f7cd54d-6zf4d" Jul 16 17:36:09.232397 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:09.232210 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f9f7cd54d-6zf4d" Jul 16 17:36:09.233818 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:09.233789 2578 patch_prober.go:28] interesting pod/console-6f9f7cd54d-6zf4d container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jul 16 17:36:09.233925 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:09.233840 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6f9f7cd54d-6zf4d" podUID="30583ecb-417c-46c0-8c1f-3a2d61679bc8" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jul 16 17:36:11.559650 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:11.559615 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qwntv" event={"ID":"e7615346-ccf4-44a6-9393-007ccf5351d3","Type":"ContainerStarted","Data":"c5bc5b87660617297ea01ff93c25c23d0c00534c248ca961bbc7a54f7425ba99"} Jul 16 17:36:11.580779 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:11.580733 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qwntv" podStartSLOduration=33.748398259 podStartE2EDuration="46.580716707s" totalImagesPullingTime="12.832318448s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:35:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:11.579645274 +0000 UTC m=+142.109069557" watchObservedRunningTime="2026-07-16 17:36:11.580716707 +0000 UTC m=+142.110140968" Jul 16 17:36:12.518979 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:12.518942 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:12.619458 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:12.619429 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:12.628911 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:12.628885 2578 patch_prober.go:28] interesting pod/image-registry-7d8d76dd8d-fztrr container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 16 17:36:12.629030 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:12.628931 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" podUID="9595d508-5f2b-4421-a272-9f6b7a348cbc" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 17:36:12.720503 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:12.720459 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:12.827076 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:12.826980 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:36:12.827076 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:12.827073 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:36:12.828208 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:12.828181 2578 patch_prober.go:28] interesting pod/console-f79dc7b55-c4cvc container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" start-of-body= Jul 16 17:36:12.828338 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:12.828223 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-f79dc7b55-c4cvc" podUID="11b1f41a-26b5-431d-996f-817f9a88f599" containerName="console" probeResult="failure" output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" Jul 16 17:36:13.461397 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:13.461364 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:13.515272 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:13.515214 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:14.784541 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:14.784509 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:15.272984 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:15.272955 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:17.644316 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:17.644281 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" podUID="9595d508-5f2b-4421-a272-9f6b7a348cbc" containerName="registry" containerID="cri-o://45b58bd992655092a680631daff9bcd3675c86d96e51d98e18f0463b3e972b89" gracePeriod=30 Jul 16 17:36:17.875676 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:17.875655 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:36:17.898305 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:17.898248 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-bound-sa-token\") pod \"9595d508-5f2b-4421-a272-9f6b7a348cbc\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " Jul 16 17:36:17.898727 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:17.898313 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9595d508-5f2b-4421-a272-9f6b7a348cbc-installation-pull-secrets\") pod \"9595d508-5f2b-4421-a272-9f6b7a348cbc\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " Jul 16 17:36:17.898727 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:17.898359 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9595d508-5f2b-4421-a272-9f6b7a348cbc-ca-trust-extracted\") pod \"9595d508-5f2b-4421-a272-9f6b7a348cbc\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " Jul 16 17:36:17.898727 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:17.898405 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9595d508-5f2b-4421-a272-9f6b7a348cbc-trusted-ca\") pod \"9595d508-5f2b-4421-a272-9f6b7a348cbc\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " Jul 16 17:36:17.898727 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:17.898477 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9595d508-5f2b-4421-a272-9f6b7a348cbc-image-registry-private-configuration\") pod \"9595d508-5f2b-4421-a272-9f6b7a348cbc\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " Jul 16 17:36:17.898727 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:17.898506 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-registry-tls\") pod \"9595d508-5f2b-4421-a272-9f6b7a348cbc\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " Jul 16 17:36:17.898727 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:17.898530 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sv7lc\" (UniqueName: \"kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-kube-api-access-sv7lc\") pod \"9595d508-5f2b-4421-a272-9f6b7a348cbc\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " Jul 16 17:36:17.898727 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:17.898559 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9595d508-5f2b-4421-a272-9f6b7a348cbc-registry-certificates\") pod \"9595d508-5f2b-4421-a272-9f6b7a348cbc\" (UID: \"9595d508-5f2b-4421-a272-9f6b7a348cbc\") " Jul 16 17:36:17.899141 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:17.899117 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9595d508-5f2b-4421-a272-9f6b7a348cbc-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9595d508-5f2b-4421-a272-9f6b7a348cbc" (UID: "9595d508-5f2b-4421-a272-9f6b7a348cbc"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:36:17.899496 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:17.899457 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9595d508-5f2b-4421-a272-9f6b7a348cbc-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9595d508-5f2b-4421-a272-9f6b7a348cbc" (UID: "9595d508-5f2b-4421-a272-9f6b7a348cbc"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:36:17.902328 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:17.901633 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9595d508-5f2b-4421-a272-9f6b7a348cbc-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9595d508-5f2b-4421-a272-9f6b7a348cbc" (UID: "9595d508-5f2b-4421-a272-9f6b7a348cbc"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:36:17.902328 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:17.901960 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-kube-api-access-sv7lc" (OuterVolumeSpecName: "kube-api-access-sv7lc") pod "9595d508-5f2b-4421-a272-9f6b7a348cbc" (UID: "9595d508-5f2b-4421-a272-9f6b7a348cbc"). InnerVolumeSpecName "kube-api-access-sv7lc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:36:17.902328 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:17.902167 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9595d508-5f2b-4421-a272-9f6b7a348cbc" (UID: "9595d508-5f2b-4421-a272-9f6b7a348cbc"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:36:17.903533 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:17.903498 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9595d508-5f2b-4421-a272-9f6b7a348cbc-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9595d508-5f2b-4421-a272-9f6b7a348cbc" (UID: "9595d508-5f2b-4421-a272-9f6b7a348cbc"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:36:17.903627 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:17.903593 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9595d508-5f2b-4421-a272-9f6b7a348cbc" (UID: "9595d508-5f2b-4421-a272-9f6b7a348cbc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:36:17.908788 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:17.908766 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9595d508-5f2b-4421-a272-9f6b7a348cbc-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9595d508-5f2b-4421-a272-9f6b7a348cbc" (UID: "9595d508-5f2b-4421-a272-9f6b7a348cbc"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 17:36:17.999280 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:17.999254 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9595d508-5f2b-4421-a272-9f6b7a348cbc-trusted-ca\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:36:17.999280 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:17.999278 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9595d508-5f2b-4421-a272-9f6b7a348cbc-image-registry-private-configuration\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:36:17.999444 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:17.999288 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-registry-tls\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:36:17.999444 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:17.999299 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sv7lc\" (UniqueName: \"kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-kube-api-access-sv7lc\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:36:17.999444 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:17.999308 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9595d508-5f2b-4421-a272-9f6b7a348cbc-registry-certificates\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:36:17.999444 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:17.999317 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9595d508-5f2b-4421-a272-9f6b7a348cbc-bound-sa-token\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:36:17.999444 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:17.999325 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9595d508-5f2b-4421-a272-9f6b7a348cbc-installation-pull-secrets\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:36:17.999444 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:17.999333 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9595d508-5f2b-4421-a272-9f6b7a348cbc-ca-trust-extracted\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:36:18.582589 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:18.582557 2578 generic.go:356] "Generic (PLEG): container finished" podID="9595d508-5f2b-4421-a272-9f6b7a348cbc" containerID="45b58bd992655092a680631daff9bcd3675c86d96e51d98e18f0463b3e972b89" exitCode=0 Jul 16 17:36:18.582736 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:18.582612 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" Jul 16 17:36:18.582736 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:18.582623 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" event={"ID":"9595d508-5f2b-4421-a272-9f6b7a348cbc","Type":"ContainerDied","Data":"45b58bd992655092a680631daff9bcd3675c86d96e51d98e18f0463b3e972b89"} Jul 16 17:36:18.582736 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:18.582686 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d8d76dd8d-fztrr" event={"ID":"9595d508-5f2b-4421-a272-9f6b7a348cbc","Type":"ContainerDied","Data":"e4e2d810c87828ebc74a2d0976bbb2320f3ff09f2017d75c20326a28d9e6c253"} Jul 16 17:36:18.582736 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:18.582705 2578 scope.go:117] "RemoveContainer" containerID="45b58bd992655092a680631daff9bcd3675c86d96e51d98e18f0463b3e972b89" Jul 16 17:36:18.590460 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:18.590442 2578 scope.go:117] "RemoveContainer" containerID="45b58bd992655092a680631daff9bcd3675c86d96e51d98e18f0463b3e972b89" Jul 16 17:36:18.590726 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:36:18.590708 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45b58bd992655092a680631daff9bcd3675c86d96e51d98e18f0463b3e972b89\": container with ID starting with 45b58bd992655092a680631daff9bcd3675c86d96e51d98e18f0463b3e972b89 not found: ID does not exist" containerID="45b58bd992655092a680631daff9bcd3675c86d96e51d98e18f0463b3e972b89" Jul 16 17:36:18.590766 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:18.590734 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45b58bd992655092a680631daff9bcd3675c86d96e51d98e18f0463b3e972b89"} err="failed to get container status \"45b58bd992655092a680631daff9bcd3675c86d96e51d98e18f0463b3e972b89\": rpc error: code = NotFound desc = could not find container \"45b58bd992655092a680631daff9bcd3675c86d96e51d98e18f0463b3e972b89\": container with ID starting with 45b58bd992655092a680631daff9bcd3675c86d96e51d98e18f0463b3e972b89 not found: ID does not exist" Jul 16 17:36:18.604443 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:18.604407 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d8d76dd8d-fztrr"] Jul 16 17:36:18.609678 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:18.609659 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7d8d76dd8d-fztrr"] Jul 16 17:36:19.231974 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.231946 2578 patch_prober.go:28] interesting pod/console-6f9f7cd54d-6zf4d container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jul 16 17:36:19.232323 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.231986 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6f9f7cd54d-6zf4d" podUID="30583ecb-417c-46c0-8c1f-3a2d61679bc8" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jul 16 17:36:19.564085 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.564001 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:19.621470 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.621446 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-vsc4m"] Jul 16 17:36:19.621686 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.621675 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9595d508-5f2b-4421-a272-9f6b7a348cbc" containerName="registry" Jul 16 17:36:19.621726 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.621687 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9595d508-5f2b-4421-a272-9f6b7a348cbc" containerName="registry" Jul 16 17:36:19.621760 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.621726 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9595d508-5f2b-4421-a272-9f6b7a348cbc" containerName="registry" Jul 16 17:36:19.626177 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.626160 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vsc4m" Jul 16 17:36:19.629001 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.628978 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 16 17:36:19.630510 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.630491 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 16 17:36:19.630646 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.630624 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 16 17:36:19.630724 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.630696 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 16 17:36:19.630781 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.630728 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 16 17:36:19.630781 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.630738 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-nc2hd\"" Jul 16 17:36:19.642821 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.642798 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-vsc4m"] Jul 16 17:36:19.643913 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.643896 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-rh4t9"] Jul 16 17:36:19.646918 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.646903 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-rh4t9" Jul 16 17:36:19.649986 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.649966 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 16 17:36:19.650078 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.649971 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-clxq6\"" Jul 16 17:36:19.650292 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.650269 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 16 17:36:19.650402 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.650352 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 16 17:36:19.657111 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.657090 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-rh4t9"] Jul 16 17:36:19.657355 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.657310 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:19.679155 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.679133 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t5wwk"] Jul 16 17:36:19.682255 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.682241 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.684841 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.684816 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zznr4\"" Jul 16 17:36:19.684928 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.684866 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 16 17:36:19.684928 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.684908 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 16 17:36:19.685225 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.685205 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 16 17:36:19.710759 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.710741 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5c88624a-20a0-449d-8807-0fe0c54fc007-root\") pod \"node-exporter-t5wwk\" (UID: \"5c88624a-20a0-449d-8807-0fe0c54fc007\") " pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.710844 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.710773 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/445883f9-9f53-454e-aa26-079e8374df9e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-vsc4m\" (UID: \"445883f9-9f53-454e-aa26-079e8374df9e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vsc4m" Jul 16 17:36:19.710844 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.710796 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwcp8\" (UniqueName: \"kubernetes.io/projected/19ab8765-01f4-497b-a2f6-a0e52caa80f3-kube-api-access-jwcp8\") pod \"kube-state-metrics-785778ff74-rh4t9\" (UID: \"19ab8765-01f4-497b-a2f6-a0e52caa80f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-rh4t9" Jul 16 17:36:19.710844 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.710836 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5c88624a-20a0-449d-8807-0fe0c54fc007-node-exporter-textfile\") pod \"node-exporter-t5wwk\" (UID: \"5c88624a-20a0-449d-8807-0fe0c54fc007\") " pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.710945 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.710871 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/19ab8765-01f4-497b-a2f6-a0e52caa80f3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-rh4t9\" (UID: \"19ab8765-01f4-497b-a2f6-a0e52caa80f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-rh4t9" Jul 16 17:36:19.710945 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.710901 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19ab8765-01f4-497b-a2f6-a0e52caa80f3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-rh4t9\" (UID: \"19ab8765-01f4-497b-a2f6-a0e52caa80f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-rh4t9" Jul 16 17:36:19.710945 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.710921 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5c88624a-20a0-449d-8807-0fe0c54fc007-node-exporter-tls\") pod \"node-exporter-t5wwk\" (UID: \"5c88624a-20a0-449d-8807-0fe0c54fc007\") " pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.710945 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.710937 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c88624a-20a0-449d-8807-0fe0c54fc007-metrics-client-ca\") pod \"node-exporter-t5wwk\" (UID: \"5c88624a-20a0-449d-8807-0fe0c54fc007\") " pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.711100 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.710958 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/445883f9-9f53-454e-aa26-079e8374df9e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-vsc4m\" (UID: \"445883f9-9f53-454e-aa26-079e8374df9e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vsc4m" Jul 16 17:36:19.711100 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.710983 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c88624a-20a0-449d-8807-0fe0c54fc007-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t5wwk\" (UID: \"5c88624a-20a0-449d-8807-0fe0c54fc007\") " pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.711100 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.710999 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c88624a-20a0-449d-8807-0fe0c54fc007-sys\") pod \"node-exporter-t5wwk\" (UID: \"5c88624a-20a0-449d-8807-0fe0c54fc007\") " pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.711100 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.711013 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5c88624a-20a0-449d-8807-0fe0c54fc007-node-exporter-accelerators-collector-config\") pod \"node-exporter-t5wwk\" (UID: \"5c88624a-20a0-449d-8807-0fe0c54fc007\") " pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.711100 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.711030 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh7cr\" (UniqueName: \"kubernetes.io/projected/5c88624a-20a0-449d-8807-0fe0c54fc007-kube-api-access-sh7cr\") pod \"node-exporter-t5wwk\" (UID: \"5c88624a-20a0-449d-8807-0fe0c54fc007\") " pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.711337 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.711111 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/445883f9-9f53-454e-aa26-079e8374df9e-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-vsc4m\" (UID: \"445883f9-9f53-454e-aa26-079e8374df9e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vsc4m" Jul 16 17:36:19.711337 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.711147 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5c88624a-20a0-449d-8807-0fe0c54fc007-node-exporter-wtmp\") pod \"node-exporter-t5wwk\" (UID: \"5c88624a-20a0-449d-8807-0fe0c54fc007\") " pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.711337 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.711175 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/19ab8765-01f4-497b-a2f6-a0e52caa80f3-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-rh4t9\" (UID: \"19ab8765-01f4-497b-a2f6-a0e52caa80f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-rh4t9" Jul 16 17:36:19.711337 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.711205 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/19ab8765-01f4-497b-a2f6-a0e52caa80f3-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-rh4t9\" (UID: \"19ab8765-01f4-497b-a2f6-a0e52caa80f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-rh4t9" Jul 16 17:36:19.711337 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.711229 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19ab8765-01f4-497b-a2f6-a0e52caa80f3-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-rh4t9\" (UID: \"19ab8765-01f4-497b-a2f6-a0e52caa80f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-rh4t9" Jul 16 17:36:19.711337 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.711265 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7fwg\" (UniqueName: \"kubernetes.io/projected/445883f9-9f53-454e-aa26-079e8374df9e-kube-api-access-l7fwg\") pod \"openshift-state-metrics-84bd68b896-vsc4m\" (UID: \"445883f9-9f53-454e-aa26-079e8374df9e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vsc4m" Jul 16 17:36:19.731696 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.731675 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:19.811824 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.811806 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwcp8\" (UniqueName: \"kubernetes.io/projected/19ab8765-01f4-497b-a2f6-a0e52caa80f3-kube-api-access-jwcp8\") pod \"kube-state-metrics-785778ff74-rh4t9\" (UID: \"19ab8765-01f4-497b-a2f6-a0e52caa80f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-rh4t9" Jul 16 17:36:19.811907 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.811835 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5c88624a-20a0-449d-8807-0fe0c54fc007-node-exporter-textfile\") pod \"node-exporter-t5wwk\" (UID: \"5c88624a-20a0-449d-8807-0fe0c54fc007\") " pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.811907 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.811853 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/19ab8765-01f4-497b-a2f6-a0e52caa80f3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-rh4t9\" (UID: \"19ab8765-01f4-497b-a2f6-a0e52caa80f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-rh4t9" Jul 16 17:36:19.811907 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.811872 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19ab8765-01f4-497b-a2f6-a0e52caa80f3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-rh4t9\" (UID: \"19ab8765-01f4-497b-a2f6-a0e52caa80f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-rh4t9" Jul 16 17:36:19.812002 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.811981 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5c88624a-20a0-449d-8807-0fe0c54fc007-node-exporter-tls\") pod \"node-exporter-t5wwk\" (UID: \"5c88624a-20a0-449d-8807-0fe0c54fc007\") " pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.812053 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.812017 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c88624a-20a0-449d-8807-0fe0c54fc007-metrics-client-ca\") pod \"node-exporter-t5wwk\" (UID: \"5c88624a-20a0-449d-8807-0fe0c54fc007\") " pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.812143 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.812125 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/445883f9-9f53-454e-aa26-079e8374df9e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-vsc4m\" (UID: \"445883f9-9f53-454e-aa26-079e8374df9e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vsc4m" Jul 16 17:36:19.812200 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.812166 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c88624a-20a0-449d-8807-0fe0c54fc007-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t5wwk\" (UID: \"5c88624a-20a0-449d-8807-0fe0c54fc007\") " pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.812200 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.812182 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5c88624a-20a0-449d-8807-0fe0c54fc007-node-exporter-textfile\") pod \"node-exporter-t5wwk\" (UID: \"5c88624a-20a0-449d-8807-0fe0c54fc007\") " pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.812200 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.812195 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c88624a-20a0-449d-8807-0fe0c54fc007-sys\") pod \"node-exporter-t5wwk\" (UID: \"5c88624a-20a0-449d-8807-0fe0c54fc007\") " pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.812350 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.812220 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5c88624a-20a0-449d-8807-0fe0c54fc007-node-exporter-accelerators-collector-config\") pod \"node-exporter-t5wwk\" (UID: \"5c88624a-20a0-449d-8807-0fe0c54fc007\") " pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.812350 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.812264 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh7cr\" (UniqueName: \"kubernetes.io/projected/5c88624a-20a0-449d-8807-0fe0c54fc007-kube-api-access-sh7cr\") pod \"node-exporter-t5wwk\" (UID: \"5c88624a-20a0-449d-8807-0fe0c54fc007\") " pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.812350 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.812331 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/445883f9-9f53-454e-aa26-079e8374df9e-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-vsc4m\" (UID: \"445883f9-9f53-454e-aa26-079e8374df9e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vsc4m" Jul 16 17:36:19.812576 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.812357 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5c88624a-20a0-449d-8807-0fe0c54fc007-node-exporter-wtmp\") pod \"node-exporter-t5wwk\" (UID: \"5c88624a-20a0-449d-8807-0fe0c54fc007\") " pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.812576 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.812383 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/19ab8765-01f4-497b-a2f6-a0e52caa80f3-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-rh4t9\" (UID: \"19ab8765-01f4-497b-a2f6-a0e52caa80f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-rh4t9" Jul 16 17:36:19.812576 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.812410 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/19ab8765-01f4-497b-a2f6-a0e52caa80f3-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-rh4t9\" (UID: \"19ab8765-01f4-497b-a2f6-a0e52caa80f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-rh4t9" Jul 16 17:36:19.812576 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.812466 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19ab8765-01f4-497b-a2f6-a0e52caa80f3-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-rh4t9\" (UID: \"19ab8765-01f4-497b-a2f6-a0e52caa80f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-rh4t9" Jul 16 17:36:19.812576 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.812501 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7fwg\" (UniqueName: \"kubernetes.io/projected/445883f9-9f53-454e-aa26-079e8374df9e-kube-api-access-l7fwg\") pod \"openshift-state-metrics-84bd68b896-vsc4m\" (UID: \"445883f9-9f53-454e-aa26-079e8374df9e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vsc4m" Jul 16 17:36:19.812576 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.812535 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5c88624a-20a0-449d-8807-0fe0c54fc007-root\") pod \"node-exporter-t5wwk\" (UID: \"5c88624a-20a0-449d-8807-0fe0c54fc007\") " pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.812576 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.812561 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/445883f9-9f53-454e-aa26-079e8374df9e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-vsc4m\" (UID: \"445883f9-9f53-454e-aa26-079e8374df9e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vsc4m" Jul 16 17:36:19.812916 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.812578 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/19ab8765-01f4-497b-a2f6-a0e52caa80f3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-rh4t9\" (UID: \"19ab8765-01f4-497b-a2f6-a0e52caa80f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-rh4t9" Jul 16 17:36:19.812916 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.812650 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c88624a-20a0-449d-8807-0fe0c54fc007-metrics-client-ca\") pod \"node-exporter-t5wwk\" (UID: \"5c88624a-20a0-449d-8807-0fe0c54fc007\") " pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.812916 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.812811 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5c88624a-20a0-449d-8807-0fe0c54fc007-node-exporter-wtmp\") pod \"node-exporter-t5wwk\" (UID: \"5c88624a-20a0-449d-8807-0fe0c54fc007\") " pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.813087 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.813065 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/19ab8765-01f4-497b-a2f6-a0e52caa80f3-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-rh4t9\" (UID: \"19ab8765-01f4-497b-a2f6-a0e52caa80f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-rh4t9" Jul 16 17:36:19.813140 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.813114 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5c88624a-20a0-449d-8807-0fe0c54fc007-node-exporter-accelerators-collector-config\") pod \"node-exporter-t5wwk\" (UID: \"5c88624a-20a0-449d-8807-0fe0c54fc007\") " pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.813194 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.812651 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c88624a-20a0-449d-8807-0fe0c54fc007-sys\") pod \"node-exporter-t5wwk\" (UID: \"5c88624a-20a0-449d-8807-0fe0c54fc007\") " pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.813249 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.813200 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5c88624a-20a0-449d-8807-0fe0c54fc007-root\") pod \"node-exporter-t5wwk\" (UID: \"5c88624a-20a0-449d-8807-0fe0c54fc007\") " pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.813727 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.813703 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19ab8765-01f4-497b-a2f6-a0e52caa80f3-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-rh4t9\" (UID: \"19ab8765-01f4-497b-a2f6-a0e52caa80f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-rh4t9" Jul 16 17:36:19.814387 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.814329 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/445883f9-9f53-454e-aa26-079e8374df9e-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-vsc4m\" (UID: \"445883f9-9f53-454e-aa26-079e8374df9e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vsc4m" Jul 16 17:36:19.814810 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.814787 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19ab8765-01f4-497b-a2f6-a0e52caa80f3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-rh4t9\" (UID: \"19ab8765-01f4-497b-a2f6-a0e52caa80f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-rh4t9" Jul 16 17:36:19.815093 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.815075 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c88624a-20a0-449d-8807-0fe0c54fc007-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t5wwk\" (UID: \"5c88624a-20a0-449d-8807-0fe0c54fc007\") " pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.815288 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.815260 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/445883f9-9f53-454e-aa26-079e8374df9e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-vsc4m\" (UID: \"445883f9-9f53-454e-aa26-079e8374df9e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vsc4m" Jul 16 17:36:19.815371 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.815343 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/19ab8765-01f4-497b-a2f6-a0e52caa80f3-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-rh4t9\" (UID: \"19ab8765-01f4-497b-a2f6-a0e52caa80f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-rh4t9" Jul 16 17:36:19.815558 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.815541 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/445883f9-9f53-454e-aa26-079e8374df9e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-vsc4m\" (UID: \"445883f9-9f53-454e-aa26-079e8374df9e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vsc4m" Jul 16 17:36:19.815751 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.815735 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5c88624a-20a0-449d-8807-0fe0c54fc007-node-exporter-tls\") pod \"node-exporter-t5wwk\" (UID: \"5c88624a-20a0-449d-8807-0fe0c54fc007\") " pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.822618 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.822596 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwcp8\" (UniqueName: \"kubernetes.io/projected/19ab8765-01f4-497b-a2f6-a0e52caa80f3-kube-api-access-jwcp8\") pod \"kube-state-metrics-785778ff74-rh4t9\" (UID: \"19ab8765-01f4-497b-a2f6-a0e52caa80f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-rh4t9" Jul 16 17:36:19.823050 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.823026 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7fwg\" (UniqueName: \"kubernetes.io/projected/445883f9-9f53-454e-aa26-079e8374df9e-kube-api-access-l7fwg\") pod \"openshift-state-metrics-84bd68b896-vsc4m\" (UID: \"445883f9-9f53-454e-aa26-079e8374df9e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vsc4m" Jul 16 17:36:19.824846 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.824827 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh7cr\" (UniqueName: \"kubernetes.io/projected/5c88624a-20a0-449d-8807-0fe0c54fc007-kube-api-access-sh7cr\") pod \"node-exporter-t5wwk\" (UID: \"5c88624a-20a0-449d-8807-0fe0c54fc007\") " pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:19.832237 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.832218 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:19.932557 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.932533 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:19.934465 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.934450 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vsc4m" Jul 16 17:36:19.955400 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.955379 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-rh4t9" Jul 16 17:36:19.990493 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:19.990467 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t5wwk" Jul 16 17:36:20.004898 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:36:20.004862 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c88624a_20a0_449d_8807_0fe0c54fc007.slice/crio-ced89ef4b14c2636376ccb91c77f3196aa18e1935380d587801d2cca7ce35005 WatchSource:0}: Error finding container ced89ef4b14c2636376ccb91c77f3196aa18e1935380d587801d2cca7ce35005: Status 404 returned error can't find the container with id ced89ef4b14c2636376ccb91c77f3196aa18e1935380d587801d2cca7ce35005 Jul 16 17:36:20.032102 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.032023 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:20.035265 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.035238 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9595d508-5f2b-4421-a272-9f6b7a348cbc" path="/var/lib/kubelet/pods/9595d508-5f2b-4421-a272-9f6b7a348cbc/volumes" Jul 16 17:36:20.074766 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.074741 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-vsc4m"] Jul 16 17:36:20.076892 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:36:20.076867 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod445883f9_9f53_454e_aa26_079e8374df9e.slice/crio-2457b1232117e07e76f08034c5767ec35f44803b71703fe4cab31d854c7ec733 WatchSource:0}: Error finding container 2457b1232117e07e76f08034c5767ec35f44803b71703fe4cab31d854c7ec733: Status 404 returned error can't find the container with id 2457b1232117e07e76f08034c5767ec35f44803b71703fe4cab31d854c7ec733 Jul 16 17:36:20.095160 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.095141 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-rh4t9"] Jul 16 17:36:20.096458 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:36:20.096436 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19ab8765_01f4_497b_a2f6_a0e52caa80f3.slice/crio-1a4ce4d3cfb96b3776dbfdf1dff52ebac14f752b929d578f1f7290de86c2de7e WatchSource:0}: Error finding container 1a4ce4d3cfb96b3776dbfdf1dff52ebac14f752b929d578f1f7290de86c2de7e: Status 404 returned error can't find the container with id 1a4ce4d3cfb96b3776dbfdf1dff52ebac14f752b929d578f1f7290de86c2de7e Jul 16 17:36:20.097893 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.097872 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:20.447188 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.447151 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:20.592510 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.592459 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vsc4m" event={"ID":"445883f9-9f53-454e-aa26-079e8374df9e","Type":"ContainerStarted","Data":"92c5aef3803722d3d51d021b86709968dc244922ad8ad6b4fed8c3f1e217ed67"} Jul 16 17:36:20.592679 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.592569 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vsc4m" event={"ID":"445883f9-9f53-454e-aa26-079e8374df9e","Type":"ContainerStarted","Data":"52ec9081ce1110184815b1c2b180bd961ff589f5fa42dcc5274131bb80e43222"} Jul 16 17:36:20.592679 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.592600 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vsc4m" event={"ID":"445883f9-9f53-454e-aa26-079e8374df9e","Type":"ContainerStarted","Data":"2457b1232117e07e76f08034c5767ec35f44803b71703fe4cab31d854c7ec733"} Jul 16 17:36:20.593919 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.593892 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-rh4t9" event={"ID":"19ab8765-01f4-497b-a2f6-a0e52caa80f3","Type":"ContainerStarted","Data":"1a4ce4d3cfb96b3776dbfdf1dff52ebac14f752b929d578f1f7290de86c2de7e"} Jul 16 17:36:20.595662 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.595635 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t5wwk" event={"ID":"5c88624a-20a0-449d-8807-0fe0c54fc007","Type":"ContainerStarted","Data":"ced89ef4b14c2636376ccb91c77f3196aa18e1935380d587801d2cca7ce35005"} Jul 16 17:36:20.611571 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.611533 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:20.701047 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.700918 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:20.707260 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.707153 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 17:36:20.711389 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.711367 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.716784 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.716736 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 16 17:36:20.717028 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.717010 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 16 17:36:20.718236 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.717516 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 16 17:36:20.718236 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.717570 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 16 17:36:20.718236 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.717797 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 16 17:36:20.718236 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.717949 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 16 17:36:20.718236 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.718020 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 16 17:36:20.718236 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.718127 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qwmv2\"" Jul 16 17:36:20.718236 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.718135 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 16 17:36:20.718236 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.718155 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 16 17:36:20.735911 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.735865 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 17:36:20.822974 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.822933 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8c89eb88-a868-4c78-989b-f236dfc33922-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.823112 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.822980 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8c89eb88-a868-4c78-989b-f236dfc33922-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.823112 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.823006 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c89eb88-a868-4c78-989b-f236dfc33922-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.823112 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.823049 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8c89eb88-a868-4c78-989b-f236dfc33922-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.823112 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.823077 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8c89eb88-a868-4c78-989b-f236dfc33922-config-volume\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.823112 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.823112 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c89eb88-a868-4c78-989b-f236dfc33922-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.823383 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.823153 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c89eb88-a868-4c78-989b-f236dfc33922-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.823383 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.823179 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c89eb88-a868-4c78-989b-f236dfc33922-web-config\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.823383 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.823224 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c89eb88-a868-4c78-989b-f236dfc33922-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.823383 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.823275 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c89eb88-a868-4c78-989b-f236dfc33922-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.823383 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.823320 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8c89eb88-a868-4c78-989b-f236dfc33922-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.823651 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.823452 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c89eb88-a868-4c78-989b-f236dfc33922-config-out\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.823651 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.823495 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2x8d\" (UniqueName: \"kubernetes.io/projected/8c89eb88-a868-4c78-989b-f236dfc33922-kube-api-access-k2x8d\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.923963 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.923928 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8c89eb88-a868-4c78-989b-f236dfc33922-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.924114 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.923974 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8c89eb88-a868-4c78-989b-f236dfc33922-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.924114 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.924054 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c89eb88-a868-4c78-989b-f236dfc33922-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.924114 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.924102 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8c89eb88-a868-4c78-989b-f236dfc33922-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.924253 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.924132 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8c89eb88-a868-4c78-989b-f236dfc33922-config-volume\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.924253 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.924168 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c89eb88-a868-4c78-989b-f236dfc33922-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.924253 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:36:20.924198 2578 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 16 17:36:20.924253 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.924215 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c89eb88-a868-4c78-989b-f236dfc33922-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.924253 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.924245 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c89eb88-a868-4c78-989b-f236dfc33922-web-config\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.924462 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:36:20.924272 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c89eb88-a868-4c78-989b-f236dfc33922-secret-alertmanager-main-tls podName:8c89eb88-a868-4c78-989b-f236dfc33922 nodeName:}" failed. No retries permitted until 2026-07-16 17:36:21.424247888 +0000 UTC m=+151.953672169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/8c89eb88-a868-4c78-989b-f236dfc33922-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "8c89eb88-a868-4c78-989b-f236dfc33922") : secret "alertmanager-main-tls" not found Jul 16 17:36:20.924462 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.924329 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c89eb88-a868-4c78-989b-f236dfc33922-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.924462 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.924366 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c89eb88-a868-4c78-989b-f236dfc33922-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.924592 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.924478 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8c89eb88-a868-4c78-989b-f236dfc33922-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.924592 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.924528 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c89eb88-a868-4c78-989b-f236dfc33922-config-out\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.924592 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.924554 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2x8d\" (UniqueName: \"kubernetes.io/projected/8c89eb88-a868-4c78-989b-f236dfc33922-kube-api-access-k2x8d\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.925205 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.924933 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c89eb88-a868-4c78-989b-f236dfc33922-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.925205 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.925141 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8c89eb88-a868-4c78-989b-f236dfc33922-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.925396 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.925366 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c89eb88-a868-4c78-989b-f236dfc33922-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.926928 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.926899 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8c89eb88-a868-4c78-989b-f236dfc33922-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.927472 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.927407 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c89eb88-a868-4c78-989b-f236dfc33922-config-out\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.928086 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.928013 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8c89eb88-a868-4c78-989b-f236dfc33922-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.928214 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.928192 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c89eb88-a868-4c78-989b-f236dfc33922-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.928827 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.928804 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8c89eb88-a868-4c78-989b-f236dfc33922-config-volume\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.928924 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.928808 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c89eb88-a868-4c78-989b-f236dfc33922-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.928924 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.928835 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c89eb88-a868-4c78-989b-f236dfc33922-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.929039 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.929021 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c89eb88-a868-4c78-989b-f236dfc33922-web-config\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:20.936507 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:20.936488 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2x8d\" (UniqueName: \"kubernetes.io/projected/8c89eb88-a868-4c78-989b-f236dfc33922-kube-api-access-k2x8d\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:21.059004 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:21.058931 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:21.429675 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:21.429639 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8c89eb88-a868-4c78-989b-f236dfc33922-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:21.432133 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:21.432105 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8c89eb88-a868-4c78-989b-f236dfc33922-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8c89eb88-a868-4c78-989b-f236dfc33922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:21.605096 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:21.604943 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-rh4t9" event={"ID":"19ab8765-01f4-497b-a2f6-a0e52caa80f3","Type":"ContainerStarted","Data":"a3b6dabf8b265862be6d479bafffabeb62b6426836c4e3fdad1d32449b4a4bca"} Jul 16 17:36:21.607528 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:21.607393 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t5wwk" event={"ID":"5c88624a-20a0-449d-8807-0fe0c54fc007","Type":"ContainerStarted","Data":"55f6d23ca746ff34eebd885bd145e777872400d2bc38d6a5f7a2bf4f33eca367"} Jul 16 17:36:21.610313 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:21.610283 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vsc4m" event={"ID":"445883f9-9f53-454e-aa26-079e8374df9e","Type":"ContainerStarted","Data":"d1eaa6ed44a1f94a03d04cfb3533f0b23e61f48b3d8a158dca3d5321527d4a0a"} Jul 16 17:36:21.626171 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:21.625940 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 17:36:21.654996 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:21.654920 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vsc4m" podStartSLOduration=1.315259478 podStartE2EDuration="2.654898662s" totalImagesPullingTime="1.339639184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:21.653120174 +0000 UTC m=+152.182544439" watchObservedRunningTime="2026-07-16 17:36:21.654898662 +0000 UTC m=+152.184322925" Jul 16 17:36:21.810097 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:21.810068 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 17:36:21.811068 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:36:21.811035 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c89eb88_a868_4c78_989b_f236dfc33922.slice/crio-70975f233b8dd569b39cd61b555f603b4fa28b9d9c555633f6c1283da05ebea0 WatchSource:0}: Error finding container 70975f233b8dd569b39cd61b555f603b4fa28b9d9c555633f6c1283da05ebea0: Status 404 returned error can't find the container with id 70975f233b8dd569b39cd61b555f603b4fa28b9d9c555633f6c1283da05ebea0 Jul 16 17:36:22.365771 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:22.365737 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:22.465410 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:22.465376 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:22.617382 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:22.617287 2578 generic.go:356] "Generic (PLEG): container finished" podID="5c88624a-20a0-449d-8807-0fe0c54fc007" containerID="55f6d23ca746ff34eebd885bd145e777872400d2bc38d6a5f7a2bf4f33eca367" exitCode=0 Jul 16 17:36:22.617881 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:22.617383 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t5wwk" event={"ID":"5c88624a-20a0-449d-8807-0fe0c54fc007","Type":"ContainerDied","Data":"55f6d23ca746ff34eebd885bd145e777872400d2bc38d6a5f7a2bf4f33eca367"} Jul 16 17:36:22.619014 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:22.618986 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c89eb88-a868-4c78-989b-f236dfc33922","Type":"ContainerStarted","Data":"70975f233b8dd569b39cd61b555f603b4fa28b9d9c555633f6c1283da05ebea0"} Jul 16 17:36:22.621595 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:22.621572 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-rh4t9" event={"ID":"19ab8765-01f4-497b-a2f6-a0e52caa80f3","Type":"ContainerStarted","Data":"272755d4bdfb21d19f86ac6327866a1497b601f894eb4a9259fc8da796d5eb4b"} Jul 16 17:36:22.621670 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:22.621618 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-rh4t9" event={"ID":"19ab8765-01f4-497b-a2f6-a0e52caa80f3","Type":"ContainerStarted","Data":"c6529331a409648cc2298f66dbcbfa92a0698f2184df2768212da5b6111e0930"} Jul 16 17:36:22.655308 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:22.655286 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:22.673616 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:22.673580 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-rh4t9" podStartSLOduration=2.24904429 podStartE2EDuration="3.673567803s" totalImagesPullingTime="1.424523513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:22.670940217 +0000 UTC m=+153.200364480" watchObservedRunningTime="2026-07-16 17:36:22.673567803 +0000 UTC m=+153.202992093" Jul 16 17:36:22.718766 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:22.718738 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:22.826332 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:22.826306 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:22.830159 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:22.830136 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:36:22.833754 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:22.833738 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:36:22.903184 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:22.903133 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:22.947102 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:22.947078 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f9f7cd54d-6zf4d"] Jul 16 17:36:23.080733 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:23.080709 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:23.155497 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:23.155434 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:23.628100 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:23.628063 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t5wwk" event={"ID":"5c88624a-20a0-449d-8807-0fe0c54fc007","Type":"ContainerStarted","Data":"46663dbdacf71bd7f7ef1e66e2a6fe633b9f5f777b5ba36e9a66858979aa4d95"} Jul 16 17:36:23.628542 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:23.628122 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t5wwk" event={"ID":"5c88624a-20a0-449d-8807-0fe0c54fc007","Type":"ContainerStarted","Data":"30bcf8fe4dd9c652280d3c0581f2acb5e47b3aab475830252023856b27838ba1"} Jul 16 17:36:23.629545 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:23.629524 2578 generic.go:356] "Generic (PLEG): container finished" podID="8c89eb88-a868-4c78-989b-f236dfc33922" containerID="7957d71f984f4f801a630973dd1c1d782a9a3c95cb95453533ab29c6bfdffa64" exitCode=0 Jul 16 17:36:23.629636 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:23.629607 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c89eb88-a868-4c78-989b-f236dfc33922","Type":"ContainerDied","Data":"7957d71f984f4f801a630973dd1c1d782a9a3c95cb95453533ab29c6bfdffa64"} Jul 16 17:36:23.650185 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:23.650143 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t5wwk" podStartSLOduration=3.04013569 podStartE2EDuration="4.650129863s" totalImagesPullingTime="1.516178324s" totalInitContainerRuntime="93.815849ms" isStatefulPod=true podCreationTimestamp="2026-07-16 17:36:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:23.648117876 +0000 UTC m=+154.177542150" watchObservedRunningTime="2026-07-16 17:36:23.650129863 +0000 UTC m=+154.179554124" Jul 16 17:36:23.664283 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:23.664260 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:24.138936 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.138903 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6647cd9cdd-jdwkz"] Jul 16 17:36:24.142158 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.142136 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" Jul 16 17:36:24.145104 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.145084 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9fqatioo799\"" Jul 16 17:36:24.145464 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.145447 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 16 17:36:24.146376 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.146357 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 16 17:36:24.146448 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.146382 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 16 17:36:24.146448 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.146360 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-mhgw6\"" Jul 16 17:36:24.146520 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.146505 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 16 17:36:24.156643 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.156623 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6647cd9cdd-jdwkz"] Jul 16 17:36:24.255109 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.255087 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7g6z\" (UniqueName: \"kubernetes.io/projected/c18e4333-f670-43b5-ad06-b442ceb5282d-kube-api-access-n7g6z\") pod \"metrics-server-6647cd9cdd-jdwkz\" (UID: \"c18e4333-f670-43b5-ad06-b442ceb5282d\") " pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" Jul 16 17:36:24.255196 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.255118 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c18e4333-f670-43b5-ad06-b442ceb5282d-secret-metrics-server-client-certs\") pod \"metrics-server-6647cd9cdd-jdwkz\" (UID: \"c18e4333-f670-43b5-ad06-b442ceb5282d\") " pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" Jul 16 17:36:24.255196 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.255136 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c18e4333-f670-43b5-ad06-b442ceb5282d-client-ca-bundle\") pod \"metrics-server-6647cd9cdd-jdwkz\" (UID: \"c18e4333-f670-43b5-ad06-b442ceb5282d\") " pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" Jul 16 17:36:24.255196 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.255162 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c18e4333-f670-43b5-ad06-b442ceb5282d-secret-metrics-server-tls\") pod \"metrics-server-6647cd9cdd-jdwkz\" (UID: \"c18e4333-f670-43b5-ad06-b442ceb5282d\") " pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" Jul 16 17:36:24.255296 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.255201 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c18e4333-f670-43b5-ad06-b442ceb5282d-metrics-server-audit-profiles\") pod \"metrics-server-6647cd9cdd-jdwkz\" (UID: \"c18e4333-f670-43b5-ad06-b442ceb5282d\") " pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" Jul 16 17:36:24.255296 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.255258 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c18e4333-f670-43b5-ad06-b442ceb5282d-audit-log\") pod \"metrics-server-6647cd9cdd-jdwkz\" (UID: \"c18e4333-f670-43b5-ad06-b442ceb5282d\") " pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" Jul 16 17:36:24.255296 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.255279 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c18e4333-f670-43b5-ad06-b442ceb5282d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6647cd9cdd-jdwkz\" (UID: \"c18e4333-f670-43b5-ad06-b442ceb5282d\") " pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" Jul 16 17:36:24.356266 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.356244 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c18e4333-f670-43b5-ad06-b442ceb5282d-audit-log\") pod \"metrics-server-6647cd9cdd-jdwkz\" (UID: \"c18e4333-f670-43b5-ad06-b442ceb5282d\") " pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" Jul 16 17:36:24.356365 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.356276 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c18e4333-f670-43b5-ad06-b442ceb5282d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6647cd9cdd-jdwkz\" (UID: \"c18e4333-f670-43b5-ad06-b442ceb5282d\") " pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" Jul 16 17:36:24.356365 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.356328 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7g6z\" (UniqueName: \"kubernetes.io/projected/c18e4333-f670-43b5-ad06-b442ceb5282d-kube-api-access-n7g6z\") pod \"metrics-server-6647cd9cdd-jdwkz\" (UID: \"c18e4333-f670-43b5-ad06-b442ceb5282d\") " pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" Jul 16 17:36:24.356365 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.356356 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c18e4333-f670-43b5-ad06-b442ceb5282d-secret-metrics-server-client-certs\") pod \"metrics-server-6647cd9cdd-jdwkz\" (UID: \"c18e4333-f670-43b5-ad06-b442ceb5282d\") " pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" Jul 16 17:36:24.356491 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.356384 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c18e4333-f670-43b5-ad06-b442ceb5282d-client-ca-bundle\") pod \"metrics-server-6647cd9cdd-jdwkz\" (UID: \"c18e4333-f670-43b5-ad06-b442ceb5282d\") " pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" Jul 16 17:36:24.356491 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.356451 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c18e4333-f670-43b5-ad06-b442ceb5282d-secret-metrics-server-tls\") pod \"metrics-server-6647cd9cdd-jdwkz\" (UID: \"c18e4333-f670-43b5-ad06-b442ceb5282d\") " pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" Jul 16 17:36:24.356491 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.356479 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c18e4333-f670-43b5-ad06-b442ceb5282d-metrics-server-audit-profiles\") pod \"metrics-server-6647cd9cdd-jdwkz\" (UID: \"c18e4333-f670-43b5-ad06-b442ceb5282d\") " pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" Jul 16 17:36:24.356723 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.356696 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c18e4333-f670-43b5-ad06-b442ceb5282d-audit-log\") pod \"metrics-server-6647cd9cdd-jdwkz\" (UID: \"c18e4333-f670-43b5-ad06-b442ceb5282d\") " pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" Jul 16 17:36:24.357214 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.357192 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c18e4333-f670-43b5-ad06-b442ceb5282d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6647cd9cdd-jdwkz\" (UID: \"c18e4333-f670-43b5-ad06-b442ceb5282d\") " pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" Jul 16 17:36:24.357460 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.357436 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c18e4333-f670-43b5-ad06-b442ceb5282d-metrics-server-audit-profiles\") pod \"metrics-server-6647cd9cdd-jdwkz\" (UID: \"c18e4333-f670-43b5-ad06-b442ceb5282d\") " pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" Jul 16 17:36:24.358804 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.358776 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c18e4333-f670-43b5-ad06-b442ceb5282d-secret-metrics-server-tls\") pod \"metrics-server-6647cd9cdd-jdwkz\" (UID: \"c18e4333-f670-43b5-ad06-b442ceb5282d\") " pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" Jul 16 17:36:24.358881 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.358763 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c18e4333-f670-43b5-ad06-b442ceb5282d-secret-metrics-server-client-certs\") pod \"metrics-server-6647cd9cdd-jdwkz\" (UID: \"c18e4333-f670-43b5-ad06-b442ceb5282d\") " pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" Jul 16 17:36:24.358917 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.358904 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c18e4333-f670-43b5-ad06-b442ceb5282d-client-ca-bundle\") pod \"metrics-server-6647cd9cdd-jdwkz\" (UID: \"c18e4333-f670-43b5-ad06-b442ceb5282d\") " pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" Jul 16 17:36:24.372797 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.372775 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7g6z\" (UniqueName: \"kubernetes.io/projected/c18e4333-f670-43b5-ad06-b442ceb5282d-kube-api-access-n7g6z\") pod \"metrics-server-6647cd9cdd-jdwkz\" (UID: \"c18e4333-f670-43b5-ad06-b442ceb5282d\") " pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" Jul 16 17:36:24.373860 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.373840 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:24.395673 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.395625 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-mnndm"] Jul 16 17:36:24.399946 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.399931 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mnndm" Jul 16 17:36:24.402306 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.402285 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 16 17:36:24.403057 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.403043 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hp5jd\"" Jul 16 17:36:24.408562 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.408543 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-mnndm"] Jul 16 17:36:24.443297 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.443275 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:24.455325 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.455302 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" Jul 16 17:36:24.457644 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.457626 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkbfq\" (UniqueName: \"kubernetes.io/projected/52880a88-4a00-417a-bf93-8593cfaca919-kube-api-access-xkbfq\") pod \"monitoring-plugin-5f68df7f58-mnndm\" (UID: \"52880a88-4a00-417a-bf93-8593cfaca919\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mnndm" Jul 16 17:36:24.457710 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.457657 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52880a88-4a00-417a-bf93-8593cfaca919-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-mnndm\" (UID: \"52880a88-4a00-417a-bf93-8593cfaca919\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mnndm" Jul 16 17:36:24.559085 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.559058 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkbfq\" (UniqueName: \"kubernetes.io/projected/52880a88-4a00-417a-bf93-8593cfaca919-kube-api-access-xkbfq\") pod \"monitoring-plugin-5f68df7f58-mnndm\" (UID: \"52880a88-4a00-417a-bf93-8593cfaca919\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mnndm" Jul 16 17:36:24.559229 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.559100 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52880a88-4a00-417a-bf93-8593cfaca919-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-mnndm\" (UID: \"52880a88-4a00-417a-bf93-8593cfaca919\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mnndm" Jul 16 17:36:24.559293 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:36:24.559254 2578 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 16 17:36:24.559350 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:36:24.559338 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52880a88-4a00-417a-bf93-8593cfaca919-monitoring-plugin-cert podName:52880a88-4a00-417a-bf93-8593cfaca919 nodeName:}" failed. No retries permitted until 2026-07-16 17:36:25.059317635 +0000 UTC m=+155.588741884 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/52880a88-4a00-417a-bf93-8593cfaca919-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-mnndm" (UID: "52880a88-4a00-417a-bf93-8593cfaca919") : secret "monitoring-plugin-cert" not found Jul 16 17:36:24.574186 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.574161 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkbfq\" (UniqueName: \"kubernetes.io/projected/52880a88-4a00-417a-bf93-8593cfaca919-kube-api-access-xkbfq\") pod \"monitoring-plugin-5f68df7f58-mnndm\" (UID: \"52880a88-4a00-417a-bf93-8593cfaca919\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mnndm" Jul 16 17:36:24.593393 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.593351 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6647cd9cdd-jdwkz"] Jul 16 17:36:24.595742 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:36:24.595723 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc18e4333_f670_43b5_ad06_b442ceb5282d.slice/crio-94d8bf72f69797ca7db1e37418b9c3cd9bd0bbc55c620a932a5fe86c90936a3c WatchSource:0}: Error finding container 94d8bf72f69797ca7db1e37418b9c3cd9bd0bbc55c620a932a5fe86c90936a3c: Status 404 returned error can't find the container with id 94d8bf72f69797ca7db1e37418b9c3cd9bd0bbc55c620a932a5fe86c90936a3c Jul 16 17:36:24.634677 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.634652 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" event={"ID":"c18e4333-f670-43b5-ad06-b442ceb5282d","Type":"ContainerStarted","Data":"94d8bf72f69797ca7db1e37418b9c3cd9bd0bbc55c620a932a5fe86c90936a3c"} Jul 16 17:36:24.969248 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:24.969216 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:25.064111 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.064075 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52880a88-4a00-417a-bf93-8593cfaca919-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-mnndm\" (UID: \"52880a88-4a00-417a-bf93-8593cfaca919\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mnndm" Jul 16 17:36:25.066749 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.066723 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52880a88-4a00-417a-bf93-8593cfaca919-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-mnndm\" (UID: \"52880a88-4a00-417a-bf93-8593cfaca919\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mnndm" Jul 16 17:36:25.309551 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.309469 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mnndm" Jul 16 17:36:25.475245 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.475216 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-mnndm"] Jul 16 17:36:25.583473 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.583441 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fffb6d5d7-zwzqc"] Jul 16 17:36:25.588047 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.588022 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fffb6d5d7-zwzqc" Jul 16 17:36:25.598118 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.597997 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fffb6d5d7-zwzqc"] Jul 16 17:36:25.668389 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.668348 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-console-serving-cert\") pod \"console-5fffb6d5d7-zwzqc\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " pod="openshift-console/console-5fffb6d5d7-zwzqc" Jul 16 17:36:25.668389 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.668391 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-trusted-ca-bundle\") pod \"console-5fffb6d5d7-zwzqc\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " pod="openshift-console/console-5fffb6d5d7-zwzqc" Jul 16 17:36:25.668907 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.668436 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-oauth-serving-cert\") pod \"console-5fffb6d5d7-zwzqc\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " pod="openshift-console/console-5fffb6d5d7-zwzqc" Jul 16 17:36:25.668907 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.668466 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-service-ca\") pod \"console-5fffb6d5d7-zwzqc\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " pod="openshift-console/console-5fffb6d5d7-zwzqc" Jul 16 17:36:25.668907 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.668521 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxcnj\" (UniqueName: \"kubernetes.io/projected/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-kube-api-access-fxcnj\") pod \"console-5fffb6d5d7-zwzqc\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " pod="openshift-console/console-5fffb6d5d7-zwzqc" Jul 16 17:36:25.668907 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.668703 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-console-config\") pod \"console-5fffb6d5d7-zwzqc\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " pod="openshift-console/console-5fffb6d5d7-zwzqc" Jul 16 17:36:25.668907 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.668754 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-console-oauth-config\") pod \"console-5fffb6d5d7-zwzqc\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " pod="openshift-console/console-5fffb6d5d7-zwzqc" Jul 16 17:36:25.769762 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.769710 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-console-oauth-config\") pod \"console-5fffb6d5d7-zwzqc\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " pod="openshift-console/console-5fffb6d5d7-zwzqc" Jul 16 17:36:25.769939 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.769772 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-console-serving-cert\") pod \"console-5fffb6d5d7-zwzqc\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " pod="openshift-console/console-5fffb6d5d7-zwzqc" Jul 16 17:36:25.769939 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.769790 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-trusted-ca-bundle\") pod \"console-5fffb6d5d7-zwzqc\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " pod="openshift-console/console-5fffb6d5d7-zwzqc" Jul 16 17:36:25.769939 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.769807 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-oauth-serving-cert\") pod \"console-5fffb6d5d7-zwzqc\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " pod="openshift-console/console-5fffb6d5d7-zwzqc" Jul 16 17:36:25.769939 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.769825 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-service-ca\") pod \"console-5fffb6d5d7-zwzqc\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " pod="openshift-console/console-5fffb6d5d7-zwzqc" Jul 16 17:36:25.769939 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.769848 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxcnj\" (UniqueName: \"kubernetes.io/projected/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-kube-api-access-fxcnj\") pod \"console-5fffb6d5d7-zwzqc\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " pod="openshift-console/console-5fffb6d5d7-zwzqc" Jul 16 17:36:25.770272 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.769952 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-console-config\") pod \"console-5fffb6d5d7-zwzqc\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " pod="openshift-console/console-5fffb6d5d7-zwzqc" Jul 16 17:36:25.770722 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.770694 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-oauth-serving-cert\") pod \"console-5fffb6d5d7-zwzqc\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " pod="openshift-console/console-5fffb6d5d7-zwzqc" Jul 16 17:36:25.770854 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.770766 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-trusted-ca-bundle\") pod \"console-5fffb6d5d7-zwzqc\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " pod="openshift-console/console-5fffb6d5d7-zwzqc" Jul 16 17:36:25.770921 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.770873 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-service-ca\") pod \"console-5fffb6d5d7-zwzqc\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " pod="openshift-console/console-5fffb6d5d7-zwzqc" Jul 16 17:36:25.770994 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.770963 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-console-config\") pod \"console-5fffb6d5d7-zwzqc\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " pod="openshift-console/console-5fffb6d5d7-zwzqc" Jul 16 17:36:25.772679 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.772657 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-console-serving-cert\") pod \"console-5fffb6d5d7-zwzqc\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " pod="openshift-console/console-5fffb6d5d7-zwzqc" Jul 16 17:36:25.772791 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.772704 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-console-oauth-config\") pod \"console-5fffb6d5d7-zwzqc\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " pod="openshift-console/console-5fffb6d5d7-zwzqc" Jul 16 17:36:25.778451 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.778407 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxcnj\" (UniqueName: \"kubernetes.io/projected/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-kube-api-access-fxcnj\") pod \"console-5fffb6d5d7-zwzqc\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " pod="openshift-console/console-5fffb6d5d7-zwzqc" Jul 16 17:36:25.868029 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.867959 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:25.875080 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:36:25.875054 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52880a88_4a00_417a_bf93_8593cfaca919.slice/crio-4c86c7e729968df812bcf48f57e1acbe52b4e49619bb5d13c4e2380c455ebf98 WatchSource:0}: Error finding container 4c86c7e729968df812bcf48f57e1acbe52b4e49619bb5d13c4e2380c455ebf98: Status 404 returned error can't find the container with id 4c86c7e729968df812bcf48f57e1acbe52b4e49619bb5d13c4e2380c455ebf98 Jul 16 17:36:25.901636 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.901609 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fffb6d5d7-zwzqc" Jul 16 17:36:25.906463 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.906445 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 17:36:25.910469 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.910452 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:25.913334 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.913305 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 16 17:36:25.913450 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.913325 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 16 17:36:25.913643 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.913624 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 16 17:36:25.913700 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.913643 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 16 17:36:25.914083 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.914062 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 16 17:36:25.914083 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.914073 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 16 17:36:25.916245 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.916223 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 16 17:36:25.916333 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.916229 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 16 17:36:25.916391 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.916348 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 16 17:36:25.916465 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.916389 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 16 17:36:25.916530 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.916520 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bei11evgv38n1\"" Jul 16 17:36:25.916581 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.916559 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 16 17:36:25.916638 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.916582 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 16 17:36:25.916808 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.916791 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4ps6s\"" Jul 16 17:36:25.919642 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.919624 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 16 17:36:25.921589 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.921571 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 16 17:36:25.933752 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.933730 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 17:36:25.945360 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.945337 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:25.972585 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.972557 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/010a7ebf-2cdd-432f-9627-3a8c06a1a725-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:25.972670 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.972595 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/010a7ebf-2cdd-432f-9627-3a8c06a1a725-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:25.972670 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.972622 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010a7ebf-2cdd-432f-9627-3a8c06a1a725-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:25.972670 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.972648 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/010a7ebf-2cdd-432f-9627-3a8c06a1a725-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:25.972670 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.972670 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzcn9\" (UniqueName: \"kubernetes.io/projected/010a7ebf-2cdd-432f-9627-3a8c06a1a725-kube-api-access-dzcn9\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:25.972842 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.972724 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/010a7ebf-2cdd-432f-9627-3a8c06a1a725-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:25.972842 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.972741 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/010a7ebf-2cdd-432f-9627-3a8c06a1a725-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:25.972842 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.972772 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/010a7ebf-2cdd-432f-9627-3a8c06a1a725-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:25.972842 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.972801 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/010a7ebf-2cdd-432f-9627-3a8c06a1a725-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:25.972842 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.972824 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/010a7ebf-2cdd-432f-9627-3a8c06a1a725-config\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:25.973022 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.972857 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010a7ebf-2cdd-432f-9627-3a8c06a1a725-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:25.973022 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.972895 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/010a7ebf-2cdd-432f-9627-3a8c06a1a725-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:25.973022 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.972920 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/010a7ebf-2cdd-432f-9627-3a8c06a1a725-config-out\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:25.973022 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.972946 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/010a7ebf-2cdd-432f-9627-3a8c06a1a725-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:25.973022 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.973001 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/010a7ebf-2cdd-432f-9627-3a8c06a1a725-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:25.973229 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.973054 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010a7ebf-2cdd-432f-9627-3a8c06a1a725-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:25.973229 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.973075 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/010a7ebf-2cdd-432f-9627-3a8c06a1a725-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:25.973229 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.973094 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/010a7ebf-2cdd-432f-9627-3a8c06a1a725-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:25.973229 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.973180 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/010a7ebf-2cdd-432f-9627-3a8c06a1a725-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:25.973229 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:25.973206 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/010a7ebf-2cdd-432f-9627-3a8c06a1a725-web-config\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.079597 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.079563 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/010a7ebf-2cdd-432f-9627-3a8c06a1a725-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.079751 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.079608 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/010a7ebf-2cdd-432f-9627-3a8c06a1a725-config\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.079751 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.079631 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010a7ebf-2cdd-432f-9627-3a8c06a1a725-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.079751 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.079660 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/010a7ebf-2cdd-432f-9627-3a8c06a1a725-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.079751 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.079683 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/010a7ebf-2cdd-432f-9627-3a8c06a1a725-config-out\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.079751 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.079707 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/010a7ebf-2cdd-432f-9627-3a8c06a1a725-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.079751 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.079743 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/010a7ebf-2cdd-432f-9627-3a8c06a1a725-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.080064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.079782 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010a7ebf-2cdd-432f-9627-3a8c06a1a725-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.080064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.079809 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/010a7ebf-2cdd-432f-9627-3a8c06a1a725-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.080064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.079830 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/010a7ebf-2cdd-432f-9627-3a8c06a1a725-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.080064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.079885 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/010a7ebf-2cdd-432f-9627-3a8c06a1a725-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.080064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.079905 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/010a7ebf-2cdd-432f-9627-3a8c06a1a725-web-config\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.080064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.079926 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/010a7ebf-2cdd-432f-9627-3a8c06a1a725-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.080064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.079949 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/010a7ebf-2cdd-432f-9627-3a8c06a1a725-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.080064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.079970 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010a7ebf-2cdd-432f-9627-3a8c06a1a725-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.080064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.080001 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/010a7ebf-2cdd-432f-9627-3a8c06a1a725-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.080064 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.080033 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzcn9\" (UniqueName: \"kubernetes.io/projected/010a7ebf-2cdd-432f-9627-3a8c06a1a725-kube-api-access-dzcn9\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.080630 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.080075 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/010a7ebf-2cdd-432f-9627-3a8c06a1a725-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.080630 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.080097 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/010a7ebf-2cdd-432f-9627-3a8c06a1a725-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.080630 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.080124 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/010a7ebf-2cdd-432f-9627-3a8c06a1a725-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.080630 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.080285 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/010a7ebf-2cdd-432f-9627-3a8c06a1a725-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.080829 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.080809 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/010a7ebf-2cdd-432f-9627-3a8c06a1a725-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.080905 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.080876 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010a7ebf-2cdd-432f-9627-3a8c06a1a725-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.081135 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.081113 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/010a7ebf-2cdd-432f-9627-3a8c06a1a725-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.082065 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.081897 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/010a7ebf-2cdd-432f-9627-3a8c06a1a725-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.082284 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.082225 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010a7ebf-2cdd-432f-9627-3a8c06a1a725-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.083025 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.082965 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/010a7ebf-2cdd-432f-9627-3a8c06a1a725-config-out\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.083462 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.083434 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010a7ebf-2cdd-432f-9627-3a8c06a1a725-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.084095 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.084071 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/010a7ebf-2cdd-432f-9627-3a8c06a1a725-config\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.084653 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.084628 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/010a7ebf-2cdd-432f-9627-3a8c06a1a725-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.085093 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.085070 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/010a7ebf-2cdd-432f-9627-3a8c06a1a725-web-config\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.086209 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.086186 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/010a7ebf-2cdd-432f-9627-3a8c06a1a725-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.086549 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.086524 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/010a7ebf-2cdd-432f-9627-3a8c06a1a725-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.086891 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.086765 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/010a7ebf-2cdd-432f-9627-3a8c06a1a725-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.086891 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.086805 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/010a7ebf-2cdd-432f-9627-3a8c06a1a725-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.087198 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.087174 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/010a7ebf-2cdd-432f-9627-3a8c06a1a725-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.087563 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.087542 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/010a7ebf-2cdd-432f-9627-3a8c06a1a725-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.087660 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.087548 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/010a7ebf-2cdd-432f-9627-3a8c06a1a725-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.088400 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.088350 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/010a7ebf-2cdd-432f-9627-3a8c06a1a725-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.089400 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.089382 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzcn9\" (UniqueName: \"kubernetes.io/projected/010a7ebf-2cdd-432f-9627-3a8c06a1a725-kube-api-access-dzcn9\") pod \"prometheus-k8s-0\" (UID: \"010a7ebf-2cdd-432f-9627-3a8c06a1a725\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.214150 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.214078 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:26.222129 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.222108 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:26.310678 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.310635 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:26.401588 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.401553 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:26.440067 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.439749 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fffb6d5d7-zwzqc"] Jul 16 17:36:26.442318 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:36:26.442295 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a39a95e_567f_43cb_ab3c_07c636b0fcb1.slice/crio-31586ff39353f07c615d70d4bde7fd538076f58bc127c371831e6a8984b6d59c WatchSource:0}: Error finding container 31586ff39353f07c615d70d4bde7fd538076f58bc127c371831e6a8984b6d59c: Status 404 returned error can't find the container with id 31586ff39353f07c615d70d4bde7fd538076f58bc127c371831e6a8984b6d59c Jul 16 17:36:26.476164 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.476134 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 17:36:26.477518 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:36:26.477494 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod010a7ebf_2cdd_432f_9627_3a8c06a1a725.slice/crio-5ff77aa9d031e25a3102a6cc6eed1f7436019740abb1228d20b554498e1c44de WatchSource:0}: Error finding container 5ff77aa9d031e25a3102a6cc6eed1f7436019740abb1228d20b554498e1c44de: Status 404 returned error can't find the container with id 5ff77aa9d031e25a3102a6cc6eed1f7436019740abb1228d20b554498e1c44de Jul 16 17:36:26.479438 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.479302 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:26.646517 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.646492 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fffb6d5d7-zwzqc" event={"ID":"3a39a95e-567f-43cb-ab3c-07c636b0fcb1","Type":"ContainerStarted","Data":"c835fa437cba9f288611fb69323f33f617fe844b1b1b2fd7756a08c1812e5edd"} Jul 16 17:36:26.646630 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.646542 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fffb6d5d7-zwzqc" event={"ID":"3a39a95e-567f-43cb-ab3c-07c636b0fcb1","Type":"ContainerStarted","Data":"31586ff39353f07c615d70d4bde7fd538076f58bc127c371831e6a8984b6d59c"} Jul 16 17:36:26.648156 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.648133 2578 generic.go:356] "Generic (PLEG): container finished" podID="010a7ebf-2cdd-432f-9627-3a8c06a1a725" containerID="41e6b155fba3f0035fe0132ad52a9b528beb9b2fe9ac02e8c9f82581a4d4f5d4" exitCode=0 Jul 16 17:36:26.648249 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.648209 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010a7ebf-2cdd-432f-9627-3a8c06a1a725","Type":"ContainerDied","Data":"41e6b155fba3f0035fe0132ad52a9b528beb9b2fe9ac02e8c9f82581a4d4f5d4"} Jul 16 17:36:26.648310 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.648268 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010a7ebf-2cdd-432f-9627-3a8c06a1a725","Type":"ContainerStarted","Data":"5ff77aa9d031e25a3102a6cc6eed1f7436019740abb1228d20b554498e1c44de"} Jul 16 17:36:26.650974 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.650950 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c89eb88-a868-4c78-989b-f236dfc33922","Type":"ContainerStarted","Data":"b5070e208a8529e2300ba50d22a4298f370cd8fdbba7dc25e3d4cf86cac7523d"} Jul 16 17:36:26.651070 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.651018 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c89eb88-a868-4c78-989b-f236dfc33922","Type":"ContainerStarted","Data":"b8dfe0d6980705f3bb4ff57a7fe3ab10ccc7dc69f89c64a6f97b2dfc0c6f7c76"} Jul 16 17:36:26.651070 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.651062 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c89eb88-a868-4c78-989b-f236dfc33922","Type":"ContainerStarted","Data":"cf162f5fb94e6ccd2df26703fbc5b5b73c2239348f2497d818629109e7640aff"} Jul 16 17:36:26.652223 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.652204 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mnndm" event={"ID":"52880a88-4a00-417a-bf93-8593cfaca919","Type":"ContainerStarted","Data":"4c86c7e729968df812bcf48f57e1acbe52b4e49619bb5d13c4e2380c455ebf98"} Jul 16 17:36:26.653730 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.653707 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" event={"ID":"c18e4333-f670-43b5-ad06-b442ceb5282d","Type":"ContainerStarted","Data":"cd59d3940bc859338d5835ef69db874331abe49b56cc35281733eeb99eb23b0b"} Jul 16 17:36:26.669301 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.669252 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5fffb6d5d7-zwzqc" podStartSLOduration=1.6692340209999998 podStartE2EDuration="1.669234021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:26.668804069 +0000 UTC m=+157.198228355" watchObservedRunningTime="2026-07-16 17:36:26.669234021 +0000 UTC m=+157.198658285" Jul 16 17:36:26.692884 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:26.692844 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" podStartSLOduration=1.015943834 podStartE2EDuration="2.692830601s" totalImagesPullingTime="1.676886767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:26.691166503 +0000 UTC m=+157.220590766" watchObservedRunningTime="2026-07-16 17:36:26.692830601 +0000 UTC m=+157.222254863" Jul 16 17:36:26.933800 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:36:26.933762 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fk9lj" podUID="bb1fa25e-7b06-453d-8064-237d8cf6dd85" Jul 16 17:36:27.429878 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:27.429816 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:27.530791 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:27.530763 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:27.662779 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:27.662749 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fk9lj" Jul 16 17:36:27.662923 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:27.662789 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c89eb88-a868-4c78-989b-f236dfc33922","Type":"ContainerStarted","Data":"7557d81e354bb1eb305ce06e87634abedca6db99bb341b4c5e152db853f409dc"} Jul 16 17:36:27.662923 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:27.662851 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c89eb88-a868-4c78-989b-f236dfc33922","Type":"ContainerStarted","Data":"cb57768272a302e2131ab4b80aa0ffb1ae621361fec6e12302c6f036eb36b434"} Jul 16 17:36:28.674943 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:28.674915 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c89eb88-a868-4c78-989b-f236dfc33922","Type":"ContainerStarted","Data":"71fd7983a56f797841c5ea0c715bc40adde98a34ecb6088dbc62c289a79f1640"} Jul 16 17:36:28.676754 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:28.676729 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mnndm" event={"ID":"52880a88-4a00-417a-bf93-8593cfaca919","Type":"ContainerStarted","Data":"80cdaaddd5a7bfe8ccd1c053c044fb19e1f0074788aeb3a30026f423f1643f06"} Jul 16 17:36:28.676923 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:28.676904 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mnndm" Jul 16 17:36:28.682799 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:28.682778 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mnndm" Jul 16 17:36:28.699011 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:28.698970 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mnndm" podStartSLOduration=2.382767857 podStartE2EDuration="4.698955401s" totalImagesPullingTime="2.316187544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:28.696562819 +0000 UTC m=+159.225987084" watchObservedRunningTime="2026-07-16 17:36:28.698955401 +0000 UTC m=+159.228379663" Jul 16 17:36:29.715905 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:29.715854 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.352588471 podStartE2EDuration="9.715836256s" totalImagesPullingTime="5.344054997s" totalInitContainerRuntime="19.192788ms" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:29.711276677 +0000 UTC m=+160.240700943" watchObservedRunningTime="2026-07-16 17:36:29.715836256 +0000 UTC m=+160.245260519" Jul 16 17:36:30.488531 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:30.488495 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:30.545430 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:30.545378 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:31.694016 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:31.693978 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010a7ebf-2cdd-432f-9627-3a8c06a1a725","Type":"ContainerStarted","Data":"1e854df4652444052d73b25c60ada9dfb25600f2e83606dee01d43763eeaa5f6"} Jul 16 17:36:31.694401 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:31.694080 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010a7ebf-2cdd-432f-9627-3a8c06a1a725","Type":"ContainerStarted","Data":"1218771e6c47fa545845c590a041d769a84c828759245be5465d4ed693e90ed1"} Jul 16 17:36:31.737852 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:31.737826 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb1fa25e-7b06-453d-8064-237d8cf6dd85-metrics-tls\") pod \"dns-default-fk9lj\" (UID: \"bb1fa25e-7b06-453d-8064-237d8cf6dd85\") " pod="openshift-dns/dns-default-fk9lj" Jul 16 17:36:31.740005 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:31.739983 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb1fa25e-7b06-453d-8064-237d8cf6dd85-metrics-tls\") pod \"dns-default-fk9lj\" (UID: \"bb1fa25e-7b06-453d-8064-237d8cf6dd85\") " pod="openshift-dns/dns-default-fk9lj" Jul 16 17:36:31.866460 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:31.866442 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-24sj8\"" Jul 16 17:36:31.874851 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:31.874825 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fk9lj" Jul 16 17:36:32.020939 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.020851 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fk9lj"] Jul 16 17:36:32.024081 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:36:32.024037 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb1fa25e_7b06_453d_8064_237d8cf6dd85.slice/crio-077dd72e4e1072e8ec912a68bdb20eac6bcf2615059d0dee3699ce1276eef099 WatchSource:0}: Error finding container 077dd72e4e1072e8ec912a68bdb20eac6bcf2615059d0dee3699ce1276eef099: Status 404 returned error can't find the container with id 077dd72e4e1072e8ec912a68bdb20eac6bcf2615059d0dee3699ce1276eef099 Jul 16 17:36:32.215386 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.215292 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fffb6d5d7-zwzqc"] Jul 16 17:36:32.257649 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.257621 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6756dd6b5-kb9cz"] Jul 16 17:36:32.260815 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.260797 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:36:32.274179 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.274152 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6756dd6b5-kb9cz"] Jul 16 17:36:32.344262 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.344228 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7caa9316-1a19-402f-916b-e62f3dd2467f-console-oauth-config\") pod \"console-6756dd6b5-kb9cz\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:36:32.344396 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.344282 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7caa9316-1a19-402f-916b-e62f3dd2467f-oauth-serving-cert\") pod \"console-6756dd6b5-kb9cz\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:36:32.344396 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.344338 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7caa9316-1a19-402f-916b-e62f3dd2467f-trusted-ca-bundle\") pod \"console-6756dd6b5-kb9cz\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:36:32.344493 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.344408 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7caa9316-1a19-402f-916b-e62f3dd2467f-console-config\") pod \"console-6756dd6b5-kb9cz\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:36:32.344525 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.344491 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk69n\" (UniqueName: \"kubernetes.io/projected/7caa9316-1a19-402f-916b-e62f3dd2467f-kube-api-access-kk69n\") pod \"console-6756dd6b5-kb9cz\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:36:32.344560 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.344530 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7caa9316-1a19-402f-916b-e62f3dd2467f-service-ca\") pod \"console-6756dd6b5-kb9cz\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:36:32.344674 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.344660 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7caa9316-1a19-402f-916b-e62f3dd2467f-console-serving-cert\") pod \"console-6756dd6b5-kb9cz\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:36:32.445406 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.445374 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7caa9316-1a19-402f-916b-e62f3dd2467f-console-serving-cert\") pod \"console-6756dd6b5-kb9cz\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:36:32.445571 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.445441 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7caa9316-1a19-402f-916b-e62f3dd2467f-console-oauth-config\") pod \"console-6756dd6b5-kb9cz\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:36:32.445571 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.445473 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7caa9316-1a19-402f-916b-e62f3dd2467f-oauth-serving-cert\") pod \"console-6756dd6b5-kb9cz\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:36:32.445571 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.445513 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7caa9316-1a19-402f-916b-e62f3dd2467f-trusted-ca-bundle\") pod \"console-6756dd6b5-kb9cz\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:36:32.445571 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.445548 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7caa9316-1a19-402f-916b-e62f3dd2467f-console-config\") pod \"console-6756dd6b5-kb9cz\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:36:32.445787 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.445578 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk69n\" (UniqueName: \"kubernetes.io/projected/7caa9316-1a19-402f-916b-e62f3dd2467f-kube-api-access-kk69n\") pod \"console-6756dd6b5-kb9cz\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:36:32.445787 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.445599 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7caa9316-1a19-402f-916b-e62f3dd2467f-service-ca\") pod \"console-6756dd6b5-kb9cz\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:36:32.446301 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.446267 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7caa9316-1a19-402f-916b-e62f3dd2467f-oauth-serving-cert\") pod \"console-6756dd6b5-kb9cz\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:36:32.446438 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.446341 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7caa9316-1a19-402f-916b-e62f3dd2467f-service-ca\") pod \"console-6756dd6b5-kb9cz\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:36:32.446868 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.446801 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7caa9316-1a19-402f-916b-e62f3dd2467f-console-config\") pod \"console-6756dd6b5-kb9cz\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:36:32.446948 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.446918 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7caa9316-1a19-402f-916b-e62f3dd2467f-trusted-ca-bundle\") pod \"console-6756dd6b5-kb9cz\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:36:32.448729 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.448690 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7caa9316-1a19-402f-916b-e62f3dd2467f-console-oauth-config\") pod \"console-6756dd6b5-kb9cz\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:36:32.449073 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.449048 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7caa9316-1a19-402f-916b-e62f3dd2467f-console-serving-cert\") pod \"console-6756dd6b5-kb9cz\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:36:32.456073 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.456050 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk69n\" (UniqueName: \"kubernetes.io/projected/7caa9316-1a19-402f-916b-e62f3dd2467f-kube-api-access-kk69n\") pod \"console-6756dd6b5-kb9cz\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:36:32.571338 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.571241 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:36:32.700997 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:32.700966 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fk9lj" event={"ID":"bb1fa25e-7b06-453d-8064-237d8cf6dd85","Type":"ContainerStarted","Data":"077dd72e4e1072e8ec912a68bdb20eac6bcf2615059d0dee3699ce1276eef099"} Jul 16 17:36:33.070843 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:33.070821 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6756dd6b5-kb9cz"] Jul 16 17:36:33.509319 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:36:33.509294 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7caa9316_1a19_402f_916b_e62f3dd2467f.slice/crio-432e8abaaf663de8b37b578d009ef89afab455398fc62f674c7ab6f5ff5053f2 WatchSource:0}: Error finding container 432e8abaaf663de8b37b578d009ef89afab455398fc62f674c7ab6f5ff5053f2: Status 404 returned error can't find the container with id 432e8abaaf663de8b37b578d009ef89afab455398fc62f674c7ab6f5ff5053f2 Jul 16 17:36:33.714056 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:33.714022 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010a7ebf-2cdd-432f-9627-3a8c06a1a725","Type":"ContainerStarted","Data":"dfc3c7080485537d1a6258ff316656cb211d2807821a876ade904df022cebc18"} Jul 16 17:36:33.714503 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:33.714108 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010a7ebf-2cdd-432f-9627-3a8c06a1a725","Type":"ContainerStarted","Data":"1329d0954eff3044643ef9d72198cd8e9775e412416c8072f463bdf03cd5ea60"} Jul 16 17:36:33.714503 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:33.714151 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010a7ebf-2cdd-432f-9627-3a8c06a1a725","Type":"ContainerStarted","Data":"ab2cae52dc77ed290eba8df8c68ac674382945c42e7ba5ae4e8c457ece3f2770"} Jul 16 17:36:33.714503 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:33.714191 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010a7ebf-2cdd-432f-9627-3a8c06a1a725","Type":"ContainerStarted","Data":"542105e155f8400297266bef3b40fd9983c15cc3ac6e3c665a6c8590b8a459b5"} Jul 16 17:36:33.716130 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:33.716092 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fk9lj" event={"ID":"bb1fa25e-7b06-453d-8064-237d8cf6dd85","Type":"ContainerStarted","Data":"fcebaca32d4a7a2957eed2dfd45977fcb2afde8b94d079ef381846ee2d438c2c"} Jul 16 17:36:33.719371 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:33.719345 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6756dd6b5-kb9cz" event={"ID":"7caa9316-1a19-402f-916b-e62f3dd2467f","Type":"ContainerStarted","Data":"378dcc4151a4f7cde3f59c51c0a356a913519a4a812388a86308550352c872b0"} Jul 16 17:36:33.719489 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:33.719387 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6756dd6b5-kb9cz" event={"ID":"7caa9316-1a19-402f-916b-e62f3dd2467f","Type":"ContainerStarted","Data":"432e8abaaf663de8b37b578d009ef89afab455398fc62f674c7ab6f5ff5053f2"} Jul 16 17:36:33.761248 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:33.760188 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.515035958 podStartE2EDuration="8.760168075s" totalImagesPullingTime="6.212556114s" totalInitContainerRuntime="32.576003ms" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:33.753183817 +0000 UTC m=+164.282608072" watchObservedRunningTime="2026-07-16 17:36:33.760168075 +0000 UTC m=+164.289592337" Jul 16 17:36:34.726176 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:34.726134 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fk9lj" event={"ID":"bb1fa25e-7b06-453d-8064-237d8cf6dd85","Type":"ContainerStarted","Data":"ef702a74e4b0ecc8f384d73092a68c135661b9a5d9007f51853d696ba5c23918"} Jul 16 17:36:34.726652 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:34.726509 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fk9lj" Jul 16 17:36:34.754007 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:34.753958 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6756dd6b5-kb9cz" podStartSLOduration=2.753940635 podStartE2EDuration="2.753940635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:33.781936125 +0000 UTC m=+164.311360387" watchObservedRunningTime="2026-07-16 17:36:34.753940635 +0000 UTC m=+165.283364898" Jul 16 17:36:34.754851 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:34.754812 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fk9lj" podStartSLOduration=130.218127762 podStartE2EDuration="2m11.754799499s" totalImagesPullingTime="1.536671737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:34.753010604 +0000 UTC m=+165.282434890" watchObservedRunningTime="2026-07-16 17:36:34.754799499 +0000 UTC m=+165.284223763" Jul 16 17:36:35.902123 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:35.902094 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5fffb6d5d7-zwzqc" Jul 16 17:36:36.222560 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:36.222499 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:40.053633 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:40.053607 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:40.154176 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:40.154147 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:40.254915 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:40.254875 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:40.754089 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:40.754060 2578 generic.go:356] "Generic (PLEG): container finished" podID="83bc0281-2e18-403e-a681-d356367d8355" containerID="aa4a541c130e0c7f5e78d825b07ed45bc24ee99ab768472aa9662d0010e87c54" exitCode=0 Jul 16 17:36:40.754258 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:40.754130 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-h7w8t" event={"ID":"83bc0281-2e18-403e-a681-d356367d8355","Type":"ContainerDied","Data":"aa4a541c130e0c7f5e78d825b07ed45bc24ee99ab768472aa9662d0010e87c54"} Jul 16 17:36:40.754488 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:40.754474 2578 scope.go:117] "RemoveContainer" containerID="aa4a541c130e0c7f5e78d825b07ed45bc24ee99ab768472aa9662d0010e87c54" Jul 16 17:36:41.264162 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:41.264132 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fk9lj_bb1fa25e-7b06-453d-8064-237d8cf6dd85/dns/0.log" Jul 16 17:36:41.273293 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:41.273273 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fk9lj_bb1fa25e-7b06-453d-8064-237d8cf6dd85/kube-rbac-proxy/0.log" Jul 16 17:36:41.564874 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:41.564813 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cxq75_8dbc1f99-f360-4ae6-8200-45ad3de61e8e/dns-node-resolver/0.log" Jul 16 17:36:41.765979 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:41.765905 2578 generic.go:356] "Generic (PLEG): container finished" podID="d188b6b9-c314-4df0-bf39-e62ece5b1c32" containerID="33d01ba6df3dc64c7d917488dffd2bdfa8de8d7d3dae0e7e08f5057aa97ebbb4" exitCode=0 Jul 16 17:36:41.766111 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:41.765996 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bnspx" event={"ID":"d188b6b9-c314-4df0-bf39-e62ece5b1c32","Type":"ContainerDied","Data":"33d01ba6df3dc64c7d917488dffd2bdfa8de8d7d3dae0e7e08f5057aa97ebbb4"} Jul 16 17:36:41.766429 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:41.766398 2578 scope.go:117] "RemoveContainer" containerID="33d01ba6df3dc64c7d917488dffd2bdfa8de8d7d3dae0e7e08f5057aa97ebbb4" Jul 16 17:36:41.768360 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:41.768340 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-h7w8t" event={"ID":"83bc0281-2e18-403e-a681-d356367d8355","Type":"ContainerStarted","Data":"09096c9d8ee7e181cbc91871c411758d9332a6ec5c1b0c323dd7ab4f85d933c0"} Jul 16 17:36:41.769829 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:41.769811 2578 generic.go:356] "Generic (PLEG): container finished" podID="02c4f876-b486-4820-b057-13bce5df4b54" containerID="1fe2ccbe7dc5c1b0582e3958c652a2c1e5287c11da50cf5897591c5dfcbca8dc" exitCode=0 Jul 16 17:36:41.769930 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:41.769846 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9w6q6" event={"ID":"02c4f876-b486-4820-b057-13bce5df4b54","Type":"ContainerDied","Data":"1fe2ccbe7dc5c1b0582e3958c652a2c1e5287c11da50cf5897591c5dfcbca8dc"} Jul 16 17:36:41.770096 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:41.770082 2578 scope.go:117] "RemoveContainer" containerID="1fe2ccbe7dc5c1b0582e3958c652a2c1e5287c11da50cf5897591c5dfcbca8dc" Jul 16 17:36:42.571407 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:42.571369 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:36:42.571845 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:42.571452 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:36:42.577456 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:42.577433 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:36:42.778295 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:42.778263 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bnspx" event={"ID":"d188b6b9-c314-4df0-bf39-e62ece5b1c32","Type":"ContainerStarted","Data":"6f7fe046ab7748ee6926343dcadde7979b58a85f934a118800296d32f083ba97"} Jul 16 17:36:42.780191 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:42.780161 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9w6q6" event={"ID":"02c4f876-b486-4820-b057-13bce5df4b54","Type":"ContainerStarted","Data":"22bd66fe599045952c7d3ea4c82ce5245b1138617278dee892e518d0285b94bc"} Jul 16 17:36:42.785721 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:42.785692 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:36:42.881108 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:42.881077 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f79dc7b55-c4cvc"] Jul 16 17:36:43.020484 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:43.020455 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:43.121938 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:43.121908 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:43.182435 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:43.182358 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:43.464372 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:43.464309 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:43.564498 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:43.564472 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:44.456381 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:44.456352 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" Jul 16 17:36:44.456814 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:44.456400 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" Jul 16 17:36:44.550105 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:44.550074 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:44.649407 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:44.649381 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:45.738127 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:45.738100 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fk9lj" Jul 16 17:36:47.966634 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:47.966598 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f9f7cd54d-6zf4d" podUID="30583ecb-417c-46c0-8c1f-3a2d61679bc8" containerName="console" containerID="cri-o://fe389aff80f5e1c8216b95e62e3ca505b6c16b9e6f5dcda953493a09a7664024" gracePeriod=15 Jul 16 17:36:48.211188 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.211166 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9f7cd54d-6zf4d" Jul 16 17:36:48.380940 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.380912 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30583ecb-417c-46c0-8c1f-3a2d61679bc8-oauth-serving-cert\") pod \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\" (UID: \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\") " Jul 16 17:36:48.381076 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.380948 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30583ecb-417c-46c0-8c1f-3a2d61679bc8-console-config\") pod \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\" (UID: \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\") " Jul 16 17:36:48.381076 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.380987 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30583ecb-417c-46c0-8c1f-3a2d61679bc8-service-ca\") pod \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\" (UID: \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\") " Jul 16 17:36:48.381076 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.381036 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30583ecb-417c-46c0-8c1f-3a2d61679bc8-console-oauth-config\") pod \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\" (UID: \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\") " Jul 16 17:36:48.381076 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.381063 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30583ecb-417c-46c0-8c1f-3a2d61679bc8-console-serving-cert\") pod \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\" (UID: \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\") " Jul 16 17:36:48.381288 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.381088 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnmfb\" (UniqueName: \"kubernetes.io/projected/30583ecb-417c-46c0-8c1f-3a2d61679bc8-kube-api-access-bnmfb\") pod \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\" (UID: \"30583ecb-417c-46c0-8c1f-3a2d61679bc8\") " Jul 16 17:36:48.381432 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.381384 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30583ecb-417c-46c0-8c1f-3a2d61679bc8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "30583ecb-417c-46c0-8c1f-3a2d61679bc8" (UID: "30583ecb-417c-46c0-8c1f-3a2d61679bc8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:36:48.381432 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.381399 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30583ecb-417c-46c0-8c1f-3a2d61679bc8-console-config" (OuterVolumeSpecName: "console-config") pod "30583ecb-417c-46c0-8c1f-3a2d61679bc8" (UID: "30583ecb-417c-46c0-8c1f-3a2d61679bc8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:36:48.381572 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.381409 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30583ecb-417c-46c0-8c1f-3a2d61679bc8-service-ca" (OuterVolumeSpecName: "service-ca") pod "30583ecb-417c-46c0-8c1f-3a2d61679bc8" (UID: "30583ecb-417c-46c0-8c1f-3a2d61679bc8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:36:48.383295 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.383268 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30583ecb-417c-46c0-8c1f-3a2d61679bc8-kube-api-access-bnmfb" (OuterVolumeSpecName: "kube-api-access-bnmfb") pod "30583ecb-417c-46c0-8c1f-3a2d61679bc8" (UID: "30583ecb-417c-46c0-8c1f-3a2d61679bc8"). InnerVolumeSpecName "kube-api-access-bnmfb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:36:48.383295 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.383269 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30583ecb-417c-46c0-8c1f-3a2d61679bc8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "30583ecb-417c-46c0-8c1f-3a2d61679bc8" (UID: "30583ecb-417c-46c0-8c1f-3a2d61679bc8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:36:48.383464 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.383349 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30583ecb-417c-46c0-8c1f-3a2d61679bc8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "30583ecb-417c-46c0-8c1f-3a2d61679bc8" (UID: "30583ecb-417c-46c0-8c1f-3a2d61679bc8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:36:48.482373 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.482348 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30583ecb-417c-46c0-8c1f-3a2d61679bc8-console-oauth-config\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:36:48.482373 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.482370 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30583ecb-417c-46c0-8c1f-3a2d61679bc8-console-serving-cert\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:36:48.482535 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.482383 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnmfb\" (UniqueName: \"kubernetes.io/projected/30583ecb-417c-46c0-8c1f-3a2d61679bc8-kube-api-access-bnmfb\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:36:48.482535 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.482397 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30583ecb-417c-46c0-8c1f-3a2d61679bc8-oauth-serving-cert\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:36:48.482535 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.482408 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30583ecb-417c-46c0-8c1f-3a2d61679bc8-console-config\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:36:48.482535 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.482445 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30583ecb-417c-46c0-8c1f-3a2d61679bc8-service-ca\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:36:48.809457 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.809354 2578 generic.go:356] "Generic (PLEG): container finished" podID="30583ecb-417c-46c0-8c1f-3a2d61679bc8" containerID="fe389aff80f5e1c8216b95e62e3ca505b6c16b9e6f5dcda953493a09a7664024" exitCode=0 Jul 16 17:36:48.809457 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.809443 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9f7cd54d-6zf4d" Jul 16 17:36:48.809669 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.809441 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9f7cd54d-6zf4d" event={"ID":"30583ecb-417c-46c0-8c1f-3a2d61679bc8","Type":"ContainerDied","Data":"fe389aff80f5e1c8216b95e62e3ca505b6c16b9e6f5dcda953493a09a7664024"} Jul 16 17:36:48.809669 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.809577 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9f7cd54d-6zf4d" event={"ID":"30583ecb-417c-46c0-8c1f-3a2d61679bc8","Type":"ContainerDied","Data":"cc366b1aaac0e61e9135402f6b23b819dcd3387ef6ac2beaa2b76fa01c41a3f9"} Jul 16 17:36:48.809669 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.809598 2578 scope.go:117] "RemoveContainer" containerID="fe389aff80f5e1c8216b95e62e3ca505b6c16b9e6f5dcda953493a09a7664024" Jul 16 17:36:48.818401 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.818385 2578 scope.go:117] "RemoveContainer" containerID="fe389aff80f5e1c8216b95e62e3ca505b6c16b9e6f5dcda953493a09a7664024" Jul 16 17:36:48.818659 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:36:48.818640 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe389aff80f5e1c8216b95e62e3ca505b6c16b9e6f5dcda953493a09a7664024\": container with ID starting with fe389aff80f5e1c8216b95e62e3ca505b6c16b9e6f5dcda953493a09a7664024 not found: ID does not exist" containerID="fe389aff80f5e1c8216b95e62e3ca505b6c16b9e6f5dcda953493a09a7664024" Jul 16 17:36:48.818712 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.818668 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe389aff80f5e1c8216b95e62e3ca505b6c16b9e6f5dcda953493a09a7664024"} err="failed to get container status \"fe389aff80f5e1c8216b95e62e3ca505b6c16b9e6f5dcda953493a09a7664024\": rpc error: code = NotFound desc = could not find container \"fe389aff80f5e1c8216b95e62e3ca505b6c16b9e6f5dcda953493a09a7664024\": container with ID starting with fe389aff80f5e1c8216b95e62e3ca505b6c16b9e6f5dcda953493a09a7664024 not found: ID does not exist" Jul 16 17:36:48.837097 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.837071 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f9f7cd54d-6zf4d"] Jul 16 17:36:48.841349 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:48.841329 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f9f7cd54d-6zf4d"] Jul 16 17:36:49.141942 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:49.141920 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:49.533570 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:49.533509 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:49.633827 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:49.633804 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:50.033122 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:50.033094 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30583ecb-417c-46c0-8c1f-3a2d61679bc8" path="/var/lib/kubelet/pods/30583ecb-417c-46c0-8c1f-3a2d61679bc8/volumes" Jul 16 17:36:53.094461 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:53.094410 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:53.149782 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:53.149752 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:57.236208 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.236141 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5fffb6d5d7-zwzqc" podUID="3a39a95e-567f-43cb-ab3c-07c636b0fcb1" containerName="console" containerID="cri-o://c835fa437cba9f288611fb69323f33f617fe844b1b1b2fd7756a08c1812e5edd" gracePeriod=15 Jul 16 17:36:57.484070 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.484047 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fffb6d5d7-zwzqc" Jul 16 17:36:57.565735 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.565662 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-trusted-ca-bundle\") pod \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " Jul 16 17:36:57.565735 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.565709 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxcnj\" (UniqueName: \"kubernetes.io/projected/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-kube-api-access-fxcnj\") pod \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " Jul 16 17:36:57.565916 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.565823 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-console-config\") pod \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " Jul 16 17:36:57.565916 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.565866 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-oauth-serving-cert\") pod \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " Jul 16 17:36:57.565916 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.565887 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-console-serving-cert\") pod \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " Jul 16 17:36:57.566066 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.565917 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-console-oauth-config\") pod \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " Jul 16 17:36:57.566066 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.565963 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-service-ca\") pod \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\" (UID: \"3a39a95e-567f-43cb-ab3c-07c636b0fcb1\") " Jul 16 17:36:57.566220 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.566096 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3a39a95e-567f-43cb-ab3c-07c636b0fcb1" (UID: "3a39a95e-567f-43cb-ab3c-07c636b0fcb1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:36:57.566371 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.566241 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3a39a95e-567f-43cb-ab3c-07c636b0fcb1" (UID: "3a39a95e-567f-43cb-ab3c-07c636b0fcb1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:36:57.566371 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.566197 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-console-config" (OuterVolumeSpecName: "console-config") pod "3a39a95e-567f-43cb-ab3c-07c636b0fcb1" (UID: "3a39a95e-567f-43cb-ab3c-07c636b0fcb1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:36:57.566371 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.566306 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-trusted-ca-bundle\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:36:57.566597 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.566522 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-service-ca" (OuterVolumeSpecName: "service-ca") pod "3a39a95e-567f-43cb-ab3c-07c636b0fcb1" (UID: "3a39a95e-567f-43cb-ab3c-07c636b0fcb1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:36:57.567860 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.567833 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-kube-api-access-fxcnj" (OuterVolumeSpecName: "kube-api-access-fxcnj") pod "3a39a95e-567f-43cb-ab3c-07c636b0fcb1" (UID: "3a39a95e-567f-43cb-ab3c-07c636b0fcb1"). InnerVolumeSpecName "kube-api-access-fxcnj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:36:57.568167 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.568143 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3a39a95e-567f-43cb-ab3c-07c636b0fcb1" (UID: "3a39a95e-567f-43cb-ab3c-07c636b0fcb1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:36:57.568232 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.568214 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3a39a95e-567f-43cb-ab3c-07c636b0fcb1" (UID: "3a39a95e-567f-43cb-ab3c-07c636b0fcb1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:36:57.666745 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.666712 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-console-config\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:36:57.666745 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.666742 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-oauth-serving-cert\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:36:57.666745 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.666753 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-console-serving-cert\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:36:57.666964 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.666762 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-console-oauth-config\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:36:57.666964 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.666771 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-service-ca\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:36:57.666964 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.666779 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxcnj\" (UniqueName: \"kubernetes.io/projected/3a39a95e-567f-43cb-ab3c-07c636b0fcb1-kube-api-access-fxcnj\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:36:57.860712 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.860678 2578 generic.go:356] "Generic (PLEG): container finished" podID="3a39a95e-567f-43cb-ab3c-07c636b0fcb1" containerID="c835fa437cba9f288611fb69323f33f617fe844b1b1b2fd7756a08c1812e5edd" exitCode=0 Jul 16 17:36:57.860861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.860728 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fffb6d5d7-zwzqc" Jul 16 17:36:57.860861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.860753 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fffb6d5d7-zwzqc" event={"ID":"3a39a95e-567f-43cb-ab3c-07c636b0fcb1","Type":"ContainerDied","Data":"c835fa437cba9f288611fb69323f33f617fe844b1b1b2fd7756a08c1812e5edd"} Jul 16 17:36:57.860861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.860830 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fffb6d5d7-zwzqc" event={"ID":"3a39a95e-567f-43cb-ab3c-07c636b0fcb1","Type":"ContainerDied","Data":"31586ff39353f07c615d70d4bde7fd538076f58bc127c371831e6a8984b6d59c"} Jul 16 17:36:57.860861 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.860855 2578 scope.go:117] "RemoveContainer" containerID="c835fa437cba9f288611fb69323f33f617fe844b1b1b2fd7756a08c1812e5edd" Jul 16 17:36:57.869254 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.869234 2578 scope.go:117] "RemoveContainer" containerID="c835fa437cba9f288611fb69323f33f617fe844b1b1b2fd7756a08c1812e5edd" Jul 16 17:36:57.869515 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:36:57.869495 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c835fa437cba9f288611fb69323f33f617fe844b1b1b2fd7756a08c1812e5edd\": container with ID starting with c835fa437cba9f288611fb69323f33f617fe844b1b1b2fd7756a08c1812e5edd not found: ID does not exist" containerID="c835fa437cba9f288611fb69323f33f617fe844b1b1b2fd7756a08c1812e5edd" Jul 16 17:36:57.869587 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.869525 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c835fa437cba9f288611fb69323f33f617fe844b1b1b2fd7756a08c1812e5edd"} err="failed to get container status \"c835fa437cba9f288611fb69323f33f617fe844b1b1b2fd7756a08c1812e5edd\": rpc error: code = NotFound desc = could not find container \"c835fa437cba9f288611fb69323f33f617fe844b1b1b2fd7756a08c1812e5edd\": container with ID starting with c835fa437cba9f288611fb69323f33f617fe844b1b1b2fd7756a08c1812e5edd not found: ID does not exist" Jul 16 17:36:57.888014 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.887993 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fffb6d5d7-zwzqc"] Jul 16 17:36:57.893801 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:57.893781 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5fffb6d5d7-zwzqc"] Jul 16 17:36:58.033563 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:58.033534 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a39a95e-567f-43cb-ab3c-07c636b0fcb1" path="/var/lib/kubelet/pods/3a39a95e-567f-43cb-ab3c-07c636b0fcb1/volumes" Jul 16 17:36:58.512704 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:58.512675 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:36:58.570724 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:36:58.570696 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:37:04.461334 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:04.461305 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" Jul 16 17:37:04.464996 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:04.464974 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6647cd9cdd-jdwkz" Jul 16 17:37:07.902608 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:07.902544 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f79dc7b55-c4cvc" podUID="11b1f41a-26b5-431d-996f-817f9a88f599" containerName="console" containerID="cri-o://eec789dc688d1b734fa37b455ba3a7632dac107e61e67de7f43ccb00d033d3bf" gracePeriod=15 Jul 16 17:37:08.166246 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.166224 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:37:08.252522 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.252489 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b1f41a-26b5-431d-996f-817f9a88f599-trusted-ca-bundle\") pod \"11b1f41a-26b5-431d-996f-817f9a88f599\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " Jul 16 17:37:08.252684 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.252553 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11b1f41a-26b5-431d-996f-817f9a88f599-service-ca\") pod \"11b1f41a-26b5-431d-996f-817f9a88f599\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " Jul 16 17:37:08.252684 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.252575 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11b1f41a-26b5-431d-996f-817f9a88f599-console-config\") pod \"11b1f41a-26b5-431d-996f-817f9a88f599\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " Jul 16 17:37:08.252684 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.252609 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11b1f41a-26b5-431d-996f-817f9a88f599-console-serving-cert\") pod \"11b1f41a-26b5-431d-996f-817f9a88f599\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " Jul 16 17:37:08.252842 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.252741 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11b1f41a-26b5-431d-996f-817f9a88f599-console-oauth-config\") pod \"11b1f41a-26b5-431d-996f-817f9a88f599\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " Jul 16 17:37:08.252842 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.252806 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sp2sq\" (UniqueName: \"kubernetes.io/projected/11b1f41a-26b5-431d-996f-817f9a88f599-kube-api-access-sp2sq\") pod \"11b1f41a-26b5-431d-996f-817f9a88f599\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " Jul 16 17:37:08.252950 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.252891 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11b1f41a-26b5-431d-996f-817f9a88f599-oauth-serving-cert\") pod \"11b1f41a-26b5-431d-996f-817f9a88f599\" (UID: \"11b1f41a-26b5-431d-996f-817f9a88f599\") " Jul 16 17:37:08.252950 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.252907 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b1f41a-26b5-431d-996f-817f9a88f599-service-ca" (OuterVolumeSpecName: "service-ca") pod "11b1f41a-26b5-431d-996f-817f9a88f599" (UID: "11b1f41a-26b5-431d-996f-817f9a88f599"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:37:08.253044 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.252963 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b1f41a-26b5-431d-996f-817f9a88f599-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "11b1f41a-26b5-431d-996f-817f9a88f599" (UID: "11b1f41a-26b5-431d-996f-817f9a88f599"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:37:08.253044 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.252982 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b1f41a-26b5-431d-996f-817f9a88f599-console-config" (OuterVolumeSpecName: "console-config") pod "11b1f41a-26b5-431d-996f-817f9a88f599" (UID: "11b1f41a-26b5-431d-996f-817f9a88f599"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:37:08.253259 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.253231 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b1f41a-26b5-431d-996f-817f9a88f599-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "11b1f41a-26b5-431d-996f-817f9a88f599" (UID: "11b1f41a-26b5-431d-996f-817f9a88f599"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:37:08.253332 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.253303 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b1f41a-26b5-431d-996f-817f9a88f599-trusted-ca-bundle\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:37:08.253332 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.253318 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11b1f41a-26b5-431d-996f-817f9a88f599-service-ca\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:37:08.253332 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.253327 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11b1f41a-26b5-431d-996f-817f9a88f599-console-config\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:37:08.254877 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.254848 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11b1f41a-26b5-431d-996f-817f9a88f599-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "11b1f41a-26b5-431d-996f-817f9a88f599" (UID: "11b1f41a-26b5-431d-996f-817f9a88f599"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:37:08.254877 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.254865 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11b1f41a-26b5-431d-996f-817f9a88f599-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "11b1f41a-26b5-431d-996f-817f9a88f599" (UID: "11b1f41a-26b5-431d-996f-817f9a88f599"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:37:08.255053 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.254916 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11b1f41a-26b5-431d-996f-817f9a88f599-kube-api-access-sp2sq" (OuterVolumeSpecName: "kube-api-access-sp2sq") pod "11b1f41a-26b5-431d-996f-817f9a88f599" (UID: "11b1f41a-26b5-431d-996f-817f9a88f599"). InnerVolumeSpecName "kube-api-access-sp2sq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:37:08.353748 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.353711 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11b1f41a-26b5-431d-996f-817f9a88f599-console-serving-cert\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:37:08.353748 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.353740 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11b1f41a-26b5-431d-996f-817f9a88f599-console-oauth-config\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:37:08.353748 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.353751 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sp2sq\" (UniqueName: \"kubernetes.io/projected/11b1f41a-26b5-431d-996f-817f9a88f599-kube-api-access-sp2sq\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:37:08.353961 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.353761 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11b1f41a-26b5-431d-996f-817f9a88f599-oauth-serving-cert\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:37:08.909279 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.909243 2578 generic.go:356] "Generic (PLEG): container finished" podID="11b1f41a-26b5-431d-996f-817f9a88f599" containerID="eec789dc688d1b734fa37b455ba3a7632dac107e61e67de7f43ccb00d033d3bf" exitCode=0 Jul 16 17:37:08.909715 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.909290 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f79dc7b55-c4cvc" Jul 16 17:37:08.909715 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.909327 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f79dc7b55-c4cvc" event={"ID":"11b1f41a-26b5-431d-996f-817f9a88f599","Type":"ContainerDied","Data":"eec789dc688d1b734fa37b455ba3a7632dac107e61e67de7f43ccb00d033d3bf"} Jul 16 17:37:08.909715 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.909377 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f79dc7b55-c4cvc" event={"ID":"11b1f41a-26b5-431d-996f-817f9a88f599","Type":"ContainerDied","Data":"8859627fd12e34326b9fb0638842d3637954459c169dd97772a31fe3292353f1"} Jul 16 17:37:08.909715 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.909397 2578 scope.go:117] "RemoveContainer" containerID="eec789dc688d1b734fa37b455ba3a7632dac107e61e67de7f43ccb00d033d3bf" Jul 16 17:37:08.918324 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.918308 2578 scope.go:117] "RemoveContainer" containerID="eec789dc688d1b734fa37b455ba3a7632dac107e61e67de7f43ccb00d033d3bf" Jul 16 17:37:08.918609 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:37:08.918588 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eec789dc688d1b734fa37b455ba3a7632dac107e61e67de7f43ccb00d033d3bf\": container with ID starting with eec789dc688d1b734fa37b455ba3a7632dac107e61e67de7f43ccb00d033d3bf not found: ID does not exist" containerID="eec789dc688d1b734fa37b455ba3a7632dac107e61e67de7f43ccb00d033d3bf" Jul 16 17:37:08.918674 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.918616 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eec789dc688d1b734fa37b455ba3a7632dac107e61e67de7f43ccb00d033d3bf"} err="failed to get container status \"eec789dc688d1b734fa37b455ba3a7632dac107e61e67de7f43ccb00d033d3bf\": rpc error: code = NotFound desc = could not find container \"eec789dc688d1b734fa37b455ba3a7632dac107e61e67de7f43ccb00d033d3bf\": container with ID starting with eec789dc688d1b734fa37b455ba3a7632dac107e61e67de7f43ccb00d033d3bf not found: ID does not exist" Jul 16 17:37:08.933548 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.933529 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f79dc7b55-c4cvc"] Jul 16 17:37:08.937123 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:08.937103 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f79dc7b55-c4cvc"] Jul 16 17:37:10.033037 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:10.033005 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11b1f41a-26b5-431d-996f-817f9a88f599" path="/var/lib/kubelet/pods/11b1f41a-26b5-431d-996f-817f9a88f599/volumes" Jul 16 17:37:13.462055 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:13.462023 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:37:13.564537 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:13.564506 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:37:26.222757 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:26.222726 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:37:26.241668 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:26.241642 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:37:27.002389 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:27.002359 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:37:35.837202 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:35.837169 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:37:35.898806 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:35.898782 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:37:38.037177 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:38.037145 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:37:38.123242 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:38.118801 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:37:40.282610 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:40.282575 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:37:45.591794 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.591759 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f588f5599-mz5rg"] Jul 16 17:37:45.592167 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.592090 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30583ecb-417c-46c0-8c1f-3a2d61679bc8" containerName="console" Jul 16 17:37:45.592167 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.592101 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="30583ecb-417c-46c0-8c1f-3a2d61679bc8" containerName="console" Jul 16 17:37:45.592167 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.592126 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a39a95e-567f-43cb-ab3c-07c636b0fcb1" containerName="console" Jul 16 17:37:45.592167 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.592133 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a39a95e-567f-43cb-ab3c-07c636b0fcb1" containerName="console" Jul 16 17:37:45.592167 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.592148 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11b1f41a-26b5-431d-996f-817f9a88f599" containerName="console" Jul 16 17:37:45.592167 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.592154 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="11b1f41a-26b5-431d-996f-817f9a88f599" containerName="console" Jul 16 17:37:45.592349 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.592207 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="11b1f41a-26b5-431d-996f-817f9a88f599" containerName="console" Jul 16 17:37:45.592349 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.592218 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a39a95e-567f-43cb-ab3c-07c636b0fcb1" containerName="console" Jul 16 17:37:45.592349 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.592225 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="30583ecb-417c-46c0-8c1f-3a2d61679bc8" containerName="console" Jul 16 17:37:45.594172 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.594157 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:37:45.620534 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.620473 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f588f5599-mz5rg"] Jul 16 17:37:45.754156 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.754113 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3683a221-a1ed-4c30-a778-a9b8ece62552-console-oauth-config\") pod \"console-7f588f5599-mz5rg\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:37:45.754333 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.754197 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3683a221-a1ed-4c30-a778-a9b8ece62552-oauth-serving-cert\") pod \"console-7f588f5599-mz5rg\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:37:45.754333 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.754229 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3683a221-a1ed-4c30-a778-a9b8ece62552-service-ca\") pod \"console-7f588f5599-mz5rg\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:37:45.754333 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.754270 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtw72\" (UniqueName: \"kubernetes.io/projected/3683a221-a1ed-4c30-a778-a9b8ece62552-kube-api-access-xtw72\") pod \"console-7f588f5599-mz5rg\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:37:45.754333 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.754294 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3683a221-a1ed-4c30-a778-a9b8ece62552-trusted-ca-bundle\") pod \"console-7f588f5599-mz5rg\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:37:45.754523 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.754344 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3683a221-a1ed-4c30-a778-a9b8ece62552-console-serving-cert\") pod \"console-7f588f5599-mz5rg\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:37:45.754523 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.754411 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3683a221-a1ed-4c30-a778-a9b8ece62552-console-config\") pod \"console-7f588f5599-mz5rg\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:37:45.855399 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.855299 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3683a221-a1ed-4c30-a778-a9b8ece62552-console-oauth-config\") pod \"console-7f588f5599-mz5rg\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:37:45.855399 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.855367 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3683a221-a1ed-4c30-a778-a9b8ece62552-oauth-serving-cert\") pod \"console-7f588f5599-mz5rg\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:37:45.855633 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.855407 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3683a221-a1ed-4c30-a778-a9b8ece62552-service-ca\") pod \"console-7f588f5599-mz5rg\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:37:45.855633 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.855481 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtw72\" (UniqueName: \"kubernetes.io/projected/3683a221-a1ed-4c30-a778-a9b8ece62552-kube-api-access-xtw72\") pod \"console-7f588f5599-mz5rg\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:37:45.855633 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.855519 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3683a221-a1ed-4c30-a778-a9b8ece62552-trusted-ca-bundle\") pod \"console-7f588f5599-mz5rg\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:37:45.855633 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.855549 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3683a221-a1ed-4c30-a778-a9b8ece62552-console-serving-cert\") pod \"console-7f588f5599-mz5rg\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:37:45.855633 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.855577 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3683a221-a1ed-4c30-a778-a9b8ece62552-console-config\") pod \"console-7f588f5599-mz5rg\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:37:45.856211 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.856183 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3683a221-a1ed-4c30-a778-a9b8ece62552-service-ca\") pod \"console-7f588f5599-mz5rg\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:37:45.856320 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.856235 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3683a221-a1ed-4c30-a778-a9b8ece62552-oauth-serving-cert\") pod \"console-7f588f5599-mz5rg\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:37:45.856370 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.856327 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3683a221-a1ed-4c30-a778-a9b8ece62552-console-config\") pod \"console-7f588f5599-mz5rg\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:37:45.856406 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.856389 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3683a221-a1ed-4c30-a778-a9b8ece62552-trusted-ca-bundle\") pod \"console-7f588f5599-mz5rg\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:37:45.857965 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.857944 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3683a221-a1ed-4c30-a778-a9b8ece62552-console-oauth-config\") pod \"console-7f588f5599-mz5rg\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:37:45.858051 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.858033 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3683a221-a1ed-4c30-a778-a9b8ece62552-console-serving-cert\") pod \"console-7f588f5599-mz5rg\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:37:45.865754 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.865732 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtw72\" (UniqueName: \"kubernetes.io/projected/3683a221-a1ed-4c30-a778-a9b8ece62552-kube-api-access-xtw72\") pod \"console-7f588f5599-mz5rg\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:37:45.903467 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:45.903431 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:37:46.056214 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:46.056155 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f588f5599-mz5rg"] Jul 16 17:37:46.058390 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:37:46.058367 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3683a221_a1ed_4c30_a778_a9b8ece62552.slice/crio-7a2d4084b41af4ac55ae483f3586592138802e9fc2a82c9102c8163d3531e030 WatchSource:0}: Error finding container 7a2d4084b41af4ac55ae483f3586592138802e9fc2a82c9102c8163d3531e030: Status 404 returned error can't find the container with id 7a2d4084b41af4ac55ae483f3586592138802e9fc2a82c9102c8163d3531e030 Jul 16 17:37:46.068320 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:46.068289 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f588f5599-mz5rg" event={"ID":"3683a221-a1ed-4c30-a778-a9b8ece62552","Type":"ContainerStarted","Data":"7a2d4084b41af4ac55ae483f3586592138802e9fc2a82c9102c8163d3531e030"} Jul 16 17:37:46.522279 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:46.522198 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:37:46.587146 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:46.587114 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:37:47.073855 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:47.073816 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f588f5599-mz5rg" event={"ID":"3683a221-a1ed-4c30-a778-a9b8ece62552","Type":"ContainerStarted","Data":"5dd90d9508d89886ee48f633ea1874595212b5c9fbea7c59fde8ff345c233a54"} Jul 16 17:37:47.135122 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:47.135066 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f588f5599-mz5rg" podStartSLOduration=2.135047938 podStartE2EDuration="2.135047938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:37:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:37:47.134165111 +0000 UTC m=+237.663589372" watchObservedRunningTime="2026-07-16 17:37:47.135047938 +0000 UTC m=+237.664472199" Jul 16 17:37:47.713112 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:47.713076 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:37:48.508160 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:48.508099 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:37:55.903829 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:55.903784 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:37:55.904224 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:55.903851 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:37:55.908515 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:55.908492 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:37:56.120206 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:56.120175 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:37:56.181855 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:56.180324 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6756dd6b5-kb9cz"] Jul 16 17:37:56.295330 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:56.295299 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:37:56.353642 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:56.353611 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:37:56.414170 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:56.414139 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:37:58.490215 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:58.490173 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:37:58.584625 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:58.584590 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:37:58.684008 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:37:58.683976 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:38:11.400147 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:11.400113 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:38:11.452658 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:11.452624 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:38:21.203452 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:21.203367 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6756dd6b5-kb9cz" podUID="7caa9316-1a19-402f-916b-e62f3dd2467f" containerName="console" containerID="cri-o://378dcc4151a4f7cde3f59c51c0a356a913519a4a812388a86308550352c872b0" gracePeriod=15 Jul 16 17:38:21.455648 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:21.455571 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:38:21.562821 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:21.562784 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7caa9316-1a19-402f-916b-e62f3dd2467f-oauth-serving-cert\") pod \"7caa9316-1a19-402f-916b-e62f3dd2467f\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " Jul 16 17:38:21.562821 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:21.562821 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7caa9316-1a19-402f-916b-e62f3dd2467f-trusted-ca-bundle\") pod \"7caa9316-1a19-402f-916b-e62f3dd2467f\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " Jul 16 17:38:21.563057 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:21.562852 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kk69n\" (UniqueName: \"kubernetes.io/projected/7caa9316-1a19-402f-916b-e62f3dd2467f-kube-api-access-kk69n\") pod \"7caa9316-1a19-402f-916b-e62f3dd2467f\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " Jul 16 17:38:21.563057 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:21.562890 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7caa9316-1a19-402f-916b-e62f3dd2467f-console-oauth-config\") pod \"7caa9316-1a19-402f-916b-e62f3dd2467f\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " Jul 16 17:38:21.563057 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:21.562969 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7caa9316-1a19-402f-916b-e62f3dd2467f-console-serving-cert\") pod \"7caa9316-1a19-402f-916b-e62f3dd2467f\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " Jul 16 17:38:21.563057 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:21.563026 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7caa9316-1a19-402f-916b-e62f3dd2467f-service-ca\") pod \"7caa9316-1a19-402f-916b-e62f3dd2467f\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " Jul 16 17:38:21.563256 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:21.563072 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7caa9316-1a19-402f-916b-e62f3dd2467f-console-config\") pod \"7caa9316-1a19-402f-916b-e62f3dd2467f\" (UID: \"7caa9316-1a19-402f-916b-e62f3dd2467f\") " Jul 16 17:38:21.563401 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:21.563371 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7caa9316-1a19-402f-916b-e62f3dd2467f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7caa9316-1a19-402f-916b-e62f3dd2467f" (UID: "7caa9316-1a19-402f-916b-e62f3dd2467f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:38:21.563549 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:21.563379 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7caa9316-1a19-402f-916b-e62f3dd2467f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7caa9316-1a19-402f-916b-e62f3dd2467f" (UID: "7caa9316-1a19-402f-916b-e62f3dd2467f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:38:21.563549 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:21.563501 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7caa9316-1a19-402f-916b-e62f3dd2467f-service-ca" (OuterVolumeSpecName: "service-ca") pod "7caa9316-1a19-402f-916b-e62f3dd2467f" (UID: "7caa9316-1a19-402f-916b-e62f3dd2467f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:38:21.563721 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:21.563700 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7caa9316-1a19-402f-916b-e62f3dd2467f-console-config" (OuterVolumeSpecName: "console-config") pod "7caa9316-1a19-402f-916b-e62f3dd2467f" (UID: "7caa9316-1a19-402f-916b-e62f3dd2467f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:38:21.565110 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:21.565078 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7caa9316-1a19-402f-916b-e62f3dd2467f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7caa9316-1a19-402f-916b-e62f3dd2467f" (UID: "7caa9316-1a19-402f-916b-e62f3dd2467f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:38:21.565211 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:21.565123 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7caa9316-1a19-402f-916b-e62f3dd2467f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7caa9316-1a19-402f-916b-e62f3dd2467f" (UID: "7caa9316-1a19-402f-916b-e62f3dd2467f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:38:21.565211 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:21.565136 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7caa9316-1a19-402f-916b-e62f3dd2467f-kube-api-access-kk69n" (OuterVolumeSpecName: "kube-api-access-kk69n") pod "7caa9316-1a19-402f-916b-e62f3dd2467f" (UID: "7caa9316-1a19-402f-916b-e62f3dd2467f"). InnerVolumeSpecName "kube-api-access-kk69n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:38:21.664538 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:21.664496 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kk69n\" (UniqueName: \"kubernetes.io/projected/7caa9316-1a19-402f-916b-e62f3dd2467f-kube-api-access-kk69n\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:38:21.664538 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:21.664531 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7caa9316-1a19-402f-916b-e62f3dd2467f-console-oauth-config\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:38:21.664538 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:21.664543 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7caa9316-1a19-402f-916b-e62f3dd2467f-console-serving-cert\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:38:21.664789 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:21.664555 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7caa9316-1a19-402f-916b-e62f3dd2467f-service-ca\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:38:21.664789 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:21.664567 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7caa9316-1a19-402f-916b-e62f3dd2467f-console-config\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:38:21.664789 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:21.664578 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7caa9316-1a19-402f-916b-e62f3dd2467f-oauth-serving-cert\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:38:21.664789 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:21.664592 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7caa9316-1a19-402f-916b-e62f3dd2467f-trusted-ca-bundle\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:38:22.232258 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:22.232223 2578 generic.go:356] "Generic (PLEG): container finished" podID="7caa9316-1a19-402f-916b-e62f3dd2467f" containerID="378dcc4151a4f7cde3f59c51c0a356a913519a4a812388a86308550352c872b0" exitCode=0 Jul 16 17:38:22.232719 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:22.232263 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6756dd6b5-kb9cz" event={"ID":"7caa9316-1a19-402f-916b-e62f3dd2467f","Type":"ContainerDied","Data":"378dcc4151a4f7cde3f59c51c0a356a913519a4a812388a86308550352c872b0"} Jul 16 17:38:22.232719 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:22.232273 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6756dd6b5-kb9cz" Jul 16 17:38:22.232719 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:22.232312 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6756dd6b5-kb9cz" event={"ID":"7caa9316-1a19-402f-916b-e62f3dd2467f","Type":"ContainerDied","Data":"432e8abaaf663de8b37b578d009ef89afab455398fc62f674c7ab6f5ff5053f2"} Jul 16 17:38:22.232719 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:22.232338 2578 scope.go:117] "RemoveContainer" containerID="378dcc4151a4f7cde3f59c51c0a356a913519a4a812388a86308550352c872b0" Jul 16 17:38:22.241080 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:22.241059 2578 scope.go:117] "RemoveContainer" containerID="378dcc4151a4f7cde3f59c51c0a356a913519a4a812388a86308550352c872b0" Jul 16 17:38:22.241443 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:38:22.241405 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"378dcc4151a4f7cde3f59c51c0a356a913519a4a812388a86308550352c872b0\": container with ID starting with 378dcc4151a4f7cde3f59c51c0a356a913519a4a812388a86308550352c872b0 not found: ID does not exist" containerID="378dcc4151a4f7cde3f59c51c0a356a913519a4a812388a86308550352c872b0" Jul 16 17:38:22.241500 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:22.241453 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"378dcc4151a4f7cde3f59c51c0a356a913519a4a812388a86308550352c872b0"} err="failed to get container status \"378dcc4151a4f7cde3f59c51c0a356a913519a4a812388a86308550352c872b0\": rpc error: code = NotFound desc = could not find container \"378dcc4151a4f7cde3f59c51c0a356a913519a4a812388a86308550352c872b0\": container with ID starting with 378dcc4151a4f7cde3f59c51c0a356a913519a4a812388a86308550352c872b0 not found: ID does not exist" Jul 16 17:38:22.250873 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:22.250832 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6756dd6b5-kb9cz"] Jul 16 17:38:22.256075 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:22.256048 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6756dd6b5-kb9cz"] Jul 16 17:38:24.034371 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:24.034333 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7caa9316-1a19-402f-916b-e62f3dd2467f" path="/var/lib/kubelet/pods/7caa9316-1a19-402f-916b-e62f3dd2467f/volumes" Jul 16 17:38:33.006115 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:33.006081 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:38:49.859933 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:38:49.859904 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 16 17:39:40.794438 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:39:40.794388 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:39:40.852240 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:39:40.852205 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:39:40.954233 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:39:40.954199 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:39:41.049078 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:39:41.048972 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:39:41.152884 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:39:41.152853 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:39:58.111489 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:39:58.111377 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:39:59.268718 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:39:59.268685 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:40:08.281863 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:40:08.281824 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:40:08.394193 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:40:08.394150 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:40:14.774167 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:40:14.774123 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:40:15.118955 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:40:15.118920 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:40:15.236845 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:40:15.236814 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:40:15.733945 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:40:15.733901 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:40:16.010050 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:40:16.009937 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:40:16.109719 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:40:16.109677 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:40:16.217843 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:40:16.217807 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:40:16.307591 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:40:16.307499 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:40:16.516582 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:40:16.516543 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:40:16.985345 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:40:16.985301 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:40:17.081012 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:40:17.080972 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:40:17.187270 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:40:17.187233 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:40:44.954339 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:40:44.954304 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:41:28.184807 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:28.184769 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:41:28.293193 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:28.293160 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:41:28.402076 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:28.402038 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:41:28.507063 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:28.506985 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:41:29.084856 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:29.084824 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:41:29.187844 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:29.187799 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:41:29.270322 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:29.270291 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:41:34.454325 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.454288 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77c97c5565-j6d46"] Jul 16 17:41:34.454712 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.454646 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7caa9316-1a19-402f-916b-e62f3dd2467f" containerName="console" Jul 16 17:41:34.454712 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.454659 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7caa9316-1a19-402f-916b-e62f3dd2467f" containerName="console" Jul 16 17:41:34.454785 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.454716 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7caa9316-1a19-402f-916b-e62f3dd2467f" containerName="console" Jul 16 17:41:34.456751 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.456729 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c97c5565-j6d46" Jul 16 17:41:34.479734 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.479705 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77c97c5565-j6d46"] Jul 16 17:41:34.539587 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.539559 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:41:34.540669 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.540643 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd3e6245-b9b0-408f-8b03-37fa87fba3ad-console-oauth-config\") pod \"console-77c97c5565-j6d46\" (UID: \"fd3e6245-b9b0-408f-8b03-37fa87fba3ad\") " pod="openshift-console/console-77c97c5565-j6d46" Jul 16 17:41:34.540806 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.540679 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd3e6245-b9b0-408f-8b03-37fa87fba3ad-service-ca\") pod \"console-77c97c5565-j6d46\" (UID: \"fd3e6245-b9b0-408f-8b03-37fa87fba3ad\") " pod="openshift-console/console-77c97c5565-j6d46" Jul 16 17:41:34.540806 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.540706 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd3e6245-b9b0-408f-8b03-37fa87fba3ad-trusted-ca-bundle\") pod \"console-77c97c5565-j6d46\" (UID: \"fd3e6245-b9b0-408f-8b03-37fa87fba3ad\") " pod="openshift-console/console-77c97c5565-j6d46" Jul 16 17:41:34.540806 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.540771 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd3e6245-b9b0-408f-8b03-37fa87fba3ad-oauth-serving-cert\") pod \"console-77c97c5565-j6d46\" (UID: \"fd3e6245-b9b0-408f-8b03-37fa87fba3ad\") " pod="openshift-console/console-77c97c5565-j6d46" Jul 16 17:41:34.540961 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.540814 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd3e6245-b9b0-408f-8b03-37fa87fba3ad-console-config\") pod \"console-77c97c5565-j6d46\" (UID: \"fd3e6245-b9b0-408f-8b03-37fa87fba3ad\") " pod="openshift-console/console-77c97c5565-j6d46" Jul 16 17:41:34.540961 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.540833 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k66f\" (UniqueName: \"kubernetes.io/projected/fd3e6245-b9b0-408f-8b03-37fa87fba3ad-kube-api-access-9k66f\") pod \"console-77c97c5565-j6d46\" (UID: \"fd3e6245-b9b0-408f-8b03-37fa87fba3ad\") " pod="openshift-console/console-77c97c5565-j6d46" Jul 16 17:41:34.540961 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.540932 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd3e6245-b9b0-408f-8b03-37fa87fba3ad-console-serving-cert\") pod \"console-77c97c5565-j6d46\" (UID: \"fd3e6245-b9b0-408f-8b03-37fa87fba3ad\") " pod="openshift-console/console-77c97c5565-j6d46" Jul 16 17:41:34.641891 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.641853 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd3e6245-b9b0-408f-8b03-37fa87fba3ad-console-oauth-config\") pod \"console-77c97c5565-j6d46\" (UID: \"fd3e6245-b9b0-408f-8b03-37fa87fba3ad\") " pod="openshift-console/console-77c97c5565-j6d46" Jul 16 17:41:34.641891 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.641895 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd3e6245-b9b0-408f-8b03-37fa87fba3ad-service-ca\") pod \"console-77c97c5565-j6d46\" (UID: \"fd3e6245-b9b0-408f-8b03-37fa87fba3ad\") " pod="openshift-console/console-77c97c5565-j6d46" Jul 16 17:41:34.642140 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.641993 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd3e6245-b9b0-408f-8b03-37fa87fba3ad-trusted-ca-bundle\") pod \"console-77c97c5565-j6d46\" (UID: \"fd3e6245-b9b0-408f-8b03-37fa87fba3ad\") " pod="openshift-console/console-77c97c5565-j6d46" Jul 16 17:41:34.642140 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.642014 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd3e6245-b9b0-408f-8b03-37fa87fba3ad-oauth-serving-cert\") pod \"console-77c97c5565-j6d46\" (UID: \"fd3e6245-b9b0-408f-8b03-37fa87fba3ad\") " pod="openshift-console/console-77c97c5565-j6d46" Jul 16 17:41:34.642140 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.642036 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd3e6245-b9b0-408f-8b03-37fa87fba3ad-console-config\") pod \"console-77c97c5565-j6d46\" (UID: \"fd3e6245-b9b0-408f-8b03-37fa87fba3ad\") " pod="openshift-console/console-77c97c5565-j6d46" Jul 16 17:41:34.642140 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.642052 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k66f\" (UniqueName: \"kubernetes.io/projected/fd3e6245-b9b0-408f-8b03-37fa87fba3ad-kube-api-access-9k66f\") pod \"console-77c97c5565-j6d46\" (UID: \"fd3e6245-b9b0-408f-8b03-37fa87fba3ad\") " pod="openshift-console/console-77c97c5565-j6d46" Jul 16 17:41:34.642140 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.642094 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd3e6245-b9b0-408f-8b03-37fa87fba3ad-console-serving-cert\") pod \"console-77c97c5565-j6d46\" (UID: \"fd3e6245-b9b0-408f-8b03-37fa87fba3ad\") " pod="openshift-console/console-77c97c5565-j6d46" Jul 16 17:41:34.642805 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.642780 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd3e6245-b9b0-408f-8b03-37fa87fba3ad-oauth-serving-cert\") pod \"console-77c97c5565-j6d46\" (UID: \"fd3e6245-b9b0-408f-8b03-37fa87fba3ad\") " pod="openshift-console/console-77c97c5565-j6d46" Jul 16 17:41:34.642908 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.642890 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd3e6245-b9b0-408f-8b03-37fa87fba3ad-console-config\") pod \"console-77c97c5565-j6d46\" (UID: \"fd3e6245-b9b0-408f-8b03-37fa87fba3ad\") " pod="openshift-console/console-77c97c5565-j6d46" Jul 16 17:41:34.642977 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.642925 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd3e6245-b9b0-408f-8b03-37fa87fba3ad-service-ca\") pod \"console-77c97c5565-j6d46\" (UID: \"fd3e6245-b9b0-408f-8b03-37fa87fba3ad\") " pod="openshift-console/console-77c97c5565-j6d46" Jul 16 17:41:34.642977 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.642959 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd3e6245-b9b0-408f-8b03-37fa87fba3ad-trusted-ca-bundle\") pod \"console-77c97c5565-j6d46\" (UID: \"fd3e6245-b9b0-408f-8b03-37fa87fba3ad\") " pod="openshift-console/console-77c97c5565-j6d46" Jul 16 17:41:34.644506 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.644485 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd3e6245-b9b0-408f-8b03-37fa87fba3ad-console-serving-cert\") pod \"console-77c97c5565-j6d46\" (UID: \"fd3e6245-b9b0-408f-8b03-37fa87fba3ad\") " pod="openshift-console/console-77c97c5565-j6d46" Jul 16 17:41:34.644597 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.644558 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd3e6245-b9b0-408f-8b03-37fa87fba3ad-console-oauth-config\") pod \"console-77c97c5565-j6d46\" (UID: \"fd3e6245-b9b0-408f-8b03-37fa87fba3ad\") " pod="openshift-console/console-77c97c5565-j6d46" Jul 16 17:41:34.653986 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.653959 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k66f\" (UniqueName: \"kubernetes.io/projected/fd3e6245-b9b0-408f-8b03-37fa87fba3ad-kube-api-access-9k66f\") pod \"console-77c97c5565-j6d46\" (UID: \"fd3e6245-b9b0-408f-8b03-37fa87fba3ad\") " pod="openshift-console/console-77c97c5565-j6d46" Jul 16 17:41:34.765336 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.765233 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c97c5565-j6d46" Jul 16 17:41:34.905391 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:34.905302 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77c97c5565-j6d46"] Jul 16 17:41:34.907659 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:41:34.907632 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd3e6245_b9b0_408f_8b03_37fa87fba3ad.slice/crio-14f426fe77617cbd17cf6d8dc9b6060add327016640b452a1af4783373ac87df WatchSource:0}: Error finding container 14f426fe77617cbd17cf6d8dc9b6060add327016640b452a1af4783373ac87df: Status 404 returned error can't find the container with id 14f426fe77617cbd17cf6d8dc9b6060add327016640b452a1af4783373ac87df Jul 16 17:41:35.040621 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:35.040523 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c97c5565-j6d46" event={"ID":"fd3e6245-b9b0-408f-8b03-37fa87fba3ad","Type":"ContainerStarted","Data":"430a9018f43bf0a78f215c58c28ea8ee30b0ac162b6c91a467ad28baa8f653e4"} Jul 16 17:41:35.040621 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:35.040586 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c97c5565-j6d46" event={"ID":"fd3e6245-b9b0-408f-8b03-37fa87fba3ad","Type":"ContainerStarted","Data":"14f426fe77617cbd17cf6d8dc9b6060add327016640b452a1af4783373ac87df"} Jul 16 17:41:35.063600 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:35.063540 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77c97c5565-j6d46" podStartSLOduration=1.063518174 podStartE2EDuration="1.063518174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:41:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:41:35.061476817 +0000 UTC m=+465.590901103" watchObservedRunningTime="2026-07-16 17:41:35.063518174 +0000 UTC m=+465.592942437" Jul 16 17:41:35.128387 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:35.128354 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:41:44.136041 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:44.136007 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:41:44.765942 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:44.765900 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77c97c5565-j6d46" Jul 16 17:41:44.766113 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:44.765975 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77c97c5565-j6d46" Jul 16 17:41:44.770686 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:44.770662 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77c97c5565-j6d46" Jul 16 17:41:45.086956 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:45.086927 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77c97c5565-j6d46" Jul 16 17:41:45.148749 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:45.148713 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f588f5599-mz5rg"] Jul 16 17:41:45.733389 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:45.733354 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:41:45.788398 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:45.788368 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:41:52.996033 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:52.995998 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:41:55.147066 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:55.147033 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:41:55.200558 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:55.200525 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:41:55.521719 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:41:55.521641 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:42:10.169720 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:10.169662 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f588f5599-mz5rg" podUID="3683a221-a1ed-4c30-a778-a9b8ece62552" containerName="console" containerID="cri-o://5dd90d9508d89886ee48f633ea1874595212b5c9fbea7c59fde8ff345c233a54" gracePeriod=15 Jul 16 17:42:10.413927 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:10.413900 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:42:10.467710 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:10.467623 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtw72\" (UniqueName: \"kubernetes.io/projected/3683a221-a1ed-4c30-a778-a9b8ece62552-kube-api-access-xtw72\") pod \"3683a221-a1ed-4c30-a778-a9b8ece62552\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " Jul 16 17:42:10.467710 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:10.467682 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3683a221-a1ed-4c30-a778-a9b8ece62552-oauth-serving-cert\") pod \"3683a221-a1ed-4c30-a778-a9b8ece62552\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " Jul 16 17:42:10.467943 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:10.467742 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3683a221-a1ed-4c30-a778-a9b8ece62552-service-ca\") pod \"3683a221-a1ed-4c30-a778-a9b8ece62552\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " Jul 16 17:42:10.467943 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:10.467768 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3683a221-a1ed-4c30-a778-a9b8ece62552-console-serving-cert\") pod \"3683a221-a1ed-4c30-a778-a9b8ece62552\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " Jul 16 17:42:10.467943 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:10.467790 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3683a221-a1ed-4c30-a778-a9b8ece62552-console-config\") pod \"3683a221-a1ed-4c30-a778-a9b8ece62552\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " Jul 16 17:42:10.467943 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:10.467827 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3683a221-a1ed-4c30-a778-a9b8ece62552-console-oauth-config\") pod \"3683a221-a1ed-4c30-a778-a9b8ece62552\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " Jul 16 17:42:10.467943 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:10.467852 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3683a221-a1ed-4c30-a778-a9b8ece62552-trusted-ca-bundle\") pod \"3683a221-a1ed-4c30-a778-a9b8ece62552\" (UID: \"3683a221-a1ed-4c30-a778-a9b8ece62552\") " Jul 16 17:42:10.468220 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:10.468182 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3683a221-a1ed-4c30-a778-a9b8ece62552-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3683a221-a1ed-4c30-a778-a9b8ece62552" (UID: "3683a221-a1ed-4c30-a778-a9b8ece62552"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:42:10.468292 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:10.468191 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3683a221-a1ed-4c30-a778-a9b8ece62552-service-ca" (OuterVolumeSpecName: "service-ca") pod "3683a221-a1ed-4c30-a778-a9b8ece62552" (UID: "3683a221-a1ed-4c30-a778-a9b8ece62552"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:42:10.468292 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:10.468245 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3683a221-a1ed-4c30-a778-a9b8ece62552-console-config" (OuterVolumeSpecName: "console-config") pod "3683a221-a1ed-4c30-a778-a9b8ece62552" (UID: "3683a221-a1ed-4c30-a778-a9b8ece62552"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:42:10.468516 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:10.468495 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3683a221-a1ed-4c30-a778-a9b8ece62552-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3683a221-a1ed-4c30-a778-a9b8ece62552" (UID: "3683a221-a1ed-4c30-a778-a9b8ece62552"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:42:10.469941 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:10.469911 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3683a221-a1ed-4c30-a778-a9b8ece62552-kube-api-access-xtw72" (OuterVolumeSpecName: "kube-api-access-xtw72") pod "3683a221-a1ed-4c30-a778-a9b8ece62552" (UID: "3683a221-a1ed-4c30-a778-a9b8ece62552"). InnerVolumeSpecName "kube-api-access-xtw72". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:42:10.470041 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:10.469938 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3683a221-a1ed-4c30-a778-a9b8ece62552-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3683a221-a1ed-4c30-a778-a9b8ece62552" (UID: "3683a221-a1ed-4c30-a778-a9b8ece62552"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:42:10.470041 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:10.469973 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3683a221-a1ed-4c30-a778-a9b8ece62552-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3683a221-a1ed-4c30-a778-a9b8ece62552" (UID: "3683a221-a1ed-4c30-a778-a9b8ece62552"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:42:10.569020 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:10.568982 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3683a221-a1ed-4c30-a778-a9b8ece62552-service-ca\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:42:10.569020 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:10.569015 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3683a221-a1ed-4c30-a778-a9b8ece62552-console-serving-cert\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:42:10.569020 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:10.569028 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3683a221-a1ed-4c30-a778-a9b8ece62552-console-config\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:42:10.569302 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:10.569040 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3683a221-a1ed-4c30-a778-a9b8ece62552-console-oauth-config\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:42:10.569302 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:10.569051 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3683a221-a1ed-4c30-a778-a9b8ece62552-trusted-ca-bundle\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:42:10.569302 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:10.569062 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtw72\" (UniqueName: \"kubernetes.io/projected/3683a221-a1ed-4c30-a778-a9b8ece62552-kube-api-access-xtw72\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:42:10.569302 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:10.569074 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3683a221-a1ed-4c30-a778-a9b8ece62552-oauth-serving-cert\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:42:11.192877 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:11.192837 2578 generic.go:356] "Generic (PLEG): container finished" podID="3683a221-a1ed-4c30-a778-a9b8ece62552" containerID="5dd90d9508d89886ee48f633ea1874595212b5c9fbea7c59fde8ff345c233a54" exitCode=0 Jul 16 17:42:11.192877 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:11.192876 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f588f5599-mz5rg" Jul 16 17:42:11.193325 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:11.192904 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f588f5599-mz5rg" event={"ID":"3683a221-a1ed-4c30-a778-a9b8ece62552","Type":"ContainerDied","Data":"5dd90d9508d89886ee48f633ea1874595212b5c9fbea7c59fde8ff345c233a54"} Jul 16 17:42:11.193325 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:11.192953 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f588f5599-mz5rg" event={"ID":"3683a221-a1ed-4c30-a778-a9b8ece62552","Type":"ContainerDied","Data":"7a2d4084b41af4ac55ae483f3586592138802e9fc2a82c9102c8163d3531e030"} Jul 16 17:42:11.193325 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:11.192981 2578 scope.go:117] "RemoveContainer" containerID="5dd90d9508d89886ee48f633ea1874595212b5c9fbea7c59fde8ff345c233a54" Jul 16 17:42:11.202442 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:11.202404 2578 scope.go:117] "RemoveContainer" containerID="5dd90d9508d89886ee48f633ea1874595212b5c9fbea7c59fde8ff345c233a54" Jul 16 17:42:11.202762 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:42:11.202743 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dd90d9508d89886ee48f633ea1874595212b5c9fbea7c59fde8ff345c233a54\": container with ID starting with 5dd90d9508d89886ee48f633ea1874595212b5c9fbea7c59fde8ff345c233a54 not found: ID does not exist" containerID="5dd90d9508d89886ee48f633ea1874595212b5c9fbea7c59fde8ff345c233a54" Jul 16 17:42:11.202829 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:11.202774 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dd90d9508d89886ee48f633ea1874595212b5c9fbea7c59fde8ff345c233a54"} err="failed to get container status \"5dd90d9508d89886ee48f633ea1874595212b5c9fbea7c59fde8ff345c233a54\": rpc error: code = NotFound desc = could not find container \"5dd90d9508d89886ee48f633ea1874595212b5c9fbea7c59fde8ff345c233a54\": container with ID starting with 5dd90d9508d89886ee48f633ea1874595212b5c9fbea7c59fde8ff345c233a54 not found: ID does not exist" Jul 16 17:42:11.220254 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:11.220220 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f588f5599-mz5rg"] Jul 16 17:42:11.227657 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:11.227631 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f588f5599-mz5rg"] Jul 16 17:42:12.033436 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:12.033394 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3683a221-a1ed-4c30-a778-a9b8ece62552" path="/var/lib/kubelet/pods/3683a221-a1ed-4c30-a778-a9b8ece62552/volumes" Jul 16 17:42:45.874229 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:45.874147 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:42:45.944355 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:45.944324 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:42:46.007194 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:46.007165 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:42:46.766189 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:46.766158 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:42:46.867595 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:46.867567 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:42:46.932427 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:42:46.932383 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:43:03.851778 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:43:03.851746 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-4jxvm"] Jul 16 17:43:03.852229 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:43:03.852073 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3683a221-a1ed-4c30-a778-a9b8ece62552" containerName="console" Jul 16 17:43:03.852229 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:43:03.852083 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3683a221-a1ed-4c30-a778-a9b8ece62552" containerName="console" Jul 16 17:43:03.852229 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:43:03.852138 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3683a221-a1ed-4c30-a778-a9b8ece62552" containerName="console" Jul 16 17:43:03.856270 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:43:03.856255 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-4jxvm" Jul 16 17:43:03.859272 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:43:03.859234 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 16 17:43:03.859272 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:43:03.859240 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 16 17:43:03.859765 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:43:03.859738 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-x6bfr\"" Jul 16 17:43:03.860572 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:43:03.860546 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 16 17:43:03.868846 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:43:03.868824 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-4jxvm"] Jul 16 17:43:03.941377 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:43:03.941345 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45a02239-cb18-4cab-94f2-a32bf962713d-model-cache\") pod \"s3-init-4jxvm\" (UID: \"45a02239-cb18-4cab-94f2-a32bf962713d\") " pod="kserve/s3-init-4jxvm" Jul 16 17:43:03.941538 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:43:03.941404 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7jlf\" (UniqueName: \"kubernetes.io/projected/45a02239-cb18-4cab-94f2-a32bf962713d-kube-api-access-f7jlf\") pod \"s3-init-4jxvm\" (UID: \"45a02239-cb18-4cab-94f2-a32bf962713d\") " pod="kserve/s3-init-4jxvm" Jul 16 17:43:04.041965 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:43:04.041933 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45a02239-cb18-4cab-94f2-a32bf962713d-model-cache\") pod \"s3-init-4jxvm\" (UID: \"45a02239-cb18-4cab-94f2-a32bf962713d\") " pod="kserve/s3-init-4jxvm" Jul 16 17:43:04.042134 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:43:04.041981 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7jlf\" (UniqueName: \"kubernetes.io/projected/45a02239-cb18-4cab-94f2-a32bf962713d-kube-api-access-f7jlf\") pod \"s3-init-4jxvm\" (UID: \"45a02239-cb18-4cab-94f2-a32bf962713d\") " pod="kserve/s3-init-4jxvm" Jul 16 17:43:04.042303 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:43:04.042279 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45a02239-cb18-4cab-94f2-a32bf962713d-model-cache\") pod \"s3-init-4jxvm\" (UID: \"45a02239-cb18-4cab-94f2-a32bf962713d\") " pod="kserve/s3-init-4jxvm" Jul 16 17:43:04.051852 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:43:04.051828 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7jlf\" (UniqueName: \"kubernetes.io/projected/45a02239-cb18-4cab-94f2-a32bf962713d-kube-api-access-f7jlf\") pod \"s3-init-4jxvm\" (UID: \"45a02239-cb18-4cab-94f2-a32bf962713d\") " pod="kserve/s3-init-4jxvm" Jul 16 17:43:04.177731 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:43:04.177638 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-4jxvm" Jul 16 17:43:04.313812 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:43:04.313786 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-4jxvm"] Jul 16 17:43:04.316323 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:43:04.316292 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45a02239_cb18_4cab_94f2_a32bf962713d.slice/crio-751b1a2a643faf3dda52c932849e5bc225653def1c1de354e25018480583e7a1 WatchSource:0}: Error finding container 751b1a2a643faf3dda52c932849e5bc225653def1c1de354e25018480583e7a1: Status 404 returned error can't find the container with id 751b1a2a643faf3dda52c932849e5bc225653def1c1de354e25018480583e7a1 Jul 16 17:43:04.318338 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:43:04.318324 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 17:43:04.413803 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:43:04.413771 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-4jxvm" event={"ID":"45a02239-cb18-4cab-94f2-a32bf962713d","Type":"ContainerStarted","Data":"751b1a2a643faf3dda52c932849e5bc225653def1c1de354e25018480583e7a1"} Jul 16 17:43:10.444015 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:43:10.443977 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-4jxvm" event={"ID":"45a02239-cb18-4cab-94f2-a32bf962713d","Type":"ContainerStarted","Data":"e71df114efd329ec090da7fe5d027e57cf345f07915a53bae0ab1af0d86f5ce6"} Jul 16 17:43:11.449591 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:43:11.449540 2578 generic.go:356] "Generic (PLEG): container finished" podID="45a02239-cb18-4cab-94f2-a32bf962713d" containerID="e71df114efd329ec090da7fe5d027e57cf345f07915a53bae0ab1af0d86f5ce6" exitCode=0 Jul 16 17:43:11.449998 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:43:11.449585 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-4jxvm" event={"ID":"45a02239-cb18-4cab-94f2-a32bf962713d","Type":"ContainerDied","Data":"e71df114efd329ec090da7fe5d027e57cf345f07915a53bae0ab1af0d86f5ce6"} Jul 16 17:43:16.476432 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:43:16.476377 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-4jxvm" event={"ID":"45a02239-cb18-4cab-94f2-a32bf962713d","Type":"ContainerStarted","Data":"8cc7ec1583991083bbb2050908ae0c8ad8017299e1f4e5fedc8869b269ff521d"} Jul 16 17:43:16.508168 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:43:16.508099 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-4jxvm" podStartSLOduration=2.241681719 podStartE2EDuration="13.508074704s" totalImagesPullingTime="10.080720331s" totalInitContainerRuntime="1.185672654s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:43:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:43:16.497660809 +0000 UTC m=+567.027085070" watchObservedRunningTime="2026-07-16 17:43:16.508074704 +0000 UTC m=+567.037498968" Jul 16 17:44:21.756186 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:44:21.756151 2578 generic.go:356] "Generic (PLEG): container finished" podID="45a02239-cb18-4cab-94f2-a32bf962713d" containerID="8cc7ec1583991083bbb2050908ae0c8ad8017299e1f4e5fedc8869b269ff521d" exitCode=0 Jul 16 17:44:21.756619 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:44:21.756218 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-4jxvm" event={"ID":"45a02239-cb18-4cab-94f2-a32bf962713d","Type":"ContainerDied","Data":"8cc7ec1583991083bbb2050908ae0c8ad8017299e1f4e5fedc8869b269ff521d"} Jul 16 17:44:22.887953 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:44:22.887926 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-4jxvm" Jul 16 17:44:22.945659 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:44:22.945630 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7jlf\" (UniqueName: \"kubernetes.io/projected/45a02239-cb18-4cab-94f2-a32bf962713d-kube-api-access-f7jlf\") pod \"45a02239-cb18-4cab-94f2-a32bf962713d\" (UID: \"45a02239-cb18-4cab-94f2-a32bf962713d\") " Jul 16 17:44:22.945811 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:44:22.945665 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45a02239-cb18-4cab-94f2-a32bf962713d-model-cache\") pod \"45a02239-cb18-4cab-94f2-a32bf962713d\" (UID: \"45a02239-cb18-4cab-94f2-a32bf962713d\") " Jul 16 17:44:22.947903 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:44:22.947870 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45a02239-cb18-4cab-94f2-a32bf962713d-kube-api-access-f7jlf" (OuterVolumeSpecName: "kube-api-access-f7jlf") pod "45a02239-cb18-4cab-94f2-a32bf962713d" (UID: "45a02239-cb18-4cab-94f2-a32bf962713d"). InnerVolumeSpecName "kube-api-access-f7jlf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:44:22.964576 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:44:22.964548 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45a02239-cb18-4cab-94f2-a32bf962713d-model-cache" (OuterVolumeSpecName: "model-cache") pod "45a02239-cb18-4cab-94f2-a32bf962713d" (UID: "45a02239-cb18-4cab-94f2-a32bf962713d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 17:44:23.046615 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:44:23.046532 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7jlf\" (UniqueName: \"kubernetes.io/projected/45a02239-cb18-4cab-94f2-a32bf962713d-kube-api-access-f7jlf\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:44:23.046615 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:44:23.046563 2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45a02239-cb18-4cab-94f2-a32bf962713d-model-cache\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:44:23.765994 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:44:23.765968 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-4jxvm" Jul 16 17:44:23.766173 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:44:23.765964 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-4jxvm" event={"ID":"45a02239-cb18-4cab-94f2-a32bf962713d","Type":"ContainerDied","Data":"751b1a2a643faf3dda52c932849e5bc225653def1c1de354e25018480583e7a1"} Jul 16 17:44:23.766173 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:44:23.766076 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="751b1a2a643faf3dda52c932849e5bc225653def1c1de354e25018480583e7a1" Jul 16 17:44:24.179128 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:44:24.179075 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:44:24.264921 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:44:24.264886 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:44:35.841667 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:44:35.841627 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:44:36.012813 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:44:36.012779 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:44:52.357341 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:44:52.357303 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:45:50.339935 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:45:50.339856 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:31.065719 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:46:31.065689 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:31.160436 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:46:31.160384 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:31.222224 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:46:31.222180 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:31.876085 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:46:31.876040 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:11.191951 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:11.191919 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:11.533170 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:11.533071 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:21.235731 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:21.235693 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:21.423399 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:21.423367 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:21.483052 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:21.483019 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:21.642378 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:21.642337 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:21.724745 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:21.724710 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl"] Jul 16 17:48:21.725084 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:21.725070 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45a02239-cb18-4cab-94f2-a32bf962713d" containerName="s3-init" Jul 16 17:48:21.725127 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:21.725086 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="45a02239-cb18-4cab-94f2-a32bf962713d" containerName="s3-init" Jul 16 17:48:21.725127 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:21.725099 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45a02239-cb18-4cab-94f2-a32bf962713d" containerName="download-hf-model" Jul 16 17:48:21.725127 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:21.725105 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="45a02239-cb18-4cab-94f2-a32bf962713d" containerName="download-hf-model" Jul 16 17:48:21.725217 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:21.725175 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="45a02239-cb18-4cab-94f2-a32bf962713d" containerName="s3-init" Jul 16 17:48:21.728120 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:21.728104 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" Jul 16 17:48:21.732359 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:21.732335 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-raw-hpa-57df2-kube-rbac-proxy-sar-config\"" Jul 16 17:48:21.733764 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:21.733732 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 16 17:48:21.733928 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:21.733907 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Jul 16 17:48:21.734039 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:21.733755 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-ft4dd\"" Jul 16 17:48:21.734039 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:21.733754 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-raw-hpa-57df2-predictor-serving-cert\"" Jul 16 17:48:21.734039 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:21.733876 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 16 17:48:21.743279 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:21.743242 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Jul 16 17:48:21.750621 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:21.750597 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:21.753818 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:21.753797 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl"] Jul 16 17:48:21.838610 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:21.838580 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:21.900574 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:21.900473 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-cabundle-cert\") pod \"isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl\" (UID: \"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" Jul 16 17:48:21.900574 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:21.900561 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl\" (UID: \"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" Jul 16 17:48:21.900795 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:21.900602 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl\" (UID: \"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" Jul 16 17:48:21.900795 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:21.900629 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzlst\" (UniqueName: \"kubernetes.io/projected/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-kube-api-access-lzlst\") pod \"isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl\" (UID: \"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" Jul 16 17:48:21.900795 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:21.900680 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl\" (UID: \"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" Jul 16 17:48:22.001809 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:22.001769 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-cabundle-cert\") pod \"isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl\" (UID: \"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" Jul 16 17:48:22.001975 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:22.001832 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl\" (UID: \"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" Jul 16 17:48:22.001975 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:22.001862 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl\" (UID: \"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" Jul 16 17:48:22.001975 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:22.001887 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzlst\" (UniqueName: \"kubernetes.io/projected/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-kube-api-access-lzlst\") pod \"isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl\" (UID: \"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" Jul 16 17:48:22.001975 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:22.001941 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl\" (UID: \"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" Jul 16 17:48:22.002433 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:22.002388 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl\" (UID: \"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" Jul 16 17:48:22.002673 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:22.002647 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-cabundle-cert\") pod \"isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl\" (UID: \"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" Jul 16 17:48:22.002796 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:22.002737 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl\" (UID: \"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" Jul 16 17:48:22.004543 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:22.004521 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl\" (UID: \"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" Jul 16 17:48:22.011168 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:22.011146 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzlst\" (UniqueName: \"kubernetes.io/projected/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-kube-api-access-lzlst\") pod \"isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl\" (UID: \"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" Jul 16 17:48:22.041551 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:22.041522 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" Jul 16 17:48:22.207755 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:22.207730 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl"] Jul 16 17:48:22.209870 ip-10-0-130-5 kubenswrapper[2578]: W0716 17:48:22.209842 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fb5e365_caf4_4df8_ba1e_13d9a1adbd69.slice/crio-a5e8ab9eab51513acc23206b90931d69aa35315324e1575dd0eecadd6f2be591 WatchSource:0}: Error finding container a5e8ab9eab51513acc23206b90931d69aa35315324e1575dd0eecadd6f2be591: Status 404 returned error can't find the container with id a5e8ab9eab51513acc23206b90931d69aa35315324e1575dd0eecadd6f2be591 Jul 16 17:48:22.743130 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:22.743095 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" event={"ID":"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69","Type":"ContainerStarted","Data":"aaf5b3dbec950ec2ba35813fbc5fb96529b9bb0212d580fd149d8c7d222cd2c7"} Jul 16 17:48:22.743598 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:22.743164 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" event={"ID":"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69","Type":"ContainerStarted","Data":"a5e8ab9eab51513acc23206b90931d69aa35315324e1575dd0eecadd6f2be591"} Jul 16 17:48:26.765136 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:26.765098 2578 generic.go:356] "Generic (PLEG): container finished" podID="7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" containerID="aaf5b3dbec950ec2ba35813fbc5fb96529b9bb0212d580fd149d8c7d222cd2c7" exitCode=0 Jul 16 17:48:26.765581 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:26.765173 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" event={"ID":"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69","Type":"ContainerDied","Data":"aaf5b3dbec950ec2ba35813fbc5fb96529b9bb0212d580fd149d8c7d222cd2c7"} Jul 16 17:48:26.766547 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:26.766533 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 17:48:47.871943 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:47.871904 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" event={"ID":"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69","Type":"ContainerStarted","Data":"3b4bb687db01d0cb134b4060ebebec782dddd5990c698befbc0bcb644afc7b99"} Jul 16 17:48:50.889597 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:50.889555 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" event={"ID":"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69","Type":"ContainerStarted","Data":"ce0c2b491be2d6f14ba68bc1f8c324be7bafcf638c7798e0c1b396bd67c9b05b"} Jul 16 17:48:50.890010 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:50.889748 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" Jul 16 17:48:50.921914 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:50.921827 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" podStartSLOduration=2.2987758 podStartE2EDuration="29.9218037s" totalImagesPullingTime="23.718713234s" totalInitContainerRuntime="3.904314666s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:48:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:48:50.920842272 +0000 UTC m=+901.450266555" watchObservedRunningTime="2026-07-16 17:48:50.9218037 +0000 UTC m=+901.451227965" Jul 16 17:48:51.894722 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:51.894689 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" Jul 16 17:48:51.895809 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:51.895780 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" podUID="7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused" Jul 16 17:48:52.899530 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:52.899487 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" podUID="7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused" Jul 16 17:48:57.904126 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:57.904089 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" Jul 16 17:48:57.904816 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:48:57.904781 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" podUID="7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused" Jul 16 17:49:07.905171 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:49:07.905125 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" podUID="7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused" Jul 16 17:49:17.905254 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:49:17.905209 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" podUID="7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused" Jul 16 17:49:22.385165 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:49:22.385124 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:27.905575 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:49:27.905536 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" podUID="7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused" Jul 16 17:49:37.905752 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:49:37.905701 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" podUID="7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused" Jul 16 17:49:47.905046 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:49:47.905005 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" podUID="7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused" Jul 16 17:49:57.905439 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:49:57.905383 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" Jul 16 17:50:01.561618 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:01.561576 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:50:01.866905 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:01.866873 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:50:11.640787 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:11.640709 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:50:11.816566 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:11.816532 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:50:11.899312 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:11.899231 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:50:11.999659 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:11.999629 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl"] Jul 16 17:50:11.999879 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:11.999849 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" podUID="7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" containerName="kserve-container" containerID="cri-o://3b4bb687db01d0cb134b4060ebebec782dddd5990c698befbc0bcb644afc7b99" gracePeriod=30 Jul 16 17:50:11.999994 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:11.999883 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" podUID="7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" containerName="kube-rbac-proxy" containerID="cri-o://ce0c2b491be2d6f14ba68bc1f8c324be7bafcf638c7798e0c1b396bd67c9b05b" gracePeriod=30 Jul 16 17:50:12.040467 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:12.040408 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:50:12.248821 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:12.248733 2578 generic.go:356] "Generic (PLEG): container finished" podID="7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" containerID="ce0c2b491be2d6f14ba68bc1f8c324be7bafcf638c7798e0c1b396bd67c9b05b" exitCode=2 Jul 16 17:50:12.248821 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:12.248798 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" event={"ID":"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69","Type":"ContainerDied","Data":"ce0c2b491be2d6f14ba68bc1f8c324be7bafcf638c7798e0c1b396bd67c9b05b"} Jul 16 17:50:12.298850 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:12.298811 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:50:12.900752 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:12.900712 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" podUID="7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.30:8643/healthz\": dial tcp 10.134.0.30:8643: connect: connection refused" Jul 16 17:50:15.747852 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:15.747827 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" Jul 16 17:50:15.818265 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:15.818182 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-kube-rbac-proxy-sar-config\") pod \"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69\" (UID: \"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69\") " Jul 16 17:50:15.818265 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:15.818222 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-kserve-provision-location\") pod \"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69\" (UID: \"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69\") " Jul 16 17:50:15.818265 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:15.818243 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzlst\" (UniqueName: \"kubernetes.io/projected/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-kube-api-access-lzlst\") pod \"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69\" (UID: \"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69\") " Jul 16 17:50:15.818575 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:15.818269 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-proxy-tls\") pod \"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69\" (UID: \"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69\") " Jul 16 17:50:15.818575 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:15.818314 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-cabundle-cert\") pod \"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69\" (UID: \"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69\") " Jul 16 17:50:15.818702 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:15.818674 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" (UID: "7fb5e365-caf4-4df8-ba1e-13d9a1adbd69"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 17:50:15.818702 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:15.818693 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" (UID: "7fb5e365-caf4-4df8-ba1e-13d9a1adbd69"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:50:15.818855 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:15.818830 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" (UID: "7fb5e365-caf4-4df8-ba1e-13d9a1adbd69"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:50:15.820636 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:15.820615 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" (UID: "7fb5e365-caf4-4df8-ba1e-13d9a1adbd69"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:50:15.820707 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:15.820639 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-kube-api-access-lzlst" (OuterVolumeSpecName: "kube-api-access-lzlst") pod "7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" (UID: "7fb5e365-caf4-4df8-ba1e-13d9a1adbd69"). InnerVolumeSpecName "kube-api-access-lzlst". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:50:15.919543 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:15.919507 2578 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-kube-rbac-proxy-sar-config\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:50:15.919543 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:15.919534 2578 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-kserve-provision-location\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:50:15.919543 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:15.919545 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzlst\" (UniqueName: \"kubernetes.io/projected/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-kube-api-access-lzlst\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:50:15.919543 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:15.919555 2578 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-proxy-tls\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:50:15.919818 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:15.919564 2578 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69-cabundle-cert\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 17:50:16.268395 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:16.268362 2578 generic.go:356] "Generic (PLEG): container finished" podID="7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" containerID="3b4bb687db01d0cb134b4060ebebec782dddd5990c698befbc0bcb644afc7b99" exitCode=0 Jul 16 17:50:16.268579 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:16.268431 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" event={"ID":"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69","Type":"ContainerDied","Data":"3b4bb687db01d0cb134b4060ebebec782dddd5990c698befbc0bcb644afc7b99"} Jul 16 17:50:16.268579 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:16.268478 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" event={"ID":"7fb5e365-caf4-4df8-ba1e-13d9a1adbd69","Type":"ContainerDied","Data":"a5e8ab9eab51513acc23206b90931d69aa35315324e1575dd0eecadd6f2be591"} Jul 16 17:50:16.268579 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:16.268502 2578 scope.go:117] "RemoveContainer" containerID="ce0c2b491be2d6f14ba68bc1f8c324be7bafcf638c7798e0c1b396bd67c9b05b" Jul 16 17:50:16.268579 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:16.268434 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl" Jul 16 17:50:16.276779 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:16.276751 2578 scope.go:117] "RemoveContainer" containerID="3b4bb687db01d0cb134b4060ebebec782dddd5990c698befbc0bcb644afc7b99" Jul 16 17:50:16.284809 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:16.284786 2578 scope.go:117] "RemoveContainer" containerID="aaf5b3dbec950ec2ba35813fbc5fb96529b9bb0212d580fd149d8c7d222cd2c7" Jul 16 17:50:16.288195 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:16.288173 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl"] Jul 16 17:50:16.292923 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:16.292898 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-57df2-predictor-58f5fb86d5-nmszl"] Jul 16 17:50:16.294928 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:16.294912 2578 scope.go:117] "RemoveContainer" containerID="ce0c2b491be2d6f14ba68bc1f8c324be7bafcf638c7798e0c1b396bd67c9b05b" Jul 16 17:50:16.295200 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:50:16.295175 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce0c2b491be2d6f14ba68bc1f8c324be7bafcf638c7798e0c1b396bd67c9b05b\": container with ID starting with ce0c2b491be2d6f14ba68bc1f8c324be7bafcf638c7798e0c1b396bd67c9b05b not found: ID does not exist" containerID="ce0c2b491be2d6f14ba68bc1f8c324be7bafcf638c7798e0c1b396bd67c9b05b" Jul 16 17:50:16.295250 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:16.295214 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce0c2b491be2d6f14ba68bc1f8c324be7bafcf638c7798e0c1b396bd67c9b05b"} err="failed to get container status \"ce0c2b491be2d6f14ba68bc1f8c324be7bafcf638c7798e0c1b396bd67c9b05b\": rpc error: code = NotFound desc = could not find container \"ce0c2b491be2d6f14ba68bc1f8c324be7bafcf638c7798e0c1b396bd67c9b05b\": container with ID starting with ce0c2b491be2d6f14ba68bc1f8c324be7bafcf638c7798e0c1b396bd67c9b05b not found: ID does not exist" Jul 16 17:50:16.295250 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:16.295238 2578 scope.go:117] "RemoveContainer" containerID="3b4bb687db01d0cb134b4060ebebec782dddd5990c698befbc0bcb644afc7b99" Jul 16 17:50:16.295533 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:50:16.295516 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b4bb687db01d0cb134b4060ebebec782dddd5990c698befbc0bcb644afc7b99\": container with ID starting with 3b4bb687db01d0cb134b4060ebebec782dddd5990c698befbc0bcb644afc7b99 not found: ID does not exist" containerID="3b4bb687db01d0cb134b4060ebebec782dddd5990c698befbc0bcb644afc7b99" Jul 16 17:50:16.295602 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:16.295538 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b4bb687db01d0cb134b4060ebebec782dddd5990c698befbc0bcb644afc7b99"} err="failed to get container status \"3b4bb687db01d0cb134b4060ebebec782dddd5990c698befbc0bcb644afc7b99\": rpc error: code = NotFound desc = could not find container \"3b4bb687db01d0cb134b4060ebebec782dddd5990c698befbc0bcb644afc7b99\": container with ID starting with 3b4bb687db01d0cb134b4060ebebec782dddd5990c698befbc0bcb644afc7b99 not found: ID does not exist" Jul 16 17:50:16.295602 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:16.295555 2578 scope.go:117] "RemoveContainer" containerID="aaf5b3dbec950ec2ba35813fbc5fb96529b9bb0212d580fd149d8c7d222cd2c7" Jul 16 17:50:16.295821 ip-10-0-130-5 kubenswrapper[2578]: E0716 17:50:16.295803 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aaf5b3dbec950ec2ba35813fbc5fb96529b9bb0212d580fd149d8c7d222cd2c7\": container with ID starting with aaf5b3dbec950ec2ba35813fbc5fb96529b9bb0212d580fd149d8c7d222cd2c7 not found: ID does not exist" containerID="aaf5b3dbec950ec2ba35813fbc5fb96529b9bb0212d580fd149d8c7d222cd2c7" Jul 16 17:50:16.295871 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:16.295828 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaf5b3dbec950ec2ba35813fbc5fb96529b9bb0212d580fd149d8c7d222cd2c7"} err="failed to get container status \"aaf5b3dbec950ec2ba35813fbc5fb96529b9bb0212d580fd149d8c7d222cd2c7\": rpc error: code = NotFound desc = could not find container \"aaf5b3dbec950ec2ba35813fbc5fb96529b9bb0212d580fd149d8c7d222cd2c7\": container with ID starting with aaf5b3dbec950ec2ba35813fbc5fb96529b9bb0212d580fd149d8c7d222cd2c7 not found: ID does not exist" Jul 16 17:50:18.039550 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:18.039513 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" path="/var/lib/kubelet/pods/7fb5e365-caf4-4df8-ba1e-13d9a1adbd69/volumes" Jul 16 17:50:22.265158 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:22.265123 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:50:22.343781 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:22.343738 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:50:31.883038 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:31.882993 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:50:31.983214 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:50:31.983175 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:07.235978 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:52:07.235942 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:08.686362 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:52:08.686330 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:54:57.495318 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:54:57.495229 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:55:02.653267 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:55:02.653230 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:55:02.817309 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:55:02.817274 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:55:04.619759 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:55:04.619684 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:56:32.978211 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:56:32.978159 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:56:33.262741 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:56:33.262649 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:56:51.034319 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:56:51.034279 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:56:51.106074 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:56:51.106035 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:56:56.198562 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:56:56.198528 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:56:56.520722 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:56:56.520623 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:57:06.312626 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:57:06.312592 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:57:11.446518 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:57:11.446475 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:57:13.052262 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:57:13.052226 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:58:03.334199 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:58:03.334108 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:58:41.642223 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:58:41.642187 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:58:46.738631 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:58:46.738593 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 17:58:47.399613 ip-10-0-130-5 kubenswrapper[2578]: I0716 17:58:47.399577 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 18:00:17.721323 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:17.721289 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 18:00:23.621033 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:23.620995 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7ztkk/must-gather-dmvwn"] Jul 16 18:00:23.621441 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:23.621316 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" containerName="storage-initializer" Jul 16 18:00:23.621441 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:23.621327 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" containerName="storage-initializer" Jul 16 18:00:23.621441 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:23.621335 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" containerName="kserve-container" Jul 16 18:00:23.621441 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:23.621341 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" containerName="kserve-container" Jul 16 18:00:23.621441 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:23.621362 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" containerName="kube-rbac-proxy" Jul 16 18:00:23.621441 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:23.621368 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" containerName="kube-rbac-proxy" Jul 16 18:00:23.621441 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:23.621439 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" containerName="kube-rbac-proxy" Jul 16 18:00:23.621662 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:23.621448 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fb5e365-caf4-4df8-ba1e-13d9a1adbd69" containerName="kserve-container" Jul 16 18:00:23.624323 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:23.624301 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7ztkk/must-gather-dmvwn" Jul 16 18:00:23.627282 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:23.627262 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7ztkk\"/\"openshift-service-ca.crt\"" Jul 16 18:00:23.628616 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:23.628594 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7ztkk\"/\"default-dockercfg-gdprx\"" Jul 16 18:00:23.628722 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:23.628597 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7ztkk\"/\"kube-root-ca.crt\"" Jul 16 18:00:23.636840 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:23.636816 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7ztkk/must-gather-dmvwn"] Jul 16 18:00:23.728712 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:23.728676 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prclw\" (UniqueName: \"kubernetes.io/projected/6348e397-e4a0-4cb0-9539-1072f5a37cbd-kube-api-access-prclw\") pod \"must-gather-dmvwn\" (UID: \"6348e397-e4a0-4cb0-9539-1072f5a37cbd\") " pod="openshift-must-gather-7ztkk/must-gather-dmvwn" Jul 16 18:00:23.728917 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:23.728723 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6348e397-e4a0-4cb0-9539-1072f5a37cbd-must-gather-output\") pod \"must-gather-dmvwn\" (UID: \"6348e397-e4a0-4cb0-9539-1072f5a37cbd\") " pod="openshift-must-gather-7ztkk/must-gather-dmvwn" Jul 16 18:00:23.730577 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:23.730543 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 18:00:23.788877 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:23.788847 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 18:00:23.829794 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:23.829761 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prclw\" (UniqueName: \"kubernetes.io/projected/6348e397-e4a0-4cb0-9539-1072f5a37cbd-kube-api-access-prclw\") pod \"must-gather-dmvwn\" (UID: \"6348e397-e4a0-4cb0-9539-1072f5a37cbd\") " pod="openshift-must-gather-7ztkk/must-gather-dmvwn" Jul 16 18:00:23.829992 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:23.829803 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6348e397-e4a0-4cb0-9539-1072f5a37cbd-must-gather-output\") pod \"must-gather-dmvwn\" (UID: \"6348e397-e4a0-4cb0-9539-1072f5a37cbd\") " pod="openshift-must-gather-7ztkk/must-gather-dmvwn" Jul 16 18:00:23.830177 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:23.830159 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6348e397-e4a0-4cb0-9539-1072f5a37cbd-must-gather-output\") pod \"must-gather-dmvwn\" (UID: \"6348e397-e4a0-4cb0-9539-1072f5a37cbd\") " pod="openshift-must-gather-7ztkk/must-gather-dmvwn" Jul 16 18:00:23.839806 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:23.839763 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prclw\" (UniqueName: \"kubernetes.io/projected/6348e397-e4a0-4cb0-9539-1072f5a37cbd-kube-api-access-prclw\") pod \"must-gather-dmvwn\" (UID: \"6348e397-e4a0-4cb0-9539-1072f5a37cbd\") " pod="openshift-must-gather-7ztkk/must-gather-dmvwn" Jul 16 18:00:23.953862 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:23.953776 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7ztkk/must-gather-dmvwn" Jul 16 18:00:24.087543 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:24.087513 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7ztkk/must-gather-dmvwn"] Jul 16 18:00:24.090192 ip-10-0-130-5 kubenswrapper[2578]: W0716 18:00:24.090166 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6348e397_e4a0_4cb0_9539_1072f5a37cbd.slice/crio-964e627196ff66b4b1f364c99ec09e001ff663df3b143ce9469cf2a7731f0741 WatchSource:0}: Error finding container 964e627196ff66b4b1f364c99ec09e001ff663df3b143ce9469cf2a7731f0741: Status 404 returned error can't find the container with id 964e627196ff66b4b1f364c99ec09e001ff663df3b143ce9469cf2a7731f0741 Jul 16 18:00:24.091955 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:24.091936 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 18:00:24.803115 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:24.803078 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7ztkk/must-gather-dmvwn" event={"ID":"6348e397-e4a0-4cb0-9539-1072f5a37cbd","Type":"ContainerStarted","Data":"964e627196ff66b4b1f364c99ec09e001ff663df3b143ce9469cf2a7731f0741"} Jul 16 18:00:31.838951 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:31.838915 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7ztkk/must-gather-dmvwn" event={"ID":"6348e397-e4a0-4cb0-9539-1072f5a37cbd","Type":"ContainerStarted","Data":"f0073628c27ee1c9ff93af998877def8001f88b40352317248bb9ffdb1179846"} Jul 16 18:00:31.839355 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:31.838960 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7ztkk/must-gather-dmvwn" event={"ID":"6348e397-e4a0-4cb0-9539-1072f5a37cbd","Type":"ContainerStarted","Data":"f89052d94163e5345bd39493f995dfbe84ca6a2e145ad0d6e736f268979521f9"} Jul 16 18:00:31.856232 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:31.856169 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7ztkk/must-gather-dmvwn" podStartSLOduration=2.093672564 podStartE2EDuration="8.856148876s" totalImagesPullingTime="6.762476312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:00:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:00:31.855410699 +0000 UTC m=+1602.384834960" watchObservedRunningTime="2026-07-16 18:00:31.856148876 +0000 UTC m=+1602.385573139" Jul 16 18:00:52.944614 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:52.944575 2578 generic.go:356] "Generic (PLEG): container finished" podID="6348e397-e4a0-4cb0-9539-1072f5a37cbd" containerID="f89052d94163e5345bd39493f995dfbe84ca6a2e145ad0d6e736f268979521f9" exitCode=0 Jul 16 18:00:52.945132 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:52.944629 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7ztkk/must-gather-dmvwn" event={"ID":"6348e397-e4a0-4cb0-9539-1072f5a37cbd","Type":"ContainerDied","Data":"f89052d94163e5345bd39493f995dfbe84ca6a2e145ad0d6e736f268979521f9"} Jul 16 18:00:52.945132 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:52.945001 2578 scope.go:117] "RemoveContainer" containerID="f89052d94163e5345bd39493f995dfbe84ca6a2e145ad0d6e736f268979521f9" Jul 16 18:00:53.308224 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:53.308140 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-7ztkk_must-gather-dmvwn_6348e397-e4a0-4cb0-9539-1072f5a37cbd/gather/0.log" Jul 16 18:00:53.785432 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:53.785381 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 18:00:53.980473 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:53.980398 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 18:00:54.150355 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:54.150323 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 18:00:56.813507 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:56.813482 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lrj7t_fd1b005f-47c0-4006-abf5-b17419b94b2a/global-pull-secret-syncer/0.log" Jul 16 18:00:56.995139 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:56.995113 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" Jul 16 18:00:57.080654 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:57.080627 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-5.ec2.internal_d4c16c32a3c36fc19378959a9303c7f1/haproxy/0.log" Jul 16 18:00:58.765155 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:58.765096 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-7ztkk/must-gather-dmvwn"] Jul 16 18:00:58.765913 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:58.765447 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-7ztkk/must-gather-dmvwn" podUID="6348e397-e4a0-4cb0-9539-1072f5a37cbd" containerName="copy" containerID="cri-o://f0073628c27ee1c9ff93af998877def8001f88b40352317248bb9ffdb1179846" gracePeriod=2 Jul 16 18:00:58.767808 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:58.767763 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-7ztkk/must-gather-dmvwn"] Jul 16 18:00:58.768033 ip-10-0-130-5 kubenswrapper[2578]: E0716 18:00:58.767982 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-dmvwn\" is forbidden: User \"system:node:ip-10-0-130-5.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-7ztkk\": no relationship found between node 'ip-10-0-130-5.ec2.internal' and this object" podUID="6348e397-e4a0-4cb0-9539-1072f5a37cbd" pod="openshift-must-gather-7ztkk/must-gather-dmvwn" Jul 16 18:00:58.973210 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:58.973184 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-7ztkk_must-gather-dmvwn_6348e397-e4a0-4cb0-9539-1072f5a37cbd/copy/0.log" Jul 16 18:00:58.973580 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:58.973559 2578 generic.go:356] "Generic (PLEG): container finished" podID="6348e397-e4a0-4cb0-9539-1072f5a37cbd" containerID="f0073628c27ee1c9ff93af998877def8001f88b40352317248bb9ffdb1179846" exitCode=143 Jul 16 18:00:59.002699 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:59.002678 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-7ztkk_must-gather-dmvwn_6348e397-e4a0-4cb0-9539-1072f5a37cbd/copy/0.log" Jul 16 18:00:59.004296 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:59.004280 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7ztkk/must-gather-dmvwn" Jul 16 18:00:59.006907 ip-10-0-130-5 kubenswrapper[2578]: E0716 18:00:59.006886 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-dmvwn\" is forbidden: User \"system:node:ip-10-0-130-5.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-7ztkk\": no relationship found between node 'ip-10-0-130-5.ec2.internal' and this object" podUID="6348e397-e4a0-4cb0-9539-1072f5a37cbd" pod="openshift-must-gather-7ztkk/must-gather-dmvwn" Jul 16 18:00:59.144860 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:59.144826 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prclw\" (UniqueName: \"kubernetes.io/projected/6348e397-e4a0-4cb0-9539-1072f5a37cbd-kube-api-access-prclw\") pod \"6348e397-e4a0-4cb0-9539-1072f5a37cbd\" (UID: \"6348e397-e4a0-4cb0-9539-1072f5a37cbd\") " Jul 16 18:00:59.145052 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:59.144916 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6348e397-e4a0-4cb0-9539-1072f5a37cbd-must-gather-output\") pod \"6348e397-e4a0-4cb0-9539-1072f5a37cbd\" (UID: \"6348e397-e4a0-4cb0-9539-1072f5a37cbd\") " Jul 16 18:00:59.146309 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:59.146280 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6348e397-e4a0-4cb0-9539-1072f5a37cbd-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "6348e397-e4a0-4cb0-9539-1072f5a37cbd" (UID: "6348e397-e4a0-4cb0-9539-1072f5a37cbd"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:00:59.147062 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:59.147032 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6348e397-e4a0-4cb0-9539-1072f5a37cbd-kube-api-access-prclw" (OuterVolumeSpecName: "kube-api-access-prclw") pod "6348e397-e4a0-4cb0-9539-1072f5a37cbd" (UID: "6348e397-e4a0-4cb0-9539-1072f5a37cbd"). InnerVolumeSpecName "kube-api-access-prclw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:00:59.245563 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:59.245531 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prclw\" (UniqueName: \"kubernetes.io/projected/6348e397-e4a0-4cb0-9539-1072f5a37cbd-kube-api-access-prclw\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 18:00:59.245563 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:59.245559 2578 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6348e397-e4a0-4cb0-9539-1072f5a37cbd-must-gather-output\") on node \"ip-10-0-130-5.ec2.internal\" DevicePath \"\"" Jul 16 18:00:59.979268 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:59.979239 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-7ztkk_must-gather-dmvwn_6348e397-e4a0-4cb0-9539-1072f5a37cbd/copy/0.log" Jul 16 18:00:59.979737 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:59.979708 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7ztkk/must-gather-dmvwn" Jul 16 18:00:59.979865 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:59.979746 2578 scope.go:117] "RemoveContainer" containerID="f0073628c27ee1c9ff93af998877def8001f88b40352317248bb9ffdb1179846" Jul 16 18:00:59.982328 ip-10-0-130-5 kubenswrapper[2578]: E0716 18:00:59.982295 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-dmvwn\" is forbidden: User \"system:node:ip-10-0-130-5.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-7ztkk\": no relationship found between node 'ip-10-0-130-5.ec2.internal' and this object" podUID="6348e397-e4a0-4cb0-9539-1072f5a37cbd" pod="openshift-must-gather-7ztkk/must-gather-dmvwn" Jul 16 18:00:59.987386 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:00:59.987367 2578 scope.go:117] "RemoveContainer" containerID="f89052d94163e5345bd39493f995dfbe84ca6a2e145ad0d6e736f268979521f9" Jul 16 18:00:59.989929 ip-10-0-130-5 kubenswrapper[2578]: E0716 18:00:59.989904 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-dmvwn\" is forbidden: User \"system:node:ip-10-0-130-5.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-7ztkk\": no relationship found between node 'ip-10-0-130-5.ec2.internal' and this object" podUID="6348e397-e4a0-4cb0-9539-1072f5a37cbd" pod="openshift-must-gather-7ztkk/must-gather-dmvwn" Jul 16 18:01:00.032539 ip-10-0-130-5 kubenswrapper[2578]: E0716 18:01:00.032507 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-dmvwn\" is forbidden: User \"system:node:ip-10-0-130-5.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-7ztkk\": no relationship found between node 'ip-10-0-130-5.ec2.internal' and this object" podUID="6348e397-e4a0-4cb0-9539-1072f5a37cbd" pod="openshift-must-gather-7ztkk/must-gather-dmvwn" Jul 16 18:01:00.032906 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:00.032887 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6348e397-e4a0-4cb0-9539-1072f5a37cbd" path="/var/lib/kubelet/pods/6348e397-e4a0-4cb0-9539-1072f5a37cbd/volumes" Jul 16 18:01:00.071108 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:00.071079 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 18:01:00.172348 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:00.172315 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7prpm_17a0dfb8-ff8f-4f01-bde7-e1b177543374/konnectivity-agent/0.log" limit=1024 Jul 16 18:01:00.761896 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:00.761865 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8c89eb88-a868-4c78-989b-f236dfc33922/alertmanager/0.log" Jul 16 18:01:00.804219 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:00.804189 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8c89eb88-a868-4c78-989b-f236dfc33922/config-reloader/0.log" Jul 16 18:01:00.842445 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:00.842406 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8c89eb88-a868-4c78-989b-f236dfc33922/kube-rbac-proxy-web/0.log" Jul 16 18:01:00.891888 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:00.891866 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8c89eb88-a868-4c78-989b-f236dfc33922/kube-rbac-proxy/0.log" Jul 16 18:01:00.925046 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:00.925023 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8c89eb88-a868-4c78-989b-f236dfc33922/kube-rbac-proxy-metric/0.log" Jul 16 18:01:00.959484 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:00.959468 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8c89eb88-a868-4c78-989b-f236dfc33922/prom-label-proxy/0.log" Jul 16 18:01:01.000790 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:01.000769 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8c89eb88-a868-4c78-989b-f236dfc33922/init-config-reloader/0.log" Jul 16 18:01:01.157809 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:01.157783 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-rh4t9_19ab8765-01f4-497b-a2f6-a0e52caa80f3/kube-state-metrics/0.log" Jul 16 18:01:01.191257 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:01.191234 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-rh4t9_19ab8765-01f4-497b-a2f6-a0e52caa80f3/kube-rbac-proxy-main/0.log" Jul 16 18:01:01.221903 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:01.221881 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-rh4t9_19ab8765-01f4-497b-a2f6-a0e52caa80f3/kube-rbac-proxy-self/0.log" Jul 16 18:01:01.259742 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:01.259718 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6647cd9cdd-jdwkz_c18e4333-f670-43b5-ad06-b442ceb5282d/metrics-server/0.log" Jul 16 18:01:01.302056 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:01.302033 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-mnndm_52880a88-4a00-417a-bf93-8593cfaca919/monitoring-plugin/0.log" Jul 16 18:01:01.522134 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:01.522064 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t5wwk_5c88624a-20a0-449d-8807-0fe0c54fc007/node-exporter/0.log" Jul 16 18:01:01.546708 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:01.546691 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t5wwk_5c88624a-20a0-449d-8807-0fe0c54fc007/kube-rbac-proxy/0.log" Jul 16 18:01:01.571351 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:01.571331 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t5wwk_5c88624a-20a0-449d-8807-0fe0c54fc007/init-textfile/0.log" Jul 16 18:01:01.600691 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:01.600669 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-vsc4m_445883f9-9f53-454e-aa26-079e8374df9e/kube-rbac-proxy-main/0.log" Jul 16 18:01:01.623973 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:01.623946 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-vsc4m_445883f9-9f53-454e-aa26-079e8374df9e/kube-rbac-proxy-self/0.log" Jul 16 18:01:01.649325 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:01.649290 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-vsc4m_445883f9-9f53-454e-aa26-079e8374df9e/openshift-state-metrics/0.log" Jul 16 18:01:01.701761 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:01.701720 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_010a7ebf-2cdd-432f-9627-3a8c06a1a725/prometheus/0.log" Jul 16 18:01:01.726201 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:01.726177 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_010a7ebf-2cdd-432f-9627-3a8c06a1a725/config-reloader/0.log" Jul 16 18:01:01.755243 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:01.755213 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_010a7ebf-2cdd-432f-9627-3a8c06a1a725/thanos-sidecar/0.log" Jul 16 18:01:01.782371 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:01.782310 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_010a7ebf-2cdd-432f-9627-3a8c06a1a725/kube-rbac-proxy-web/0.log" Jul 16 18:01:01.808858 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:01.808840 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_010a7ebf-2cdd-432f-9627-3a8c06a1a725/kube-rbac-proxy/0.log" Jul 16 18:01:01.834113 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:01.834089 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_010a7ebf-2cdd-432f-9627-3a8c06a1a725/kube-rbac-proxy-thanos/0.log" Jul 16 18:01:01.862098 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:01.862077 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_010a7ebf-2cdd-432f-9627-3a8c06a1a725/init-config-reloader/0.log" Jul 16 18:01:01.943880 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:01.943837 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-546mt_745de2af-ab69-4819-bcc4-9857e8566442/prometheus-operator-admission-webhook/0.log" Jul 16 18:01:03.470980 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:03.470952 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-rj7vd_8dd12cb4-6e1a-4100-a38b-34968b67a86d/networking-console-plugin/0.log" Jul 16 18:01:04.441175 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:04.441146 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-77c97c5565-j6d46_fd3e6245-b9b0-408f-8b03-37fa87fba3ad/console/0.log" Jul 16 18:01:04.985094 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:04.985063 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-tnqr8_f1beb1db-48e4-4b9f-a6b1-7c7f89761ba7/volume-data-source-validator/0.log" Jul 16 18:01:05.449259 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.449230 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-trlt4/perf-node-gather-daemonset-vlh5l"] Jul 16 18:01:05.449578 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.449565 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6348e397-e4a0-4cb0-9539-1072f5a37cbd" containerName="gather" Jul 16 18:01:05.449632 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.449579 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6348e397-e4a0-4cb0-9539-1072f5a37cbd" containerName="gather" Jul 16 18:01:05.449632 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.449602 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6348e397-e4a0-4cb0-9539-1072f5a37cbd" containerName="copy" Jul 16 18:01:05.449632 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.449607 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6348e397-e4a0-4cb0-9539-1072f5a37cbd" containerName="copy" Jul 16 18:01:05.449721 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.449662 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6348e397-e4a0-4cb0-9539-1072f5a37cbd" containerName="copy" Jul 16 18:01:05.449721 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.449671 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6348e397-e4a0-4cb0-9539-1072f5a37cbd" containerName="gather" Jul 16 18:01:05.453633 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.453610 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-trlt4/perf-node-gather-daemonset-vlh5l" Jul 16 18:01:05.456224 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.456202 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-trlt4\"/\"openshift-service-ca.crt\"" Jul 16 18:01:05.456364 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.456346 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-trlt4\"/\"kube-root-ca.crt\"" Jul 16 18:01:05.457474 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.457455 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-trlt4\"/\"default-dockercfg-qc85p\"" Jul 16 18:01:05.462662 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.462640 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-trlt4/perf-node-gather-daemonset-vlh5l"] Jul 16 18:01:05.489823 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.489803 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/61301842-3f72-4e6d-9900-105dd0a16c85-podres\") pod \"perf-node-gather-daemonset-vlh5l\" (UID: \"61301842-3f72-4e6d-9900-105dd0a16c85\") " pod="openshift-must-gather-trlt4/perf-node-gather-daemonset-vlh5l" Jul 16 18:01:05.490057 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.489848 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61301842-3f72-4e6d-9900-105dd0a16c85-lib-modules\") pod \"perf-node-gather-daemonset-vlh5l\" (UID: \"61301842-3f72-4e6d-9900-105dd0a16c85\") " pod="openshift-must-gather-trlt4/perf-node-gather-daemonset-vlh5l" Jul 16 18:01:05.490057 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.489877 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61301842-3f72-4e6d-9900-105dd0a16c85-sys\") pod \"perf-node-gather-daemonset-vlh5l\" (UID: \"61301842-3f72-4e6d-9900-105dd0a16c85\") " pod="openshift-must-gather-trlt4/perf-node-gather-daemonset-vlh5l" Jul 16 18:01:05.490057 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.489919 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9fvz\" (UniqueName: \"kubernetes.io/projected/61301842-3f72-4e6d-9900-105dd0a16c85-kube-api-access-x9fvz\") pod \"perf-node-gather-daemonset-vlh5l\" (UID: \"61301842-3f72-4e6d-9900-105dd0a16c85\") " pod="openshift-must-gather-trlt4/perf-node-gather-daemonset-vlh5l" Jul 16 18:01:05.490057 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.489953 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/61301842-3f72-4e6d-9900-105dd0a16c85-proc\") pod \"perf-node-gather-daemonset-vlh5l\" (UID: \"61301842-3f72-4e6d-9900-105dd0a16c85\") " pod="openshift-must-gather-trlt4/perf-node-gather-daemonset-vlh5l" Jul 16 18:01:05.591155 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.591111 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61301842-3f72-4e6d-9900-105dd0a16c85-lib-modules\") pod \"perf-node-gather-daemonset-vlh5l\" (UID: \"61301842-3f72-4e6d-9900-105dd0a16c85\") " pod="openshift-must-gather-trlt4/perf-node-gather-daemonset-vlh5l" Jul 16 18:01:05.591155 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.591167 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61301842-3f72-4e6d-9900-105dd0a16c85-sys\") pod \"perf-node-gather-daemonset-vlh5l\" (UID: \"61301842-3f72-4e6d-9900-105dd0a16c85\") " pod="openshift-must-gather-trlt4/perf-node-gather-daemonset-vlh5l" Jul 16 18:01:05.591342 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.591292 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61301842-3f72-4e6d-9900-105dd0a16c85-sys\") pod \"perf-node-gather-daemonset-vlh5l\" (UID: \"61301842-3f72-4e6d-9900-105dd0a16c85\") " pod="openshift-must-gather-trlt4/perf-node-gather-daemonset-vlh5l" Jul 16 18:01:05.591342 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.591313 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9fvz\" (UniqueName: \"kubernetes.io/projected/61301842-3f72-4e6d-9900-105dd0a16c85-kube-api-access-x9fvz\") pod \"perf-node-gather-daemonset-vlh5l\" (UID: \"61301842-3f72-4e6d-9900-105dd0a16c85\") " pod="openshift-must-gather-trlt4/perf-node-gather-daemonset-vlh5l" Jul 16 18:01:05.591442 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.591363 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/61301842-3f72-4e6d-9900-105dd0a16c85-proc\") pod \"perf-node-gather-daemonset-vlh5l\" (UID: \"61301842-3f72-4e6d-9900-105dd0a16c85\") " pod="openshift-must-gather-trlt4/perf-node-gather-daemonset-vlh5l" Jul 16 18:01:05.591442 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.591292 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61301842-3f72-4e6d-9900-105dd0a16c85-lib-modules\") pod \"perf-node-gather-daemonset-vlh5l\" (UID: \"61301842-3f72-4e6d-9900-105dd0a16c85\") " pod="openshift-must-gather-trlt4/perf-node-gather-daemonset-vlh5l" Jul 16 18:01:05.591442 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.591409 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/61301842-3f72-4e6d-9900-105dd0a16c85-podres\") pod \"perf-node-gather-daemonset-vlh5l\" (UID: \"61301842-3f72-4e6d-9900-105dd0a16c85\") " pod="openshift-must-gather-trlt4/perf-node-gather-daemonset-vlh5l" Jul 16 18:01:05.591565 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.591406 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/61301842-3f72-4e6d-9900-105dd0a16c85-proc\") pod \"perf-node-gather-daemonset-vlh5l\" (UID: \"61301842-3f72-4e6d-9900-105dd0a16c85\") " pod="openshift-must-gather-trlt4/perf-node-gather-daemonset-vlh5l" Jul 16 18:01:05.591565 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.591481 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/61301842-3f72-4e6d-9900-105dd0a16c85-podres\") pod \"perf-node-gather-daemonset-vlh5l\" (UID: \"61301842-3f72-4e6d-9900-105dd0a16c85\") " pod="openshift-must-gather-trlt4/perf-node-gather-daemonset-vlh5l" Jul 16 18:01:05.600246 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.600224 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9fvz\" (UniqueName: \"kubernetes.io/projected/61301842-3f72-4e6d-9900-105dd0a16c85-kube-api-access-x9fvz\") pod \"perf-node-gather-daemonset-vlh5l\" (UID: \"61301842-3f72-4e6d-9900-105dd0a16c85\") " pod="openshift-must-gather-trlt4/perf-node-gather-daemonset-vlh5l" Jul 16 18:01:05.763493 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.763401 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-trlt4/perf-node-gather-daemonset-vlh5l" Jul 16 18:01:05.889972 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.889950 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-trlt4/perf-node-gather-daemonset-vlh5l"] Jul 16 18:01:05.891851 ip-10-0-130-5 kubenswrapper[2578]: W0716 18:01:05.891819 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod61301842_3f72_4e6d_9900_105dd0a16c85.slice/crio-313bc8f940178ffdd13ac408363ccd3621a79cc582dbcafc0f56e71aab16e18d WatchSource:0}: Error finding container 313bc8f940178ffdd13ac408363ccd3621a79cc582dbcafc0f56e71aab16e18d: Status 404 returned error can't find the container with id 313bc8f940178ffdd13ac408363ccd3621a79cc582dbcafc0f56e71aab16e18d Jul 16 18:01:05.926855 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.926825 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fk9lj_bb1fa25e-7b06-453d-8064-237d8cf6dd85/dns/0.log" Jul 16 18:01:05.977597 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:05.977574 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fk9lj_bb1fa25e-7b06-453d-8064-237d8cf6dd85/kube-rbac-proxy/0.log" Jul 16 18:01:06.005737 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:06.005712 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-trlt4/perf-node-gather-daemonset-vlh5l" event={"ID":"61301842-3f72-4e6d-9900-105dd0a16c85","Type":"ContainerStarted","Data":"41b99a1c72662e2295fd050a4370edd7716d7d83a1bc4554a74af9ff0703c16e"} Jul 16 18:01:06.006007 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:06.005764 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-trlt4/perf-node-gather-daemonset-vlh5l" event={"ID":"61301842-3f72-4e6d-9900-105dd0a16c85","Type":"ContainerStarted","Data":"313bc8f940178ffdd13ac408363ccd3621a79cc582dbcafc0f56e71aab16e18d"} Jul 16 18:01:06.006007 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:06.005826 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-trlt4/perf-node-gather-daemonset-vlh5l" Jul 16 18:01:06.024984 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:06.024912 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-trlt4/perf-node-gather-daemonset-vlh5l" podStartSLOduration=1.024899256 podStartE2EDuration="1.024899256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 18:01:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:01:06.024097328 +0000 UTC m=+1636.553521619" watchObservedRunningTime="2026-07-16 18:01:06.024899256 +0000 UTC m=+1636.554323519" Jul 16 18:01:06.144090 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:06.144072 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cxq75_8dbc1f99-f360-4ae6-8200-45ad3de61e8e/dns-node-resolver/0.log" Jul 16 18:01:06.662591 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:06.662566 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c5cwf_d9755014-b229-4b27-8e7c-a754e8729ed1/node-ca/0.log" Jul 16 18:01:08.014121 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:08.014095 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5bb9j_c8e9f9c3-67f6-43f0-8fc3-03a69ec68c4f/serve-healthcheck-canary/0.log" Jul 16 18:01:08.474182 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:08.474152 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-h7w8t_83bc0281-2e18-403e-a681-d356367d8355/insights-operator/0.log" Jul 16 18:01:08.474591 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:08.474579 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-h7w8t_83bc0281-2e18-403e-a681-d356367d8355/insights-operator/1.log" Jul 16 18:01:08.578590 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:08.578558 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qwntv_e7615346-ccf4-44a6-9393-007ccf5351d3/kube-rbac-proxy/0.log" Jul 16 18:01:08.611428 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:08.611387 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qwntv_e7615346-ccf4-44a6-9393-007ccf5351d3/exporter/0.log" Jul 16 18:01:08.638765 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:08.638737 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qwntv_e7615346-ccf4-44a6-9393-007ccf5351d3/extractor/0.log" Jul 16 18:01:10.942817 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:10.942780 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-4jxvm_45a02239-cb18-4cab-94f2-a32bf962713d/s3-init/0.log" Jul 16 18:01:10.962266 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:10.962240 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-4jxvm_45a02239-cb18-4cab-94f2-a32bf962713d/download-hf-model/0.log" Jul 16 18:01:12.018900 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:12.018874 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-trlt4/perf-node-gather-daemonset-vlh5l" Jul 16 18:01:15.581982 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:15.581947 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-bnspx_d188b6b9-c314-4df0-bf39-e62ece5b1c32/kube-storage-version-migrator-operator/1.log" Jul 16 18:01:15.582761 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:15.582745 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-bnspx_d188b6b9-c314-4df0-bf39-e62ece5b1c32/kube-storage-version-migrator-operator/0.log" Jul 16 18:01:16.573709 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:16.573629 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5jnzr_f3ac9bba-8d89-4279-86fb-f26b11164aff/kube-multus/0.log" Jul 16 18:01:16.980910 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:16.980881 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vg8xg_122835d2-068b-4ef1-a09e-5f5dccd90a9f/kube-multus-additional-cni-plugins/0.log" Jul 16 18:01:17.005548 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:17.005523 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vg8xg_122835d2-068b-4ef1-a09e-5f5dccd90a9f/egress-router-binary-copy/0.log" Jul 16 18:01:17.032943 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:17.032910 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vg8xg_122835d2-068b-4ef1-a09e-5f5dccd90a9f/cni-plugins/0.log" Jul 16 18:01:17.067464 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:17.067410 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vg8xg_122835d2-068b-4ef1-a09e-5f5dccd90a9f/bond-cni-plugin/0.log" Jul 16 18:01:17.091692 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:17.091662 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vg8xg_122835d2-068b-4ef1-a09e-5f5dccd90a9f/routeoverride-cni/0.log" Jul 16 18:01:17.115322 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:17.115247 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vg8xg_122835d2-068b-4ef1-a09e-5f5dccd90a9f/whereabouts-cni-bincopy/0.log" Jul 16 18:01:17.140677 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:17.140646 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vg8xg_122835d2-068b-4ef1-a09e-5f5dccd90a9f/whereabouts-cni/0.log" Jul 16 18:01:17.198265 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:17.198234 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7xmt6_a4e3a253-031e-47d3-9ca3-18c97f49e614/network-metrics-daemon/0.log" Jul 16 18:01:17.223440 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:17.223401 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7xmt6_a4e3a253-031e-47d3-9ca3-18c97f49e614/kube-rbac-proxy/0.log" Jul 16 18:01:18.518722 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:18.518693 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvlwv_9ced5729-ce86-4189-90a5-161317525b5a/ovn-controller/0.log" Jul 16 18:01:18.538398 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:18.538370 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvlwv_9ced5729-ce86-4189-90a5-161317525b5a/ovn-acl-logging/0.log" Jul 16 18:01:18.563131 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:18.563100 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvlwv_9ced5729-ce86-4189-90a5-161317525b5a/kube-rbac-proxy-node/0.log" Jul 16 18:01:18.586341 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:18.586309 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvlwv_9ced5729-ce86-4189-90a5-161317525b5a/kube-rbac-proxy-ovn-metrics/0.log" Jul 16 18:01:18.609735 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:18.609709 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvlwv_9ced5729-ce86-4189-90a5-161317525b5a/northd/0.log" Jul 16 18:01:18.637429 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:18.637390 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvlwv_9ced5729-ce86-4189-90a5-161317525b5a/nbdb/0.log" Jul 16 18:01:18.661012 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:18.660986 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvlwv_9ced5729-ce86-4189-90a5-161317525b5a/sbdb/0.log" Jul 16 18:01:18.702586 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:18.702560 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvlwv_9ced5729-ce86-4189-90a5-161317525b5a/ovnkube-controller/0.log" Jul 16 18:01:19.687895 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:19.687858 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-h8zgd_9ed27992-7654-4b37-9b2a-dc5aa5cb6dde/network-check-target-container/0.log" Jul 16 18:01:20.618758 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:20.618725 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-9qckj_a9508dc3-c294-4959-bce4-6697f0ed0f0b/iptables-alerter/0.log" Jul 16 18:01:21.353226 ip-10-0-130-5 kubenswrapper[2578]: I0716 18:01:21.353196 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-4d257_c11bb9f3-bb53-4f79-974a-7c3ceff0db72/tuned/0.log"