Jul 06 19:05:11.825693 ip-10-0-136-29 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 19:05:11.825706 ip-10-0-136-29 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 19:05:11.825715 ip-10-0-136-29 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 19:05:11.826037 ip-10-0-136-29 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 19:05:22.075349 ip-10-0-136-29 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 19:05:22.075367 ip-10-0-136-29 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 8cc0d04774844cf4abd2e16bf8354ba3 -- Jul 06 19:07:15.030130 ip-10-0-136-29 systemd[1]: Starting Kubernetes Kubelet... Jul 06 19:07:15.417504 ip-10-0-136-29 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:07:15.417504 ip-10-0-136-29 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 19:07:15.417504 ip-10-0-136-29 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:07:15.417504 ip-10-0-136-29 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 19:07:15.417504 ip-10-0-136-29 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:07:15.418156 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.417490 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 19:07:15.422823 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422807 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:07:15.422823 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422822 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:07:15.422900 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422826 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:07:15.422900 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422829 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:07:15.422900 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422832 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:07:15.422900 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422848 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:07:15.422900 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422851 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:07:15.422900 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422854 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:07:15.422900 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422857 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:07:15.422900 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422860 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:07:15.422900 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422863 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:07:15.422900 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422865 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:07:15.422900 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422870 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:07:15.422900 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422874 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:07:15.422900 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422877 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:07:15.422900 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422880 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:07:15.422900 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422883 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:07:15.422900 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422885 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:07:15.422900 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422888 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:07:15.422900 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422891 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:07:15.422900 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422894 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:07:15.423351 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422899 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:07:15.423351 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422901 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:07:15.423351 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422904 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:07:15.423351 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422907 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:07:15.423351 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422909 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:07:15.423351 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422913 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:07:15.423351 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422916 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:07:15.423351 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422918 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:07:15.423351 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422922 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:07:15.423351 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422924 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:07:15.423351 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422928 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:07:15.423351 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422930 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:07:15.423351 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422933 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:07:15.423351 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422935 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:07:15.423351 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422938 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:07:15.423351 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422940 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:07:15.423351 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422943 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:07:15.423351 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422946 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:07:15.423351 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422948 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:07:15.423351 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422950 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:07:15.423826 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422953 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:07:15.423826 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422955 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:07:15.423826 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422958 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:07:15.423826 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422960 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:07:15.423826 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422963 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:07:15.423826 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422965 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:07:15.423826 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422967 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:07:15.423826 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422970 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:07:15.423826 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422973 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:07:15.423826 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422975 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:07:15.423826 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422977 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:07:15.423826 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422980 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:07:15.423826 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422982 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:07:15.423826 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422985 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:07:15.423826 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422988 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:07:15.423826 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422991 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:07:15.423826 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422994 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:07:15.423826 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422996 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:07:15.423826 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.422999 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:07:15.423826 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423001 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:07:15.424322 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423005 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:07:15.424322 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423007 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:07:15.424322 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423010 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:07:15.424322 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423013 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:07:15.424322 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423016 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:07:15.424322 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423018 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:07:15.424322 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423021 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:07:15.424322 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423024 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:07:15.424322 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423026 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:07:15.424322 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423029 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:07:15.424322 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423031 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:07:15.424322 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423034 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:07:15.424322 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423037 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:07:15.424322 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423039 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:07:15.424322 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423043 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:07:15.424322 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423046 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:07:15.424322 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423049 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:07:15.424322 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423052 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:07:15.424322 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423055 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:07:15.425044 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423058 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:07:15.425044 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423060 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:07:15.425044 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423063 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:07:15.425044 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423065 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:07:15.425044 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423068 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:07:15.425044 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423070 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:07:15.425044 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423074 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:07:15.425044 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423077 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:07:15.425044 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423081 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:07:15.425044 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423083 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:07:15.425044 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423086 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:07:15.425044 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423088 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:07:15.425044 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423091 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:07:15.425044 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423094 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:07:15.425044 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423096 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:07:15.425044 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423099 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:07:15.425044 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423102 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:07:15.425044 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423104 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:07:15.425044 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423107 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:07:15.425044 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423795 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:07:15.425799 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423802 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:07:15.425799 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423804 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:07:15.425799 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423807 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:07:15.425799 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423809 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:07:15.425799 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423812 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:07:15.425799 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423815 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:07:15.425799 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423817 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:07:15.425799 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423820 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:07:15.425799 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423823 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:07:15.425799 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423826 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:07:15.425799 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423828 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:07:15.425799 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423831 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:07:15.425799 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423849 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:07:15.425799 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423852 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:07:15.425799 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423856 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:07:15.425799 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423859 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:07:15.425799 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423861 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:07:15.425799 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423864 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:07:15.425799 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423867 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:07:15.425799 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423870 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:07:15.426630 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423872 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:07:15.426630 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423875 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:07:15.426630 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423878 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:07:15.426630 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423880 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:07:15.426630 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423883 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:07:15.426630 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423885 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:07:15.426630 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423888 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:07:15.426630 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423890 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:07:15.426630 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423892 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:07:15.426630 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423895 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:07:15.426630 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423898 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:07:15.426630 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423901 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:07:15.426630 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423904 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:07:15.426630 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423906 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:07:15.426630 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423909 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:07:15.426630 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423911 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:07:15.426630 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423914 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:07:15.426630 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423917 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:07:15.426630 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423920 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:07:15.427332 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423922 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:07:15.427332 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423925 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:07:15.427332 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423928 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:07:15.427332 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423930 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:07:15.427332 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423932 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:07:15.427332 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423935 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:07:15.427332 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423937 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:07:15.427332 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423940 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:07:15.427332 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423942 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:07:15.427332 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423945 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:07:15.427332 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423947 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:07:15.427332 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423950 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:07:15.427332 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423953 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:07:15.427332 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423955 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:07:15.427332 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423958 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:07:15.427332 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423960 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:07:15.427332 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423962 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:07:15.427332 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423965 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:07:15.427332 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423968 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:07:15.427332 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423970 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:07:15.427919 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423972 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:07:15.427919 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423978 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:07:15.427919 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423982 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:07:15.427919 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423985 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:07:15.427919 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423989 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:07:15.427919 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423992 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:07:15.427919 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423995 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:07:15.427919 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.423997 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:07:15.427919 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424001 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:07:15.427919 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424005 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:07:15.427919 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424008 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:07:15.427919 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424011 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:07:15.427919 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424013 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:07:15.427919 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424016 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:07:15.427919 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424019 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:07:15.427919 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424022 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:07:15.427919 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424025 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:07:15.427919 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424027 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:07:15.428412 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424030 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:07:15.428412 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424033 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:07:15.428412 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424035 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:07:15.428412 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424038 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:07:15.428412 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424041 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:07:15.428412 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424043 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:07:15.428412 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424046 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:07:15.428412 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424049 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:07:15.428412 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424051 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:07:15.428412 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424055 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:07:15.428412 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424057 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:07:15.428412 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424061 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:07:15.428412 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424063 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:07:15.428412 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424066 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:07:15.428412 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424068 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:07:15.428412 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424070 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:07:15.428412 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424073 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:07:15.428412 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424075 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:07:15.428412 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424077 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:07:15.428412 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424081 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:07:15.429157 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424083 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:07:15.429157 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424694 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:07:15.429157 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424707 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:07:15.429157 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424713 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:07:15.429157 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424718 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:07:15.429157 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424724 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:07:15.429157 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424734 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:07:15.429157 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424739 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:07:15.429157 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424744 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:07:15.429157 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424749 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:07:15.429157 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424753 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:07:15.429157 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424758 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:07:15.429157 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424762 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:07:15.429157 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424766 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:07:15.429157 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424771 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:07:15.429157 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424775 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:07:15.429157 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424780 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:07:15.429157 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424785 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:07:15.429157 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424789 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:07:15.429157 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424797 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:07:15.429677 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424801 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:07:15.429677 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424804 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:07:15.429677 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424809 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:07:15.429677 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424814 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:07:15.429677 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424817 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:07:15.429677 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424821 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:07:15.429677 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424825 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:07:15.429677 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424829 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:07:15.429677 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424833 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:07:15.429677 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424852 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:07:15.429677 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424856 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:07:15.429677 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424870 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:07:15.429677 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424875 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:07:15.429677 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424881 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:07:15.429677 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424885 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:07:15.429677 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424891 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:07:15.429677 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424896 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:07:15.429677 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424901 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:07:15.429677 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424905 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:07:15.430189 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424909 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:07:15.430189 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424913 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:07:15.430189 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424917 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:07:15.430189 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424922 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:07:15.430189 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424931 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:07:15.430189 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424935 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:07:15.430189 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424939 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:07:15.430189 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424943 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:07:15.430189 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424947 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:07:15.430189 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424953 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:07:15.430189 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424957 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:07:15.430189 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424961 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:07:15.430189 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424967 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:07:15.430189 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424971 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:07:15.430189 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424975 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:07:15.430189 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424983 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:07:15.430189 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424987 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:07:15.430189 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424991 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:07:15.430189 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424996 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:07:15.430189 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.424999 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:07:15.430768 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425004 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:07:15.430768 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425007 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:07:15.430768 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425011 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:07:15.430768 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425015 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:07:15.430768 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425022 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:07:15.430768 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425027 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:07:15.430768 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425031 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:07:15.430768 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425035 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:07:15.430768 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425043 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:07:15.430768 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425047 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:07:15.430768 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425051 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:07:15.430768 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425055 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:07:15.430768 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425059 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:07:15.430768 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425062 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:07:15.430768 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425067 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:07:15.430768 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425073 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:07:15.430768 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425078 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:07:15.430768 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425083 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:07:15.430768 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425087 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:07:15.431265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425091 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:07:15.431265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425099 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:07:15.431265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425104 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:07:15.431265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425108 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:07:15.431265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425112 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:07:15.431265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425116 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:07:15.431265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425120 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:07:15.431265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425125 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:07:15.431265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425129 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:07:15.431265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425133 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:07:15.431265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425137 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:07:15.431265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425141 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:07:15.431265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425146 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:07:15.431265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425150 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:07:15.431265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425159 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:07:15.431265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425163 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:07:15.431265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425167 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:07:15.431265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425173 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:07:15.431265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425179 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:07:15.431265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425185 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:07:15.431740 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425190 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:07:15.431740 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.425195 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:07:15.431740 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425338 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 19:07:15.431740 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425349 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 19:07:15.431740 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425394 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 19:07:15.431740 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425401 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 19:07:15.431740 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425407 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 19:07:15.431740 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425412 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 19:07:15.431740 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425435 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 19:07:15.431740 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425447 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 19:07:15.431740 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425452 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 19:07:15.431740 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425457 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 19:07:15.431740 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425462 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 19:07:15.431740 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425468 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 19:07:15.431740 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425473 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 19:07:15.431740 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425478 2578 flags.go:64] FLAG: --cgroup-root="" Jul 06 19:07:15.431740 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425483 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 19:07:15.431740 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425493 2578 flags.go:64] FLAG: --client-ca-file="" Jul 06 19:07:15.431740 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425498 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 06 19:07:15.431740 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425503 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 19:07:15.431740 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425511 2578 flags.go:64] FLAG: --cluster-domain="" Jul 06 19:07:15.431740 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425516 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 19:07:15.431740 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425522 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 19:07:15.432333 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425527 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 19:07:15.432333 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425533 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 19:07:15.432333 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425539 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 19:07:15.432333 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425550 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 19:07:15.432333 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425555 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 19:07:15.432333 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425561 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 19:07:15.432333 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425569 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 06 19:07:15.432333 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425574 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 19:07:15.432333 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425578 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 19:07:15.432333 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425584 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 19:07:15.432333 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425589 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 19:07:15.432333 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425601 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 19:07:15.432333 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425606 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 19:07:15.432333 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425611 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 19:07:15.432333 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425616 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 19:07:15.432333 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425621 2578 flags.go:64] FLAG: --enable-server="true" Jul 06 19:07:15.432333 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425625 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 19:07:15.432333 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425633 2578 flags.go:64] FLAG: --event-burst="100" Jul 06 19:07:15.432333 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425638 2578 flags.go:64] FLAG: --event-qps="50" Jul 06 19:07:15.432333 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425642 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 19:07:15.432333 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425652 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 19:07:15.432333 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425657 2578 flags.go:64] FLAG: --eviction-hard="" Jul 06 19:07:15.432333 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425663 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 19:07:15.432333 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425668 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 19:07:15.432938 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425673 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 19:07:15.432938 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425677 2578 flags.go:64] FLAG: --eviction-soft="" Jul 06 19:07:15.432938 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425682 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 19:07:15.432938 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425687 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 19:07:15.432938 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425697 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 19:07:15.432938 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425702 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 19:07:15.432938 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425707 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 19:07:15.432938 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425712 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 19:07:15.432938 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425717 2578 flags.go:64] FLAG: --feature-gates="" Jul 06 19:07:15.432938 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425722 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 19:07:15.432938 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425727 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 19:07:15.432938 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425732 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 19:07:15.432938 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425742 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 19:07:15.432938 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425746 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 06 19:07:15.432938 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425753 2578 flags.go:64] FLAG: --help="false" Jul 06 19:07:15.432938 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425758 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-136-29.ec2.internal" Jul 06 19:07:15.432938 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425763 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 19:07:15.432938 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425768 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 19:07:15.432938 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425774 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 19:07:15.432938 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425780 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 19:07:15.432938 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425786 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 19:07:15.432938 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425796 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 19:07:15.432938 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425812 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 19:07:15.433591 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425817 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 19:07:15.433591 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425827 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 19:07:15.433591 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425832 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 19:07:15.433591 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425852 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 19:07:15.433591 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425857 2578 flags.go:64] FLAG: --kube-reserved="" Jul 06 19:07:15.433591 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425862 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 19:07:15.433591 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425867 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 19:07:15.433591 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425872 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 19:07:15.433591 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425877 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 19:07:15.433591 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425880 2578 flags.go:64] FLAG: --lock-file="" Jul 06 19:07:15.433591 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425886 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 19:07:15.433591 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425890 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 19:07:15.433591 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425893 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 19:07:15.433591 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425914 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 19:07:15.433591 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.425918 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 19:07:15.433591 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426053 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 19:07:15.433591 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426064 2578 flags.go:64] FLAG: --logging-format="text" Jul 06 19:07:15.433591 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426071 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 19:07:15.433591 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426077 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 19:07:15.433591 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426083 2578 flags.go:64] FLAG: --manifest-url="" Jul 06 19:07:15.433591 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426088 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 06 19:07:15.433591 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426109 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 19:07:15.433591 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426114 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 19:07:15.433591 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426121 2578 flags.go:64] FLAG: --max-pods="110" Jul 06 19:07:15.433591 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426126 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 19:07:15.434224 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426131 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 19:07:15.434224 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426136 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 19:07:15.434224 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426141 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 19:07:15.434224 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426146 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 19:07:15.434224 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426152 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 19:07:15.434224 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426157 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 19:07:15.434224 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426171 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 19:07:15.434224 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426176 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 19:07:15.434224 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426181 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 19:07:15.434224 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426187 2578 flags.go:64] FLAG: --pod-cidr="" Jul 06 19:07:15.434224 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426192 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 19:07:15.434224 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426200 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 19:07:15.434224 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426205 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 19:07:15.434224 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426210 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 06 19:07:15.434224 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426214 2578 flags.go:64] FLAG: --port="10250" Jul 06 19:07:15.434224 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426220 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 19:07:15.434224 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426224 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b0253ddfa5816a12" Jul 06 19:07:15.434224 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426230 2578 flags.go:64] FLAG: --qos-reserved="" Jul 06 19:07:15.434224 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426235 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 06 19:07:15.434224 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426240 2578 flags.go:64] FLAG: --register-node="true" Jul 06 19:07:15.434224 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426245 2578 flags.go:64] FLAG: --register-with-taints="" Jul 06 19:07:15.434224 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426251 2578 flags.go:64] FLAG: --registry-burst="10" Jul 06 19:07:15.434224 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426257 2578 flags.go:64] FLAG: --registry-qps="5" Jul 06 19:07:15.434224 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426262 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 06 19:07:15.434804 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426267 2578 flags.go:64] FLAG: --reserved-memory="" Jul 06 19:07:15.434804 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426273 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 19:07:15.434804 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426278 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 19:07:15.434804 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426283 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 19:07:15.434804 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426287 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 19:07:15.434804 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426292 2578 flags.go:64] FLAG: --runonce="false" Jul 06 19:07:15.434804 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426297 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 19:07:15.434804 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426302 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 19:07:15.434804 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426307 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 06 19:07:15.434804 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426312 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 19:07:15.434804 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426317 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 19:07:15.434804 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426322 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 19:07:15.434804 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426327 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 19:07:15.434804 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426332 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 19:07:15.434804 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426337 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 19:07:15.434804 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426342 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 19:07:15.434804 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426346 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 19:07:15.434804 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426351 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 19:07:15.434804 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426356 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 19:07:15.434804 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426361 2578 flags.go:64] FLAG: --system-cgroups="" Jul 06 19:07:15.434804 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426366 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 19:07:15.434804 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426376 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 19:07:15.434804 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426381 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 06 19:07:15.434804 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426385 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 19:07:15.434804 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426393 2578 flags.go:64] FLAG: --tls-min-version="" Jul 06 19:07:15.435427 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426398 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 19:07:15.435427 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426402 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 19:07:15.435427 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426408 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 19:07:15.435427 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426413 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 19:07:15.435427 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426418 2578 flags.go:64] FLAG: --v="2" Jul 06 19:07:15.435427 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426427 2578 flags.go:64] FLAG: --version="false" Jul 06 19:07:15.435427 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426434 2578 flags.go:64] FLAG: --vmodule="" Jul 06 19:07:15.435427 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426442 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 19:07:15.435427 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.426448 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 19:07:15.435427 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426638 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:07:15.435427 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426645 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:07:15.435427 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426650 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:07:15.435427 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426655 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:07:15.435427 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426660 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:07:15.435427 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426664 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:07:15.435427 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426668 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:07:15.435427 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426673 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:07:15.435427 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426677 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:07:15.435427 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426681 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:07:15.435427 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426686 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:07:15.435427 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426690 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:07:15.435427 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426694 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:07:15.436006 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426699 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:07:15.436006 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426705 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:07:15.436006 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426711 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:07:15.436006 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426716 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:07:15.436006 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426721 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:07:15.436006 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426725 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:07:15.436006 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426730 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:07:15.436006 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426734 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:07:15.436006 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426738 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:07:15.436006 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426742 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:07:15.436006 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426746 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:07:15.436006 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426751 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:07:15.436006 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426755 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:07:15.436006 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426759 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:07:15.436006 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426763 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:07:15.436006 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426770 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:07:15.436006 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426774 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:07:15.436006 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426779 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:07:15.436006 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426784 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:07:15.436464 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426788 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:07:15.436464 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426793 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:07:15.436464 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426797 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:07:15.436464 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426801 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:07:15.436464 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426805 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:07:15.436464 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426809 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:07:15.436464 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426814 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:07:15.436464 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426818 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:07:15.436464 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426822 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:07:15.436464 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426826 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:07:15.436464 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426830 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:07:15.436464 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426855 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:07:15.436464 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426860 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:07:15.436464 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426864 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:07:15.436464 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426868 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:07:15.436464 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426873 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:07:15.436464 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426878 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:07:15.436464 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426883 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:07:15.436464 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426887 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:07:15.436464 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426892 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:07:15.436992 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426896 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:07:15.436992 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426900 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:07:15.436992 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426904 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:07:15.436992 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426909 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:07:15.436992 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426913 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:07:15.436992 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426918 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:07:15.436992 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426922 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:07:15.436992 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426926 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:07:15.436992 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426932 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:07:15.436992 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426937 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:07:15.436992 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426941 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:07:15.436992 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426946 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:07:15.436992 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426951 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:07:15.436992 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426956 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:07:15.436992 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426960 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:07:15.436992 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426964 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:07:15.436992 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426969 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:07:15.436992 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426973 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:07:15.436992 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426977 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:07:15.436992 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426981 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:07:15.437472 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426985 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:07:15.437472 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426991 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:07:15.437472 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.426998 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:07:15.437472 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.427002 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:07:15.437472 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.427006 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:07:15.437472 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.427010 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:07:15.437472 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.427015 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:07:15.437472 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.427019 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:07:15.437472 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.427026 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:07:15.437472 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.427031 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:07:15.437472 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.427036 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:07:15.437472 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.427041 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:07:15.437472 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.427045 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:07:15.437472 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.427050 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:07:15.437472 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.427054 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:07:15.437472 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.427058 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:07:15.437472 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.427062 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:07:15.437472 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.427066 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:07:15.437472 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.427071 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:07:15.437951 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.427075 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:07:15.437951 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.427081 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:07:15.437951 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.427085 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:07:15.437951 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.427090 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:07:15.437951 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.427094 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:07:15.437951 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.427098 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:07:15.437951 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.427103 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:07:15.437951 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.427107 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:07:15.437951 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.427723 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:07:15.437951 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.435534 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 19:07:15.437951 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.435548 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 19:07:15.437951 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.435566 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 19:07:15.437951 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.435572 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 19:07:15.437951 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435628 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:07:15.438296 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435633 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:07:15.438296 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435637 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:07:15.438296 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435640 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:07:15.438296 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435642 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:07:15.438296 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435645 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:07:15.438296 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435648 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:07:15.438296 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435650 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:07:15.438296 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435653 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:07:15.438296 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435655 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:07:15.438296 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435658 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:07:15.438296 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435661 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:07:15.438296 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435663 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:07:15.438296 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435666 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:07:15.438296 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435668 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:07:15.438296 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435671 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:07:15.438296 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435673 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:07:15.438296 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435676 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:07:15.438296 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435678 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:07:15.438296 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435681 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:07:15.438296 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435683 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:07:15.438766 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435686 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:07:15.438766 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435689 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:07:15.438766 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435691 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:07:15.438766 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435694 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:07:15.438766 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435698 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:07:15.438766 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435700 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:07:15.438766 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435702 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:07:15.438766 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435705 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:07:15.438766 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435709 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:07:15.438766 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435711 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:07:15.438766 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435714 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:07:15.438766 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435717 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:07:15.438766 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435719 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:07:15.438766 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435722 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:07:15.438766 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435724 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:07:15.438766 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435728 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:07:15.438766 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435730 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:07:15.438766 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435733 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:07:15.438766 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435735 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:07:15.438766 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435738 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:07:15.439265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435740 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:07:15.439265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435743 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:07:15.439265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435746 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:07:15.439265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435748 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:07:15.439265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435751 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:07:15.439265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435753 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:07:15.439265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435755 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:07:15.439265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435758 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:07:15.439265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435760 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:07:15.439265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435764 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:07:15.439265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435768 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:07:15.439265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435771 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:07:15.439265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435773 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:07:15.439265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435776 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:07:15.439265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435778 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:07:15.439265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435781 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:07:15.439265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435783 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:07:15.439265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435787 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:07:15.439265 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435789 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:07:15.439724 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435792 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:07:15.439724 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435795 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:07:15.439724 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435797 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:07:15.439724 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435800 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:07:15.439724 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435802 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:07:15.439724 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435805 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:07:15.439724 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435807 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:07:15.439724 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435810 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:07:15.439724 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435813 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:07:15.439724 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435815 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:07:15.439724 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435819 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:07:15.439724 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435822 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:07:15.439724 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435825 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:07:15.439724 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435827 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:07:15.439724 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435830 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:07:15.439724 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435832 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:07:15.439724 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435849 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:07:15.439724 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435852 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:07:15.439724 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435855 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:07:15.440204 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435859 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:07:15.440204 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435862 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:07:15.440204 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435865 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:07:15.440204 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435869 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:07:15.440204 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435871 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:07:15.440204 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435874 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:07:15.440204 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435877 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:07:15.440204 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435880 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:07:15.440204 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435882 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:07:15.440204 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435885 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:07:15.440204 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435888 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:07:15.440204 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435890 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:07:15.440204 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435894 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:07:15.440204 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435897 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:07:15.440204 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435900 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:07:15.440204 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435902 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:07:15.440204 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435905 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:07:15.440204 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435907 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:07:15.440204 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435910 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:07:15.440676 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.435913 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:07:15.440676 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.435917 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:07:15.440676 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436053 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:07:15.440676 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436058 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:07:15.440676 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436061 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:07:15.440676 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436064 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:07:15.440676 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436067 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:07:15.440676 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436070 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:07:15.440676 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436072 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:07:15.440676 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436075 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:07:15.440676 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436077 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:07:15.440676 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436082 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:07:15.440676 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436085 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:07:15.440676 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436089 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:07:15.441045 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436092 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:07:15.441045 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436096 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:07:15.441045 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436098 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:07:15.441045 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436101 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:07:15.441045 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436103 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:07:15.441045 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436106 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:07:15.441045 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436108 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:07:15.441045 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436111 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:07:15.441045 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436113 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:07:15.441045 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436116 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:07:15.441045 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436118 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:07:15.441045 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436121 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:07:15.441045 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436124 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:07:15.441045 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436127 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:07:15.441045 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436129 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:07:15.441045 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436132 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:07:15.441045 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436135 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:07:15.441045 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436137 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:07:15.441045 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436140 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:07:15.441045 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436142 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:07:15.441517 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436145 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:07:15.441517 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436147 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:07:15.441517 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436151 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:07:15.441517 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436154 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:07:15.441517 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436157 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:07:15.441517 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436160 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:07:15.441517 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436162 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:07:15.441517 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436165 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:07:15.441517 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436167 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:07:15.441517 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436170 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:07:15.441517 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436172 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:07:15.441517 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436175 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:07:15.441517 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436177 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:07:15.441517 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436180 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:07:15.441517 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436182 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:07:15.441517 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436185 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:07:15.441517 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436187 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:07:15.441517 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436190 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:07:15.441517 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436192 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:07:15.441517 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436195 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:07:15.442011 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436197 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:07:15.442011 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436200 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:07:15.442011 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436203 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:07:15.442011 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436205 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:07:15.442011 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436208 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:07:15.442011 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436211 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:07:15.442011 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436214 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:07:15.442011 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436216 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:07:15.442011 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436219 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:07:15.442011 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436221 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:07:15.442011 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436224 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:07:15.442011 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436226 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:07:15.442011 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436229 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:07:15.442011 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436231 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:07:15.442011 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436234 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:07:15.442011 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436236 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:07:15.442011 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436239 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:07:15.442011 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436241 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:07:15.442011 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436243 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:07:15.442011 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436246 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:07:15.442484 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436248 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:07:15.442484 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436251 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:07:15.442484 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436253 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:07:15.442484 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436256 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:07:15.442484 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436259 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:07:15.442484 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436261 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:07:15.442484 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436264 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:07:15.442484 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436266 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:07:15.442484 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436269 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:07:15.442484 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436284 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:07:15.442484 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436288 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:07:15.442484 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436291 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:07:15.442484 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436294 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:07:15.442484 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436296 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:07:15.442484 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436301 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:07:15.442484 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436303 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:07:15.442484 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436306 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:07:15.442484 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436309 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:07:15.442484 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436312 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:07:15.442994 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436315 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:07:15.442994 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436317 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:07:15.442994 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436320 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:07:15.442994 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436322 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:07:15.442994 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436325 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:07:15.442994 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436327 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:07:15.442994 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436330 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:07:15.442994 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:15.436332 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:07:15.442994 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.436337 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:07:15.442994 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.436445 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 19:07:15.442994 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.438407 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 19:07:15.442994 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.439816 2578 server.go:1019] "Starting client certificate rotation" Jul 06 19:07:15.442994 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.439910 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 19:07:15.442994 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.440575 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 19:07:15.443342 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.442460 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 19:07:15.449047 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.449026 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 19:07:15.460643 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.460549 2578 log.go:25] "Validated CRI v1 runtime API" Jul 06 19:07:15.463256 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.463238 2578 log.go:25] "Validated CRI v1 image API" Jul 06 19:07:15.464049 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.464025 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 19:07:15.466521 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.466495 2578 fs.go:135] Filesystem UUIDs: map[3ec794ba-8a30-46e8-b537-068e3c9ccab5:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f6466003-c4ea-41a0-82e4-ea88a3678595:/dev/nvme0n1p4] Jul 06 19:07:15.466583 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.466520 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 19:07:15.472617 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.472503 2578 manager.go:216] Machine: {Timestamp:2026-07-06 19:07:15.47019936 +0000 UTC m=+0.325284937 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093295 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec276339a77dfc5479648a40a673360f SystemUUID:ec276339-a77d-fc54-7964-8a40a673360f BootID:8cc0d047-7484-4cf4-abd2-e16bf8354ba3 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c4:f5:33:5e:67 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c4:f5:33:5e:67 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:35:a9:6f:e3:e9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 19:07:15.472617 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.472609 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 19:07:15.472730 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.472718 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 19:07:15.476077 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.476049 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 19:07:15.476276 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.476259 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 19:07:15.476331 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.476080 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-29.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 19:07:15.477546 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.477533 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 19:07:15.477610 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.477553 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 19:07:15.477610 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.477565 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 19:07:15.478133 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.478121 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 19:07:15.479401 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.479390 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 19:07:15.481906 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.481892 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 06 19:07:15.482041 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.482030 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 19:07:15.482098 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.482069 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 06 19:07:15.482098 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.482084 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 19:07:15.482190 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.482102 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 19:07:15.482190 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.482116 2578 kubelet.go:398] "Adding apiserver pod source" Jul 06 19:07:15.482190 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.482129 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 19:07:15.482517 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.482503 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 19:07:15.482589 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.482526 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 19:07:15.484325 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.484308 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 19:07:15.486106 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.486094 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 19:07:15.486156 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.486124 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 19:07:15.487191 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.487180 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 19:07:15.487234 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.487196 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 19:07:15.487234 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.487202 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 19:07:15.487234 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.487207 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 19:07:15.487234 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.487215 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 19:07:15.487234 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.487220 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 19:07:15.487234 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.487228 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 19:07:15.487477 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.487233 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 19:07:15.487477 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.487276 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 19:07:15.487477 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.487281 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 19:07:15.487477 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.487290 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 19:07:15.487477 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.487295 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 19:07:15.488704 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.488691 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 19:07:15.488751 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.488708 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 19:07:15.491898 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.491884 2578 server.go:1268] "Started kubelet" Jul 06 19:07:15.492026 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.491971 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 19:07:15.492084 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.492051 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 19:07:15.492219 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.492108 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 19:07:15.492784 ip-10-0-136-29 systemd[1]: Started Kubernetes Kubelet. Jul 06 19:07:15.497754 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.497732 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 19:07:15.498053 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.498027 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 06 19:07:15.498255 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:15.498230 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-29.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 19:07:15.498706 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:15.498682 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 19:07:15.498792 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:15.498741 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 19:07:15.498889 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.498872 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-29.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 19:07:15.503229 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.503211 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 19:07:15.503305 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.503213 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 19:07:15.503392 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:15.503331 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-29.ec2.internal\" not found" Jul 06 19:07:15.504111 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.504026 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 19:07:15.504111 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.504026 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 19:07:15.504111 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.504060 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 19:07:15.504111 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.504108 2578 factory.go:55] Registering systemd factory Jul 06 19:07:15.504759 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.504124 2578 factory.go:223] Registration of the systemd container factory successfully Jul 06 19:07:15.504759 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.504167 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 06 19:07:15.504759 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.504175 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 06 19:07:15.504921 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.504828 2578 factory.go:153] Registering CRI-O factory Jul 06 19:07:15.504921 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.504860 2578 factory.go:223] Registration of the crio container factory successfully Jul 06 19:07:15.504921 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.504917 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 19:07:15.505060 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.504940 2578 factory.go:103] Registering Raw factory Jul 06 19:07:15.505060 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.504962 2578 manager.go:1196] Started watching for new ooms in manager Jul 06 19:07:15.505399 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.505382 2578 manager.go:349] Starting recovery of all containers Jul 06 19:07:15.505974 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:15.505019 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-29.ec2.internal.18bfc8de846a517e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-29.ec2.internal,UID:ip-10-0-136-29.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-29.ec2.internal,},FirstTimestamp:2026-07-06 19:07:15.491860862 +0000 UTC m=+0.346946439,LastTimestamp:2026-07-06 19:07:15.491860862 +0000 UTC m=+0.346946439,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-29.ec2.internal,}" Jul 06 19:07:15.513953 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:15.513926 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 19:07:15.514562 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:15.514081 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-29.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 19:07:15.516989 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.516974 2578 manager.go:354] Recovery completed Jul 06 19:07:15.521027 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.521016 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:07:15.522696 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.522670 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-29.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:07:15.522758 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.522719 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-29.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:07:15.522758 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.522733 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-29.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:07:15.523175 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.523161 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 19:07:15.523175 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.523174 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 19:07:15.523259 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.523189 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 06 19:07:15.523259 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.523197 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:07:15.523890 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.523866 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-29.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:07:15.523961 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.523900 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-29.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:07:15.523961 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.523910 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-29.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:07:15.524426 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.524415 2578 policy_none.go:49] "None policy: Start" Jul 06 19:07:15.524459 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.524430 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 19:07:15.524459 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.524441 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 19:07:15.524876 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:15.524799 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-29.ec2.internal.18bfc8de8640dc2a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-29.ec2.internal,UID:ip-10-0-136-29.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-29.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-29.ec2.internal,},FirstTimestamp:2026-07-06 19:07:15.522698282 +0000 UTC m=+0.377783867,LastTimestamp:2026-07-06 19:07:15.522698282 +0000 UTC m=+0.377783867,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-29.ec2.internal,}" Jul 06 19:07:15.525696 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.525684 2578 policy_none.go:47] "Start" Jul 06 19:07:15.528325 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.528301 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4m84t" Jul 06 19:07:15.534905 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:15.534833 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-29.ec2.internal.18bfc8de86414d0b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-29.ec2.internal,UID:ip-10-0-136-29.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-29.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-29.ec2.internal,},FirstTimestamp:2026-07-06 19:07:15.522727179 +0000 UTC m=+0.377812759,LastTimestamp:2026-07-06 19:07:15.522727179 +0000 UTC m=+0.377812759,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-29.ec2.internal,}" Jul 06 19:07:15.543427 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.543400 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4m84t" Jul 06 19:07:15.545357 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:15.545248 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-29.ec2.internal.18bfc8de86417393 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-29.ec2.internal,UID:ip-10-0-136-29.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-29.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-29.ec2.internal,},FirstTimestamp:2026-07-06 19:07:15.522737043 +0000 UTC m=+0.377822620,LastTimestamp:2026-07-06 19:07:15.522737043 +0000 UTC m=+0.377822620,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-29.ec2.internal,}" Jul 06 19:07:15.563593 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.563575 2578 manager.go:337] "Starting Device Plugin manager" Jul 06 19:07:15.563665 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:15.563609 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 19:07:15.563665 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.563619 2578 server.go:87] "Starting device plugin registration server" Jul 06 19:07:15.564092 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.563870 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 19:07:15.564153 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.564108 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 19:07:15.564242 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.564220 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 19:07:15.564340 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.564324 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 19:07:15.564340 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.564336 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 19:07:15.564906 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:15.564883 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 19:07:15.565022 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:15.564932 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-29.ec2.internal\" not found" Jul 06 19:07:15.645103 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.645059 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 19:07:15.646431 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.646413 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 19:07:15.646486 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.646462 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 19:07:15.646527 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.646487 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 19:07:15.646565 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:15.646530 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 19:07:15.650432 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.650407 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:07:15.664968 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.664954 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:07:15.665872 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.665856 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-29.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:07:15.665949 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.665886 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-29.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:07:15.665949 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.665896 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-29.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:07:15.665949 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.665922 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-29.ec2.internal" Jul 06 19:07:15.678662 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.678609 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-29.ec2.internal" Jul 06 19:07:15.678662 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:15.678634 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-29.ec2.internal\": node \"ip-10-0-136-29.ec2.internal\" not found" Jul 06 19:07:15.723186 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:15.723158 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-29.ec2.internal\" not found" Jul 06 19:07:15.747386 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.747361 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-29.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-29.ec2.internal"] Jul 06 19:07:15.747458 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.747428 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:07:15.748451 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.748426 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-29.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:07:15.748451 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.748457 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-29.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:07:15.748640 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.748468 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-29.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:07:15.749728 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.749714 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:07:15.749895 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.749878 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-29.ec2.internal" Jul 06 19:07:15.749988 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.749959 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:07:15.750513 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.750491 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-29.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:07:15.750600 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.750526 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-29.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:07:15.750600 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.750536 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-29.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:07:15.750600 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.750560 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-29.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:07:15.750600 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.750539 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-29.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:07:15.750791 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.750571 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-29.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:07:15.751861 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.751843 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-29.ec2.internal" Jul 06 19:07:15.751977 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.751873 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:07:15.752600 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.752579 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-29.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:07:15.752685 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.752611 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-29.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:07:15.752685 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.752627 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-29.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:07:15.775498 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:15.775477 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-29.ec2.internal\" not found" node="ip-10-0-136-29.ec2.internal" Jul 06 19:07:15.779336 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:15.779319 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-29.ec2.internal\" not found" node="ip-10-0-136-29.ec2.internal" Jul 06 19:07:15.805593 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.805567 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b229ed7c47b8bbc40f36104a81e67543-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-29.ec2.internal\" (UID: \"b229ed7c47b8bbc40f36104a81e67543\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-29.ec2.internal" Jul 06 19:07:15.805690 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.805596 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d3790303dbdd7a7168052dca674a531-config\") pod \"kube-apiserver-proxy-ip-10-0-136-29.ec2.internal\" (UID: \"8d3790303dbdd7a7168052dca674a531\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-29.ec2.internal" Jul 06 19:07:15.805690 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.805613 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b229ed7c47b8bbc40f36104a81e67543-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-29.ec2.internal\" (UID: \"b229ed7c47b8bbc40f36104a81e67543\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-29.ec2.internal" Jul 06 19:07:15.823367 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:15.823335 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-29.ec2.internal\" not found" Jul 06 19:07:15.906399 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.906360 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b229ed7c47b8bbc40f36104a81e67543-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-29.ec2.internal\" (UID: \"b229ed7c47b8bbc40f36104a81e67543\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-29.ec2.internal" Jul 06 19:07:15.906399 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.906394 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d3790303dbdd7a7168052dca674a531-config\") pod \"kube-apiserver-proxy-ip-10-0-136-29.ec2.internal\" (UID: \"8d3790303dbdd7a7168052dca674a531\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-29.ec2.internal" Jul 06 19:07:15.906620 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.906442 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b229ed7c47b8bbc40f36104a81e67543-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-29.ec2.internal\" (UID: \"b229ed7c47b8bbc40f36104a81e67543\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-29.ec2.internal" Jul 06 19:07:15.906620 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.906450 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d3790303dbdd7a7168052dca674a531-config\") pod \"kube-apiserver-proxy-ip-10-0-136-29.ec2.internal\" (UID: \"8d3790303dbdd7a7168052dca674a531\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-29.ec2.internal" Jul 06 19:07:15.906620 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.906469 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b229ed7c47b8bbc40f36104a81e67543-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-29.ec2.internal\" (UID: \"b229ed7c47b8bbc40f36104a81e67543\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-29.ec2.internal" Jul 06 19:07:15.906620 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:15.906534 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b229ed7c47b8bbc40f36104a81e67543-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-29.ec2.internal\" (UID: \"b229ed7c47b8bbc40f36104a81e67543\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-29.ec2.internal" Jul 06 19:07:15.924422 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:15.924397 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-29.ec2.internal\" not found" Jul 06 19:07:16.025900 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:16.025818 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-29.ec2.internal\" not found" Jul 06 19:07:16.079190 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:16.079165 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-29.ec2.internal" Jul 06 19:07:16.082460 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:16.082423 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-29.ec2.internal" Jul 06 19:07:16.126203 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:16.126173 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-29.ec2.internal\" not found" Jul 06 19:07:16.226748 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:16.226709 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-29.ec2.internal\" not found" Jul 06 19:07:16.327863 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:16.327767 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-29.ec2.internal\" not found" Jul 06 19:07:16.428419 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:16.428372 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-29.ec2.internal\" not found" Jul 06 19:07:16.439332 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:16.439305 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 19:07:16.439493 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:16.439471 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 19:07:16.529160 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:16.529127 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-29.ec2.internal\" not found" Jul 06 19:07:16.547075 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:16.547030 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 19:02:16 +0000 UTC" deadline="2028-04-18 20:33:30.490145392 +0000 UTC" Jul 06 19:07:16.547075 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:16.547068 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15649h26m13.94308126s" Jul 06 19:07:16.630135 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:16.630051 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-29.ec2.internal\" not found" Jul 06 19:07:16.683682 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:16.683645 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:07:16.684811 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:16.684787 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-29.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:07:16.684964 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:16.684823 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-29.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:07:16.684964 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:16.684834 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-29.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:07:16.716177 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:16.716149 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:07:16.760871 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:16.760833 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d3790303dbdd7a7168052dca674a531.slice/crio-03e243c0f5c03096613ccf2227c03d9687639283162862bef6dff05d8fa1b1fe WatchSource:0}: Error finding container 03e243c0f5c03096613ccf2227c03d9687639283162862bef6dff05d8fa1b1fe: Status 404 returned error can't find the container with id 03e243c0f5c03096613ccf2227c03d9687639283162862bef6dff05d8fa1b1fe Jul 06 19:07:16.761100 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:16.761075 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb229ed7c47b8bbc40f36104a81e67543.slice/crio-eee44b2a1e1d7b49315482a52a24469062378102627e1766df665273140b83ea WatchSource:0}: Error finding container eee44b2a1e1d7b49315482a52a24469062378102627e1766df665273140b83ea: Status 404 returned error can't find the container with id eee44b2a1e1d7b49315482a52a24469062378102627e1766df665273140b83ea Jul 06 19:07:16.765481 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:16.765466 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:07:16.804643 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:16.804602 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-29.ec2.internal" Jul 06 19:07:16.831581 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:16.831557 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 19:07:16.833958 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:16.833939 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-29.ec2.internal" Jul 06 19:07:16.850612 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:16.850593 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 19:07:17.021734 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.021646 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:07:17.064669 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.064630 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:07:17.485589 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.485497 2578 apiserver.go:52] "Watching apiserver" Jul 06 19:07:17.497374 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.496956 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 19:07:17.499227 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.499195 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-29.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz","openshift-dns/node-resolver-gjvsc","openshift-multus/multus-slbwt","openshift-multus/network-metrics-daemon-qx7rr","openshift-network-diagnostics/network-check-target-q4cm4","openshift-ovn-kubernetes/ovnkube-node-mxfxf","kube-system/global-pull-secret-syncer-56hnl","kube-system/konnectivity-agent-drlkn","openshift-cluster-node-tuning-operator/tuned-wh7f8","openshift-image-registry/node-ca-sc2cl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-29.ec2.internal","openshift-multus/multus-additional-cni-plugins-9slzb","openshift-network-operator/iptables-alerter-gdwbp"] Jul 06 19:07:17.501146 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.501061 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.502685 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.502662 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9slzb" Jul 06 19:07:17.504799 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.504319 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gjvsc" Jul 06 19:07:17.504799 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.504554 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 19:07:17.505649 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.505603 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.507983 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.507953 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:17.508076 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:17.508034 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx7rr" podUID="40e3ecd3-e42e-46d6-858c-ca3c21710c7a" Jul 06 19:07:17.508294 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.508272 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:07:17.508392 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:17.508365 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4cm4" podUID="4c53b7be-5d92-4555-a03e-37d50ecb15c4" Jul 06 19:07:17.510520 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.510492 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-drlkn" Jul 06 19:07:17.510722 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.510705 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gdwbp" Jul 06 19:07:17.512400 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.512368 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" Jul 06 19:07:17.512569 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.512371 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pkgcg\"" Jul 06 19:07:17.512569 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.512538 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 19:07:17.513105 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.513081 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 19:07:17.513226 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.513189 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 19:07:17.513326 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.513307 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 19:07:17.513401 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.513389 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 19:07:17.513517 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.513500 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 19:07:17.513633 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.513612 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 19:07:17.514807 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.513879 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.515456 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.515428 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 19:07:17.519279 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.515637 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 19:07:17.519279 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.516095 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 19:07:17.519279 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.516247 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 19:07:17.519279 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.516364 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sc2cl" Jul 06 19:07:17.519279 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.516504 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24f3c199-698c-4a41-b391-9aa34578da40-tmp-dir\") pod \"node-resolver-gjvsc\" (UID: \"24f3c199-698c-4a41-b391-9aa34578da40\") " pod="openshift-dns/node-resolver-gjvsc" Jul 06 19:07:17.519279 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.516536 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-cnibin\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.519279 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.516563 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-multus-conf-dir\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.519279 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.516594 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-log-socket\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.519279 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.516625 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6877b4b-db74-4525-afab-b8cd5da25885-cnibin\") pod \"multus-additional-cni-plugins-9slzb\" (UID: \"d6877b4b-db74-4525-afab-b8cd5da25885\") " pod="openshift-multus/multus-additional-cni-plugins-9slzb" Jul 06 19:07:17.519279 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.516650 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6877b4b-db74-4525-afab-b8cd5da25885-os-release\") pod \"multus-additional-cni-plugins-9slzb\" (UID: \"d6877b4b-db74-4525-afab-b8cd5da25885\") " pod="openshift-multus/multus-additional-cni-plugins-9slzb" Jul 06 19:07:17.519279 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.516695 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d6877b4b-db74-4525-afab-b8cd5da25885-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9slzb\" (UID: \"d6877b4b-db74-4525-afab-b8cd5da25885\") " pod="openshift-multus/multus-additional-cni-plugins-9slzb" Jul 06 19:07:17.519279 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.516719 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-system-cni-dir\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.519279 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.516766 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-multus-cni-dir\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.519279 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.516792 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-os-release\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.519279 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.516817 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-host-run-netns\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.519279 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.516855 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-hostroot\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.519279 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.516901 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kg6l\" (UniqueName: \"kubernetes.io/projected/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-kube-api-access-4kg6l\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.519279 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.516960 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-var-lib-openvswitch\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.519279 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517009 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-etc-openvswitch\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.519279 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517034 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:17.520360 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:17.517104 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56hnl" podUID="38637c2e-e315-4bf4-89c8-e081abdb8502" Jul 06 19:07:17.520360 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517038 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/24f3c199-698c-4a41-b391-9aa34578da40-hosts-file\") pod \"node-resolver-gjvsc\" (UID: \"24f3c199-698c-4a41-b391-9aa34578da40\") " pod="openshift-dns/node-resolver-gjvsc" Jul 06 19:07:17.520360 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517175 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-multus-socket-dir-parent\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.520360 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517211 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-host-var-lib-kubelet\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.520360 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517242 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-host-slash\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.520360 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517272 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-run-systemd\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.520360 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517290 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 19:07:17.520360 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517296 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-run-ovn\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.520360 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517333 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-host-cni-netd\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.520360 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517377 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.520360 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517430 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-host-run-k8s-cni-cncf-io\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.520360 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517457 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 19:07:17.520360 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517466 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-host-var-lib-cni-multus\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.520360 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517496 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-host-run-ovn-kubernetes\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.520360 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517525 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6f50399f-0464-42ab-a086-28fe26616279-ovnkube-config\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.520360 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517580 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6f50399f-0464-42ab-a086-28fe26616279-env-overrides\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.520360 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517606 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkxgk\" (UniqueName: \"kubernetes.io/projected/6f50399f-0464-42ab-a086-28fe26616279-kube-api-access-kkxgk\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.521220 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517661 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6877b4b-db74-4525-afab-b8cd5da25885-system-cni-dir\") pod \"multus-additional-cni-plugins-9slzb\" (UID: \"d6877b4b-db74-4525-afab-b8cd5da25885\") " pod="openshift-multus/multus-additional-cni-plugins-9slzb" Jul 06 19:07:17.521220 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517700 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6877b4b-db74-4525-afab-b8cd5da25885-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9slzb\" (UID: \"d6877b4b-db74-4525-afab-b8cd5da25885\") " pod="openshift-multus/multus-additional-cni-plugins-9slzb" Jul 06 19:07:17.521220 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517740 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-cni-binary-copy\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.521220 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517797 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-host-run-netns\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.521220 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517826 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-node-log\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.521220 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517858 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6f50399f-0464-42ab-a086-28fe26616279-ovnkube-script-lib\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.521220 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517896 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4hzs\" (UniqueName: \"kubernetes.io/projected/24f3c199-698c-4a41-b391-9aa34578da40-kube-api-access-g4hzs\") pod \"node-resolver-gjvsc\" (UID: \"24f3c199-698c-4a41-b391-9aa34578da40\") " pod="openshift-dns/node-resolver-gjvsc" Jul 06 19:07:17.521220 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517943 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-multus-daemon-config\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.521220 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517970 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-etc-kubernetes\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.521220 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517996 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-host-kubelet\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.521220 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.518022 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6877b4b-db74-4525-afab-b8cd5da25885-cni-binary-copy\") pod \"multus-additional-cni-plugins-9slzb\" (UID: \"d6877b4b-db74-4525-afab-b8cd5da25885\") " pod="openshift-multus/multus-additional-cni-plugins-9slzb" Jul 06 19:07:17.521220 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.518102 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lqlgm\"" Jul 06 19:07:17.521220 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.518258 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 19:07:17.521220 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.518335 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h9nbv\"" Jul 06 19:07:17.521220 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.518554 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d6877b4b-db74-4525-afab-b8cd5da25885-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9slzb\" (UID: \"d6877b4b-db74-4525-afab-b8cd5da25885\") " pod="openshift-multus/multus-additional-cni-plugins-9slzb" Jul 06 19:07:17.521220 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.518590 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:07:17.521220 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.518601 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5w7x\" (UniqueName: \"kubernetes.io/projected/d6877b4b-db74-4525-afab-b8cd5da25885-kube-api-access-b5w7x\") pod \"multus-additional-cni-plugins-9slzb\" (UID: \"d6877b4b-db74-4525-afab-b8cd5da25885\") " pod="openshift-multus/multus-additional-cni-plugins-9slzb" Jul 06 19:07:17.521220 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.518612 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bnhnb\"" Jul 06 19:07:17.521220 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.518632 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-host-var-lib-cni-bin\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.522215 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.518681 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-host-run-multus-certs\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.522215 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.518709 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-systemd-units\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.522215 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.518735 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-run-openvswitch\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.522215 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.518761 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-host-cni-bin\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.522215 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.518790 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f50399f-0464-42ab-a086-28fe26616279-ovn-node-metrics-cert\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.522215 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.517340 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 19:07:17.522215 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.518908 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 19:07:17.522215 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.518987 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 19:07:17.522215 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.519265 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x5dnh\"" Jul 06 19:07:17.522215 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.519612 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mgxwp\"" Jul 06 19:07:17.552925 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.552878 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 19:07:17.553647 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.553624 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 19:07:17.553760 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.553750 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 19:07:17.553915 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.553883 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 19:07:17.554470 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.554123 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 19:07:17.554470 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.554141 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 19:07:17.554951 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.554930 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 19:07:17.555064 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.555044 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qw6dn\"" Jul 06 19:07:17.555132 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.555045 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zktjv\"" Jul 06 19:07:17.555222 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.555205 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:07:17.555301 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.554932 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 19:07:17.556153 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.555643 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ncs5h\"" Jul 06 19:07:17.572711 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.572688 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 19:07:17.572832 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.572813 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jdn7j" Jul 06 19:07:17.605495 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.605472 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 19:07:17.625683 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.619916 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-host-run-multus-certs\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.625683 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.619961 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-systemd-units\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.625683 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.619989 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-host-cni-bin\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.625683 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620000 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-host-run-multus-certs\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.625683 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620019 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-etc-sysctl-d\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.625683 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620056 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-cnibin\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.625683 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620081 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-systemd-units\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.625683 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620087 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-multus-conf-dir\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.625683 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620128 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-host-cni-bin\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.625683 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620135 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6877b4b-db74-4525-afab-b8cd5da25885-cnibin\") pod \"multus-additional-cni-plugins-9slzb\" (UID: \"d6877b4b-db74-4525-afab-b8cd5da25885\") " pod="openshift-multus/multus-additional-cni-plugins-9slzb" Jul 06 19:07:17.625683 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620161 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6877b4b-db74-4525-afab-b8cd5da25885-os-release\") pod \"multus-additional-cni-plugins-9slzb\" (UID: \"d6877b4b-db74-4525-afab-b8cd5da25885\") " pod="openshift-multus/multus-additional-cni-plugins-9slzb" Jul 06 19:07:17.625683 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620184 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-cnibin\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.625683 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620188 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/38637c2e-e315-4bf4-89c8-e081abdb8502-dbus\") pod \"global-pull-secret-syncer-56hnl\" (UID: \"38637c2e-e315-4bf4-89c8-e081abdb8502\") " pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:17.625683 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620215 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/06412cf4-7f2f-421a-a09b-b83409783de8-konnectivity-ca\") pod \"konnectivity-agent-drlkn\" (UID: \"06412cf4-7f2f-421a-a09b-b83409783de8\") " pod="kube-system/konnectivity-agent-drlkn" Jul 06 19:07:17.625683 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620230 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6877b4b-db74-4525-afab-b8cd5da25885-cnibin\") pod \"multus-additional-cni-plugins-9slzb\" (UID: \"d6877b4b-db74-4525-afab-b8cd5da25885\") " pod="openshift-multus/multus-additional-cni-plugins-9slzb" Jul 06 19:07:17.625683 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620241 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-lib-modules\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.625683 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620265 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-host\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.625683 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620273 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-multus-conf-dir\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.626662 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620294 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d6877b4b-db74-4525-afab-b8cd5da25885-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9slzb\" (UID: \"d6877b4b-db74-4525-afab-b8cd5da25885\") " pod="openshift-multus/multus-additional-cni-plugins-9slzb" Jul 06 19:07:17.626662 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620322 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40e3ecd3-e42e-46d6-858c-ca3c21710c7a-metrics-certs\") pod \"network-metrics-daemon-qx7rr\" (UID: \"40e3ecd3-e42e-46d6-858c-ca3c21710c7a\") " pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:17.626662 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620346 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-run\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.626662 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620351 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6877b4b-db74-4525-afab-b8cd5da25885-os-release\") pod \"multus-additional-cni-plugins-9slzb\" (UID: \"d6877b4b-db74-4525-afab-b8cd5da25885\") " pod="openshift-multus/multus-additional-cni-plugins-9slzb" Jul 06 19:07:17.626662 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620371 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-system-cni-dir\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.626662 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620396 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-multus-cni-dir\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.626662 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620613 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-multus-cni-dir\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.626662 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620656 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-os-release\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.626662 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620682 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-host-run-netns\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.626662 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620709 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-host-cni-netd\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.626662 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620737 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d6877b4b-db74-4525-afab-b8cd5da25885-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9slzb\" (UID: \"d6877b4b-db74-4525-afab-b8cd5da25885\") " pod="openshift-multus/multus-additional-cni-plugins-9slzb" Jul 06 19:07:17.626662 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620764 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/24f3c199-698c-4a41-b391-9aa34578da40-hosts-file\") pod \"node-resolver-gjvsc\" (UID: \"24f3c199-698c-4a41-b391-9aa34578da40\") " pod="openshift-dns/node-resolver-gjvsc" Jul 06 19:07:17.626662 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620791 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-multus-socket-dir-parent\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.626662 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620816 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-run-systemd\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.626662 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620842 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6f50399f-0464-42ab-a086-28fe26616279-ovnkube-config\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.626662 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620890 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6877b4b-db74-4525-afab-b8cd5da25885-system-cni-dir\") pod \"multus-additional-cni-plugins-9slzb\" (UID: \"d6877b4b-db74-4525-afab-b8cd5da25885\") " pod="openshift-multus/multus-additional-cni-plugins-9slzb" Jul 06 19:07:17.626662 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620949 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh25l\" (UniqueName: \"kubernetes.io/projected/ee733dc7-7c7b-47a0-8c61-10c35b7b9b67-kube-api-access-rh25l\") pod \"aws-ebs-csi-driver-node-tf5gz\" (UID: \"ee733dc7-7c7b-47a0-8c61-10c35b7b9b67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" Jul 06 19:07:17.627529 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.620981 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-host-run-ovn-kubernetes\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.627529 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621020 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkxgk\" (UniqueName: \"kubernetes.io/projected/6f50399f-0464-42ab-a086-28fe26616279-kube-api-access-kkxgk\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.627529 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621030 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d6877b4b-db74-4525-afab-b8cd5da25885-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9slzb\" (UID: \"d6877b4b-db74-4525-afab-b8cd5da25885\") " pod="openshift-multus/multus-additional-cni-plugins-9slzb" Jul 06 19:07:17.627529 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621048 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6877b4b-db74-4525-afab-b8cd5da25885-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9slzb\" (UID: \"d6877b4b-db74-4525-afab-b8cd5da25885\") " pod="openshift-multus/multus-additional-cni-plugins-9slzb" Jul 06 19:07:17.627529 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621087 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ee733dc7-7c7b-47a0-8c61-10c35b7b9b67-sys-fs\") pod \"aws-ebs-csi-driver-node-tf5gz\" (UID: \"ee733dc7-7c7b-47a0-8c61-10c35b7b9b67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" Jul 06 19:07:17.627529 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621114 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0986e47c-3c46-4099-8ca4-d49caa7246cd-tmp\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.627529 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621130 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-system-cni-dir\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.627529 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621146 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-node-log\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.627529 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621194 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkmh2\" (UniqueName: \"kubernetes.io/projected/ff4d48d8-20fe-4762-bd9e-9fa53deb24df-kube-api-access-nkmh2\") pod \"node-ca-sc2cl\" (UID: \"ff4d48d8-20fe-4762-bd9e-9fa53deb24df\") " pod="openshift-image-registry/node-ca-sc2cl" Jul 06 19:07:17.627529 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621220 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ee733dc7-7c7b-47a0-8c61-10c35b7b9b67-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tf5gz\" (UID: \"ee733dc7-7c7b-47a0-8c61-10c35b7b9b67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" Jul 06 19:07:17.627529 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621250 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4hzs\" (UniqueName: \"kubernetes.io/projected/24f3c199-698c-4a41-b391-9aa34578da40-kube-api-access-g4hzs\") pod \"node-resolver-gjvsc\" (UID: \"24f3c199-698c-4a41-b391-9aa34578da40\") " pod="openshift-dns/node-resolver-gjvsc" Jul 06 19:07:17.627529 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621286 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-multus-daemon-config\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.627529 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621313 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-etc-kubernetes\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.627529 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621349 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5w7x\" (UniqueName: \"kubernetes.io/projected/d6877b4b-db74-4525-afab-b8cd5da25885-kube-api-access-b5w7x\") pod \"multus-additional-cni-plugins-9slzb\" (UID: \"d6877b4b-db74-4525-afab-b8cd5da25885\") " pod="openshift-multus/multus-additional-cni-plugins-9slzb" Jul 06 19:07:17.627529 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621378 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/38637c2e-e315-4bf4-89c8-e081abdb8502-kubelet-config\") pod \"global-pull-secret-syncer-56hnl\" (UID: \"38637c2e-e315-4bf4-89c8-e081abdb8502\") " pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:17.627529 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621409 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-host-var-lib-cni-bin\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.627529 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621435 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-run-openvswitch\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.628370 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621461 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f50399f-0464-42ab-a086-28fe26616279-ovn-node-metrics-cert\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.628370 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621497 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqh6r\" (UniqueName: \"kubernetes.io/projected/40e3ecd3-e42e-46d6-858c-ca3c21710c7a-kube-api-access-vqh6r\") pod \"network-metrics-daemon-qx7rr\" (UID: \"40e3ecd3-e42e-46d6-858c-ca3c21710c7a\") " pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:17.628370 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621525 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/406ca369-0b72-422d-a5eb-e2a40a07a0e9-iptables-alerter-script\") pod \"iptables-alerter-gdwbp\" (UID: \"406ca369-0b72-422d-a5eb-e2a40a07a0e9\") " pod="openshift-network-operator/iptables-alerter-gdwbp" Jul 06 19:07:17.628370 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621553 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-etc-kubernetes\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.628370 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621582 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-etc-systemd\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.628370 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621610 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24f3c199-698c-4a41-b391-9aa34578da40-tmp-dir\") pod \"node-resolver-gjvsc\" (UID: \"24f3c199-698c-4a41-b391-9aa34578da40\") " pod="openshift-dns/node-resolver-gjvsc" Jul 06 19:07:17.628370 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621636 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-log-socket\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.628370 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621658 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6f50399f-0464-42ab-a086-28fe26616279-ovnkube-config\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.628370 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621661 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ee733dc7-7c7b-47a0-8c61-10c35b7b9b67-device-dir\") pod \"aws-ebs-csi-driver-node-tf5gz\" (UID: \"ee733dc7-7c7b-47a0-8c61-10c35b7b9b67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" Jul 06 19:07:17.628370 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621772 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-etc-sysctl-conf\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.628370 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621820 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6877b4b-db74-4525-afab-b8cd5da25885-system-cni-dir\") pod \"multus-additional-cni-plugins-9slzb\" (UID: \"d6877b4b-db74-4525-afab-b8cd5da25885\") " pod="openshift-multus/multus-additional-cni-plugins-9slzb" Jul 06 19:07:17.628370 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621880 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-os-release\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.628370 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621927 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-host-run-netns\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.628370 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.621964 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-host-run-ovn-kubernetes\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.628370 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.622100 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-host-cni-netd\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.628370 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.622171 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-host-var-lib-cni-bin\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.628370 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.622230 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-run-openvswitch\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.629217 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.622257 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6877b4b-db74-4525-afab-b8cd5da25885-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9slzb\" (UID: \"d6877b4b-db74-4525-afab-b8cd5da25885\") " pod="openshift-multus/multus-additional-cni-plugins-9slzb" Jul 06 19:07:17.629217 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.622551 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24f3c199-698c-4a41-b391-9aa34578da40-tmp-dir\") pod \"node-resolver-gjvsc\" (UID: \"24f3c199-698c-4a41-b391-9aa34578da40\") " pod="openshift-dns/node-resolver-gjvsc" Jul 06 19:07:17.629217 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.622637 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-log-socket\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.629217 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.622558 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 19:07:17.629217 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623015 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d6877b4b-db74-4525-afab-b8cd5da25885-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9slzb\" (UID: \"d6877b4b-db74-4525-afab-b8cd5da25885\") " pod="openshift-multus/multus-additional-cni-plugins-9slzb" Jul 06 19:07:17.629217 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623059 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-node-log\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.629217 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623064 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/24f3c199-698c-4a41-b391-9aa34578da40-hosts-file\") pod \"node-resolver-gjvsc\" (UID: \"24f3c199-698c-4a41-b391-9aa34578da40\") " pod="openshift-dns/node-resolver-gjvsc" Jul 06 19:07:17.629217 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623108 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-run-systemd\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.629217 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623111 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-multus-socket-dir-parent\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.629217 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623150 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-etc-kubernetes\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.629217 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623339 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-sys\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.629217 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623378 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff4d48d8-20fe-4762-bd9e-9fa53deb24df-host\") pod \"node-ca-sc2cl\" (UID: \"ff4d48d8-20fe-4762-bd9e-9fa53deb24df\") " pod="openshift-image-registry/node-ca-sc2cl" Jul 06 19:07:17.629217 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623408 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ee733dc7-7c7b-47a0-8c61-10c35b7b9b67-socket-dir\") pod \"aws-ebs-csi-driver-node-tf5gz\" (UID: \"ee733dc7-7c7b-47a0-8c61-10c35b7b9b67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" Jul 06 19:07:17.629217 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623445 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-etc-sysconfig\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.629217 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623479 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-hostroot\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.629217 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623511 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kg6l\" (UniqueName: \"kubernetes.io/projected/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-kube-api-access-4kg6l\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.629217 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623539 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-var-lib-openvswitch\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.629217 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623587 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-etc-openvswitch\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.630097 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623625 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-run-ovn\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.630097 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623656 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.630097 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623664 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-multus-daemon-config\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.630097 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623683 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/06412cf4-7f2f-421a-a09b-b83409783de8-agent-certs\") pod \"konnectivity-agent-drlkn\" (UID: \"06412cf4-7f2f-421a-a09b-b83409783de8\") " pod="kube-system/konnectivity-agent-drlkn" Jul 06 19:07:17.630097 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623710 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdwfb\" (UniqueName: \"kubernetes.io/projected/406ca369-0b72-422d-a5eb-e2a40a07a0e9-kube-api-access-zdwfb\") pod \"iptables-alerter-gdwbp\" (UID: \"406ca369-0b72-422d-a5eb-e2a40a07a0e9\") " pod="openshift-network-operator/iptables-alerter-gdwbp" Jul 06 19:07:17.630097 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623715 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-var-lib-openvswitch\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.630097 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623736 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ff4d48d8-20fe-4762-bd9e-9fa53deb24df-serviceca\") pod \"node-ca-sc2cl\" (UID: \"ff4d48d8-20fe-4762-bd9e-9fa53deb24df\") " pod="openshift-image-registry/node-ca-sc2cl" Jul 06 19:07:17.630097 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623765 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-host-var-lib-kubelet\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.630097 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623773 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-run-ovn\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.630097 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623792 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-host-slash\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.630097 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623808 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-hostroot\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.630097 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623821 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6f50399f-0464-42ab-a086-28fe26616279-env-overrides\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.630097 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623848 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38637c2e-e315-4bf4-89c8-e081abdb8502-original-pull-secret\") pod \"global-pull-secret-syncer-56hnl\" (UID: \"38637c2e-e315-4bf4-89c8-e081abdb8502\") " pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:17.630097 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623909 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-var-lib-kubelet\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.630097 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623960 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-host-run-k8s-cni-cncf-io\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.630097 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.623988 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-host-var-lib-cni-multus\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.630097 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.624016 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/406ca369-0b72-422d-a5eb-e2a40a07a0e9-host-slash\") pod \"iptables-alerter-gdwbp\" (UID: \"406ca369-0b72-422d-a5eb-e2a40a07a0e9\") " pod="openshift-network-operator/iptables-alerter-gdwbp" Jul 06 19:07:17.630760 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.624044 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-etc-modprobe-d\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.630760 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.624047 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-etc-openvswitch\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.630760 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.624077 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-cni-binary-copy\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.630760 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.624102 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-host-var-lib-kubelet\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.630760 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.624106 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-host-run-netns\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.630760 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.624136 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6f50399f-0464-42ab-a086-28fe26616279-ovnkube-script-lib\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.630760 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.624139 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-host-slash\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.630760 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.624236 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77j9h\" (UniqueName: \"kubernetes.io/projected/4c53b7be-5d92-4555-a03e-37d50ecb15c4-kube-api-access-77j9h\") pod \"network-check-target-q4cm4\" (UID: \"4c53b7be-5d92-4555-a03e-37d50ecb15c4\") " pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:07:17.630760 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.624271 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ee733dc7-7c7b-47a0-8c61-10c35b7b9b67-etc-selinux\") pod \"aws-ebs-csi-driver-node-tf5gz\" (UID: \"ee733dc7-7c7b-47a0-8c61-10c35b7b9b67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" Jul 06 19:07:17.630760 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.624296 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0986e47c-3c46-4099-8ca4-d49caa7246cd-etc-tuned\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.630760 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.624323 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp7pd\" (UniqueName: \"kubernetes.io/projected/0986e47c-3c46-4099-8ca4-d49caa7246cd-kube-api-access-wp7pd\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.630760 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.624352 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-host-kubelet\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.630760 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.624381 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6877b4b-db74-4525-afab-b8cd5da25885-cni-binary-copy\") pod \"multus-additional-cni-plugins-9slzb\" (UID: \"d6877b4b-db74-4525-afab-b8cd5da25885\") " pod="openshift-multus/multus-additional-cni-plugins-9slzb" Jul 06 19:07:17.630760 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.624411 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ee733dc7-7c7b-47a0-8c61-10c35b7b9b67-registration-dir\") pod \"aws-ebs-csi-driver-node-tf5gz\" (UID: \"ee733dc7-7c7b-47a0-8c61-10c35b7b9b67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" Jul 06 19:07:17.630760 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.624489 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6f50399f-0464-42ab-a086-28fe26616279-env-overrides\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.630760 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.624494 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.630760 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.624545 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-host-run-netns\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.631506 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.624581 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f50399f-0464-42ab-a086-28fe26616279-host-kubelet\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.631506 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.625045 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6877b4b-db74-4525-afab-b8cd5da25885-cni-binary-copy\") pod \"multus-additional-cni-plugins-9slzb\" (UID: \"d6877b4b-db74-4525-afab-b8cd5da25885\") " pod="openshift-multus/multus-additional-cni-plugins-9slzb" Jul 06 19:07:17.631506 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.625045 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6f50399f-0464-42ab-a086-28fe26616279-ovnkube-script-lib\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.631506 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.625093 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-host-run-k8s-cni-cncf-io\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.631506 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.625155 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-host-var-lib-cni-multus\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.631506 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.625646 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-cni-binary-copy\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.631506 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.630133 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f50399f-0464-42ab-a086-28fe26616279-ovn-node-metrics-cert\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.653717 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.652283 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5w7x\" (UniqueName: \"kubernetes.io/projected/d6877b4b-db74-4525-afab-b8cd5da25885-kube-api-access-b5w7x\") pod \"multus-additional-cni-plugins-9slzb\" (UID: \"d6877b4b-db74-4525-afab-b8cd5da25885\") " pod="openshift-multus/multus-additional-cni-plugins-9slzb" Jul 06 19:07:17.653717 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.652963 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-29.ec2.internal" event={"ID":"8d3790303dbdd7a7168052dca674a531","Type":"ContainerStarted","Data":"03e243c0f5c03096613ccf2227c03d9687639283162862bef6dff05d8fa1b1fe"} Jul 06 19:07:17.654930 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.654873 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kg6l\" (UniqueName: \"kubernetes.io/projected/78e35a02-e9a1-4f86-b9b2-c6b68912f3a0-kube-api-access-4kg6l\") pod \"multus-slbwt\" (UID: \"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0\") " pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.656248 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.656103 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-29.ec2.internal" event={"ID":"b229ed7c47b8bbc40f36104a81e67543","Type":"ContainerStarted","Data":"eee44b2a1e1d7b49315482a52a24469062378102627e1766df665273140b83ea"} Jul 06 19:07:17.656455 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.656430 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4hzs\" (UniqueName: \"kubernetes.io/projected/24f3c199-698c-4a41-b391-9aa34578da40-kube-api-access-g4hzs\") pod \"node-resolver-gjvsc\" (UID: \"24f3c199-698c-4a41-b391-9aa34578da40\") " pod="openshift-dns/node-resolver-gjvsc" Jul 06 19:07:17.657805 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.657781 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkxgk\" (UniqueName: \"kubernetes.io/projected/6f50399f-0464-42ab-a086-28fe26616279-kube-api-access-kkxgk\") pod \"ovnkube-node-mxfxf\" (UID: \"6f50399f-0464-42ab-a086-28fe26616279\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.725832 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.725789 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkmh2\" (UniqueName: \"kubernetes.io/projected/ff4d48d8-20fe-4762-bd9e-9fa53deb24df-kube-api-access-nkmh2\") pod \"node-ca-sc2cl\" (UID: \"ff4d48d8-20fe-4762-bd9e-9fa53deb24df\") " pod="openshift-image-registry/node-ca-sc2cl" Jul 06 19:07:17.725832 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.725841 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ee733dc7-7c7b-47a0-8c61-10c35b7b9b67-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tf5gz\" (UID: \"ee733dc7-7c7b-47a0-8c61-10c35b7b9b67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" Jul 06 19:07:17.726082 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.725895 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/38637c2e-e315-4bf4-89c8-e081abdb8502-kubelet-config\") pod \"global-pull-secret-syncer-56hnl\" (UID: \"38637c2e-e315-4bf4-89c8-e081abdb8502\") " pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:17.726082 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.725928 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqh6r\" (UniqueName: \"kubernetes.io/projected/40e3ecd3-e42e-46d6-858c-ca3c21710c7a-kube-api-access-vqh6r\") pod \"network-metrics-daemon-qx7rr\" (UID: \"40e3ecd3-e42e-46d6-858c-ca3c21710c7a\") " pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:17.726082 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.725957 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/406ca369-0b72-422d-a5eb-e2a40a07a0e9-iptables-alerter-script\") pod \"iptables-alerter-gdwbp\" (UID: \"406ca369-0b72-422d-a5eb-e2a40a07a0e9\") " pod="openshift-network-operator/iptables-alerter-gdwbp" Jul 06 19:07:17.726082 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.725982 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-etc-kubernetes\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.726082 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726007 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-etc-systemd\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.726082 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726023 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/38637c2e-e315-4bf4-89c8-e081abdb8502-kubelet-config\") pod \"global-pull-secret-syncer-56hnl\" (UID: \"38637c2e-e315-4bf4-89c8-e081abdb8502\") " pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:17.726082 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726027 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ee733dc7-7c7b-47a0-8c61-10c35b7b9b67-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tf5gz\" (UID: \"ee733dc7-7c7b-47a0-8c61-10c35b7b9b67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" Jul 06 19:07:17.726082 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726032 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ee733dc7-7c7b-47a0-8c61-10c35b7b9b67-device-dir\") pod \"aws-ebs-csi-driver-node-tf5gz\" (UID: \"ee733dc7-7c7b-47a0-8c61-10c35b7b9b67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" Jul 06 19:07:17.726563 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726091 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ee733dc7-7c7b-47a0-8c61-10c35b7b9b67-device-dir\") pod \"aws-ebs-csi-driver-node-tf5gz\" (UID: \"ee733dc7-7c7b-47a0-8c61-10c35b7b9b67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" Jul 06 19:07:17.726563 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726107 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-etc-systemd\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.726563 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726116 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-etc-kubernetes\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.726563 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726150 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-etc-sysctl-conf\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.726563 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726177 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-sys\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.726563 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726201 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff4d48d8-20fe-4762-bd9e-9fa53deb24df-host\") pod \"node-ca-sc2cl\" (UID: \"ff4d48d8-20fe-4762-bd9e-9fa53deb24df\") " pod="openshift-image-registry/node-ca-sc2cl" Jul 06 19:07:17.726563 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726229 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ee733dc7-7c7b-47a0-8c61-10c35b7b9b67-socket-dir\") pod \"aws-ebs-csi-driver-node-tf5gz\" (UID: \"ee733dc7-7c7b-47a0-8c61-10c35b7b9b67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" Jul 06 19:07:17.726563 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726252 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-etc-sysconfig\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.726563 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726284 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/06412cf4-7f2f-421a-a09b-b83409783de8-agent-certs\") pod \"konnectivity-agent-drlkn\" (UID: \"06412cf4-7f2f-421a-a09b-b83409783de8\") " pod="kube-system/konnectivity-agent-drlkn" Jul 06 19:07:17.726563 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726284 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-etc-sysctl-conf\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.726563 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726253 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-sys\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.726563 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726282 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff4d48d8-20fe-4762-bd9e-9fa53deb24df-host\") pod \"node-ca-sc2cl\" (UID: \"ff4d48d8-20fe-4762-bd9e-9fa53deb24df\") " pod="openshift-image-registry/node-ca-sc2cl" Jul 06 19:07:17.726563 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726335 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-etc-sysconfig\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.726563 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726366 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdwfb\" (UniqueName: \"kubernetes.io/projected/406ca369-0b72-422d-a5eb-e2a40a07a0e9-kube-api-access-zdwfb\") pod \"iptables-alerter-gdwbp\" (UID: \"406ca369-0b72-422d-a5eb-e2a40a07a0e9\") " pod="openshift-network-operator/iptables-alerter-gdwbp" Jul 06 19:07:17.726563 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726375 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ee733dc7-7c7b-47a0-8c61-10c35b7b9b67-socket-dir\") pod \"aws-ebs-csi-driver-node-tf5gz\" (UID: \"ee733dc7-7c7b-47a0-8c61-10c35b7b9b67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" Jul 06 19:07:17.726563 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726393 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ff4d48d8-20fe-4762-bd9e-9fa53deb24df-serviceca\") pod \"node-ca-sc2cl\" (UID: \"ff4d48d8-20fe-4762-bd9e-9fa53deb24df\") " pod="openshift-image-registry/node-ca-sc2cl" Jul 06 19:07:17.726563 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726475 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38637c2e-e315-4bf4-89c8-e081abdb8502-original-pull-secret\") pod \"global-pull-secret-syncer-56hnl\" (UID: \"38637c2e-e315-4bf4-89c8-e081abdb8502\") " pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:17.726563 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726522 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-var-lib-kubelet\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.727454 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726552 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/406ca369-0b72-422d-a5eb-e2a40a07a0e9-host-slash\") pod \"iptables-alerter-gdwbp\" (UID: \"406ca369-0b72-422d-a5eb-e2a40a07a0e9\") " pod="openshift-network-operator/iptables-alerter-gdwbp" Jul 06 19:07:17.727454 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726581 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-etc-modprobe-d\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.727454 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726631 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77j9h\" (UniqueName: \"kubernetes.io/projected/4c53b7be-5d92-4555-a03e-37d50ecb15c4-kube-api-access-77j9h\") pod \"network-check-target-q4cm4\" (UID: \"4c53b7be-5d92-4555-a03e-37d50ecb15c4\") " pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:07:17.727454 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726658 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ee733dc7-7c7b-47a0-8c61-10c35b7b9b67-etc-selinux\") pod \"aws-ebs-csi-driver-node-tf5gz\" (UID: \"ee733dc7-7c7b-47a0-8c61-10c35b7b9b67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" Jul 06 19:07:17.727454 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726682 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0986e47c-3c46-4099-8ca4-d49caa7246cd-etc-tuned\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.727454 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726701 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/406ca369-0b72-422d-a5eb-e2a40a07a0e9-iptables-alerter-script\") pod \"iptables-alerter-gdwbp\" (UID: \"406ca369-0b72-422d-a5eb-e2a40a07a0e9\") " pod="openshift-network-operator/iptables-alerter-gdwbp" Jul 06 19:07:17.727454 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:17.726709 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:07:17.727454 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726709 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp7pd\" (UniqueName: \"kubernetes.io/projected/0986e47c-3c46-4099-8ca4-d49caa7246cd-kube-api-access-wp7pd\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.727454 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726632 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-var-lib-kubelet\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.727454 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726752 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ee733dc7-7c7b-47a0-8c61-10c35b7b9b67-registration-dir\") pod \"aws-ebs-csi-driver-node-tf5gz\" (UID: \"ee733dc7-7c7b-47a0-8c61-10c35b7b9b67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" Jul 06 19:07:17.727454 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726786 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-etc-sysctl-d\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.727454 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726832 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ff4d48d8-20fe-4762-bd9e-9fa53deb24df-serviceca\") pod \"node-ca-sc2cl\" (UID: \"ff4d48d8-20fe-4762-bd9e-9fa53deb24df\") " pod="openshift-image-registry/node-ca-sc2cl" Jul 06 19:07:17.727454 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:17.726838 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38637c2e-e315-4bf4-89c8-e081abdb8502-original-pull-secret podName:38637c2e-e315-4bf4-89c8-e081abdb8502 nodeName:}" failed. No retries permitted until 2026-07-06 19:07:18.22681648 +0000 UTC m=+3.081902050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38637c2e-e315-4bf4-89c8-e081abdb8502-original-pull-secret") pod "global-pull-secret-syncer-56hnl" (UID: "38637c2e-e315-4bf4-89c8-e081abdb8502") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:07:17.727454 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726871 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/38637c2e-e315-4bf4-89c8-e081abdb8502-dbus\") pod \"global-pull-secret-syncer-56hnl\" (UID: \"38637c2e-e315-4bf4-89c8-e081abdb8502\") " pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:17.727454 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726857 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ee733dc7-7c7b-47a0-8c61-10c35b7b9b67-etc-selinux\") pod \"aws-ebs-csi-driver-node-tf5gz\" (UID: \"ee733dc7-7c7b-47a0-8c61-10c35b7b9b67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" Jul 06 19:07:17.727454 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726894 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/06412cf4-7f2f-421a-a09b-b83409783de8-konnectivity-ca\") pod \"konnectivity-agent-drlkn\" (UID: \"06412cf4-7f2f-421a-a09b-b83409783de8\") " pod="kube-system/konnectivity-agent-drlkn" Jul 06 19:07:17.727454 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726932 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-lib-modules\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.728335 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726985 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-etc-sysctl-d\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.728335 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.727064 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ee733dc7-7c7b-47a0-8c61-10c35b7b9b67-registration-dir\") pod \"aws-ebs-csi-driver-node-tf5gz\" (UID: \"ee733dc7-7c7b-47a0-8c61-10c35b7b9b67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" Jul 06 19:07:17.728335 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.727080 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/406ca369-0b72-422d-a5eb-e2a40a07a0e9-host-slash\") pod \"iptables-alerter-gdwbp\" (UID: \"406ca369-0b72-422d-a5eb-e2a40a07a0e9\") " pod="openshift-network-operator/iptables-alerter-gdwbp" Jul 06 19:07:17.728335 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.727189 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/38637c2e-e315-4bf4-89c8-e081abdb8502-dbus\") pod \"global-pull-secret-syncer-56hnl\" (UID: \"38637c2e-e315-4bf4-89c8-e081abdb8502\") " pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:17.728335 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.727210 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-etc-modprobe-d\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.728335 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.727343 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-lib-modules\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.728335 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.727417 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-host\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.728335 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.726948 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-host\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.728335 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.727511 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40e3ecd3-e42e-46d6-858c-ca3c21710c7a-metrics-certs\") pod \"network-metrics-daemon-qx7rr\" (UID: \"40e3ecd3-e42e-46d6-858c-ca3c21710c7a\") " pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:17.728335 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.727536 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-run\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.728335 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.727576 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh25l\" (UniqueName: \"kubernetes.io/projected/ee733dc7-7c7b-47a0-8c61-10c35b7b9b67-kube-api-access-rh25l\") pod \"aws-ebs-csi-driver-node-tf5gz\" (UID: \"ee733dc7-7c7b-47a0-8c61-10c35b7b9b67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" Jul 06 19:07:17.728335 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.727608 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ee733dc7-7c7b-47a0-8c61-10c35b7b9b67-sys-fs\") pod \"aws-ebs-csi-driver-node-tf5gz\" (UID: \"ee733dc7-7c7b-47a0-8c61-10c35b7b9b67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" Jul 06 19:07:17.728335 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:17.727628 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:07:17.728335 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.727642 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0986e47c-3c46-4099-8ca4-d49caa7246cd-tmp\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.728335 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:17.727736 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40e3ecd3-e42e-46d6-858c-ca3c21710c7a-metrics-certs podName:40e3ecd3-e42e-46d6-858c-ca3c21710c7a nodeName:}" failed. No retries permitted until 2026-07-06 19:07:18.22771013 +0000 UTC m=+3.082795715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40e3ecd3-e42e-46d6-858c-ca3c21710c7a-metrics-certs") pod "network-metrics-daemon-qx7rr" (UID: "40e3ecd3-e42e-46d6-858c-ca3c21710c7a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:07:17.728335 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.727749 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ee733dc7-7c7b-47a0-8c61-10c35b7b9b67-sys-fs\") pod \"aws-ebs-csi-driver-node-tf5gz\" (UID: \"ee733dc7-7c7b-47a0-8c61-10c35b7b9b67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" Jul 06 19:07:17.728335 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.727774 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/06412cf4-7f2f-421a-a09b-b83409783de8-konnectivity-ca\") pod \"konnectivity-agent-drlkn\" (UID: \"06412cf4-7f2f-421a-a09b-b83409783de8\") " pod="kube-system/konnectivity-agent-drlkn" Jul 06 19:07:17.729098 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.727792 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0986e47c-3c46-4099-8ca4-d49caa7246cd-run\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.730165 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.730138 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0986e47c-3c46-4099-8ca4-d49caa7246cd-etc-tuned\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.730305 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.730180 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0986e47c-3c46-4099-8ca4-d49caa7246cd-tmp\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.730480 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.730450 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/06412cf4-7f2f-421a-a09b-b83409783de8-agent-certs\") pod \"konnectivity-agent-drlkn\" (UID: \"06412cf4-7f2f-421a-a09b-b83409783de8\") " pod="kube-system/konnectivity-agent-drlkn" Jul 06 19:07:17.762306 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:17.762218 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:07:17.762306 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:17.762249 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:07:17.762306 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:17.762264 2578 projected.go:196] Error preparing data for projected volume kube-api-access-77j9h for pod openshift-network-diagnostics/network-check-target-q4cm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:07:17.762544 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:17.762338 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c53b7be-5d92-4555-a03e-37d50ecb15c4-kube-api-access-77j9h podName:4c53b7be-5d92-4555-a03e-37d50ecb15c4 nodeName:}" failed. No retries permitted until 2026-07-06 19:07:18.262321707 +0000 UTC m=+3.117407273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-77j9h" (UniqueName: "kubernetes.io/projected/4c53b7be-5d92-4555-a03e-37d50ecb15c4-kube-api-access-77j9h") pod "network-check-target-q4cm4" (UID: "4c53b7be-5d92-4555-a03e-37d50ecb15c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:07:17.769480 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.769449 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqh6r\" (UniqueName: \"kubernetes.io/projected/40e3ecd3-e42e-46d6-858c-ca3c21710c7a-kube-api-access-vqh6r\") pod \"network-metrics-daemon-qx7rr\" (UID: \"40e3ecd3-e42e-46d6-858c-ca3c21710c7a\") " pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:17.769822 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.769778 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkmh2\" (UniqueName: \"kubernetes.io/projected/ff4d48d8-20fe-4762-bd9e-9fa53deb24df-kube-api-access-nkmh2\") pod \"node-ca-sc2cl\" (UID: \"ff4d48d8-20fe-4762-bd9e-9fa53deb24df\") " pod="openshift-image-registry/node-ca-sc2cl" Jul 06 19:07:17.771243 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.771036 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdwfb\" (UniqueName: \"kubernetes.io/projected/406ca369-0b72-422d-a5eb-e2a40a07a0e9-kube-api-access-zdwfb\") pod \"iptables-alerter-gdwbp\" (UID: \"406ca369-0b72-422d-a5eb-e2a40a07a0e9\") " pod="openshift-network-operator/iptables-alerter-gdwbp" Jul 06 19:07:17.771243 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.771148 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh25l\" (UniqueName: \"kubernetes.io/projected/ee733dc7-7c7b-47a0-8c61-10c35b7b9b67-kube-api-access-rh25l\") pod \"aws-ebs-csi-driver-node-tf5gz\" (UID: \"ee733dc7-7c7b-47a0-8c61-10c35b7b9b67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" Jul 06 19:07:17.771668 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.771639 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp7pd\" (UniqueName: \"kubernetes.io/projected/0986e47c-3c46-4099-8ca4-d49caa7246cd-kube-api-access-wp7pd\") pod \"tuned-wh7f8\" (UID: \"0986e47c-3c46-4099-8ca4-d49caa7246cd\") " pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.805979 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.803167 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:07:17.818468 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.818437 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:17.828083 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.828056 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9slzb" Jul 06 19:07:17.839053 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.839027 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gjvsc" Jul 06 19:07:17.855570 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.855543 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-slbwt" Jul 06 19:07:17.865213 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.865180 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-drlkn" Jul 06 19:07:17.874106 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.874087 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gdwbp" Jul 06 19:07:17.882856 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.882830 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" Jul 06 19:07:17.891610 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.891589 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" Jul 06 19:07:17.898443 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:17.898418 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sc2cl" Jul 06 19:07:18.231147 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:18.231052 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38637c2e-e315-4bf4-89c8-e081abdb8502-original-pull-secret\") pod \"global-pull-secret-syncer-56hnl\" (UID: \"38637c2e-e315-4bf4-89c8-e081abdb8502\") " pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:18.231337 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:18.231225 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:07:18.231337 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:18.231239 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40e3ecd3-e42e-46d6-858c-ca3c21710c7a-metrics-certs\") pod \"network-metrics-daemon-qx7rr\" (UID: \"40e3ecd3-e42e-46d6-858c-ca3c21710c7a\") " pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:18.231337 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:18.231297 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38637c2e-e315-4bf4-89c8-e081abdb8502-original-pull-secret podName:38637c2e-e315-4bf4-89c8-e081abdb8502 nodeName:}" failed. No retries permitted until 2026-07-06 19:07:19.231274965 +0000 UTC m=+4.086360530 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38637c2e-e315-4bf4-89c8-e081abdb8502-original-pull-secret") pod "global-pull-secret-syncer-56hnl" (UID: "38637c2e-e315-4bf4-89c8-e081abdb8502") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:07:18.231497 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:18.231356 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:07:18.231497 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:18.231423 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40e3ecd3-e42e-46d6-858c-ca3c21710c7a-metrics-certs podName:40e3ecd3-e42e-46d6-858c-ca3c21710c7a nodeName:}" failed. No retries permitted until 2026-07-06 19:07:19.231406058 +0000 UTC m=+4.086491631 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40e3ecd3-e42e-46d6-858c-ca3c21710c7a-metrics-certs") pod "network-metrics-daemon-qx7rr" (UID: "40e3ecd3-e42e-46d6-858c-ca3c21710c7a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:07:18.332230 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:18.332189 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77j9h\" (UniqueName: \"kubernetes.io/projected/4c53b7be-5d92-4555-a03e-37d50ecb15c4-kube-api-access-77j9h\") pod \"network-check-target-q4cm4\" (UID: \"4c53b7be-5d92-4555-a03e-37d50ecb15c4\") " pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:07:18.332407 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:18.332385 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:07:18.332453 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:18.332408 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:07:18.332453 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:18.332425 2578 projected.go:196] Error preparing data for projected volume kube-api-access-77j9h for pod openshift-network-diagnostics/network-check-target-q4cm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:07:18.332533 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:18.332488 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c53b7be-5d92-4555-a03e-37d50ecb15c4-kube-api-access-77j9h podName:4c53b7be-5d92-4555-a03e-37d50ecb15c4 nodeName:}" failed. No retries permitted until 2026-07-06 19:07:19.332473227 +0000 UTC m=+4.187558797 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-77j9h" (UniqueName: "kubernetes.io/projected/4c53b7be-5d92-4555-a03e-37d50ecb15c4-kube-api-access-77j9h") pod "network-check-target-q4cm4" (UID: "4c53b7be-5d92-4555-a03e-37d50ecb15c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:07:18.578865 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:18.578758 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:02:18 +0000 UTC" deadline="2028-02-16 01:03:36.771806223 +0000 UTC" Jul 06 19:07:18.578865 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:18.578787 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14141h56m18.193022683s" Jul 06 19:07:18.829727 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:18.829597 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78e35a02_e9a1_4f86_b9b2_c6b68912f3a0.slice/crio-450fc212cbb4787d8dea89715475596b02e4ad7803b729ad74e770554988ae7e WatchSource:0}: Error finding container 450fc212cbb4787d8dea89715475596b02e4ad7803b729ad74e770554988ae7e: Status 404 returned error can't find the container with id 450fc212cbb4787d8dea89715475596b02e4ad7803b729ad74e770554988ae7e Jul 06 19:07:18.831209 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:18.831165 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6877b4b_db74_4525_afab_b8cd5da25885.slice/crio-0e03a5423d5d17b699b58b49d18afffdf65598f833ac1b9ead4e62548a866ecb WatchSource:0}: Error finding container 0e03a5423d5d17b699b58b49d18afffdf65598f833ac1b9ead4e62548a866ecb: Status 404 returned error can't find the container with id 0e03a5423d5d17b699b58b49d18afffdf65598f833ac1b9ead4e62548a866ecb Jul 06 19:07:18.832506 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:18.832473 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f50399f_0464_42ab_a086_28fe26616279.slice/crio-cc9ab22e4281b934ba41bc46a7c523bd5e9f5f4eb44480b03da199f1aa58c9c6 WatchSource:0}: Error finding container cc9ab22e4281b934ba41bc46a7c523bd5e9f5f4eb44480b03da199f1aa58c9c6: Status 404 returned error can't find the container with id cc9ab22e4281b934ba41bc46a7c523bd5e9f5f4eb44480b03da199f1aa58c9c6 Jul 06 19:07:18.833461 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:18.833347 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod406ca369_0b72_422d_a5eb_e2a40a07a0e9.slice/crio-4667eb56b01ec30b24daf5f5599d3ea99bd3c50009ef6f556dc772552ec09ea6 WatchSource:0}: Error finding container 4667eb56b01ec30b24daf5f5599d3ea99bd3c50009ef6f556dc772552ec09ea6: Status 404 returned error can't find the container with id 4667eb56b01ec30b24daf5f5599d3ea99bd3c50009ef6f556dc772552ec09ea6 Jul 06 19:07:18.835175 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:18.835132 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0986e47c_3c46_4099_8ca4_d49caa7246cd.slice/crio-2c6b722cc7b56a1fa5aa08e71112805a97635ab5f24ad1ee3a110e96a7719320 WatchSource:0}: Error finding container 2c6b722cc7b56a1fa5aa08e71112805a97635ab5f24ad1ee3a110e96a7719320: Status 404 returned error can't find the container with id 2c6b722cc7b56a1fa5aa08e71112805a97635ab5f24ad1ee3a110e96a7719320 Jul 06 19:07:18.838578 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:18.838509 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06412cf4_7f2f_421a_a09b_b83409783de8.slice/crio-fa56f08d34679019e6ad8d67a5158029e1acea29b57fd8a6142a27fbbdd86cae WatchSource:0}: Error finding container fa56f08d34679019e6ad8d67a5158029e1acea29b57fd8a6142a27fbbdd86cae: Status 404 returned error can't find the container with id fa56f08d34679019e6ad8d67a5158029e1acea29b57fd8a6142a27fbbdd86cae Jul 06 19:07:18.840104 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:18.839710 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff4d48d8_20fe_4762_bd9e_9fa53deb24df.slice/crio-e4d0faaaa3c8715a3722ed60ece610be20d39b2a42d6c2945a271350c709c60e WatchSource:0}: Error finding container e4d0faaaa3c8715a3722ed60ece610be20d39b2a42d6c2945a271350c709c60e: Status 404 returned error can't find the container with id e4d0faaaa3c8715a3722ed60ece610be20d39b2a42d6c2945a271350c709c60e Jul 06 19:07:19.240523 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:19.240084 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40e3ecd3-e42e-46d6-858c-ca3c21710c7a-metrics-certs\") pod \"network-metrics-daemon-qx7rr\" (UID: \"40e3ecd3-e42e-46d6-858c-ca3c21710c7a\") " pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:19.240523 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:19.240403 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:07:19.240523 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:19.240416 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38637c2e-e315-4bf4-89c8-e081abdb8502-original-pull-secret\") pod \"global-pull-secret-syncer-56hnl\" (UID: \"38637c2e-e315-4bf4-89c8-e081abdb8502\") " pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:19.240523 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:19.240490 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40e3ecd3-e42e-46d6-858c-ca3c21710c7a-metrics-certs podName:40e3ecd3-e42e-46d6-858c-ca3c21710c7a nodeName:}" failed. No retries permitted until 2026-07-06 19:07:21.240464533 +0000 UTC m=+6.095550101 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40e3ecd3-e42e-46d6-858c-ca3c21710c7a-metrics-certs") pod "network-metrics-daemon-qx7rr" (UID: "40e3ecd3-e42e-46d6-858c-ca3c21710c7a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:07:19.240910 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:19.240602 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:07:19.240910 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:19.240671 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38637c2e-e315-4bf4-89c8-e081abdb8502-original-pull-secret podName:38637c2e-e315-4bf4-89c8-e081abdb8502 nodeName:}" failed. No retries permitted until 2026-07-06 19:07:21.240653587 +0000 UTC m=+6.095739169 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38637c2e-e315-4bf4-89c8-e081abdb8502-original-pull-secret") pod "global-pull-secret-syncer-56hnl" (UID: "38637c2e-e315-4bf4-89c8-e081abdb8502") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:07:19.341203 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:19.341102 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77j9h\" (UniqueName: \"kubernetes.io/projected/4c53b7be-5d92-4555-a03e-37d50ecb15c4-kube-api-access-77j9h\") pod \"network-check-target-q4cm4\" (UID: \"4c53b7be-5d92-4555-a03e-37d50ecb15c4\") " pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:07:19.341359 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:19.341291 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:07:19.341359 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:19.341315 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:07:19.341359 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:19.341328 2578 projected.go:196] Error preparing data for projected volume kube-api-access-77j9h for pod openshift-network-diagnostics/network-check-target-q4cm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:07:19.341502 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:19.341391 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c53b7be-5d92-4555-a03e-37d50ecb15c4-kube-api-access-77j9h podName:4c53b7be-5d92-4555-a03e-37d50ecb15c4 nodeName:}" failed. No retries permitted until 2026-07-06 19:07:21.341370406 +0000 UTC m=+6.196455973 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-77j9h" (UniqueName: "kubernetes.io/projected/4c53b7be-5d92-4555-a03e-37d50ecb15c4-kube-api-access-77j9h") pod "network-check-target-q4cm4" (UID: "4c53b7be-5d92-4555-a03e-37d50ecb15c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:07:19.579645 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:19.579574 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:02:18 +0000 UTC" deadline="2028-03-03 14:34:10.839308099 +0000 UTC" Jul 06 19:07:19.579645 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:19.579642 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14539h26m51.259670192s" Jul 06 19:07:19.649536 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:19.649456 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:19.649693 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:19.649596 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56hnl" podUID="38637c2e-e315-4bf4-89c8-e081abdb8502" Jul 06 19:07:19.650044 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:19.650024 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:19.650161 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:19.650141 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx7rr" podUID="40e3ecd3-e42e-46d6-858c-ca3c21710c7a" Jul 06 19:07:19.650241 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:19.650206 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:07:19.650363 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:19.650344 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4cm4" podUID="4c53b7be-5d92-4555-a03e-37d50ecb15c4" Jul 06 19:07:19.680248 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:19.680183 2578 generic.go:356] "Generic (PLEG): container finished" podID="b229ed7c47b8bbc40f36104a81e67543" containerID="3ac67c36963cf82445852cf73a63d037b73cddd875b7bbfbcfe5d169053cb901" exitCode=0 Jul 06 19:07:19.680574 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:19.680546 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-29.ec2.internal" event={"ID":"b229ed7c47b8bbc40f36104a81e67543","Type":"ContainerDied","Data":"3ac67c36963cf82445852cf73a63d037b73cddd875b7bbfbcfe5d169053cb901"} Jul 06 19:07:19.685662 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:19.685630 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sc2cl" event={"ID":"ff4d48d8-20fe-4762-bd9e-9fa53deb24df","Type":"ContainerStarted","Data":"e4d0faaaa3c8715a3722ed60ece610be20d39b2a42d6c2945a271350c709c60e"} Jul 06 19:07:19.701287 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:19.701257 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-drlkn" event={"ID":"06412cf4-7f2f-421a-a09b-b83409783de8","Type":"ContainerStarted","Data":"fa56f08d34679019e6ad8d67a5158029e1acea29b57fd8a6142a27fbbdd86cae"} Jul 06 19:07:19.708432 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:19.708399 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-29.ec2.internal" event={"ID":"8d3790303dbdd7a7168052dca674a531","Type":"ContainerStarted","Data":"13a739379c4b058d939fd8350fcd871edaf663294d29b603c9c01b16e3dd5fea"} Jul 06 19:07:19.717560 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:19.717533 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" event={"ID":"ee733dc7-7c7b-47a0-8c61-10c35b7b9b67","Type":"ContainerStarted","Data":"b0113d4643f416c4a3873822fd4bf82822c3a0d52359c3185960efd37485d0a5"} Jul 06 19:07:19.725701 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:19.725653 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gjvsc" event={"ID":"24f3c199-698c-4a41-b391-9aa34578da40","Type":"ContainerStarted","Data":"d59f0df9885073164956d4b56de55d924410278ebd8eddc20903e1044fd2dbbf"} Jul 06 19:07:19.729572 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:19.729545 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" event={"ID":"0986e47c-3c46-4099-8ca4-d49caa7246cd","Type":"ContainerStarted","Data":"2c6b722cc7b56a1fa5aa08e71112805a97635ab5f24ad1ee3a110e96a7719320"} Jul 06 19:07:19.736275 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:19.736201 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gdwbp" event={"ID":"406ca369-0b72-422d-a5eb-e2a40a07a0e9","Type":"ContainerStarted","Data":"4667eb56b01ec30b24daf5f5599d3ea99bd3c50009ef6f556dc772552ec09ea6"} Jul 06 19:07:19.745766 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:19.745735 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" event={"ID":"6f50399f-0464-42ab-a086-28fe26616279","Type":"ContainerStarted","Data":"cc9ab22e4281b934ba41bc46a7c523bd5e9f5f4eb44480b03da199f1aa58c9c6"} Jul 06 19:07:19.755972 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:19.755941 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9slzb" event={"ID":"d6877b4b-db74-4525-afab-b8cd5da25885","Type":"ContainerStarted","Data":"0e03a5423d5d17b699b58b49d18afffdf65598f833ac1b9ead4e62548a866ecb"} Jul 06 19:07:19.769804 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:19.769722 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-slbwt" event={"ID":"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0","Type":"ContainerStarted","Data":"450fc212cbb4787d8dea89715475596b02e4ad7803b729ad74e770554988ae7e"} Jul 06 19:07:20.793518 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:20.792968 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-29.ec2.internal" event={"ID":"b229ed7c47b8bbc40f36104a81e67543","Type":"ContainerStarted","Data":"63664095ea5de7dc463322fb9e7574bbce9d22a34a25e2a7549778b5ee0da6d2"} Jul 06 19:07:20.818681 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:20.818570 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-29.ec2.internal" podStartSLOduration=3.818539167 podStartE2EDuration="3.818539167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:07:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:19.732637329 +0000 UTC m=+4.587722914" watchObservedRunningTime="2026-07-06 19:07:20.818539167 +0000 UTC m=+5.673624762" Jul 06 19:07:21.258368 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:21.258274 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38637c2e-e315-4bf4-89c8-e081abdb8502-original-pull-secret\") pod \"global-pull-secret-syncer-56hnl\" (UID: \"38637c2e-e315-4bf4-89c8-e081abdb8502\") " pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:21.258368 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:21.258356 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40e3ecd3-e42e-46d6-858c-ca3c21710c7a-metrics-certs\") pod \"network-metrics-daemon-qx7rr\" (UID: \"40e3ecd3-e42e-46d6-858c-ca3c21710c7a\") " pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:21.258616 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:21.258503 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:07:21.258616 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:21.258570 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40e3ecd3-e42e-46d6-858c-ca3c21710c7a-metrics-certs podName:40e3ecd3-e42e-46d6-858c-ca3c21710c7a nodeName:}" failed. No retries permitted until 2026-07-06 19:07:25.258550409 +0000 UTC m=+10.113635980 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40e3ecd3-e42e-46d6-858c-ca3c21710c7a-metrics-certs") pod "network-metrics-daemon-qx7rr" (UID: "40e3ecd3-e42e-46d6-858c-ca3c21710c7a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:07:21.258737 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:21.258637 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:07:21.258737 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:21.258670 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38637c2e-e315-4bf4-89c8-e081abdb8502-original-pull-secret podName:38637c2e-e315-4bf4-89c8-e081abdb8502 nodeName:}" failed. No retries permitted until 2026-07-06 19:07:25.258658743 +0000 UTC m=+10.113744315 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38637c2e-e315-4bf4-89c8-e081abdb8502-original-pull-secret") pod "global-pull-secret-syncer-56hnl" (UID: "38637c2e-e315-4bf4-89c8-e081abdb8502") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:07:21.359635 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:21.359594 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77j9h\" (UniqueName: \"kubernetes.io/projected/4c53b7be-5d92-4555-a03e-37d50ecb15c4-kube-api-access-77j9h\") pod \"network-check-target-q4cm4\" (UID: \"4c53b7be-5d92-4555-a03e-37d50ecb15c4\") " pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:07:21.359831 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:21.359811 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:07:21.359893 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:21.359835 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:07:21.359893 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:21.359849 2578 projected.go:196] Error preparing data for projected volume kube-api-access-77j9h for pod openshift-network-diagnostics/network-check-target-q4cm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:07:21.360030 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:21.359928 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c53b7be-5d92-4555-a03e-37d50ecb15c4-kube-api-access-77j9h podName:4c53b7be-5d92-4555-a03e-37d50ecb15c4 nodeName:}" failed. No retries permitted until 2026-07-06 19:07:25.359908093 +0000 UTC m=+10.214993674 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-77j9h" (UniqueName: "kubernetes.io/projected/4c53b7be-5d92-4555-a03e-37d50ecb15c4-kube-api-access-77j9h") pod "network-check-target-q4cm4" (UID: "4c53b7be-5d92-4555-a03e-37d50ecb15c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:07:21.649852 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:21.649769 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:21.650047 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:21.649904 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56hnl" podUID="38637c2e-e315-4bf4-89c8-e081abdb8502" Jul 06 19:07:21.650047 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:21.649996 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:21.650181 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:21.650097 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx7rr" podUID="40e3ecd3-e42e-46d6-858c-ca3c21710c7a" Jul 06 19:07:21.650181 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:21.650144 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:07:21.650287 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:21.650213 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4cm4" podUID="4c53b7be-5d92-4555-a03e-37d50ecb15c4" Jul 06 19:07:23.648050 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:23.647162 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:07:23.648050 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:23.647297 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4cm4" podUID="4c53b7be-5d92-4555-a03e-37d50ecb15c4" Jul 06 19:07:23.648050 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:23.647854 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:23.648050 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:23.647981 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx7rr" podUID="40e3ecd3-e42e-46d6-858c-ca3c21710c7a" Jul 06 19:07:23.648700 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:23.648133 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:23.648700 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:23.648232 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56hnl" podUID="38637c2e-e315-4bf4-89c8-e081abdb8502" Jul 06 19:07:25.292200 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:25.292161 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38637c2e-e315-4bf4-89c8-e081abdb8502-original-pull-secret\") pod \"global-pull-secret-syncer-56hnl\" (UID: \"38637c2e-e315-4bf4-89c8-e081abdb8502\") " pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:25.292655 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:25.292243 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40e3ecd3-e42e-46d6-858c-ca3c21710c7a-metrics-certs\") pod \"network-metrics-daemon-qx7rr\" (UID: \"40e3ecd3-e42e-46d6-858c-ca3c21710c7a\") " pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:25.292655 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:25.292333 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:07:25.292655 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:25.292373 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:07:25.292655 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:25.292402 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38637c2e-e315-4bf4-89c8-e081abdb8502-original-pull-secret podName:38637c2e-e315-4bf4-89c8-e081abdb8502 nodeName:}" failed. No retries permitted until 2026-07-06 19:07:33.292385831 +0000 UTC m=+18.147471396 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38637c2e-e315-4bf4-89c8-e081abdb8502-original-pull-secret") pod "global-pull-secret-syncer-56hnl" (UID: "38637c2e-e315-4bf4-89c8-e081abdb8502") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:07:25.292655 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:25.292433 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40e3ecd3-e42e-46d6-858c-ca3c21710c7a-metrics-certs podName:40e3ecd3-e42e-46d6-858c-ca3c21710c7a nodeName:}" failed. No retries permitted until 2026-07-06 19:07:33.292413777 +0000 UTC m=+18.147499347 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40e3ecd3-e42e-46d6-858c-ca3c21710c7a-metrics-certs") pod "network-metrics-daemon-qx7rr" (UID: "40e3ecd3-e42e-46d6-858c-ca3c21710c7a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:07:25.392736 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:25.392672 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77j9h\" (UniqueName: \"kubernetes.io/projected/4c53b7be-5d92-4555-a03e-37d50ecb15c4-kube-api-access-77j9h\") pod \"network-check-target-q4cm4\" (UID: \"4c53b7be-5d92-4555-a03e-37d50ecb15c4\") " pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:07:25.392948 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:25.392886 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:07:25.392948 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:25.392918 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:07:25.392948 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:25.392934 2578 projected.go:196] Error preparing data for projected volume kube-api-access-77j9h for pod openshift-network-diagnostics/network-check-target-q4cm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:07:25.393096 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:25.393036 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c53b7be-5d92-4555-a03e-37d50ecb15c4-kube-api-access-77j9h podName:4c53b7be-5d92-4555-a03e-37d50ecb15c4 nodeName:}" failed. No retries permitted until 2026-07-06 19:07:33.393015737 +0000 UTC m=+18.248101307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-77j9h" (UniqueName: "kubernetes.io/projected/4c53b7be-5d92-4555-a03e-37d50ecb15c4-kube-api-access-77j9h") pod "network-check-target-q4cm4" (UID: "4c53b7be-5d92-4555-a03e-37d50ecb15c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:07:25.647751 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:25.647665 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:25.647946 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:25.647796 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56hnl" podUID="38637c2e-e315-4bf4-89c8-e081abdb8502" Jul 06 19:07:25.648255 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:25.648195 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:25.648432 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:25.648303 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx7rr" podUID="40e3ecd3-e42e-46d6-858c-ca3c21710c7a" Jul 06 19:07:25.649427 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:25.649274 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:07:25.649427 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:25.649379 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4cm4" podUID="4c53b7be-5d92-4555-a03e-37d50ecb15c4" Jul 06 19:07:27.647034 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:27.646940 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:27.647034 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:27.646960 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:07:27.647521 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:27.647075 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56hnl" podUID="38637c2e-e315-4bf4-89c8-e081abdb8502" Jul 06 19:07:27.647521 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:27.647132 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:27.647521 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:27.647243 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx7rr" podUID="40e3ecd3-e42e-46d6-858c-ca3c21710c7a" Jul 06 19:07:27.647521 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:27.647315 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4cm4" podUID="4c53b7be-5d92-4555-a03e-37d50ecb15c4" Jul 06 19:07:29.647283 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:29.647249 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:29.647283 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:29.647282 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:29.647654 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:29.647343 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:07:29.647654 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:29.647464 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx7rr" podUID="40e3ecd3-e42e-46d6-858c-ca3c21710c7a" Jul 06 19:07:29.647654 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:29.647572 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56hnl" podUID="38637c2e-e315-4bf4-89c8-e081abdb8502" Jul 06 19:07:29.647654 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:29.647642 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4cm4" podUID="4c53b7be-5d92-4555-a03e-37d50ecb15c4" Jul 06 19:07:31.647373 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:31.647339 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:31.647899 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:31.647338 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:07:31.647899 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:31.647473 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx7rr" podUID="40e3ecd3-e42e-46d6-858c-ca3c21710c7a" Jul 06 19:07:31.647899 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:31.647343 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:31.647899 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:31.647544 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4cm4" podUID="4c53b7be-5d92-4555-a03e-37d50ecb15c4" Jul 06 19:07:31.647899 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:31.647636 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56hnl" podUID="38637c2e-e315-4bf4-89c8-e081abdb8502" Jul 06 19:07:33.352685 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:33.352663 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38637c2e-e315-4bf4-89c8-e081abdb8502-original-pull-secret\") pod \"global-pull-secret-syncer-56hnl\" (UID: \"38637c2e-e315-4bf4-89c8-e081abdb8502\") " pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:33.352981 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:33.352708 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40e3ecd3-e42e-46d6-858c-ca3c21710c7a-metrics-certs\") pod \"network-metrics-daemon-qx7rr\" (UID: \"40e3ecd3-e42e-46d6-858c-ca3c21710c7a\") " pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:33.352981 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:33.352790 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:07:33.352981 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:33.352799 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:07:33.352981 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:33.352857 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38637c2e-e315-4bf4-89c8-e081abdb8502-original-pull-secret podName:38637c2e-e315-4bf4-89c8-e081abdb8502 nodeName:}" failed. No retries permitted until 2026-07-06 19:07:49.352825967 +0000 UTC m=+34.207911534 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38637c2e-e315-4bf4-89c8-e081abdb8502-original-pull-secret") pod "global-pull-secret-syncer-56hnl" (UID: "38637c2e-e315-4bf4-89c8-e081abdb8502") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:07:33.352981 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:33.352871 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40e3ecd3-e42e-46d6-858c-ca3c21710c7a-metrics-certs podName:40e3ecd3-e42e-46d6-858c-ca3c21710c7a nodeName:}" failed. No retries permitted until 2026-07-06 19:07:49.352864475 +0000 UTC m=+34.207950038 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40e3ecd3-e42e-46d6-858c-ca3c21710c7a-metrics-certs") pod "network-metrics-daemon-qx7rr" (UID: "40e3ecd3-e42e-46d6-858c-ca3c21710c7a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:07:33.453265 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:33.453232 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77j9h\" (UniqueName: \"kubernetes.io/projected/4c53b7be-5d92-4555-a03e-37d50ecb15c4-kube-api-access-77j9h\") pod \"network-check-target-q4cm4\" (UID: \"4c53b7be-5d92-4555-a03e-37d50ecb15c4\") " pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:07:33.453413 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:33.453367 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:07:33.453413 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:33.453385 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:07:33.453413 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:33.453394 2578 projected.go:196] Error preparing data for projected volume kube-api-access-77j9h for pod openshift-network-diagnostics/network-check-target-q4cm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:07:33.453507 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:33.453439 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c53b7be-5d92-4555-a03e-37d50ecb15c4-kube-api-access-77j9h podName:4c53b7be-5d92-4555-a03e-37d50ecb15c4 nodeName:}" failed. No retries permitted until 2026-07-06 19:07:49.453426465 +0000 UTC m=+34.308512028 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-77j9h" (UniqueName: "kubernetes.io/projected/4c53b7be-5d92-4555-a03e-37d50ecb15c4-kube-api-access-77j9h") pod "network-check-target-q4cm4" (UID: "4c53b7be-5d92-4555-a03e-37d50ecb15c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:07:33.647314 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:33.647228 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:33.647314 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:33.647262 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:07:33.647526 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:33.647235 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:33.647526 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:33.647365 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56hnl" podUID="38637c2e-e315-4bf4-89c8-e081abdb8502" Jul 06 19:07:33.647526 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:33.647485 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx7rr" podUID="40e3ecd3-e42e-46d6-858c-ca3c21710c7a" Jul 06 19:07:33.647730 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:33.647551 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4cm4" podUID="4c53b7be-5d92-4555-a03e-37d50ecb15c4" Jul 06 19:07:35.648271 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:35.648218 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:35.648817 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:35.648330 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx7rr" podUID="40e3ecd3-e42e-46d6-858c-ca3c21710c7a" Jul 06 19:07:35.648817 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:35.648336 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:07:35.648817 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:35.648358 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:35.648817 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:35.648420 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4cm4" podUID="4c53b7be-5d92-4555-a03e-37d50ecb15c4" Jul 06 19:07:35.648817 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:35.648488 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56hnl" podUID="38637c2e-e315-4bf4-89c8-e081abdb8502" Jul 06 19:07:37.647347 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:37.647321 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:37.647730 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:37.647457 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56hnl" podUID="38637c2e-e315-4bf4-89c8-e081abdb8502" Jul 06 19:07:37.647730 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:37.647320 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:37.647730 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:37.647567 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx7rr" podUID="40e3ecd3-e42e-46d6-858c-ca3c21710c7a" Jul 06 19:07:37.647730 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:37.647607 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:07:37.647730 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:37.647672 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4cm4" podUID="4c53b7be-5d92-4555-a03e-37d50ecb15c4" Jul 06 19:07:37.847158 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:37.847040 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gjvsc" event={"ID":"24f3c199-698c-4a41-b391-9aa34578da40","Type":"ContainerStarted","Data":"33483c34ea3f8873a901420c61bc2c63e8e195210a1373863633036d058871a3"} Jul 06 19:07:37.848990 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:37.848860 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" event={"ID":"0986e47c-3c46-4099-8ca4-d49caa7246cd","Type":"ContainerStarted","Data":"234518f31c8a2f3d8651c2cf91cc209788ff07be53919153570e77c99c4dd9ff"} Jul 06 19:07:37.850627 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:37.850600 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" event={"ID":"6f50399f-0464-42ab-a086-28fe26616279","Type":"ContainerStarted","Data":"7a4c9ede3bc54536ea64f23e117fb37f99e61682557d23e57ddc5134a598a242"} Jul 06 19:07:37.852251 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:37.852232 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9slzb" event={"ID":"d6877b4b-db74-4525-afab-b8cd5da25885","Type":"ContainerStarted","Data":"2092528545f80ff184787567639f78d4ca6f7dddb93953ed14c70c25541f1f19"} Jul 06 19:07:37.854116 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:37.854088 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-slbwt" event={"ID":"78e35a02-e9a1-4f86-b9b2-c6b68912f3a0","Type":"ContainerStarted","Data":"9543a38d4cdcba1af9656698ba9df752521d236d333ed8acff0ee38f6e5d6fa8"} Jul 06 19:07:37.855797 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:37.855773 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sc2cl" event={"ID":"ff4d48d8-20fe-4762-bd9e-9fa53deb24df","Type":"ContainerStarted","Data":"c6baac190d48fcb84db50ac0e3160d74bfeabb86b7167a09a98eaf5b7068b2d7"} Jul 06 19:07:37.857020 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:37.857001 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-drlkn" event={"ID":"06412cf4-7f2f-421a-a09b-b83409783de8","Type":"ContainerStarted","Data":"06c23b99cfc08855cc9f7d7a5741292f5c588120c1c63db8dacfd9e141b6fd33"} Jul 06 19:07:37.858596 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:37.858576 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" event={"ID":"ee733dc7-7c7b-47a0-8c61-10c35b7b9b67","Type":"ContainerStarted","Data":"61030977942c81dfcd963edef4da2ad091773b1c7990f691aa09c7ac9353cbee"} Jul 06 19:07:37.863898 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:37.863828 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-29.ec2.internal" podStartSLOduration=20.863812601 podStartE2EDuration="20.863812601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:07:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:20.819528779 +0000 UTC m=+5.674614369" watchObservedRunningTime="2026-07-06 19:07:37.863812601 +0000 UTC m=+22.718898188" Jul 06 19:07:37.864417 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:37.864365 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gjvsc" podStartSLOduration=3.077227343 podStartE2EDuration="21.864355879s" totalImagesPullingTime="18.787128536s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:07:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:37.863767284 +0000 UTC m=+22.718852871" watchObservedRunningTime="2026-07-06 19:07:37.864355879 +0000 UTC m=+22.719441466" Jul 06 19:07:37.910735 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:37.910555 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-slbwt" podStartSLOduration=3.045506996 podStartE2EDuration="21.910538629s" totalImagesPullingTime="18.865031633s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:07:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:37.910223571 +0000 UTC m=+22.765309158" watchObservedRunningTime="2026-07-06 19:07:37.910538629 +0000 UTC m=+22.765624214" Jul 06 19:07:37.932450 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:37.932280 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-drlkn" podStartSLOduration=7.423623801 podStartE2EDuration="21.932264241s" totalImagesPullingTime="14.50864044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:07:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:37.931640919 +0000 UTC m=+22.786726506" watchObservedRunningTime="2026-07-06 19:07:37.932264241 +0000 UTC m=+22.787349826" Jul 06 19:07:37.952003 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:37.951956 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wh7f8" podStartSLOduration=3.142019643 podStartE2EDuration="21.951938926s" totalImagesPullingTime="18.809919283s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:07:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:37.951716802 +0000 UTC m=+22.806802391" watchObservedRunningTime="2026-07-06 19:07:37.951938926 +0000 UTC m=+22.807024511" Jul 06 19:07:37.976289 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:37.976240 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sc2cl" podStartSLOduration=3.190270266 podStartE2EDuration="21.976223364s" totalImagesPullingTime="18.785953098s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:07:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:37.976116573 +0000 UTC m=+22.831202159" watchObservedRunningTime="2026-07-06 19:07:37.976223364 +0000 UTC m=+22.831308950" Jul 06 19:07:38.862604 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:38.862563 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" event={"ID":"6f50399f-0464-42ab-a086-28fe26616279","Type":"ContainerStarted","Data":"df6829d6ff257ac0814d2161d99813a0edb88dfcbdb770315a7c0ee261455e2f"} Jul 06 19:07:38.863443 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:38.862665 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" event={"ID":"6f50399f-0464-42ab-a086-28fe26616279","Type":"ContainerStarted","Data":"92d49cc30aee0929a7224f7c5c3abd15f06c11b6c10a61e84596955a56ba844b"} Jul 06 19:07:38.863443 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:38.862705 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" event={"ID":"6f50399f-0464-42ab-a086-28fe26616279","Type":"ContainerStarted","Data":"902f062ed87a80852a3cb6aed6b246e78bad2dd40625d995939434f081a265b7"} Jul 06 19:07:38.863443 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:38.862733 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" event={"ID":"6f50399f-0464-42ab-a086-28fe26616279","Type":"ContainerStarted","Data":"6547a1c5293bdce064c2217a9ef3947df0d0daec169402c599dd3d5ef9ae91ef"} Jul 06 19:07:38.863443 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:38.862766 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" event={"ID":"6f50399f-0464-42ab-a086-28fe26616279","Type":"ContainerStarted","Data":"0a435ee1a5062918f65b73147f6b29212c565d2c8b93fe01df44923f4958cce2"} Jul 06 19:07:38.863931 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:38.863909 2578 generic.go:356] "Generic (PLEG): container finished" podID="d6877b4b-db74-4525-afab-b8cd5da25885" containerID="2092528545f80ff184787567639f78d4ca6f7dddb93953ed14c70c25541f1f19" exitCode=0 Jul 06 19:07:38.864010 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:38.863961 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9slzb" event={"ID":"d6877b4b-db74-4525-afab-b8cd5da25885","Type":"ContainerDied","Data":"2092528545f80ff184787567639f78d4ca6f7dddb93953ed14c70c25541f1f19"} Jul 06 19:07:39.177634 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:39.177612 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 19:07:39.579039 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:39.578855 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T19:07:39.1776299Z","UUID":"94820490-ba90-4917-abe0-2440446475e7","Handler":null,"Name":"","Endpoint":""} Jul 06 19:07:39.580647 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:39.580620 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 19:07:39.580762 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:39.580665 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 19:07:39.647086 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:39.647054 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:39.647086 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:39.647072 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:39.647086 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:39.647087 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:07:39.647384 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:39.647189 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56hnl" podUID="38637c2e-e315-4bf4-89c8-e081abdb8502" Jul 06 19:07:39.647633 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:39.647593 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4cm4" podUID="4c53b7be-5d92-4555-a03e-37d50ecb15c4" Jul 06 19:07:39.647752 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:39.647722 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx7rr" podUID="40e3ecd3-e42e-46d6-858c-ca3c21710c7a" Jul 06 19:07:39.867978 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:39.867933 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gdwbp" event={"ID":"406ca369-0b72-422d-a5eb-e2a40a07a0e9","Type":"ContainerStarted","Data":"213af066737476420bfcca75ee2ec8de06e7f0a1075f1ab028b7b9d173b14c4b"} Jul 06 19:07:39.870124 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:39.870100 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" event={"ID":"ee733dc7-7c7b-47a0-8c61-10c35b7b9b67","Type":"ContainerStarted","Data":"9f49392ae5d65e734b446386eccc88a9795cd82ef0328e42ce7e15b407d24e52"} Jul 06 19:07:39.884535 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:39.884489 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gdwbp" podStartSLOduration=5.094239881 podStartE2EDuration="23.884470781s" totalImagesPullingTime="18.7902309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:07:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:39.884227548 +0000 UTC m=+24.739313137" watchObservedRunningTime="2026-07-06 19:07:39.884470781 +0000 UTC m=+24.739556366" Jul 06 19:07:40.874567 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:40.874522 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" event={"ID":"ee733dc7-7c7b-47a0-8c61-10c35b7b9b67","Type":"ContainerStarted","Data":"9e335ef15a2583f75aba841e1bbc1328236ceb9b2853d0061b518b1a8a56d21b"} Jul 06 19:07:40.878274 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:40.878239 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" event={"ID":"6f50399f-0464-42ab-a086-28fe26616279","Type":"ContainerStarted","Data":"71c2abeb1caa486defa3a4ea478f3f1312acc340d895421becc37f511e900595"} Jul 06 19:07:40.900068 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:40.900013 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tf5gz" podStartSLOduration=3.833748386 podStartE2EDuration="24.899993872s" totalImagesPullingTime="21.066245486s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:07:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:40.899418853 +0000 UTC m=+25.754504443" watchObservedRunningTime="2026-07-06 19:07:40.899993872 +0000 UTC m=+25.755079455" Jul 06 19:07:41.647466 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:41.647437 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:41.647466 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:41.647487 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:07:41.647716 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:41.647513 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:41.647716 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:41.647566 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4cm4" podUID="4c53b7be-5d92-4555-a03e-37d50ecb15c4" Jul 06 19:07:41.647716 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:41.647624 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx7rr" podUID="40e3ecd3-e42e-46d6-858c-ca3c21710c7a" Jul 06 19:07:41.647897 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:41.647715 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56hnl" podUID="38637c2e-e315-4bf4-89c8-e081abdb8502" Jul 06 19:07:42.723411 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:42.723122 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-drlkn" Jul 06 19:07:42.723831 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:42.723817 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-drlkn" Jul 06 19:07:42.882741 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:42.882715 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-drlkn" Jul 06 19:07:42.883248 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:42.883230 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-drlkn" Jul 06 19:07:43.647552 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:43.647355 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:43.647717 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:43.647354 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:43.647717 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:43.647384 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:07:43.647717 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:43.647643 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56hnl" podUID="38637c2e-e315-4bf4-89c8-e081abdb8502" Jul 06 19:07:43.647918 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:43.647752 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4cm4" podUID="4c53b7be-5d92-4555-a03e-37d50ecb15c4" Jul 06 19:07:43.647918 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:43.647818 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx7rr" podUID="40e3ecd3-e42e-46d6-858c-ca3c21710c7a" Jul 06 19:07:43.888059 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:43.888026 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" event={"ID":"6f50399f-0464-42ab-a086-28fe26616279","Type":"ContainerStarted","Data":"1305c2c767ba7cf01f157e424598fa961c890f660d044380fe24caea593bb3ee"} Jul 06 19:07:43.888986 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:43.888249 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:43.889899 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:43.889873 2578 generic.go:356] "Generic (PLEG): container finished" podID="d6877b4b-db74-4525-afab-b8cd5da25885" containerID="6f1f31d9aabd9ed106148048b789c13a524bb01c658041a1cedd833013f22159" exitCode=0 Jul 06 19:07:43.890033 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:43.889949 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9slzb" event={"ID":"d6877b4b-db74-4525-afab-b8cd5da25885","Type":"ContainerDied","Data":"6f1f31d9aabd9ed106148048b789c13a524bb01c658041a1cedd833013f22159"} Jul 06 19:07:43.904789 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:43.904720 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:43.921110 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:43.919942 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" podStartSLOduration=9.052683146 podStartE2EDuration="27.919914128s" totalImagesPullingTime="18.867230982s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:07:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:43.918173972 +0000 UTC m=+28.773259558" watchObservedRunningTime="2026-07-06 19:07:43.919914128 +0000 UTC m=+28.774999718" Jul 06 19:07:44.892230 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:44.892201 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 19:07:44.892719 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:44.892432 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:44.907204 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:44.907178 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:45.174122 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:45.174040 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-56hnl"] Jul 06 19:07:45.174301 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:45.174196 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:45.174378 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:45.174317 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56hnl" podUID="38637c2e-e315-4bf4-89c8-e081abdb8502" Jul 06 19:07:45.174827 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:45.174804 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q4cm4"] Jul 06 19:07:45.174956 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:45.174901 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:07:45.175019 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:45.174964 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4cm4" podUID="4c53b7be-5d92-4555-a03e-37d50ecb15c4" Jul 06 19:07:45.180118 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:45.180098 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qx7rr"] Jul 06 19:07:45.180204 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:45.180179 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:45.180272 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:45.180254 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx7rr" podUID="40e3ecd3-e42e-46d6-858c-ca3c21710c7a" Jul 06 19:07:45.895869 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:45.895812 2578 generic.go:356] "Generic (PLEG): container finished" podID="d6877b4b-db74-4525-afab-b8cd5da25885" containerID="6aacbd93eb83bb3a470a3af6075e2561b126ab51190156a7b0f281120e439332" exitCode=0 Jul 06 19:07:45.896265 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:45.895902 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9slzb" event={"ID":"d6877b4b-db74-4525-afab-b8cd5da25885","Type":"ContainerDied","Data":"6aacbd93eb83bb3a470a3af6075e2561b126ab51190156a7b0f281120e439332"} Jul 06 19:07:45.896265 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:45.896010 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 19:07:46.647604 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:46.647574 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:07:46.647741 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:46.647680 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4cm4" podUID="4c53b7be-5d92-4555-a03e-37d50ecb15c4" Jul 06 19:07:46.899526 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:46.899440 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 19:07:47.224539 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:47.224505 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:07:47.647314 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:47.647281 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:47.647487 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:47.647393 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx7rr" podUID="40e3ecd3-e42e-46d6-858c-ca3c21710c7a" Jul 06 19:07:47.647487 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:47.647457 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:47.647593 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:47.647571 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56hnl" podUID="38637c2e-e315-4bf4-89c8-e081abdb8502" Jul 06 19:07:47.903588 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:47.903508 2578 generic.go:356] "Generic (PLEG): container finished" podID="d6877b4b-db74-4525-afab-b8cd5da25885" containerID="2b98487ec8b6ce814113d46eba0c0e67a296fc763b4d7e7dea7ee72d74914bfa" exitCode=0 Jul 06 19:07:47.903588 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:47.903572 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9slzb" event={"ID":"d6877b4b-db74-4525-afab-b8cd5da25885","Type":"ContainerDied","Data":"2b98487ec8b6ce814113d46eba0c0e67a296fc763b4d7e7dea7ee72d74914bfa"} Jul 06 19:07:48.646823 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:48.646788 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:07:48.646995 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:48.646907 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4cm4" podUID="4c53b7be-5d92-4555-a03e-37d50ecb15c4" Jul 06 19:07:49.380940 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:49.380722 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38637c2e-e315-4bf4-89c8-e081abdb8502-original-pull-secret\") pod \"global-pull-secret-syncer-56hnl\" (UID: \"38637c2e-e315-4bf4-89c8-e081abdb8502\") " pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:49.381357 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:49.380987 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40e3ecd3-e42e-46d6-858c-ca3c21710c7a-metrics-certs\") pod \"network-metrics-daemon-qx7rr\" (UID: \"40e3ecd3-e42e-46d6-858c-ca3c21710c7a\") " pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:49.381357 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:49.380883 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:07:49.381357 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:49.381077 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38637c2e-e315-4bf4-89c8-e081abdb8502-original-pull-secret podName:38637c2e-e315-4bf4-89c8-e081abdb8502 nodeName:}" failed. No retries permitted until 2026-07-06 19:08:21.381056978 +0000 UTC m=+66.236142557 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38637c2e-e315-4bf4-89c8-e081abdb8502-original-pull-secret") pod "global-pull-secret-syncer-56hnl" (UID: "38637c2e-e315-4bf4-89c8-e081abdb8502") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:07:49.381357 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:49.381106 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:07:49.381357 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:49.381149 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40e3ecd3-e42e-46d6-858c-ca3c21710c7a-metrics-certs podName:40e3ecd3-e42e-46d6-858c-ca3c21710c7a nodeName:}" failed. No retries permitted until 2026-07-06 19:08:21.381137719 +0000 UTC m=+66.236223283 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40e3ecd3-e42e-46d6-858c-ca3c21710c7a-metrics-certs") pod "network-metrics-daemon-qx7rr" (UID: "40e3ecd3-e42e-46d6-858c-ca3c21710c7a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:07:49.481609 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:49.481573 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77j9h\" (UniqueName: \"kubernetes.io/projected/4c53b7be-5d92-4555-a03e-37d50ecb15c4-kube-api-access-77j9h\") pod \"network-check-target-q4cm4\" (UID: \"4c53b7be-5d92-4555-a03e-37d50ecb15c4\") " pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:07:49.481789 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:49.481698 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:07:49.481789 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:49.481714 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:07:49.481789 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:49.481723 2578 projected.go:196] Error preparing data for projected volume kube-api-access-77j9h for pod openshift-network-diagnostics/network-check-target-q4cm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:07:49.481789 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:49.481771 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c53b7be-5d92-4555-a03e-37d50ecb15c4-kube-api-access-77j9h podName:4c53b7be-5d92-4555-a03e-37d50ecb15c4 nodeName:}" failed. No retries permitted until 2026-07-06 19:08:21.481758682 +0000 UTC m=+66.336844247 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-77j9h" (UniqueName: "kubernetes.io/projected/4c53b7be-5d92-4555-a03e-37d50ecb15c4-kube-api-access-77j9h") pod "network-check-target-q4cm4" (UID: "4c53b7be-5d92-4555-a03e-37d50ecb15c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:07:49.646927 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:49.646855 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:49.647089 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:49.646855 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:49.647089 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:49.646973 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qx7rr" podUID="40e3ecd3-e42e-46d6-858c-ca3c21710c7a" Jul 06 19:07:49.647089 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:49.647059 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56hnl" podUID="38637c2e-e315-4bf4-89c8-e081abdb8502" Jul 06 19:07:50.409545 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.409471 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-29.ec2.internal" event="NodeReady" Jul 06 19:07:50.409919 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.409592 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 19:07:50.463342 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.463316 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57484589cb-nlmd5"] Jul 06 19:07:50.465141 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.465122 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:50.468121 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.468097 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 19:07:50.468121 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.468113 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qrn75\"" Jul 06 19:07:50.470644 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.470601 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 19:07:50.470777 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.470688 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 19:07:50.487262 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.487238 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 19:07:50.493166 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.493146 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57484589cb-nlmd5"] Jul 06 19:07:50.523853 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.523808 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-q24rz"] Jul 06 19:07:50.525657 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.525635 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-q24rz" Jul 06 19:07:50.528415 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.528396 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 19:07:50.534651 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.531169 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jlcxl\"" Jul 06 19:07:50.534651 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.531288 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 19:07:50.534651 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.531526 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 19:07:50.555016 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.554991 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-r9h8k"] Jul 06 19:07:50.556580 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.556566 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r9h8k" Jul 06 19:07:50.559435 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.559420 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 19:07:50.559682 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.559670 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-59swk\"" Jul 06 19:07:50.571153 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.571134 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-q24rz"] Jul 06 19:07:50.576879 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.576808 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r9h8k"] Jul 06 19:07:50.588448 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.588427 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 19:07:50.592082 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.592063 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-tls\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:50.592156 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.592091 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-bound-sa-token\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:50.592156 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.592111 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23d26b44-20fe-4f81-9812-a92ebc94e3e1-ca-trust-extracted\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:50.592156 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.592130 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23d26b44-20fe-4f81-9812-a92ebc94e3e1-trusted-ca\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:50.592265 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.592233 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23d26b44-20fe-4f81-9812-a92ebc94e3e1-image-registry-private-configuration\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:50.592265 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.592256 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-certificates\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:50.592356 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.592274 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23d26b44-20fe-4f81-9812-a92ebc94e3e1-installation-pull-secrets\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:50.592356 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.592289 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jqhb\" (UniqueName: \"kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-kube-api-access-4jqhb\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:50.646785 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.646760 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:07:50.655601 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.655582 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bf7v6\"" Jul 06 19:07:50.655712 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.655582 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 19:07:50.655712 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.655607 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 19:07:50.693288 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.693208 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23d26b44-20fe-4f81-9812-a92ebc94e3e1-ca-trust-extracted\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:50.693288 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.693253 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b9e40546-7e20-4cba-858a-cb9a0635815c-config-volume\") pod \"dns-default-r9h8k\" (UID: \"b9e40546-7e20-4cba-858a-cb9a0635815c\") " pod="openshift-dns/dns-default-r9h8k" Jul 06 19:07:50.693288 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.693288 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23d26b44-20fe-4f81-9812-a92ebc94e3e1-trusted-ca\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:50.693523 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.693328 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9e40546-7e20-4cba-858a-cb9a0635815c-tmp-dir\") pod \"dns-default-r9h8k\" (UID: \"b9e40546-7e20-4cba-858a-cb9a0635815c\") " pod="openshift-dns/dns-default-r9h8k" Jul 06 19:07:50.693523 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.693356 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdcwx\" (UniqueName: \"kubernetes.io/projected/58497cf0-3338-4a5f-9d84-898a69488e36-kube-api-access-tdcwx\") pod \"ingress-canary-q24rz\" (UID: \"58497cf0-3338-4a5f-9d84-898a69488e36\") " pod="openshift-ingress-canary/ingress-canary-q24rz" Jul 06 19:07:50.693523 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.693406 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23d26b44-20fe-4f81-9812-a92ebc94e3e1-image-registry-private-configuration\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:50.693523 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.693429 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-certificates\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:50.693523 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.693454 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23d26b44-20fe-4f81-9812-a92ebc94e3e1-installation-pull-secrets\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:50.693523 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.693479 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jqhb\" (UniqueName: \"kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-kube-api-access-4jqhb\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:50.693803 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.693542 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9e40546-7e20-4cba-858a-cb9a0635815c-metrics-tls\") pod \"dns-default-r9h8k\" (UID: \"b9e40546-7e20-4cba-858a-cb9a0635815c\") " pod="openshift-dns/dns-default-r9h8k" Jul 06 19:07:50.693803 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.693581 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq9kn\" (UniqueName: \"kubernetes.io/projected/b9e40546-7e20-4cba-858a-cb9a0635815c-kube-api-access-wq9kn\") pod \"dns-default-r9h8k\" (UID: \"b9e40546-7e20-4cba-858a-cb9a0635815c\") " pod="openshift-dns/dns-default-r9h8k" Jul 06 19:07:50.693803 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.693636 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58497cf0-3338-4a5f-9d84-898a69488e36-cert\") pod \"ingress-canary-q24rz\" (UID: \"58497cf0-3338-4a5f-9d84-898a69488e36\") " pod="openshift-ingress-canary/ingress-canary-q24rz" Jul 06 19:07:50.693803 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.693653 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23d26b44-20fe-4f81-9812-a92ebc94e3e1-ca-trust-extracted\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:50.693803 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.693687 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-tls\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:50.693803 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.693714 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-bound-sa-token\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:50.694093 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:50.693944 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:07:50.694093 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:50.693963 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57484589cb-nlmd5: secret "image-registry-tls" not found Jul 06 19:07:50.694093 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:50.694027 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-tls podName:23d26b44-20fe-4f81-9812-a92ebc94e3e1 nodeName:}" failed. No retries permitted until 2026-07-06 19:07:51.194006593 +0000 UTC m=+36.049092170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-tls") pod "image-registry-57484589cb-nlmd5" (UID: "23d26b44-20fe-4f81-9812-a92ebc94e3e1") : secret "image-registry-tls" not found Jul 06 19:07:50.694238 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.694214 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-certificates\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:50.694808 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.694785 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23d26b44-20fe-4f81-9812-a92ebc94e3e1-trusted-ca\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:50.697962 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.697942 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23d26b44-20fe-4f81-9812-a92ebc94e3e1-image-registry-private-configuration\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:50.698038 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.697966 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23d26b44-20fe-4f81-9812-a92ebc94e3e1-installation-pull-secrets\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:50.708113 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.708091 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-bound-sa-token\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:50.708302 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.708284 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jqhb\" (UniqueName: \"kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-kube-api-access-4jqhb\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:50.794990 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.794959 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9e40546-7e20-4cba-858a-cb9a0635815c-metrics-tls\") pod \"dns-default-r9h8k\" (UID: \"b9e40546-7e20-4cba-858a-cb9a0635815c\") " pod="openshift-dns/dns-default-r9h8k" Jul 06 19:07:50.794990 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.794993 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq9kn\" (UniqueName: \"kubernetes.io/projected/b9e40546-7e20-4cba-858a-cb9a0635815c-kube-api-access-wq9kn\") pod \"dns-default-r9h8k\" (UID: \"b9e40546-7e20-4cba-858a-cb9a0635815c\") " pod="openshift-dns/dns-default-r9h8k" Jul 06 19:07:50.795224 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.795015 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58497cf0-3338-4a5f-9d84-898a69488e36-cert\") pod \"ingress-canary-q24rz\" (UID: \"58497cf0-3338-4a5f-9d84-898a69488e36\") " pod="openshift-ingress-canary/ingress-canary-q24rz" Jul 06 19:07:50.795224 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.795064 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b9e40546-7e20-4cba-858a-cb9a0635815c-config-volume\") pod \"dns-default-r9h8k\" (UID: \"b9e40546-7e20-4cba-858a-cb9a0635815c\") " pod="openshift-dns/dns-default-r9h8k" Jul 06 19:07:50.795224 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.795110 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9e40546-7e20-4cba-858a-cb9a0635815c-tmp-dir\") pod \"dns-default-r9h8k\" (UID: \"b9e40546-7e20-4cba-858a-cb9a0635815c\") " pod="openshift-dns/dns-default-r9h8k" Jul 06 19:07:50.795224 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:50.795114 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:07:50.795224 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:50.795175 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9e40546-7e20-4cba-858a-cb9a0635815c-metrics-tls podName:b9e40546-7e20-4cba-858a-cb9a0635815c nodeName:}" failed. No retries permitted until 2026-07-06 19:07:51.295155737 +0000 UTC m=+36.150241310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9e40546-7e20-4cba-858a-cb9a0635815c-metrics-tls") pod "dns-default-r9h8k" (UID: "b9e40546-7e20-4cba-858a-cb9a0635815c") : secret "dns-default-metrics-tls" not found Jul 06 19:07:50.795473 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.795295 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdcwx\" (UniqueName: \"kubernetes.io/projected/58497cf0-3338-4a5f-9d84-898a69488e36-kube-api-access-tdcwx\") pod \"ingress-canary-q24rz\" (UID: \"58497cf0-3338-4a5f-9d84-898a69488e36\") " pod="openshift-ingress-canary/ingress-canary-q24rz" Jul 06 19:07:50.795473 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.795413 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9e40546-7e20-4cba-858a-cb9a0635815c-tmp-dir\") pod \"dns-default-r9h8k\" (UID: \"b9e40546-7e20-4cba-858a-cb9a0635815c\") " pod="openshift-dns/dns-default-r9h8k" Jul 06 19:07:50.795790 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.795753 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b9e40546-7e20-4cba-858a-cb9a0635815c-config-volume\") pod \"dns-default-r9h8k\" (UID: \"b9e40546-7e20-4cba-858a-cb9a0635815c\") " pod="openshift-dns/dns-default-r9h8k" Jul 06 19:07:50.797586 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.797566 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58497cf0-3338-4a5f-9d84-898a69488e36-cert\") pod \"ingress-canary-q24rz\" (UID: \"58497cf0-3338-4a5f-9d84-898a69488e36\") " pod="openshift-ingress-canary/ingress-canary-q24rz" Jul 06 19:07:50.810664 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.810637 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq9kn\" (UniqueName: \"kubernetes.io/projected/b9e40546-7e20-4cba-858a-cb9a0635815c-kube-api-access-wq9kn\") pod \"dns-default-r9h8k\" (UID: \"b9e40546-7e20-4cba-858a-cb9a0635815c\") " pod="openshift-dns/dns-default-r9h8k" Jul 06 19:07:50.815588 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.815572 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdcwx\" (UniqueName: \"kubernetes.io/projected/58497cf0-3338-4a5f-9d84-898a69488e36-kube-api-access-tdcwx\") pod \"ingress-canary-q24rz\" (UID: \"58497cf0-3338-4a5f-9d84-898a69488e36\") " pod="openshift-ingress-canary/ingress-canary-q24rz" Jul 06 19:07:50.836848 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.836825 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-q24rz" Jul 06 19:07:50.840453 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.840410 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:50.950387 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.950309 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:50.989648 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:50.989620 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-q24rz"] Jul 06 19:07:50.993704 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:50.993681 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58497cf0_3338_4a5f_9d84_898a69488e36.slice/crio-4969b654717e1f7d28f976eab9e09d3f9285e506ef2364ee5f52708d96ce3210 WatchSource:0}: Error finding container 4969b654717e1f7d28f976eab9e09d3f9285e506ef2364ee5f52708d96ce3210: Status 404 returned error can't find the container with id 4969b654717e1f7d28f976eab9e09d3f9285e506ef2364ee5f52708d96ce3210 Jul 06 19:07:51.199041 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:51.198995 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-tls\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:51.199213 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:51.199151 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:07:51.199213 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:51.199172 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57484589cb-nlmd5: secret "image-registry-tls" not found Jul 06 19:07:51.199302 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:51.199229 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-tls podName:23d26b44-20fe-4f81-9812-a92ebc94e3e1 nodeName:}" failed. No retries permitted until 2026-07-06 19:07:52.199211306 +0000 UTC m=+37.054296890 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-tls") pod "image-registry-57484589cb-nlmd5" (UID: "23d26b44-20fe-4f81-9812-a92ebc94e3e1") : secret "image-registry-tls" not found Jul 06 19:07:51.300010 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:51.299927 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9e40546-7e20-4cba-858a-cb9a0635815c-metrics-tls\") pod \"dns-default-r9h8k\" (UID: \"b9e40546-7e20-4cba-858a-cb9a0635815c\") " pod="openshift-dns/dns-default-r9h8k" Jul 06 19:07:51.300167 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:51.300109 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:07:51.300222 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:51.300185 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9e40546-7e20-4cba-858a-cb9a0635815c-metrics-tls podName:b9e40546-7e20-4cba-858a-cb9a0635815c nodeName:}" failed. No retries permitted until 2026-07-06 19:07:52.300164223 +0000 UTC m=+37.155249791 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9e40546-7e20-4cba-858a-cb9a0635815c-metrics-tls") pod "dns-default-r9h8k" (UID: "b9e40546-7e20-4cba-858a-cb9a0635815c") : secret "dns-default-metrics-tls" not found Jul 06 19:07:51.647137 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:51.647102 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:07:51.648041 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:51.647155 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:07:51.653056 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:51.653033 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kvrq8\"" Jul 06 19:07:51.653701 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:51.653678 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 19:07:51.653809 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:51.653684 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 19:07:51.915499 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:51.915417 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-q24rz" event={"ID":"58497cf0-3338-4a5f-9d84-898a69488e36","Type":"ContainerStarted","Data":"4969b654717e1f7d28f976eab9e09d3f9285e506ef2364ee5f52708d96ce3210"} Jul 06 19:07:52.208576 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:52.208492 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-tls\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:52.208736 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:52.208606 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:07:52.208736 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:52.208622 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57484589cb-nlmd5: secret "image-registry-tls" not found Jul 06 19:07:52.208736 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:52.208670 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-tls podName:23d26b44-20fe-4f81-9812-a92ebc94e3e1 nodeName:}" failed. No retries permitted until 2026-07-06 19:07:54.208658026 +0000 UTC m=+39.063743593 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-tls") pod "image-registry-57484589cb-nlmd5" (UID: "23d26b44-20fe-4f81-9812-a92ebc94e3e1") : secret "image-registry-tls" not found Jul 06 19:07:52.309702 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:52.309662 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9e40546-7e20-4cba-858a-cb9a0635815c-metrics-tls\") pod \"dns-default-r9h8k\" (UID: \"b9e40546-7e20-4cba-858a-cb9a0635815c\") " pod="openshift-dns/dns-default-r9h8k" Jul 06 19:07:52.309900 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:52.309808 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:07:52.309900 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:52.309888 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9e40546-7e20-4cba-858a-cb9a0635815c-metrics-tls podName:b9e40546-7e20-4cba-858a-cb9a0635815c nodeName:}" failed. No retries permitted until 2026-07-06 19:07:54.309869826 +0000 UTC m=+39.164955390 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9e40546-7e20-4cba-858a-cb9a0635815c-metrics-tls") pod "dns-default-r9h8k" (UID: "b9e40546-7e20-4cba-858a-cb9a0635815c") : secret "dns-default-metrics-tls" not found Jul 06 19:07:52.700357 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:52.700139 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:52.802455 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:52.802423 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:52.911865 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:52.911804 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:53.513725 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:53.513661 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:53.601298 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:53.601269 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:53.709303 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:53.709267 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:53.802769 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:53.802652 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:53.906786 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:53.906741 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:54.223546 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:54.223515 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-tls\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:54.223717 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:54.223681 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:07:54.223717 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:54.223704 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57484589cb-nlmd5: secret "image-registry-tls" not found Jul 06 19:07:54.223828 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:54.223777 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-tls podName:23d26b44-20fe-4f81-9812-a92ebc94e3e1 nodeName:}" failed. No retries permitted until 2026-07-06 19:07:58.223755478 +0000 UTC m=+43.078841060 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-tls") pod "image-registry-57484589cb-nlmd5" (UID: "23d26b44-20fe-4f81-9812-a92ebc94e3e1") : secret "image-registry-tls" not found Jul 06 19:07:54.324369 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:54.324328 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9e40546-7e20-4cba-858a-cb9a0635815c-metrics-tls\") pod \"dns-default-r9h8k\" (UID: \"b9e40546-7e20-4cba-858a-cb9a0635815c\") " pod="openshift-dns/dns-default-r9h8k" Jul 06 19:07:54.324514 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:54.324488 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:07:54.324575 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:54.324565 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9e40546-7e20-4cba-858a-cb9a0635815c-metrics-tls podName:b9e40546-7e20-4cba-858a-cb9a0635815c nodeName:}" failed. No retries permitted until 2026-07-06 19:07:58.324544347 +0000 UTC m=+43.179629928 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9e40546-7e20-4cba-858a-cb9a0635815c-metrics-tls") pod "dns-default-r9h8k" (UID: "b9e40546-7e20-4cba-858a-cb9a0635815c") : secret "dns-default-metrics-tls" not found Jul 06 19:07:54.927381 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:54.927337 2578 generic.go:356] "Generic (PLEG): container finished" podID="d6877b4b-db74-4525-afab-b8cd5da25885" containerID="49b264ecb1cc7781d8489125f577746ae6673e921e86864c870f795e91bbcf75" exitCode=0 Jul 06 19:07:54.927869 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:54.927420 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9slzb" event={"ID":"d6877b4b-db74-4525-afab-b8cd5da25885","Type":"ContainerDied","Data":"49b264ecb1cc7781d8489125f577746ae6673e921e86864c870f795e91bbcf75"} Jul 06 19:07:54.929032 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:54.929007 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-q24rz" event={"ID":"58497cf0-3338-4a5f-9d84-898a69488e36","Type":"ContainerStarted","Data":"ad3733bd13113680e192c42800574534d6aab460eaa6a763e2f1f1153605837a"} Jul 06 19:07:54.969268 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:54.969220 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:55.087570 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:55.087531 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:55.934526 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:55.934493 2578 generic.go:356] "Generic (PLEG): container finished" podID="d6877b4b-db74-4525-afab-b8cd5da25885" containerID="f3334f13ade22668038d36dac2f7d3b69a1c1563ec796cc81f4638211cada7fd" exitCode=0 Jul 06 19:07:55.934926 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:55.934568 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9slzb" event={"ID":"d6877b4b-db74-4525-afab-b8cd5da25885","Type":"ContainerDied","Data":"f3334f13ade22668038d36dac2f7d3b69a1c1563ec796cc81f4638211cada7fd"} Jul 06 19:07:55.965853 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:55.965791 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-q24rz" podStartSLOduration=2.325437714 podStartE2EDuration="5.965771592s" totalImagesPullingTime="3.640333878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:54.977592559 +0000 UTC m=+39.832678144" watchObservedRunningTime="2026-07-06 19:07:55.965771592 +0000 UTC m=+40.820857180" Jul 06 19:07:56.445857 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.445815 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-p7q47"] Jul 06 19:07:56.467928 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.467897 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-72ztj"] Jul 06 19:07:56.468059 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.468028 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-p7q47" Jul 06 19:07:56.470916 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.470890 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-rrdv4\"" Jul 06 19:07:56.486610 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.486588 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85k7k"] Jul 06 19:07:56.486728 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.486705 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-72ztj" Jul 06 19:07:56.491221 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.490202 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 06 19:07:56.491221 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.490123 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 06 19:07:56.491475 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.491434 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:07:56.491724 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.491648 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pvztv\"" Jul 06 19:07:56.506533 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.506512 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-v2klg"] Jul 06 19:07:56.506651 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.506636 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85k7k" Jul 06 19:07:56.516914 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.516890 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 19:07:56.517071 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.517054 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 19:07:56.517629 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.517491 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 06 19:07:56.517629 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.517515 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lns9g\"" Jul 06 19:07:56.517629 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.517545 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 06 19:07:56.525307 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.525290 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7d89958d75-2chxs"] Jul 06 19:07:56.525422 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.525407 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-v2klg" Jul 06 19:07:56.529035 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.529016 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 06 19:07:56.529140 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.529088 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 19:07:56.529208 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.529196 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-jdbzp\"" Jul 06 19:07:56.529474 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.529459 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 06 19:07:56.529553 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.529460 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 19:07:56.536044 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.536028 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 06 19:07:56.538876 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.538856 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edde0b2e-410b-4d1e-86c6-c927402a1c83-tmp\") pod \"insights-operator-5c847dcfc4-v2klg\" (UID: \"edde0b2e-410b-4d1e-86c6-c927402a1c83\") " pod="openshift-insights/insights-operator-5c847dcfc4-v2klg" Jul 06 19:07:56.538954 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.538887 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edde0b2e-410b-4d1e-86c6-c927402a1c83-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-v2klg\" (UID: \"edde0b2e-410b-4d1e-86c6-c927402a1c83\") " pod="openshift-insights/insights-operator-5c847dcfc4-v2klg" Jul 06 19:07:56.538954 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.538906 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edde0b2e-410b-4d1e-86c6-c927402a1c83-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-v2klg\" (UID: \"edde0b2e-410b-4d1e-86c6-c927402a1c83\") " pod="openshift-insights/insights-operator-5c847dcfc4-v2klg" Jul 06 19:07:56.538954 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.538922 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/edde0b2e-410b-4d1e-86c6-c927402a1c83-serving-cert\") pod \"insights-operator-5c847dcfc4-v2klg\" (UID: \"edde0b2e-410b-4d1e-86c6-c927402a1c83\") " pod="openshift-insights/insights-operator-5c847dcfc4-v2klg" Jul 06 19:07:56.538954 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.538937 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq8fx\" (UniqueName: \"kubernetes.io/projected/49397d03-e891-4f65-bcc3-a17b8302ae95-kube-api-access-qq8fx\") pod \"cluster-monitoring-operator-64786d9cbb-85k7k\" (UID: \"49397d03-e891-4f65-bcc3-a17b8302ae95\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85k7k" Jul 06 19:07:56.539112 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.538987 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/edde0b2e-410b-4d1e-86c6-c927402a1c83-snapshots\") pod \"insights-operator-5c847dcfc4-v2klg\" (UID: \"edde0b2e-410b-4d1e-86c6-c927402a1c83\") " pod="openshift-insights/insights-operator-5c847dcfc4-v2klg" Jul 06 19:07:56.539112 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.539005 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0a419c56-3132-4f19-a6d6-f745864cb51a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-72ztj\" (UID: \"0a419c56-3132-4f19-a6d6-f745864cb51a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-72ztj" Jul 06 19:07:56.539112 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.539026 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/49397d03-e891-4f65-bcc3-a17b8302ae95-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-85k7k\" (UID: \"49397d03-e891-4f65-bcc3-a17b8302ae95\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85k7k" Jul 06 19:07:56.539112 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.539064 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqqth\" (UniqueName: \"kubernetes.io/projected/0a419c56-3132-4f19-a6d6-f745864cb51a-kube-api-access-hqqth\") pod \"cluster-samples-operator-56fcf86bf-72ztj\" (UID: \"0a419c56-3132-4f19-a6d6-f745864cb51a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-72ztj" Jul 06 19:07:56.539112 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.539095 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdwcn\" (UniqueName: \"kubernetes.io/projected/288531d2-d4e0-4d19-b849-c30d8faf6a12-kube-api-access-fdwcn\") pod \"network-check-source-989f8b8dc-p7q47\" (UID: \"288531d2-d4e0-4d19-b849-c30d8faf6a12\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-p7q47" Jul 06 19:07:56.539251 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.539133 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cccft\" (UniqueName: \"kubernetes.io/projected/edde0b2e-410b-4d1e-86c6-c927402a1c83-kube-api-access-cccft\") pod \"insights-operator-5c847dcfc4-v2klg\" (UID: \"edde0b2e-410b-4d1e-86c6-c927402a1c83\") " pod="openshift-insights/insights-operator-5c847dcfc4-v2klg" Jul 06 19:07:56.539251 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.539155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49397d03-e891-4f65-bcc3-a17b8302ae95-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-85k7k\" (UID: \"49397d03-e891-4f65-bcc3-a17b8302ae95\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85k7k" Jul 06 19:07:56.542278 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.542260 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-p7q47"] Jul 06 19:07:56.542354 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.542287 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85k7k"] Jul 06 19:07:56.542354 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.542301 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-v2klg"] Jul 06 19:07:56.542354 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.542315 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-72ztj"] Jul 06 19:07:56.542354 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.542335 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7d89958d75-2chxs"] Jul 06 19:07:56.542502 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.542390 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:07:56.547678 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.547646 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 06 19:07:56.548014 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.547993 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 19:07:56.548105 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.548002 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 06 19:07:56.548178 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.548104 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-sw4bq\"" Jul 06 19:07:56.548178 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.548003 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 06 19:07:56.548340 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.548323 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 06 19:07:56.548579 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.548558 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zfhbl"] Jul 06 19:07:56.548661 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.548639 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 19:07:56.568407 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.568389 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zfhbl"] Jul 06 19:07:56.568506 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.568464 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zfhbl" Jul 06 19:07:56.571832 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.571810 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:07:56.571832 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.571818 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-c5wxw\"" Jul 06 19:07:56.571999 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.571853 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 06 19:07:56.640289 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.640254 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49397d03-e891-4f65-bcc3-a17b8302ae95-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-85k7k\" (UID: \"49397d03-e891-4f65-bcc3-a17b8302ae95\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85k7k" Jul 06 19:07:56.640456 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.640333 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8btkq\" (UniqueName: \"kubernetes.io/projected/e70f9aa5-7890-4e6e-8a24-74323e9bc819-kube-api-access-8btkq\") pod \"volume-data-source-validator-5d456fdbcd-zfhbl\" (UID: \"e70f9aa5-7890-4e6e-8a24-74323e9bc819\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zfhbl" Jul 06 19:07:56.640456 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.640366 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/517eef3e-b288-4ece-83c5-10ecf912d99d-metrics-certs\") pod \"router-default-7d89958d75-2chxs\" (UID: \"517eef3e-b288-4ece-83c5-10ecf912d99d\") " pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:07:56.640456 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:56.640404 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 19:07:56.640773 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:56.640458 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49397d03-e891-4f65-bcc3-a17b8302ae95-cluster-monitoring-operator-tls podName:49397d03-e891-4f65-bcc3-a17b8302ae95 nodeName:}" failed. No retries permitted until 2026-07-06 19:07:57.140443255 +0000 UTC m=+41.995528822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/49397d03-e891-4f65-bcc3-a17b8302ae95-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-85k7k" (UID: "49397d03-e891-4f65-bcc3-a17b8302ae95") : secret "cluster-monitoring-operator-tls" not found Jul 06 19:07:56.640773 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.640408 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/49397d03-e891-4f65-bcc3-a17b8302ae95-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-85k7k\" (UID: \"49397d03-e891-4f65-bcc3-a17b8302ae95\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85k7k" Jul 06 19:07:56.640773 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.640547 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqqth\" (UniqueName: \"kubernetes.io/projected/0a419c56-3132-4f19-a6d6-f745864cb51a-kube-api-access-hqqth\") pod \"cluster-samples-operator-56fcf86bf-72ztj\" (UID: \"0a419c56-3132-4f19-a6d6-f745864cb51a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-72ztj" Jul 06 19:07:56.640773 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.640722 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/517eef3e-b288-4ece-83c5-10ecf912d99d-stats-auth\") pod \"router-default-7d89958d75-2chxs\" (UID: \"517eef3e-b288-4ece-83c5-10ecf912d99d\") " pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:07:56.641016 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.640855 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdwcn\" (UniqueName: \"kubernetes.io/projected/288531d2-d4e0-4d19-b849-c30d8faf6a12-kube-api-access-fdwcn\") pod \"network-check-source-989f8b8dc-p7q47\" (UID: \"288531d2-d4e0-4d19-b849-c30d8faf6a12\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-p7q47" Jul 06 19:07:56.641016 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.640893 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xxqf\" (UniqueName: \"kubernetes.io/projected/517eef3e-b288-4ece-83c5-10ecf912d99d-kube-api-access-4xxqf\") pod \"router-default-7d89958d75-2chxs\" (UID: \"517eef3e-b288-4ece-83c5-10ecf912d99d\") " pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:07:56.641016 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.640933 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cccft\" (UniqueName: \"kubernetes.io/projected/edde0b2e-410b-4d1e-86c6-c927402a1c83-kube-api-access-cccft\") pod \"insights-operator-5c847dcfc4-v2klg\" (UID: \"edde0b2e-410b-4d1e-86c6-c927402a1c83\") " pod="openshift-insights/insights-operator-5c847dcfc4-v2klg" Jul 06 19:07:56.641016 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.640973 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/517eef3e-b288-4ece-83c5-10ecf912d99d-default-certificate\") pod \"router-default-7d89958d75-2chxs\" (UID: \"517eef3e-b288-4ece-83c5-10ecf912d99d\") " pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:07:56.641016 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.641009 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edde0b2e-410b-4d1e-86c6-c927402a1c83-tmp\") pod \"insights-operator-5c847dcfc4-v2klg\" (UID: \"edde0b2e-410b-4d1e-86c6-c927402a1c83\") " pod="openshift-insights/insights-operator-5c847dcfc4-v2klg" Jul 06 19:07:56.641248 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.641035 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edde0b2e-410b-4d1e-86c6-c927402a1c83-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-v2klg\" (UID: \"edde0b2e-410b-4d1e-86c6-c927402a1c83\") " pod="openshift-insights/insights-operator-5c847dcfc4-v2klg" Jul 06 19:07:56.641248 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.641082 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edde0b2e-410b-4d1e-86c6-c927402a1c83-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-v2klg\" (UID: \"edde0b2e-410b-4d1e-86c6-c927402a1c83\") " pod="openshift-insights/insights-operator-5c847dcfc4-v2klg" Jul 06 19:07:56.641248 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.641109 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq8fx\" (UniqueName: \"kubernetes.io/projected/49397d03-e891-4f65-bcc3-a17b8302ae95-kube-api-access-qq8fx\") pod \"cluster-monitoring-operator-64786d9cbb-85k7k\" (UID: \"49397d03-e891-4f65-bcc3-a17b8302ae95\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85k7k" Jul 06 19:07:56.641248 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.641142 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/edde0b2e-410b-4d1e-86c6-c927402a1c83-serving-cert\") pod \"insights-operator-5c847dcfc4-v2klg\" (UID: \"edde0b2e-410b-4d1e-86c6-c927402a1c83\") " pod="openshift-insights/insights-operator-5c847dcfc4-v2klg" Jul 06 19:07:56.641248 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.641173 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/edde0b2e-410b-4d1e-86c6-c927402a1c83-snapshots\") pod \"insights-operator-5c847dcfc4-v2klg\" (UID: \"edde0b2e-410b-4d1e-86c6-c927402a1c83\") " pod="openshift-insights/insights-operator-5c847dcfc4-v2klg" Jul 06 19:07:56.641248 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.641175 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/49397d03-e891-4f65-bcc3-a17b8302ae95-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-85k7k\" (UID: \"49397d03-e891-4f65-bcc3-a17b8302ae95\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85k7k" Jul 06 19:07:56.641248 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.641236 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0a419c56-3132-4f19-a6d6-f745864cb51a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-72ztj\" (UID: \"0a419c56-3132-4f19-a6d6-f745864cb51a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-72ztj" Jul 06 19:07:56.641595 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.641264 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/517eef3e-b288-4ece-83c5-10ecf912d99d-service-ca-bundle\") pod \"router-default-7d89958d75-2chxs\" (UID: \"517eef3e-b288-4ece-83c5-10ecf912d99d\") " pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:07:56.641595 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.641342 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edde0b2e-410b-4d1e-86c6-c927402a1c83-tmp\") pod \"insights-operator-5c847dcfc4-v2klg\" (UID: \"edde0b2e-410b-4d1e-86c6-c927402a1c83\") " pod="openshift-insights/insights-operator-5c847dcfc4-v2klg" Jul 06 19:07:56.641595 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:56.641347 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:07:56.641595 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:56.641395 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a419c56-3132-4f19-a6d6-f745864cb51a-samples-operator-tls podName:0a419c56-3132-4f19-a6d6-f745864cb51a nodeName:}" failed. No retries permitted until 2026-07-06 19:07:57.1413833 +0000 UTC m=+41.996468867 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0a419c56-3132-4f19-a6d6-f745864cb51a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-72ztj" (UID: "0a419c56-3132-4f19-a6d6-f745864cb51a") : secret "samples-operator-tls" not found Jul 06 19:07:56.641765 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.641666 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edde0b2e-410b-4d1e-86c6-c927402a1c83-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-v2klg\" (UID: \"edde0b2e-410b-4d1e-86c6-c927402a1c83\") " pod="openshift-insights/insights-operator-5c847dcfc4-v2klg" Jul 06 19:07:56.641817 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.641773 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/edde0b2e-410b-4d1e-86c6-c927402a1c83-snapshots\") pod \"insights-operator-5c847dcfc4-v2klg\" (UID: \"edde0b2e-410b-4d1e-86c6-c927402a1c83\") " pod="openshift-insights/insights-operator-5c847dcfc4-v2klg" Jul 06 19:07:56.641902 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.641882 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edde0b2e-410b-4d1e-86c6-c927402a1c83-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-v2klg\" (UID: \"edde0b2e-410b-4d1e-86c6-c927402a1c83\") " pod="openshift-insights/insights-operator-5c847dcfc4-v2klg" Jul 06 19:07:56.645005 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.644983 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/edde0b2e-410b-4d1e-86c6-c927402a1c83-serving-cert\") pod \"insights-operator-5c847dcfc4-v2klg\" (UID: \"edde0b2e-410b-4d1e-86c6-c927402a1c83\") " pod="openshift-insights/insights-operator-5c847dcfc4-v2klg" Jul 06 19:07:56.645437 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.645422 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9nlp9"] Jul 06 19:07:56.660510 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.660486 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqqth\" (UniqueName: \"kubernetes.io/projected/0a419c56-3132-4f19-a6d6-f745864cb51a-kube-api-access-hqqth\") pod \"cluster-samples-operator-56fcf86bf-72ztj\" (UID: \"0a419c56-3132-4f19-a6d6-f745864cb51a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-72ztj" Jul 06 19:07:56.666729 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.666699 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdwcn\" (UniqueName: \"kubernetes.io/projected/288531d2-d4e0-4d19-b849-c30d8faf6a12-kube-api-access-fdwcn\") pod \"network-check-source-989f8b8dc-p7q47\" (UID: \"288531d2-d4e0-4d19-b849-c30d8faf6a12\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-p7q47" Jul 06 19:07:56.666856 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.666816 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cccft\" (UniqueName: \"kubernetes.io/projected/edde0b2e-410b-4d1e-86c6-c927402a1c83-kube-api-access-cccft\") pod \"insights-operator-5c847dcfc4-v2klg\" (UID: \"edde0b2e-410b-4d1e-86c6-c927402a1c83\") " pod="openshift-insights/insights-operator-5c847dcfc4-v2klg" Jul 06 19:07:56.666914 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.666853 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq8fx\" (UniqueName: \"kubernetes.io/projected/49397d03-e891-4f65-bcc3-a17b8302ae95-kube-api-access-qq8fx\") pod \"cluster-monitoring-operator-64786d9cbb-85k7k\" (UID: \"49397d03-e891-4f65-bcc3-a17b8302ae95\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85k7k" Jul 06 19:07:56.676202 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.676183 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-hcl4d"] Jul 06 19:07:56.676338 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.676313 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9nlp9" Jul 06 19:07:56.678612 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.678591 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 19:07:56.678698 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.678624 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-r2jbq\"" Jul 06 19:07:56.678771 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.678749 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:07:56.679648 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.679629 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 19:07:56.679829 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.679807 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 19:07:56.697520 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.697472 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7cdw9"] Jul 06 19:07:56.697592 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.697578 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" Jul 06 19:07:56.699880 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.699862 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:07:56.700085 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.700071 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 06 19:07:56.700432 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.700418 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 06 19:07:56.700539 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.700525 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-96jv4\"" Jul 06 19:07:56.701272 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.701255 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 06 19:07:56.706743 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.706723 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 06 19:07:56.717915 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.717899 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9nlp9"] Jul 06 19:07:56.717988 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.717927 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-hcl4d"] Jul 06 19:07:56.717988 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.717942 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7cdw9"] Jul 06 19:07:56.718057 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.718009 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7cdw9" Jul 06 19:07:56.722168 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.722152 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 06 19:07:56.722672 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.722656 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 06 19:07:56.733081 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.733064 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-trvfv\"" Jul 06 19:07:56.733480 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.733465 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 06 19:07:56.733538 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.733470 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:07:56.741908 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.741889 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/35e1dc35-17cd-44db-ba5b-28b57c3763d4-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-7cdw9\" (UID: \"35e1dc35-17cd-44db-ba5b-28b57c3763d4\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7cdw9" Jul 06 19:07:56.741982 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.741914 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6-config\") pod \"console-operator-68b757fb67-hcl4d\" (UID: \"a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6\") " pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" Jul 06 19:07:56.741982 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.741936 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn4bz\" (UniqueName: \"kubernetes.io/projected/35e1dc35-17cd-44db-ba5b-28b57c3763d4-kube-api-access-xn4bz\") pod \"service-ca-operator-5d46d9ffd4-7cdw9\" (UID: \"35e1dc35-17cd-44db-ba5b-28b57c3763d4\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7cdw9" Jul 06 19:07:56.741982 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.741964 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8btkq\" (UniqueName: \"kubernetes.io/projected/e70f9aa5-7890-4e6e-8a24-74323e9bc819-kube-api-access-8btkq\") pod \"volume-data-source-validator-5d456fdbcd-zfhbl\" (UID: \"e70f9aa5-7890-4e6e-8a24-74323e9bc819\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zfhbl" Jul 06 19:07:56.742091 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.742024 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/517eef3e-b288-4ece-83c5-10ecf912d99d-metrics-certs\") pod \"router-default-7d89958d75-2chxs\" (UID: \"517eef3e-b288-4ece-83c5-10ecf912d99d\") " pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:07:56.742091 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.742065 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c7c4f9b5-959b-481b-bf82-acc2dd175d1e-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-9nlp9\" (UID: \"c7c4f9b5-959b-481b-bf82-acc2dd175d1e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9nlp9" Jul 06 19:07:56.742158 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:56.742096 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:07:56.742158 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.742105 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqpv8\" (UniqueName: \"kubernetes.io/projected/a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6-kube-api-access-dqpv8\") pod \"console-operator-68b757fb67-hcl4d\" (UID: \"a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6\") " pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" Jul 06 19:07:56.742158 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.742135 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6-serving-cert\") pod \"console-operator-68b757fb67-hcl4d\" (UID: \"a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6\") " pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" Jul 06 19:07:56.742270 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:56.742166 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/517eef3e-b288-4ece-83c5-10ecf912d99d-metrics-certs podName:517eef3e-b288-4ece-83c5-10ecf912d99d nodeName:}" failed. No retries permitted until 2026-07-06 19:07:57.24214853 +0000 UTC m=+42.097234094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/517eef3e-b288-4ece-83c5-10ecf912d99d-metrics-certs") pod "router-default-7d89958d75-2chxs" (UID: "517eef3e-b288-4ece-83c5-10ecf912d99d") : secret "router-metrics-certs-default" not found Jul 06 19:07:56.742270 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.742192 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c7c4f9b5-959b-481b-bf82-acc2dd175d1e-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-9nlp9\" (UID: \"c7c4f9b5-959b-481b-bf82-acc2dd175d1e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9nlp9" Jul 06 19:07:56.742270 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.742216 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/517eef3e-b288-4ece-83c5-10ecf912d99d-stats-auth\") pod \"router-default-7d89958d75-2chxs\" (UID: \"517eef3e-b288-4ece-83c5-10ecf912d99d\") " pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:07:56.742270 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.742237 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xxqf\" (UniqueName: \"kubernetes.io/projected/517eef3e-b288-4ece-83c5-10ecf912d99d-kube-api-access-4xxqf\") pod \"router-default-7d89958d75-2chxs\" (UID: \"517eef3e-b288-4ece-83c5-10ecf912d99d\") " pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:07:56.742270 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.742259 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6-trusted-ca\") pod \"console-operator-68b757fb67-hcl4d\" (UID: \"a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6\") " pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" Jul 06 19:07:56.742455 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.742300 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/517eef3e-b288-4ece-83c5-10ecf912d99d-default-certificate\") pod \"router-default-7d89958d75-2chxs\" (UID: \"517eef3e-b288-4ece-83c5-10ecf912d99d\") " pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:07:56.742455 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.742321 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97qrw\" (UniqueName: \"kubernetes.io/projected/c7c4f9b5-959b-481b-bf82-acc2dd175d1e-kube-api-access-97qrw\") pod \"kube-storage-version-migrator-operator-846bf668f7-9nlp9\" (UID: \"c7c4f9b5-959b-481b-bf82-acc2dd175d1e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9nlp9" Jul 06 19:07:56.742455 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.742386 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/517eef3e-b288-4ece-83c5-10ecf912d99d-service-ca-bundle\") pod \"router-default-7d89958d75-2chxs\" (UID: \"517eef3e-b288-4ece-83c5-10ecf912d99d\") " pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:07:56.742455 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.742419 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/35e1dc35-17cd-44db-ba5b-28b57c3763d4-config\") pod \"service-ca-operator-5d46d9ffd4-7cdw9\" (UID: \"35e1dc35-17cd-44db-ba5b-28b57c3763d4\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7cdw9" Jul 06 19:07:56.742599 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:56.742524 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/517eef3e-b288-4ece-83c5-10ecf912d99d-service-ca-bundle podName:517eef3e-b288-4ece-83c5-10ecf912d99d nodeName:}" failed. No retries permitted until 2026-07-06 19:07:57.242507158 +0000 UTC m=+42.097592737 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/517eef3e-b288-4ece-83c5-10ecf912d99d-service-ca-bundle") pod "router-default-7d89958d75-2chxs" (UID: "517eef3e-b288-4ece-83c5-10ecf912d99d") : configmap references non-existent config key: service-ca.crt Jul 06 19:07:56.744457 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.744434 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/517eef3e-b288-4ece-83c5-10ecf912d99d-default-certificate\") pod \"router-default-7d89958d75-2chxs\" (UID: \"517eef3e-b288-4ece-83c5-10ecf912d99d\") " pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:07:56.744520 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.744475 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/517eef3e-b288-4ece-83c5-10ecf912d99d-stats-auth\") pod \"router-default-7d89958d75-2chxs\" (UID: \"517eef3e-b288-4ece-83c5-10ecf912d99d\") " pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:07:56.755520 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.755496 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xxqf\" (UniqueName: \"kubernetes.io/projected/517eef3e-b288-4ece-83c5-10ecf912d99d-kube-api-access-4xxqf\") pod \"router-default-7d89958d75-2chxs\" (UID: \"517eef3e-b288-4ece-83c5-10ecf912d99d\") " pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:07:56.756020 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.756003 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8btkq\" (UniqueName: \"kubernetes.io/projected/e70f9aa5-7890-4e6e-8a24-74323e9bc819-kube-api-access-8btkq\") pod \"volume-data-source-validator-5d456fdbcd-zfhbl\" (UID: \"e70f9aa5-7890-4e6e-8a24-74323e9bc819\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zfhbl" Jul 06 19:07:56.773057 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.773025 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:56.776825 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.776809 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-p7q47" Jul 06 19:07:56.832884 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.832854 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-v2klg" Jul 06 19:07:56.844055 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.843279 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/35e1dc35-17cd-44db-ba5b-28b57c3763d4-config\") pod \"service-ca-operator-5d46d9ffd4-7cdw9\" (UID: \"35e1dc35-17cd-44db-ba5b-28b57c3763d4\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7cdw9" Jul 06 19:07:56.844055 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.843349 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/35e1dc35-17cd-44db-ba5b-28b57c3763d4-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-7cdw9\" (UID: \"35e1dc35-17cd-44db-ba5b-28b57c3763d4\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7cdw9" Jul 06 19:07:56.844055 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.843375 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6-config\") pod \"console-operator-68b757fb67-hcl4d\" (UID: \"a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6\") " pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" Jul 06 19:07:56.844055 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.843410 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn4bz\" (UniqueName: \"kubernetes.io/projected/35e1dc35-17cd-44db-ba5b-28b57c3763d4-kube-api-access-xn4bz\") pod \"service-ca-operator-5d46d9ffd4-7cdw9\" (UID: \"35e1dc35-17cd-44db-ba5b-28b57c3763d4\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7cdw9" Jul 06 19:07:56.844055 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.843495 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c7c4f9b5-959b-481b-bf82-acc2dd175d1e-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-9nlp9\" (UID: \"c7c4f9b5-959b-481b-bf82-acc2dd175d1e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9nlp9" Jul 06 19:07:56.844055 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.843529 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqpv8\" (UniqueName: \"kubernetes.io/projected/a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6-kube-api-access-dqpv8\") pod \"console-operator-68b757fb67-hcl4d\" (UID: \"a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6\") " pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" Jul 06 19:07:56.844055 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.843558 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6-serving-cert\") pod \"console-operator-68b757fb67-hcl4d\" (UID: \"a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6\") " pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" Jul 06 19:07:56.844055 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.843590 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c7c4f9b5-959b-481b-bf82-acc2dd175d1e-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-9nlp9\" (UID: \"c7c4f9b5-959b-481b-bf82-acc2dd175d1e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9nlp9" Jul 06 19:07:56.844055 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.843626 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6-trusted-ca\") pod \"console-operator-68b757fb67-hcl4d\" (UID: \"a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6\") " pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" Jul 06 19:07:56.844055 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.843671 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97qrw\" (UniqueName: \"kubernetes.io/projected/c7c4f9b5-959b-481b-bf82-acc2dd175d1e-kube-api-access-97qrw\") pod \"kube-storage-version-migrator-operator-846bf668f7-9nlp9\" (UID: \"c7c4f9b5-959b-481b-bf82-acc2dd175d1e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9nlp9" Jul 06 19:07:56.852831 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.847446 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6-config\") pod \"console-operator-68b757fb67-hcl4d\" (UID: \"a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6\") " pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" Jul 06 19:07:56.852831 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.848249 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c7c4f9b5-959b-481b-bf82-acc2dd175d1e-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-9nlp9\" (UID: \"c7c4f9b5-959b-481b-bf82-acc2dd175d1e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9nlp9" Jul 06 19:07:56.852831 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.849471 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/35e1dc35-17cd-44db-ba5b-28b57c3763d4-config\") pod \"service-ca-operator-5d46d9ffd4-7cdw9\" (UID: \"35e1dc35-17cd-44db-ba5b-28b57c3763d4\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7cdw9" Jul 06 19:07:56.856370 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.853907 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6-trusted-ca\") pod \"console-operator-68b757fb67-hcl4d\" (UID: \"a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6\") " pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" Jul 06 19:07:56.856370 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.854393 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:56.856370 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.856327 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97qrw\" (UniqueName: \"kubernetes.io/projected/c7c4f9b5-959b-481b-bf82-acc2dd175d1e-kube-api-access-97qrw\") pod \"kube-storage-version-migrator-operator-846bf668f7-9nlp9\" (UID: \"c7c4f9b5-959b-481b-bf82-acc2dd175d1e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9nlp9" Jul 06 19:07:56.872058 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.871751 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn4bz\" (UniqueName: \"kubernetes.io/projected/35e1dc35-17cd-44db-ba5b-28b57c3763d4-kube-api-access-xn4bz\") pod \"service-ca-operator-5d46d9ffd4-7cdw9\" (UID: \"35e1dc35-17cd-44db-ba5b-28b57c3763d4\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7cdw9" Jul 06 19:07:56.872058 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.872003 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6-serving-cert\") pod \"console-operator-68b757fb67-hcl4d\" (UID: \"a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6\") " pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" Jul 06 19:07:56.872058 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.872021 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/35e1dc35-17cd-44db-ba5b-28b57c3763d4-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-7cdw9\" (UID: \"35e1dc35-17cd-44db-ba5b-28b57c3763d4\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7cdw9" Jul 06 19:07:56.872311 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.872061 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c7c4f9b5-959b-481b-bf82-acc2dd175d1e-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-9nlp9\" (UID: \"c7c4f9b5-959b-481b-bf82-acc2dd175d1e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9nlp9" Jul 06 19:07:56.874705 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.874422 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqpv8\" (UniqueName: \"kubernetes.io/projected/a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6-kube-api-access-dqpv8\") pod \"console-operator-68b757fb67-hcl4d\" (UID: \"a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6\") " pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" Jul 06 19:07:56.876082 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.875990 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zfhbl" Jul 06 19:07:56.942228 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.942197 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9slzb" event={"ID":"d6877b4b-db74-4525-afab-b8cd5da25885","Type":"ContainerStarted","Data":"af1d2c829901cb103595c2dd31a8c364407799723adda84a61a7160759d4b56b"} Jul 06 19:07:56.948074 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.948004 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-p7q47"] Jul 06 19:07:56.952120 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:56.952088 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod288531d2_d4e0_4d19_b849_c30d8faf6a12.slice/crio-c082d711d1a957dece0ed9e2da501ba84a77d1d827dc48e9bd9085ce85c0e7df WatchSource:0}: Error finding container c082d711d1a957dece0ed9e2da501ba84a77d1d827dc48e9bd9085ce85c0e7df: Status 404 returned error can't find the container with id c082d711d1a957dece0ed9e2da501ba84a77d1d827dc48e9bd9085ce85c0e7df Jul 06 19:07:56.986251 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.986051 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9nlp9" Jul 06 19:07:56.993030 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:56.992957 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9slzb" podStartSLOduration=9.174833943 podStartE2EDuration="40.992935388s" totalImagesPullingTime="31.818101445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:07:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:56.992463016 +0000 UTC m=+41.847548602" watchObservedRunningTime="2026-07-06 19:07:56.992935388 +0000 UTC m=+41.848020975" Jul 06 19:07:57.005478 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:57.005449 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" Jul 06 19:07:57.025548 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:57.025517 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7cdw9" Jul 06 19:07:57.037832 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:57.037806 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedde0b2e_410b_4d1e_86c6_c927402a1c83.slice/crio-53f85d191f2e9eaf3a8571b61ae2589f0b668c8f29d9601e6263e977b723afab WatchSource:0}: Error finding container 53f85d191f2e9eaf3a8571b61ae2589f0b668c8f29d9601e6263e977b723afab: Status 404 returned error can't find the container with id 53f85d191f2e9eaf3a8571b61ae2589f0b668c8f29d9601e6263e977b723afab Jul 06 19:07:57.040368 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:57.040333 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-v2klg"] Jul 06 19:07:57.048129 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:57.048109 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zfhbl"] Jul 06 19:07:57.053370 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:57.053344 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode70f9aa5_7890_4e6e_8a24_74323e9bc819.slice/crio-9e0a7157a55e15ff187a70eff6958fa0e88a75f17561619fc68357970241ad6d WatchSource:0}: Error finding container 9e0a7157a55e15ff187a70eff6958fa0e88a75f17561619fc68357970241ad6d: Status 404 returned error can't find the container with id 9e0a7157a55e15ff187a70eff6958fa0e88a75f17561619fc68357970241ad6d Jul 06 19:07:57.147398 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:57.147369 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0a419c56-3132-4f19-a6d6-f745864cb51a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-72ztj\" (UID: \"0a419c56-3132-4f19-a6d6-f745864cb51a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-72ztj" Jul 06 19:07:57.147540 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:57.147421 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49397d03-e891-4f65-bcc3-a17b8302ae95-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-85k7k\" (UID: \"49397d03-e891-4f65-bcc3-a17b8302ae95\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85k7k" Jul 06 19:07:57.147614 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:57.147591 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 19:07:57.147684 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:57.147608 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:07:57.147684 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:57.147665 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49397d03-e891-4f65-bcc3-a17b8302ae95-cluster-monitoring-operator-tls podName:49397d03-e891-4f65-bcc3-a17b8302ae95 nodeName:}" failed. No retries permitted until 2026-07-06 19:07:58.14764715 +0000 UTC m=+43.002732736 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/49397d03-e891-4f65-bcc3-a17b8302ae95-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-85k7k" (UID: "49397d03-e891-4f65-bcc3-a17b8302ae95") : secret "cluster-monitoring-operator-tls" not found Jul 06 19:07:57.147684 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:57.147681 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a419c56-3132-4f19-a6d6-f745864cb51a-samples-operator-tls podName:0a419c56-3132-4f19-a6d6-f745864cb51a nodeName:}" failed. No retries permitted until 2026-07-06 19:07:58.14767374 +0000 UTC m=+43.002759303 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0a419c56-3132-4f19-a6d6-f745864cb51a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-72ztj" (UID: "0a419c56-3132-4f19-a6d6-f745864cb51a") : secret "samples-operator-tls" not found Jul 06 19:07:57.188372 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:57.188347 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:57.196019 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:57.195994 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9nlp9"] Jul 06 19:07:57.196454 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:57.196437 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7c4f9b5_959b_481b_bf82_acc2dd175d1e.slice/crio-ef3c3634d7800d203494b2b571a5fe8e0972a30c3012e126e54dcb36d1a96e2d WatchSource:0}: Error finding container ef3c3634d7800d203494b2b571a5fe8e0972a30c3012e126e54dcb36d1a96e2d: Status 404 returned error can't find the container with id ef3c3634d7800d203494b2b571a5fe8e0972a30c3012e126e54dcb36d1a96e2d Jul 06 19:07:57.248315 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:57.248284 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/517eef3e-b288-4ece-83c5-10ecf912d99d-metrics-certs\") pod \"router-default-7d89958d75-2chxs\" (UID: \"517eef3e-b288-4ece-83c5-10ecf912d99d\") " pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:07:57.248481 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:57.248403 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/517eef3e-b288-4ece-83c5-10ecf912d99d-service-ca-bundle\") pod \"router-default-7d89958d75-2chxs\" (UID: \"517eef3e-b288-4ece-83c5-10ecf912d99d\") " pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:07:57.248481 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:57.248432 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:07:57.248591 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:57.248515 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/517eef3e-b288-4ece-83c5-10ecf912d99d-metrics-certs podName:517eef3e-b288-4ece-83c5-10ecf912d99d nodeName:}" failed. No retries permitted until 2026-07-06 19:07:58.248498032 +0000 UTC m=+43.103583602 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/517eef3e-b288-4ece-83c5-10ecf912d99d-metrics-certs") pod "router-default-7d89958d75-2chxs" (UID: "517eef3e-b288-4ece-83c5-10ecf912d99d") : secret "router-metrics-certs-default" not found Jul 06 19:07:57.248591 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:57.248533 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/517eef3e-b288-4ece-83c5-10ecf912d99d-service-ca-bundle podName:517eef3e-b288-4ece-83c5-10ecf912d99d nodeName:}" failed. No retries permitted until 2026-07-06 19:07:58.248526177 +0000 UTC m=+43.103611741 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/517eef3e-b288-4ece-83c5-10ecf912d99d-service-ca-bundle") pod "router-default-7d89958d75-2chxs" (UID: "517eef3e-b288-4ece-83c5-10ecf912d99d") : configmap references non-existent config key: service-ca.crt Jul 06 19:07:57.286203 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:57.286175 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-hcl4d"] Jul 06 19:07:57.289875 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:57.289847 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0de7d5e_4fbd_43c1_a8d6_9c0741fdbfa6.slice/crio-07d012785b672e635fd063526d891ca6c69b1d6525e1871cbbde95e16e2c503a WatchSource:0}: Error finding container 07d012785b672e635fd063526d891ca6c69b1d6525e1871cbbde95e16e2c503a: Status 404 returned error can't find the container with id 07d012785b672e635fd063526d891ca6c69b1d6525e1871cbbde95e16e2c503a Jul 06 19:07:57.292469 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:57.292445 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7cdw9"] Jul 06 19:07:57.295766 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:07:57.295743 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35e1dc35_17cd_44db_ba5b_28b57c3763d4.slice/crio-7d44bb93d094103d4f72e160dae260f4e66bbda77cd079bbaeb3d0ce69ee9a19 WatchSource:0}: Error finding container 7d44bb93d094103d4f72e160dae260f4e66bbda77cd079bbaeb3d0ce69ee9a19: Status 404 returned error can't find the container with id 7d44bb93d094103d4f72e160dae260f4e66bbda77cd079bbaeb3d0ce69ee9a19 Jul 06 19:07:57.322086 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:57.322053 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:57.397313 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:57.397276 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:57.947638 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:57.947602 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" event={"ID":"a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6","Type":"ContainerStarted","Data":"07d012785b672e635fd063526d891ca6c69b1d6525e1871cbbde95e16e2c503a"} Jul 06 19:07:57.949245 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:57.949218 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-v2klg" event={"ID":"edde0b2e-410b-4d1e-86c6-c927402a1c83","Type":"ContainerStarted","Data":"53f85d191f2e9eaf3a8571b61ae2589f0b668c8f29d9601e6263e977b723afab"} Jul 06 19:07:57.951655 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:57.951600 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-p7q47" event={"ID":"288531d2-d4e0-4d19-b849-c30d8faf6a12","Type":"ContainerStarted","Data":"c082d711d1a957dece0ed9e2da501ba84a77d1d827dc48e9bd9085ce85c0e7df"} Jul 06 19:07:57.954058 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:57.954030 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7cdw9" event={"ID":"35e1dc35-17cd-44db-ba5b-28b57c3763d4","Type":"ContainerStarted","Data":"7d44bb93d094103d4f72e160dae260f4e66bbda77cd079bbaeb3d0ce69ee9a19"} Jul 06 19:07:57.955976 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:57.955953 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9nlp9" event={"ID":"c7c4f9b5-959b-481b-bf82-acc2dd175d1e","Type":"ContainerStarted","Data":"ef3c3634d7800d203494b2b571a5fe8e0972a30c3012e126e54dcb36d1a96e2d"} Jul 06 19:07:57.958382 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:57.958322 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zfhbl" event={"ID":"e70f9aa5-7890-4e6e-8a24-74323e9bc819","Type":"ContainerStarted","Data":"9e0a7157a55e15ff187a70eff6958fa0e88a75f17561619fc68357970241ad6d"} Jul 06 19:07:58.158705 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:58.158668 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49397d03-e891-4f65-bcc3-a17b8302ae95-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-85k7k\" (UID: \"49397d03-e891-4f65-bcc3-a17b8302ae95\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85k7k" Jul 06 19:07:58.158914 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:58.158850 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 19:07:58.158914 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:58.158872 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0a419c56-3132-4f19-a6d6-f745864cb51a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-72ztj\" (UID: \"0a419c56-3132-4f19-a6d6-f745864cb51a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-72ztj" Jul 06 19:07:58.158914 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:58.158931 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49397d03-e891-4f65-bcc3-a17b8302ae95-cluster-monitoring-operator-tls podName:49397d03-e891-4f65-bcc3-a17b8302ae95 nodeName:}" failed. No retries permitted until 2026-07-06 19:08:00.158906089 +0000 UTC m=+45.013991664 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/49397d03-e891-4f65-bcc3-a17b8302ae95-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-85k7k" (UID: "49397d03-e891-4f65-bcc3-a17b8302ae95") : secret "cluster-monitoring-operator-tls" not found Jul 06 19:07:58.159155 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:58.159008 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:07:58.159155 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:58.159067 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a419c56-3132-4f19-a6d6-f745864cb51a-samples-operator-tls podName:0a419c56-3132-4f19-a6d6-f745864cb51a nodeName:}" failed. No retries permitted until 2026-07-06 19:08:00.1590516 +0000 UTC m=+45.014137165 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0a419c56-3132-4f19-a6d6-f745864cb51a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-72ztj" (UID: "0a419c56-3132-4f19-a6d6-f745864cb51a") : secret "samples-operator-tls" not found Jul 06 19:07:58.260979 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:58.259902 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/517eef3e-b288-4ece-83c5-10ecf912d99d-metrics-certs\") pod \"router-default-7d89958d75-2chxs\" (UID: \"517eef3e-b288-4ece-83c5-10ecf912d99d\") " pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:07:58.260979 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:58.260025 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-tls\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:07:58.260979 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:58.260068 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/517eef3e-b288-4ece-83c5-10ecf912d99d-service-ca-bundle\") pod \"router-default-7d89958d75-2chxs\" (UID: \"517eef3e-b288-4ece-83c5-10ecf912d99d\") " pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:07:58.260979 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:58.260274 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/517eef3e-b288-4ece-83c5-10ecf912d99d-service-ca-bundle podName:517eef3e-b288-4ece-83c5-10ecf912d99d nodeName:}" failed. No retries permitted until 2026-07-06 19:08:00.260256064 +0000 UTC m=+45.115341634 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/517eef3e-b288-4ece-83c5-10ecf912d99d-service-ca-bundle") pod "router-default-7d89958d75-2chxs" (UID: "517eef3e-b288-4ece-83c5-10ecf912d99d") : configmap references non-existent config key: service-ca.crt Jul 06 19:07:58.260979 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:58.260675 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:07:58.260979 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:58.260731 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/517eef3e-b288-4ece-83c5-10ecf912d99d-metrics-certs podName:517eef3e-b288-4ece-83c5-10ecf912d99d nodeName:}" failed. No retries permitted until 2026-07-06 19:08:00.260715675 +0000 UTC m=+45.115801244 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/517eef3e-b288-4ece-83c5-10ecf912d99d-metrics-certs") pod "router-default-7d89958d75-2chxs" (UID: "517eef3e-b288-4ece-83c5-10ecf912d99d") : secret "router-metrics-certs-default" not found Jul 06 19:07:58.260979 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:58.260800 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:07:58.260979 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:58.260810 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57484589cb-nlmd5: secret "image-registry-tls" not found Jul 06 19:07:58.260979 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:58.260859 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-tls podName:23d26b44-20fe-4f81-9812-a92ebc94e3e1 nodeName:}" failed. No retries permitted until 2026-07-06 19:08:06.26083237 +0000 UTC m=+51.115917935 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-tls") pod "image-registry-57484589cb-nlmd5" (UID: "23d26b44-20fe-4f81-9812-a92ebc94e3e1") : secret "image-registry-tls" not found Jul 06 19:07:58.361596 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:58.361558 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9e40546-7e20-4cba-858a-cb9a0635815c-metrics-tls\") pod \"dns-default-r9h8k\" (UID: \"b9e40546-7e20-4cba-858a-cb9a0635815c\") " pod="openshift-dns/dns-default-r9h8k" Jul 06 19:07:58.361888 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:58.361821 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:07:58.361980 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:07:58.361899 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9e40546-7e20-4cba-858a-cb9a0635815c-metrics-tls podName:b9e40546-7e20-4cba-858a-cb9a0635815c nodeName:}" failed. No retries permitted until 2026-07-06 19:08:06.361880134 +0000 UTC m=+51.216965703 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9e40546-7e20-4cba-858a-cb9a0635815c-metrics-tls") pod "dns-default-r9h8k" (UID: "b9e40546-7e20-4cba-858a-cb9a0635815c") : secret "dns-default-metrics-tls" not found Jul 06 19:07:58.626412 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:58.626344 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:59.298896 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:59.298782 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:59.386509 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:07:59.386465 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:00.177957 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:00.177918 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0a419c56-3132-4f19-a6d6-f745864cb51a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-72ztj\" (UID: \"0a419c56-3132-4f19-a6d6-f745864cb51a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-72ztj" Jul 06 19:08:00.178147 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:00.177990 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49397d03-e891-4f65-bcc3-a17b8302ae95-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-85k7k\" (UID: \"49397d03-e891-4f65-bcc3-a17b8302ae95\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85k7k" Jul 06 19:08:00.178147 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:00.178106 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:08:00.178264 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:00.178178 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 19:08:00.178264 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:00.178189 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a419c56-3132-4f19-a6d6-f745864cb51a-samples-operator-tls podName:0a419c56-3132-4f19-a6d6-f745864cb51a nodeName:}" failed. No retries permitted until 2026-07-06 19:08:04.178168368 +0000 UTC m=+49.033253954 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0a419c56-3132-4f19-a6d6-f745864cb51a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-72ztj" (UID: "0a419c56-3132-4f19-a6d6-f745864cb51a") : secret "samples-operator-tls" not found Jul 06 19:08:00.178264 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:00.178231 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49397d03-e891-4f65-bcc3-a17b8302ae95-cluster-monitoring-operator-tls podName:49397d03-e891-4f65-bcc3-a17b8302ae95 nodeName:}" failed. No retries permitted until 2026-07-06 19:08:04.178215419 +0000 UTC m=+49.033300996 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/49397d03-e891-4f65-bcc3-a17b8302ae95-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-85k7k" (UID: "49397d03-e891-4f65-bcc3-a17b8302ae95") : secret "cluster-monitoring-operator-tls" not found Jul 06 19:08:00.279469 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:00.279435 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/517eef3e-b288-4ece-83c5-10ecf912d99d-service-ca-bundle\") pod \"router-default-7d89958d75-2chxs\" (UID: \"517eef3e-b288-4ece-83c5-10ecf912d99d\") " pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:08:00.279633 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:00.279524 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/517eef3e-b288-4ece-83c5-10ecf912d99d-metrics-certs\") pod \"router-default-7d89958d75-2chxs\" (UID: \"517eef3e-b288-4ece-83c5-10ecf912d99d\") " pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:08:00.279633 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:00.279619 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/517eef3e-b288-4ece-83c5-10ecf912d99d-service-ca-bundle podName:517eef3e-b288-4ece-83c5-10ecf912d99d nodeName:}" failed. No retries permitted until 2026-07-06 19:08:04.279601324 +0000 UTC m=+49.134686901 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/517eef3e-b288-4ece-83c5-10ecf912d99d-service-ca-bundle") pod "router-default-7d89958d75-2chxs" (UID: "517eef3e-b288-4ece-83c5-10ecf912d99d") : configmap references non-existent config key: service-ca.crt Jul 06 19:08:00.279755 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:00.279699 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:08:00.279805 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:00.279770 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/517eef3e-b288-4ece-83c5-10ecf912d99d-metrics-certs podName:517eef3e-b288-4ece-83c5-10ecf912d99d nodeName:}" failed. No retries permitted until 2026-07-06 19:08:04.279752855 +0000 UTC m=+49.134838435 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/517eef3e-b288-4ece-83c5-10ecf912d99d-metrics-certs") pod "router-default-7d89958d75-2chxs" (UID: "517eef3e-b288-4ece-83c5-10ecf912d99d") : secret "router-metrics-certs-default" not found Jul 06 19:08:03.384418 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:03.384386 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:03.484691 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:03.484663 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:03.588194 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:03.588123 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:03.976084 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:03.976053 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hcl4d_a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6/console-operator/0.log" Jul 06 19:08:03.976254 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:03.976097 2578 generic.go:356] "Generic (PLEG): container finished" podID="a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6" containerID="8dac9a8e98daed632c89eb29a84457aca791e3b4684ed8cc7f2ba6c052f7c37a" exitCode=255 Jul 06 19:08:03.976254 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:03.976177 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" event={"ID":"a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6","Type":"ContainerDied","Data":"8dac9a8e98daed632c89eb29a84457aca791e3b4684ed8cc7f2ba6c052f7c37a"} Jul 06 19:08:03.976573 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:03.976441 2578 scope.go:117] "RemoveContainer" containerID="8dac9a8e98daed632c89eb29a84457aca791e3b4684ed8cc7f2ba6c052f7c37a" Jul 06 19:08:03.978109 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:03.978080 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-v2klg" event={"ID":"edde0b2e-410b-4d1e-86c6-c927402a1c83","Type":"ContainerStarted","Data":"045f0305c6020aa9effe563f069980662aa8b45c673c1cbcbff8e934f9f24cc9"} Jul 06 19:08:03.980475 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:03.980436 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-p7q47" event={"ID":"288531d2-d4e0-4d19-b849-c30d8faf6a12","Type":"ContainerStarted","Data":"2edf8013388c6570205b8792482380a7aa9d5df89a93be2ad2c98e3945077910"} Jul 06 19:08:03.981996 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:03.981966 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7cdw9" event={"ID":"35e1dc35-17cd-44db-ba5b-28b57c3763d4","Type":"ContainerStarted","Data":"d717cfb687dee6dd0fa56ba042894b8bca0bec37a2110be2e97b5f253dcac579"} Jul 06 19:08:03.983587 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:03.983545 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9nlp9" event={"ID":"c7c4f9b5-959b-481b-bf82-acc2dd175d1e","Type":"ContainerStarted","Data":"a899553b8586f32b7b1709f1705e36ac0894c9ed504cb2dd3c778ec8b508c657"} Jul 06 19:08:03.985059 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:03.985037 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zfhbl" event={"ID":"e70f9aa5-7890-4e6e-8a24-74323e9bc819","Type":"ContainerStarted","Data":"7ce574ee997139e4ded4b620e0cfa9e081f96b9ae6b9a7f26138f2573ad040ec"} Jul 06 19:08:04.027583 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:04.027536 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-p7q47" podStartSLOduration=1.662481562 podStartE2EDuration="8.027521229s" totalImagesPullingTime="6.365039667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:04.026733966 +0000 UTC m=+48.881819552" watchObservedRunningTime="2026-07-06 19:08:04.027521229 +0000 UTC m=+48.882606816" Jul 06 19:08:04.056916 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:04.056870 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zfhbl" podStartSLOduration=4.222236929 podStartE2EDuration="8.056854571s" totalImagesPullingTime="3.834617642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:04.055565452 +0000 UTC m=+48.910651084" watchObservedRunningTime="2026-07-06 19:08:04.056854571 +0000 UTC m=+48.911940149" Jul 06 19:08:04.083381 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:04.083328 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9nlp9" podStartSLOduration=1.971258351 podStartE2EDuration="8.08330765s" totalImagesPullingTime="6.112049299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:04.08251417 +0000 UTC m=+48.937599759" watchObservedRunningTime="2026-07-06 19:08:04.08330765 +0000 UTC m=+48.938393239" Jul 06 19:08:04.152967 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:04.152392 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7cdw9" podStartSLOduration=2.139266907 podStartE2EDuration="8.152374513s" totalImagesPullingTime="6.013107606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:04.152238106 +0000 UTC m=+49.007323693" watchObservedRunningTime="2026-07-06 19:08:04.152374513 +0000 UTC m=+49.007460138" Jul 06 19:08:04.153413 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:04.153375 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-v2klg" podStartSLOduration=1.883216348 podStartE2EDuration="8.153363633s" totalImagesPullingTime="6.270147285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:04.119066949 +0000 UTC m=+48.974152537" watchObservedRunningTime="2026-07-06 19:08:04.153363633 +0000 UTC m=+49.008449219" Jul 06 19:08:04.218867 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:04.218824 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0a419c56-3132-4f19-a6d6-f745864cb51a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-72ztj\" (UID: \"0a419c56-3132-4f19-a6d6-f745864cb51a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-72ztj" Jul 06 19:08:04.219046 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:04.218912 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49397d03-e891-4f65-bcc3-a17b8302ae95-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-85k7k\" (UID: \"49397d03-e891-4f65-bcc3-a17b8302ae95\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85k7k" Jul 06 19:08:04.219046 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:04.218992 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:08:04.219170 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:04.219066 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a419c56-3132-4f19-a6d6-f745864cb51a-samples-operator-tls podName:0a419c56-3132-4f19-a6d6-f745864cb51a nodeName:}" failed. No retries permitted until 2026-07-06 19:08:12.219045509 +0000 UTC m=+57.074131077 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0a419c56-3132-4f19-a6d6-f745864cb51a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-72ztj" (UID: "0a419c56-3132-4f19-a6d6-f745864cb51a") : secret "samples-operator-tls" not found Jul 06 19:08:04.219170 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:04.219091 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 19:08:04.219170 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:04.219146 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49397d03-e891-4f65-bcc3-a17b8302ae95-cluster-monitoring-operator-tls podName:49397d03-e891-4f65-bcc3-a17b8302ae95 nodeName:}" failed. No retries permitted until 2026-07-06 19:08:12.219129 +0000 UTC m=+57.074214589 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/49397d03-e891-4f65-bcc3-a17b8302ae95-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-85k7k" (UID: "49397d03-e891-4f65-bcc3-a17b8302ae95") : secret "cluster-monitoring-operator-tls" not found Jul 06 19:08:04.278234 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:04.278145 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:04.320227 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:04.320184 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/517eef3e-b288-4ece-83c5-10ecf912d99d-service-ca-bundle\") pod \"router-default-7d89958d75-2chxs\" (UID: \"517eef3e-b288-4ece-83c5-10ecf912d99d\") " pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:08:04.320461 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:04.320294 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/517eef3e-b288-4ece-83c5-10ecf912d99d-metrics-certs\") pod \"router-default-7d89958d75-2chxs\" (UID: \"517eef3e-b288-4ece-83c5-10ecf912d99d\") " pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:08:04.320461 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:04.320370 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/517eef3e-b288-4ece-83c5-10ecf912d99d-service-ca-bundle podName:517eef3e-b288-4ece-83c5-10ecf912d99d nodeName:}" failed. No retries permitted until 2026-07-06 19:08:12.320348117 +0000 UTC m=+57.175433688 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/517eef3e-b288-4ece-83c5-10ecf912d99d-service-ca-bundle") pod "router-default-7d89958d75-2chxs" (UID: "517eef3e-b288-4ece-83c5-10ecf912d99d") : configmap references non-existent config key: service-ca.crt Jul 06 19:08:04.320585 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:04.320462 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:08:04.320585 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:04.320510 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/517eef3e-b288-4ece-83c5-10ecf912d99d-metrics-certs podName:517eef3e-b288-4ece-83c5-10ecf912d99d nodeName:}" failed. No retries permitted until 2026-07-06 19:08:12.320495806 +0000 UTC m=+57.175581375 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/517eef3e-b288-4ece-83c5-10ecf912d99d-metrics-certs") pod "router-default-7d89958d75-2chxs" (UID: "517eef3e-b288-4ece-83c5-10ecf912d99d") : secret "router-metrics-certs-default" not found Jul 06 19:08:04.415331 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:04.415295 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:04.504093 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:04.504048 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:04.609721 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:04.609683 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:04.871197 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:04.871114 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:04.993894 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:04.993864 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hcl4d_a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6/console-operator/1.log" Jul 06 19:08:04.994265 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:04.994251 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hcl4d_a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6/console-operator/0.log" Jul 06 19:08:04.994322 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:04.994284 2578 generic.go:356] "Generic (PLEG): container finished" podID="a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6" containerID="81f4914ff225fb1b10d4d4dfcb06adf8ee284c52a9e494f691a201b39baecec1" exitCode=255 Jul 06 19:08:04.994375 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:04.994316 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" event={"ID":"a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6","Type":"ContainerDied","Data":"81f4914ff225fb1b10d4d4dfcb06adf8ee284c52a9e494f691a201b39baecec1"} Jul 06 19:08:04.994435 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:04.994406 2578 scope.go:117] "RemoveContainer" containerID="8dac9a8e98daed632c89eb29a84457aca791e3b4684ed8cc7f2ba6c052f7c37a" Jul 06 19:08:04.994710 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:04.994682 2578 scope.go:117] "RemoveContainer" containerID="81f4914ff225fb1b10d4d4dfcb06adf8ee284c52a9e494f691a201b39baecec1" Jul 06 19:08:04.994904 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:04.994886 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-hcl4d_openshift-console-operator(a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6)\"" pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" podUID="a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6" Jul 06 19:08:05.054282 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.054239 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:05.218759 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.218677 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hjkpn"] Jul 06 19:08:05.229676 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.229641 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:05.250398 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.250363 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hjkpn" Jul 06 19:08:05.264917 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.264889 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 19:08:05.264917 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.264905 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 19:08:05.265211 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.265192 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xhq2g\"" Jul 06 19:08:05.275192 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.275162 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hjkpn"] Jul 06 19:08:05.329457 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.329422 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bbbe3018-f456-4857-ab4f-68e07472bb0c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjkpn\" (UID: \"bbbe3018-f456-4857-ab4f-68e07472bb0c\") " pod="openshift-insights/insights-runtime-extractor-hjkpn" Jul 06 19:08:05.329604 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.329485 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bbbe3018-f456-4857-ab4f-68e07472bb0c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjkpn\" (UID: \"bbbe3018-f456-4857-ab4f-68e07472bb0c\") " pod="openshift-insights/insights-runtime-extractor-hjkpn" Jul 06 19:08:05.329604 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.329549 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bbbe3018-f456-4857-ab4f-68e07472bb0c-crio-socket\") pod \"insights-runtime-extractor-hjkpn\" (UID: \"bbbe3018-f456-4857-ab4f-68e07472bb0c\") " pod="openshift-insights/insights-runtime-extractor-hjkpn" Jul 06 19:08:05.329696 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.329647 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czm46\" (UniqueName: \"kubernetes.io/projected/bbbe3018-f456-4857-ab4f-68e07472bb0c-kube-api-access-czm46\") pod \"insights-runtime-extractor-hjkpn\" (UID: \"bbbe3018-f456-4857-ab4f-68e07472bb0c\") " pod="openshift-insights/insights-runtime-extractor-hjkpn" Jul 06 19:08:05.329747 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.329708 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bbbe3018-f456-4857-ab4f-68e07472bb0c-data-volume\") pod \"insights-runtime-extractor-hjkpn\" (UID: \"bbbe3018-f456-4857-ab4f-68e07472bb0c\") " pod="openshift-insights/insights-runtime-extractor-hjkpn" Jul 06 19:08:05.415207 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.415174 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:05.430350 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.430318 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bbbe3018-f456-4857-ab4f-68e07472bb0c-crio-socket\") pod \"insights-runtime-extractor-hjkpn\" (UID: \"bbbe3018-f456-4857-ab4f-68e07472bb0c\") " pod="openshift-insights/insights-runtime-extractor-hjkpn" Jul 06 19:08:05.430770 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.430413 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czm46\" (UniqueName: \"kubernetes.io/projected/bbbe3018-f456-4857-ab4f-68e07472bb0c-kube-api-access-czm46\") pod \"insights-runtime-extractor-hjkpn\" (UID: \"bbbe3018-f456-4857-ab4f-68e07472bb0c\") " pod="openshift-insights/insights-runtime-extractor-hjkpn" Jul 06 19:08:05.430770 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.430482 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bbbe3018-f456-4857-ab4f-68e07472bb0c-data-volume\") pod \"insights-runtime-extractor-hjkpn\" (UID: \"bbbe3018-f456-4857-ab4f-68e07472bb0c\") " pod="openshift-insights/insights-runtime-extractor-hjkpn" Jul 06 19:08:05.430770 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.430537 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bbbe3018-f456-4857-ab4f-68e07472bb0c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjkpn\" (UID: \"bbbe3018-f456-4857-ab4f-68e07472bb0c\") " pod="openshift-insights/insights-runtime-extractor-hjkpn" Jul 06 19:08:05.430770 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.430566 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bbbe3018-f456-4857-ab4f-68e07472bb0c-crio-socket\") pod \"insights-runtime-extractor-hjkpn\" (UID: \"bbbe3018-f456-4857-ab4f-68e07472bb0c\") " pod="openshift-insights/insights-runtime-extractor-hjkpn" Jul 06 19:08:05.430770 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.430595 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bbbe3018-f456-4857-ab4f-68e07472bb0c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjkpn\" (UID: \"bbbe3018-f456-4857-ab4f-68e07472bb0c\") " pod="openshift-insights/insights-runtime-extractor-hjkpn" Jul 06 19:08:05.430770 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:05.430669 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:08:05.430770 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:05.430733 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbbe3018-f456-4857-ab4f-68e07472bb0c-insights-runtime-extractor-tls podName:bbbe3018-f456-4857-ab4f-68e07472bb0c nodeName:}" failed. No retries permitted until 2026-07-06 19:08:05.930718674 +0000 UTC m=+50.785804243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bbbe3018-f456-4857-ab4f-68e07472bb0c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hjkpn" (UID: "bbbe3018-f456-4857-ab4f-68e07472bb0c") : secret "insights-runtime-extractor-tls" not found Jul 06 19:08:05.430770 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:05.430669 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:08:05.431059 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:05.430804 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bbbe3018-f456-4857-ab4f-68e07472bb0c-kube-rbac-proxy-cm podName:bbbe3018-f456-4857-ab4f-68e07472bb0c nodeName:}" failed. No retries permitted until 2026-07-06 19:08:05.930793165 +0000 UTC m=+50.785878733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bbbe3018-f456-4857-ab4f-68e07472bb0c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hjkpn" (UID: "bbbe3018-f456-4857-ab4f-68e07472bb0c") : configmap "kube-rbac-proxy" not found Jul 06 19:08:05.431059 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.430822 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bbbe3018-f456-4857-ab4f-68e07472bb0c-data-volume\") pod \"insights-runtime-extractor-hjkpn\" (UID: \"bbbe3018-f456-4857-ab4f-68e07472bb0c\") " pod="openshift-insights/insights-runtime-extractor-hjkpn" Jul 06 19:08:05.455722 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.455687 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czm46\" (UniqueName: \"kubernetes.io/projected/bbbe3018-f456-4857-ab4f-68e07472bb0c-kube-api-access-czm46\") pod \"insights-runtime-extractor-hjkpn\" (UID: \"bbbe3018-f456-4857-ab4f-68e07472bb0c\") " pod="openshift-insights/insights-runtime-extractor-hjkpn" Jul 06 19:08:05.717273 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.717241 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:05.808736 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.808704 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:05.926325 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.926281 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:05.935283 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.935256 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bbbe3018-f456-4857-ab4f-68e07472bb0c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjkpn\" (UID: \"bbbe3018-f456-4857-ab4f-68e07472bb0c\") " pod="openshift-insights/insights-runtime-extractor-hjkpn" Jul 06 19:08:05.935440 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.935307 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bbbe3018-f456-4857-ab4f-68e07472bb0c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjkpn\" (UID: \"bbbe3018-f456-4857-ab4f-68e07472bb0c\") " pod="openshift-insights/insights-runtime-extractor-hjkpn" Jul 06 19:08:05.935440 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:05.935423 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:08:05.935547 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:05.935452 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:08:05.935547 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:05.935484 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbbe3018-f456-4857-ab4f-68e07472bb0c-insights-runtime-extractor-tls podName:bbbe3018-f456-4857-ab4f-68e07472bb0c nodeName:}" failed. No retries permitted until 2026-07-06 19:08:06.935467371 +0000 UTC m=+51.790552952 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bbbe3018-f456-4857-ab4f-68e07472bb0c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hjkpn" (UID: "bbbe3018-f456-4857-ab4f-68e07472bb0c") : secret "insights-runtime-extractor-tls" not found Jul 06 19:08:05.935547 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:05.935500 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bbbe3018-f456-4857-ab4f-68e07472bb0c-kube-rbac-proxy-cm podName:bbbe3018-f456-4857-ab4f-68e07472bb0c nodeName:}" failed. No retries permitted until 2026-07-06 19:08:06.935492755 +0000 UTC m=+51.790578319 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bbbe3018-f456-4857-ab4f-68e07472bb0c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hjkpn" (UID: "bbbe3018-f456-4857-ab4f-68e07472bb0c") : configmap "kube-rbac-proxy" not found Jul 06 19:08:05.999151 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.999080 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hcl4d_a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6/console-operator/1.log" Jul 06 19:08:05.999415 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:05.999401 2578 scope.go:117] "RemoveContainer" containerID="81f4914ff225fb1b10d4d4dfcb06adf8ee284c52a9e494f691a201b39baecec1" Jul 06 19:08:05.999600 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:05.999583 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-hcl4d_openshift-console-operator(a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6)\"" pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" podUID="a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6" Jul 06 19:08:06.339969 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:06.339940 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-tls\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:08:06.340133 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:06.340101 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:08:06.340133 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:06.340118 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57484589cb-nlmd5: secret "image-registry-tls" not found Jul 06 19:08:06.340203 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:06.340170 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-tls podName:23d26b44-20fe-4f81-9812-a92ebc94e3e1 nodeName:}" failed. No retries permitted until 2026-07-06 19:08:22.340155704 +0000 UTC m=+67.195241268 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-tls") pod "image-registry-57484589cb-nlmd5" (UID: "23d26b44-20fe-4f81-9812-a92ebc94e3e1") : secret "image-registry-tls" not found Jul 06 19:08:06.441784 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:06.441745 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9e40546-7e20-4cba-858a-cb9a0635815c-metrics-tls\") pod \"dns-default-r9h8k\" (UID: \"b9e40546-7e20-4cba-858a-cb9a0635815c\") " pod="openshift-dns/dns-default-r9h8k" Jul 06 19:08:06.442596 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:06.442573 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:08:06.442769 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:06.442758 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9e40546-7e20-4cba-858a-cb9a0635815c-metrics-tls podName:b9e40546-7e20-4cba-858a-cb9a0635815c nodeName:}" failed. No retries permitted until 2026-07-06 19:08:22.442730409 +0000 UTC m=+67.297815992 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9e40546-7e20-4cba-858a-cb9a0635815c-metrics-tls") pod "dns-default-r9h8k" (UID: "b9e40546-7e20-4cba-858a-cb9a0635815c") : secret "dns-default-metrics-tls" not found Jul 06 19:08:06.606652 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:06.606571 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:06.946229 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:06.946153 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bbbe3018-f456-4857-ab4f-68e07472bb0c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjkpn\" (UID: \"bbbe3018-f456-4857-ab4f-68e07472bb0c\") " pod="openshift-insights/insights-runtime-extractor-hjkpn" Jul 06 19:08:06.946229 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:06.946206 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bbbe3018-f456-4857-ab4f-68e07472bb0c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjkpn\" (UID: \"bbbe3018-f456-4857-ab4f-68e07472bb0c\") " pod="openshift-insights/insights-runtime-extractor-hjkpn" Jul 06 19:08:06.946413 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:06.946300 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:08:06.946413 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:06.946362 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbbe3018-f456-4857-ab4f-68e07472bb0c-insights-runtime-extractor-tls podName:bbbe3018-f456-4857-ab4f-68e07472bb0c nodeName:}" failed. No retries permitted until 2026-07-06 19:08:08.946347119 +0000 UTC m=+53.801432683 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bbbe3018-f456-4857-ab4f-68e07472bb0c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hjkpn" (UID: "bbbe3018-f456-4857-ab4f-68e07472bb0c") : secret "insights-runtime-extractor-tls" not found Jul 06 19:08:06.946678 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:06.946663 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bbbe3018-f456-4857-ab4f-68e07472bb0c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjkpn\" (UID: \"bbbe3018-f456-4857-ab4f-68e07472bb0c\") " pod="openshift-insights/insights-runtime-extractor-hjkpn" Jul 06 19:08:07.006077 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:07.006037 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" Jul 06 19:08:07.006245 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:07.006114 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" Jul 06 19:08:07.006452 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:07.006438 2578 scope.go:117] "RemoveContainer" containerID="81f4914ff225fb1b10d4d4dfcb06adf8ee284c52a9e494f691a201b39baecec1" Jul 06 19:08:07.006617 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:07.006588 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-hcl4d_openshift-console-operator(a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6)\"" pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" podUID="a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6" Jul 06 19:08:07.021023 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:07.020984 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:07.112965 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:07.112934 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:07.564109 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:07.564083 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gjvsc_24f3c199-698c-4a41-b391-9aa34578da40/dns-node-resolver/0.log" Jul 06 19:08:08.309326 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:08.309288 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:08.561250 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:08.561182 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sc2cl_ff4d48d8-20fe-4762-bd9e-9fa53deb24df/node-ca/0.log" Jul 06 19:08:08.961541 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:08.961505 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bbbe3018-f456-4857-ab4f-68e07472bb0c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjkpn\" (UID: \"bbbe3018-f456-4857-ab4f-68e07472bb0c\") " pod="openshift-insights/insights-runtime-extractor-hjkpn" Jul 06 19:08:08.961961 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:08.961660 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:08:08.961961 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:08.961722 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbbe3018-f456-4857-ab4f-68e07472bb0c-insights-runtime-extractor-tls podName:bbbe3018-f456-4857-ab4f-68e07472bb0c nodeName:}" failed. No retries permitted until 2026-07-06 19:08:12.961707775 +0000 UTC m=+57.816793344 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bbbe3018-f456-4857-ab4f-68e07472bb0c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hjkpn" (UID: "bbbe3018-f456-4857-ab4f-68e07472bb0c") : secret "insights-runtime-extractor-tls" not found Jul 06 19:08:09.054021 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:09.053981 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:09.148138 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:09.148103 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:09.561909 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:09.561879 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-q24rz_58497cf0-3338-4a5f-9d84-898a69488e36/serve-healthcheck-canary/0.log" Jul 06 19:08:10.161926 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:10.161890 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-9nlp9_c7c4f9b5-959b-481b-bf82-acc2dd175d1e/kube-storage-version-migrator-operator/0.log" Jul 06 19:08:10.994965 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:10.994934 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:12.099853 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:12.099806 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:12.210049 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:12.210005 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:12.288895 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:12.288856 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0a419c56-3132-4f19-a6d6-f745864cb51a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-72ztj\" (UID: \"0a419c56-3132-4f19-a6d6-f745864cb51a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-72ztj" Jul 06 19:08:12.289064 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:12.288929 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49397d03-e891-4f65-bcc3-a17b8302ae95-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-85k7k\" (UID: \"49397d03-e891-4f65-bcc3-a17b8302ae95\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85k7k" Jul 06 19:08:12.289064 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:12.288978 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:08:12.289064 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:12.289056 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a419c56-3132-4f19-a6d6-f745864cb51a-samples-operator-tls podName:0a419c56-3132-4f19-a6d6-f745864cb51a nodeName:}" failed. No retries permitted until 2026-07-06 19:08:28.289039764 +0000 UTC m=+73.144125328 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0a419c56-3132-4f19-a6d6-f745864cb51a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-72ztj" (UID: "0a419c56-3132-4f19-a6d6-f745864cb51a") : secret "samples-operator-tls" not found Jul 06 19:08:12.289192 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:12.289070 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 19:08:12.289192 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:12.289116 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49397d03-e891-4f65-bcc3-a17b8302ae95-cluster-monitoring-operator-tls podName:49397d03-e891-4f65-bcc3-a17b8302ae95 nodeName:}" failed. No retries permitted until 2026-07-06 19:08:28.289102754 +0000 UTC m=+73.144188318 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/49397d03-e891-4f65-bcc3-a17b8302ae95-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-85k7k" (UID: "49397d03-e891-4f65-bcc3-a17b8302ae95") : secret "cluster-monitoring-operator-tls" not found Jul 06 19:08:12.300008 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:12.299978 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:12.390231 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:12.390140 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/517eef3e-b288-4ece-83c5-10ecf912d99d-service-ca-bundle\") pod \"router-default-7d89958d75-2chxs\" (UID: \"517eef3e-b288-4ece-83c5-10ecf912d99d\") " pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:08:12.390410 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:12.390238 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/517eef3e-b288-4ece-83c5-10ecf912d99d-metrics-certs\") pod \"router-default-7d89958d75-2chxs\" (UID: \"517eef3e-b288-4ece-83c5-10ecf912d99d\") " pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:08:12.390410 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:12.390339 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:08:12.390410 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:12.390408 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/517eef3e-b288-4ece-83c5-10ecf912d99d-metrics-certs podName:517eef3e-b288-4ece-83c5-10ecf912d99d nodeName:}" failed. No retries permitted until 2026-07-06 19:08:28.390386721 +0000 UTC m=+73.245472290 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/517eef3e-b288-4ece-83c5-10ecf912d99d-metrics-certs") pod "router-default-7d89958d75-2chxs" (UID: "517eef3e-b288-4ece-83c5-10ecf912d99d") : secret "router-metrics-certs-default" not found Jul 06 19:08:12.390749 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:12.390735 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/517eef3e-b288-4ece-83c5-10ecf912d99d-service-ca-bundle podName:517eef3e-b288-4ece-83c5-10ecf912d99d nodeName:}" failed. No retries permitted until 2026-07-06 19:08:28.390721383 +0000 UTC m=+73.245806951 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/517eef3e-b288-4ece-83c5-10ecf912d99d-service-ca-bundle") pod "router-default-7d89958d75-2chxs" (UID: "517eef3e-b288-4ece-83c5-10ecf912d99d") : configmap references non-existent config key: service-ca.crt Jul 06 19:08:12.404572 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:12.404543 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:12.517110 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:12.517077 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:12.689872 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:12.689763 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:12.773483 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:12.773446 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:12.995728 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:12.995639 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bbbe3018-f456-4857-ab4f-68e07472bb0c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjkpn\" (UID: \"bbbe3018-f456-4857-ab4f-68e07472bb0c\") " pod="openshift-insights/insights-runtime-extractor-hjkpn" Jul 06 19:08:12.995911 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:12.995795 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:08:12.995911 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:12.995892 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbbe3018-f456-4857-ab4f-68e07472bb0c-insights-runtime-extractor-tls podName:bbbe3018-f456-4857-ab4f-68e07472bb0c nodeName:}" failed. No retries permitted until 2026-07-06 19:08:20.995877446 +0000 UTC m=+65.850963014 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bbbe3018-f456-4857-ab4f-68e07472bb0c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hjkpn" (UID: "bbbe3018-f456-4857-ab4f-68e07472bb0c") : secret "insights-runtime-extractor-tls" not found Jul 06 19:08:13.389022 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:13.388991 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:13.775115 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:13.775018 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:14.189415 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:14.189382 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:14.396891 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:14.396858 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:14.847938 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:14.847879 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:15.040774 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:15.040743 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:15.570146 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:15.570115 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:15.766678 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:15.766645 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:16.010031 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:16.009995 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:16.230832 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:16.230798 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:16.366928 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:16.366898 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:16.466282 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:16.466249 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:17.015238 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:17.015198 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:17.132991 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:17.132965 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:17.616505 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:17.616471 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:17.829083 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:17.829053 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:17.914745 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:17.914678 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxfxf" Jul 06 19:08:18.004405 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:18.004369 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:18.182582 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:18.182500 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:18.650781 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:18.650737 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:19.184930 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:19.184892 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:19.353898 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:19.353865 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:19.426677 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:19.426641 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:19.581148 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:19.581063 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:19.647474 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:19.647446 2578 scope.go:117] "RemoveContainer" containerID="81f4914ff225fb1b10d4d4dfcb06adf8ee284c52a9e494f691a201b39baecec1" Jul 06 19:08:19.992945 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:19.992911 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:20.043902 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:20.043880 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hcl4d_a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6/console-operator/2.log" Jul 06 19:08:20.044304 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:20.044289 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hcl4d_a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6/console-operator/1.log" Jul 06 19:08:20.044357 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:20.044322 2578 generic.go:356] "Generic (PLEG): container finished" podID="a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6" containerID="b5ac33eed5ad37f22b006fb3df840e7d770b092bc618dbcda1d9a754e3a8adc3" exitCode=255 Jul 06 19:08:20.044391 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:20.044356 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" event={"ID":"a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6","Type":"ContainerDied","Data":"b5ac33eed5ad37f22b006fb3df840e7d770b092bc618dbcda1d9a754e3a8adc3"} Jul 06 19:08:20.044424 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:20.044404 2578 scope.go:117] "RemoveContainer" containerID="81f4914ff225fb1b10d4d4dfcb06adf8ee284c52a9e494f691a201b39baecec1" Jul 06 19:08:20.044703 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:20.044685 2578 scope.go:117] "RemoveContainer" containerID="b5ac33eed5ad37f22b006fb3df840e7d770b092bc618dbcda1d9a754e3a8adc3" Jul 06 19:08:20.044888 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:20.044867 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-hcl4d_openshift-console-operator(a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6)\"" pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" podUID="a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6" Jul 06 19:08:20.586429 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:20.586387 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:20.774690 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:20.774655 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:21.049122 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:21.049050 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hcl4d_a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6/console-operator/2.log" Jul 06 19:08:21.066531 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:21.066507 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bbbe3018-f456-4857-ab4f-68e07472bb0c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjkpn\" (UID: \"bbbe3018-f456-4857-ab4f-68e07472bb0c\") " pod="openshift-insights/insights-runtime-extractor-hjkpn" Jul 06 19:08:21.068788 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:21.068766 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bbbe3018-f456-4857-ab4f-68e07472bb0c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjkpn\" (UID: \"bbbe3018-f456-4857-ab4f-68e07472bb0c\") " pod="openshift-insights/insights-runtime-extractor-hjkpn" Jul 06 19:08:21.161852 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:21.161805 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xhq2g\"" Jul 06 19:08:21.169218 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:21.169198 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hjkpn" Jul 06 19:08:21.301866 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:21.301771 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hjkpn"] Jul 06 19:08:21.304981 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:08:21.304953 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbbe3018_f456_4857_ab4f_68e07472bb0c.slice/crio-d94776f0c65997bcc279754f2e37f6b6e46ca1458a6e4a461583219e3c8d00c4 WatchSource:0}: Error finding container d94776f0c65997bcc279754f2e37f6b6e46ca1458a6e4a461583219e3c8d00c4: Status 404 returned error can't find the container with id d94776f0c65997bcc279754f2e37f6b6e46ca1458a6e4a461583219e3c8d00c4 Jul 06 19:08:21.455448 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:21.455416 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:21.469482 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:21.469459 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40e3ecd3-e42e-46d6-858c-ca3c21710c7a-metrics-certs\") pod \"network-metrics-daemon-qx7rr\" (UID: \"40e3ecd3-e42e-46d6-858c-ca3c21710c7a\") " pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:08:21.469578 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:21.469562 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38637c2e-e315-4bf4-89c8-e081abdb8502-original-pull-secret\") pod \"global-pull-secret-syncer-56hnl\" (UID: \"38637c2e-e315-4bf4-89c8-e081abdb8502\") " pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:08:21.475641 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:21.475620 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 19:08:21.475708 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:21.475694 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 19:08:21.481956 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:21.481927 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38637c2e-e315-4bf4-89c8-e081abdb8502-original-pull-secret\") pod \"global-pull-secret-syncer-56hnl\" (UID: \"38637c2e-e315-4bf4-89c8-e081abdb8502\") " pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:08:21.482060 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:21.481956 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40e3ecd3-e42e-46d6-858c-ca3c21710c7a-metrics-certs\") pod \"network-metrics-daemon-qx7rr\" (UID: \"40e3ecd3-e42e-46d6-858c-ca3c21710c7a\") " pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:08:21.570192 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:21.570116 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77j9h\" (UniqueName: \"kubernetes.io/projected/4c53b7be-5d92-4555-a03e-37d50ecb15c4-kube-api-access-77j9h\") pod \"network-check-target-q4cm4\" (UID: \"4c53b7be-5d92-4555-a03e-37d50ecb15c4\") " pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:08:21.572479 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:21.572454 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77j9h\" (UniqueName: \"kubernetes.io/projected/4c53b7be-5d92-4555-a03e-37d50ecb15c4-kube-api-access-77j9h\") pod \"network-check-target-q4cm4\" (UID: \"4c53b7be-5d92-4555-a03e-37d50ecb15c4\") " pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:08:21.665152 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:21.665120 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kvrq8\"" Jul 06 19:08:21.667929 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:21.667911 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56hnl" Jul 06 19:08:21.672379 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:21.672360 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qx7rr" Jul 06 19:08:21.789541 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:21.789509 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:21.829713 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:21.828952 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-56hnl"] Jul 06 19:08:21.832956 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:08:21.832908 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38637c2e_e315_4bf4_89c8_e081abdb8502.slice/crio-0f9cf5deba8d44b0e6484dfeb87d273027a89bacdf281dafff10d859a0041d9c WatchSource:0}: Error finding container 0f9cf5deba8d44b0e6484dfeb87d273027a89bacdf281dafff10d859a0041d9c: Status 404 returned error can't find the container with id 0f9cf5deba8d44b0e6484dfeb87d273027a89bacdf281dafff10d859a0041d9c Jul 06 19:08:21.850316 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:21.850284 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qx7rr"] Jul 06 19:08:21.853914 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:08:21.853878 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40e3ecd3_e42e_46d6_858c_ca3c21710c7a.slice/crio-0f2d5a8ec51e4a366c7de1de5e0d0f33d5e47cd5994b73eab7c0ed43c5dcc7f4 WatchSource:0}: Error finding container 0f2d5a8ec51e4a366c7de1de5e0d0f33d5e47cd5994b73eab7c0ed43c5dcc7f4: Status 404 returned error can't find the container with id 0f2d5a8ec51e4a366c7de1de5e0d0f33d5e47cd5994b73eab7c0ed43c5dcc7f4 Jul 06 19:08:21.857703 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:21.857677 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bf7v6\"" Jul 06 19:08:21.866319 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:21.866291 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:08:22.048916 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:22.048815 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q4cm4"] Jul 06 19:08:22.057799 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:22.057767 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qx7rr" event={"ID":"40e3ecd3-e42e-46d6-858c-ca3c21710c7a","Type":"ContainerStarted","Data":"0f2d5a8ec51e4a366c7de1de5e0d0f33d5e47cd5994b73eab7c0ed43c5dcc7f4"} Jul 06 19:08:22.059788 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:22.059727 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-56hnl" event={"ID":"38637c2e-e315-4bf4-89c8-e081abdb8502","Type":"ContainerStarted","Data":"0f9cf5deba8d44b0e6484dfeb87d273027a89bacdf281dafff10d859a0041d9c"} Jul 06 19:08:22.061337 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:22.061313 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hjkpn" event={"ID":"bbbe3018-f456-4857-ab4f-68e07472bb0c","Type":"ContainerStarted","Data":"d94776f0c65997bcc279754f2e37f6b6e46ca1458a6e4a461583219e3c8d00c4"} Jul 06 19:08:22.193822 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:22.193778 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:22.378293 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:22.378211 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-tls\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:08:22.381415 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:22.381389 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-tls\") pod \"image-registry-57484589cb-nlmd5\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:08:22.480028 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:22.479969 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9e40546-7e20-4cba-858a-cb9a0635815c-metrics-tls\") pod \"dns-default-r9h8k\" (UID: \"b9e40546-7e20-4cba-858a-cb9a0635815c\") " pod="openshift-dns/dns-default-r9h8k" Jul 06 19:08:22.484385 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:22.484327 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9e40546-7e20-4cba-858a-cb9a0635815c-metrics-tls\") pod \"dns-default-r9h8k\" (UID: \"b9e40546-7e20-4cba-858a-cb9a0635815c\") " pod="openshift-dns/dns-default-r9h8k" Jul 06 19:08:22.579061 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:22.579029 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qrn75\"" Jul 06 19:08:22.586687 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:22.586652 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:08:22.587240 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:22.587163 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:22.668577 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:22.668549 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-59swk\"" Jul 06 19:08:22.674825 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:22.674786 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r9h8k" Jul 06 19:08:22.788685 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:22.788651 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57484589cb-nlmd5"] Jul 06 19:08:22.793474 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:08:22.793258 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23d26b44_20fe_4f81_9812_a92ebc94e3e1.slice/crio-0145265a9a8c1710a5494a2d4f48546729e377586609d59a7ea2e9f807be1e5e WatchSource:0}: Error finding container 0145265a9a8c1710a5494a2d4f48546729e377586609d59a7ea2e9f807be1e5e: Status 404 returned error can't find the container with id 0145265a9a8c1710a5494a2d4f48546729e377586609d59a7ea2e9f807be1e5e Jul 06 19:08:22.801824 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:22.801751 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:22.882116 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:22.881731 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r9h8k"] Jul 06 19:08:22.986344 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:22.986266 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:23.067913 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:23.067877 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57484589cb-nlmd5" event={"ID":"23d26b44-20fe-4f81-9812-a92ebc94e3e1","Type":"ContainerStarted","Data":"0145265a9a8c1710a5494a2d4f48546729e377586609d59a7ea2e9f807be1e5e"} Jul 06 19:08:23.075178 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:23.075141 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q4cm4" event={"ID":"4c53b7be-5d92-4555-a03e-37d50ecb15c4","Type":"ContainerStarted","Data":"03d7ff45e5dd2070e3db8eabd50630fe1c91e33a613e54e4027e6b483a7a81ac"} Jul 06 19:08:23.075309 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:23.075200 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q4cm4" event={"ID":"4c53b7be-5d92-4555-a03e-37d50ecb15c4","Type":"ContainerStarted","Data":"a1052e1dc5b971b61e2077b11ad95885ce83c911bdc6c5f9c67b58427ed91307"} Jul 06 19:08:23.075935 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:23.075904 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:08:23.108437 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:23.108393 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-q4cm4" podStartSLOduration=67.108377142 podStartE2EDuration="1m7.108377142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:07:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:23.107069813 +0000 UTC m=+67.962155400" watchObservedRunningTime="2026-07-06 19:08:23.108377142 +0000 UTC m=+67.963462706" Jul 06 19:08:23.158257 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:08:23.158225 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9e40546_7e20_4cba_858a_cb9a0635815c.slice/crio-21013db0778dfd5340282c598be57e13f904133d7196b6e8cab014232f4a7b6f WatchSource:0}: Error finding container 21013db0778dfd5340282c598be57e13f904133d7196b6e8cab014232f4a7b6f: Status 404 returned error can't find the container with id 21013db0778dfd5340282c598be57e13f904133d7196b6e8cab014232f4a7b6f Jul 06 19:08:24.080960 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:24.080926 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r9h8k" event={"ID":"b9e40546-7e20-4cba-858a-cb9a0635815c","Type":"ContainerStarted","Data":"21013db0778dfd5340282c598be57e13f904133d7196b6e8cab014232f4a7b6f"} Jul 06 19:08:26.633640 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:26.633595 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:26.850384 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:26.850298 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:26.973534 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:26.973503 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:27.006402 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:27.006375 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" Jul 06 19:08:27.006555 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:27.006434 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" Jul 06 19:08:27.006785 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:27.006771 2578 scope.go:117] "RemoveContainer" containerID="b5ac33eed5ad37f22b006fb3df840e7d770b092bc618dbcda1d9a754e3a8adc3" Jul 06 19:08:27.006964 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:27.006945 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-hcl4d_openshift-console-operator(a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6)\"" pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" podUID="a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6" Jul 06 19:08:27.195522 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:27.195423 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:27.360719 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:27.360680 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:27.484674 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:27.484589 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:27.652249 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:27.652189 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:28.103131 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.103013 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qx7rr" event={"ID":"40e3ecd3-e42e-46d6-858c-ca3c21710c7a","Type":"ContainerStarted","Data":"287b23dca6ea61ef9b0669c1942c477e605db92bf8e8d121549d09b148bed9d6"} Jul 06 19:08:28.103131 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.103077 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qx7rr" event={"ID":"40e3ecd3-e42e-46d6-858c-ca3c21710c7a","Type":"ContainerStarted","Data":"692c0c451027087513a564c3c7010254b562bf9e1431a371340ade7aaf1ada2c"} Jul 06 19:08:28.104657 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.104631 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57484589cb-nlmd5" event={"ID":"23d26b44-20fe-4f81-9812-a92ebc94e3e1","Type":"ContainerStarted","Data":"10579e435a29c866a23c50f42b29d9c989e77228c5a11ad7cd69354ec2a8cb46"} Jul 06 19:08:28.105139 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.105115 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:08:28.106797 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.106602 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r9h8k" event={"ID":"b9e40546-7e20-4cba-858a-cb9a0635815c","Type":"ContainerStarted","Data":"f13c7e152a4ed0435c288d846c6fa7b7d1b00d9032b58f301ea3d98ef93b4301"} Jul 06 19:08:28.106797 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.106650 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-r9h8k" Jul 06 19:08:28.106797 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.106677 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r9h8k" event={"ID":"b9e40546-7e20-4cba-858a-cb9a0635815c","Type":"ContainerStarted","Data":"9cf2a1ccb4684703605cbc87e99d0b34fa6547a559bb01043a09f998cd1a57f3"} Jul 06 19:08:28.108281 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.108246 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-56hnl" event={"ID":"38637c2e-e315-4bf4-89c8-e081abdb8502","Type":"ContainerStarted","Data":"7705c96cec7e606eb3c94a5d5541c7ccf87939ad3ca44200a182e29d8ba2a8df"} Jul 06 19:08:28.110066 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.110045 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hjkpn" event={"ID":"bbbe3018-f456-4857-ab4f-68e07472bb0c","Type":"ContainerStarted","Data":"47615be14de2cac5f6fd3cd3fc4ae8c4b9ffabf3a9992c8c9a0994208586cae1"} Jul 06 19:08:28.142491 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.142441 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qx7rr" podStartSLOduration=66.623651454 podStartE2EDuration="1m12.142418669s" totalImagesPullingTime="5.518767215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:07:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:28.142207013 +0000 UTC m=+72.997292600" watchObservedRunningTime="2026-07-06 19:08:28.142418669 +0000 UTC m=+72.997504255" Jul 06 19:08:28.189285 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.189233 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57484589cb-nlmd5" podStartSLOduration=71.189216567 podStartE2EDuration="1m11.189216567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:07:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:28.187695057 +0000 UTC m=+73.042780642" watchObservedRunningTime="2026-07-06 19:08:28.189216567 +0000 UTC m=+73.044302152" Jul 06 19:08:28.241253 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.241199 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-r9h8k" podStartSLOduration=33.543993042 podStartE2EDuration="38.241183176s" totalImagesPullingTime="4.697190134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:28.233910216 +0000 UTC m=+73.088995802" watchObservedRunningTime="2026-07-06 19:08:28.241183176 +0000 UTC m=+73.096268759" Jul 06 19:08:28.277650 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.277603 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-56hnl" podStartSLOduration=65.736369014 podStartE2EDuration="1m11.277585352s" totalImagesPullingTime="5.541216338s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:07:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:28.27432177 +0000 UTC m=+73.129407359" watchObservedRunningTime="2026-07-06 19:08:28.277585352 +0000 UTC m=+73.132670939" Jul 06 19:08:28.334961 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.334921 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0a419c56-3132-4f19-a6d6-f745864cb51a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-72ztj\" (UID: \"0a419c56-3132-4f19-a6d6-f745864cb51a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-72ztj" Jul 06 19:08:28.335146 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.335012 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49397d03-e891-4f65-bcc3-a17b8302ae95-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-85k7k\" (UID: \"49397d03-e891-4f65-bcc3-a17b8302ae95\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85k7k" Jul 06 19:08:28.337902 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.337873 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49397d03-e891-4f65-bcc3-a17b8302ae95-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-85k7k\" (UID: \"49397d03-e891-4f65-bcc3-a17b8302ae95\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85k7k" Jul 06 19:08:28.337902 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.337892 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0a419c56-3132-4f19-a6d6-f745864cb51a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-72ztj\" (UID: \"0a419c56-3132-4f19-a6d6-f745864cb51a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-72ztj" Jul 06 19:08:28.435812 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.435770 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/517eef3e-b288-4ece-83c5-10ecf912d99d-service-ca-bundle\") pod \"router-default-7d89958d75-2chxs\" (UID: \"517eef3e-b288-4ece-83c5-10ecf912d99d\") " pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:08:28.436009 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.435857 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/517eef3e-b288-4ece-83c5-10ecf912d99d-metrics-certs\") pod \"router-default-7d89958d75-2chxs\" (UID: \"517eef3e-b288-4ece-83c5-10ecf912d99d\") " pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:08:28.436487 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.436461 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/517eef3e-b288-4ece-83c5-10ecf912d99d-service-ca-bundle\") pod \"router-default-7d89958d75-2chxs\" (UID: \"517eef3e-b288-4ece-83c5-10ecf912d99d\") " pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:08:28.438476 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.438453 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/517eef3e-b288-4ece-83c5-10ecf912d99d-metrics-certs\") pod \"router-default-7d89958d75-2chxs\" (UID: \"517eef3e-b288-4ece-83c5-10ecf912d99d\") " pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:08:28.454931 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.454884 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:28.599033 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.598947 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pvztv\"" Jul 06 19:08:28.607179 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.607156 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-72ztj" Jul 06 19:08:28.618456 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.618426 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lns9g\"" Jul 06 19:08:28.625150 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.625125 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85k7k" Jul 06 19:08:28.627938 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.627799 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:28.652938 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.652914 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-sw4bq\"" Jul 06 19:08:28.661553 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.661516 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:08:28.792771 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.792738 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-72ztj"] Jul 06 19:08:28.806397 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.806370 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:28.816571 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.816551 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85k7k"] Jul 06 19:08:28.819269 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:08:28.819235 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49397d03_e891_4f65_bcc3_a17b8302ae95.slice/crio-69f14225ea4438b76c3b11b2e265b726c0d28430fcb1ccc288bb343e5f85627d WatchSource:0}: Error finding container 69f14225ea4438b76c3b11b2e265b726c0d28430fcb1ccc288bb343e5f85627d: Status 404 returned error can't find the container with id 69f14225ea4438b76c3b11b2e265b726c0d28430fcb1ccc288bb343e5f85627d Jul 06 19:08:28.823232 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:28.823212 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7d89958d75-2chxs"] Jul 06 19:08:28.823690 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:08:28.823671 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod517eef3e_b288_4ece_83c5_10ecf912d99d.slice/crio-be81fc91ab0cb83119805588e61b1c7128ab6c3648fe3c18cf23b90c8369fbb9 WatchSource:0}: Error finding container be81fc91ab0cb83119805588e61b1c7128ab6c3648fe3c18cf23b90c8369fbb9: Status 404 returned error can't find the container with id be81fc91ab0cb83119805588e61b1c7128ab6c3648fe3c18cf23b90c8369fbb9 Jul 06 19:08:29.116740 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:29.116632 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hjkpn" event={"ID":"bbbe3018-f456-4857-ab4f-68e07472bb0c","Type":"ContainerStarted","Data":"2fe4d0eb9ffeb15960ce2268f3924e6eec76f38f5cfef0a406c381e6079e1913"} Jul 06 19:08:29.118433 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:29.118400 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7d89958d75-2chxs" event={"ID":"517eef3e-b288-4ece-83c5-10ecf912d99d","Type":"ContainerStarted","Data":"b408f418aee2fe8642dfbde0f64e22dd6e1caaf26fda263eb324cc9f87ec07ad"} Jul 06 19:08:29.118567 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:29.118448 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7d89958d75-2chxs" event={"ID":"517eef3e-b288-4ece-83c5-10ecf912d99d","Type":"ContainerStarted","Data":"be81fc91ab0cb83119805588e61b1c7128ab6c3648fe3c18cf23b90c8369fbb9"} Jul 06 19:08:29.119684 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:29.119626 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85k7k" event={"ID":"49397d03-e891-4f65-bcc3-a17b8302ae95","Type":"ContainerStarted","Data":"69f14225ea4438b76c3b11b2e265b726c0d28430fcb1ccc288bb343e5f85627d"} Jul 06 19:08:29.121045 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:29.120691 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-72ztj" event={"ID":"0a419c56-3132-4f19-a6d6-f745864cb51a","Type":"ContainerStarted","Data":"e0a1bc02cfd43ffaeef3017c93aa473e479028ed7302318bedbad8232900a418"} Jul 06 19:08:29.662412 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:29.662381 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:08:29.665561 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:29.665529 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:08:29.813654 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:29.812434 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7d89958d75-2chxs" podStartSLOduration=33.81241074 podStartE2EDuration="33.81241074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:07:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:29.202063848 +0000 UTC m=+74.057149437" watchObservedRunningTime="2026-07-06 19:08:29.81241074 +0000 UTC m=+74.667496328" Jul 06 19:08:30.126087 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:30.126051 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:08:30.127345 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:30.127314 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7d89958d75-2chxs" Jul 06 19:08:30.520736 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:30.520659 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:30.618394 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:30.618357 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:31.722413 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:31.722371 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:31.827233 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:31.827195 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:31.905216 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:31.905183 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:32.526460 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:32.526403 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:32.658082 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:32.658048 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:32.976460 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:32.976381 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:33.139174 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:33.139131 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hjkpn" event={"ID":"bbbe3018-f456-4857-ab4f-68e07472bb0c","Type":"ContainerStarted","Data":"e1d1be04b209e897139f23e112ede0aef87f73bea4c87872df31493b4b41b194"} Jul 06 19:08:33.140649 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:33.140624 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85k7k" event={"ID":"49397d03-e891-4f65-bcc3-a17b8302ae95","Type":"ContainerStarted","Data":"9bafc5fb678add44089975baa3454893ab39d25607e16e52d77be5f12fe3f190"} Jul 06 19:08:33.142320 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:33.142298 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-72ztj" event={"ID":"0a419c56-3132-4f19-a6d6-f745864cb51a","Type":"ContainerStarted","Data":"e1a1a3e2deab391601b1e9d8998fbae4c52c8e743fd1ca8cc175cc7750418a57"} Jul 06 19:08:33.142421 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:33.142336 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-72ztj" event={"ID":"0a419c56-3132-4f19-a6d6-f745864cb51a","Type":"ContainerStarted","Data":"7253be6a1ef58f335ad8911155596f139a8225b753c655479f4e7deece8e9ea9"} Jul 06 19:08:33.224971 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:33.224922 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hjkpn" podStartSLOduration=17.608296155 podStartE2EDuration="28.224904713s" totalImagesPullingTime="10.616608558s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:08:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:33.170333002 +0000 UTC m=+78.025418588" watchObservedRunningTime="2026-07-06 19:08:33.224904713 +0000 UTC m=+78.079990292" Jul 06 19:08:33.225252 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:33.225230 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-72ztj" podStartSLOduration=34.002577622 podStartE2EDuration="37.225224807s" totalImagesPullingTime="3.222647185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:33.22473404 +0000 UTC m=+78.079819626" watchObservedRunningTime="2026-07-06 19:08:33.225224807 +0000 UTC m=+78.080310392" Jul 06 19:08:33.759687 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:33.759655 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:36.954064 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:36.954008 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:37.037282 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:37.037153 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:37.133115 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:37.133080 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:38.099516 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:38.099477 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:38.123280 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:38.123259 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-r9h8k" Jul 06 19:08:38.160946 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:38.160897 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85k7k" podStartSLOduration=38.922621501 podStartE2EDuration="42.160881097s" totalImagesPullingTime="3.238259596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:33.272820905 +0000 UTC m=+78.127906555" watchObservedRunningTime="2026-07-06 19:08:38.160881097 +0000 UTC m=+83.015966684" Jul 06 19:08:38.206868 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:38.206819 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:38.408460 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:38.408365 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:38.647329 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:38.647297 2578 scope.go:117] "RemoveContainer" containerID="b5ac33eed5ad37f22b006fb3df840e7d770b092bc618dbcda1d9a754e3a8adc3" Jul 06 19:08:38.647495 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:38.647460 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-hcl4d_openshift-console-operator(a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6)\"" pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" podUID="a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6" Jul 06 19:08:40.469949 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:40.469912 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:42.088911 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.088869 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:42.152747 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.152709 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:42.397588 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.397509 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:42.701356 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.701274 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:42.761502 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.761469 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-22twp"] Jul 06 19:08:42.764304 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.764283 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:42.769892 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.769871 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 19:08:42.770387 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.770328 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 19:08:42.770387 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.770377 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 19:08:42.770523 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.770509 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mmqkr\"" Jul 06 19:08:42.770581 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.770335 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 19:08:42.808752 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.808725 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf"] Jul 06 19:08:42.810916 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.810897 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf" Jul 06 19:08:42.812553 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.812537 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 06 19:08:42.812718 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.812694 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-ddpw8\"" Jul 06 19:08:42.812832 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.812817 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 06 19:08:42.813381 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.813363 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 06 19:08:42.815259 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.815231 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:42.835949 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.835923 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf"] Jul 06 19:08:42.843336 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.843309 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/501bccb8-ee67-46e1-bf1b-e547c0b835fe-sys\") pod \"node-exporter-22twp\" (UID: \"501bccb8-ee67-46e1-bf1b-e547c0b835fe\") " pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:42.843446 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.843387 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmkqk\" (UniqueName: \"kubernetes.io/projected/501bccb8-ee67-46e1-bf1b-e547c0b835fe-kube-api-access-nmkqk\") pod \"node-exporter-22twp\" (UID: \"501bccb8-ee67-46e1-bf1b-e547c0b835fe\") " pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:42.843446 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.843417 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-8cwcf\" (UID: \"8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf" Jul 06 19:08:42.843530 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.843446 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-8cwcf\" (UID: \"8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf" Jul 06 19:08:42.843530 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.843514 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/501bccb8-ee67-46e1-bf1b-e547c0b835fe-node-exporter-tls\") pod \"node-exporter-22twp\" (UID: \"501bccb8-ee67-46e1-bf1b-e547c0b835fe\") " pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:42.843593 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.843540 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-8cwcf\" (UID: \"8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf" Jul 06 19:08:42.843593 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.843573 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/501bccb8-ee67-46e1-bf1b-e547c0b835fe-metrics-client-ca\") pod \"node-exporter-22twp\" (UID: \"501bccb8-ee67-46e1-bf1b-e547c0b835fe\") " pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:42.843653 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.843591 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/501bccb8-ee67-46e1-bf1b-e547c0b835fe-node-exporter-textfile\") pod \"node-exporter-22twp\" (UID: \"501bccb8-ee67-46e1-bf1b-e547c0b835fe\") " pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:42.843653 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.843611 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/501bccb8-ee67-46e1-bf1b-e547c0b835fe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-22twp\" (UID: \"501bccb8-ee67-46e1-bf1b-e547c0b835fe\") " pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:42.843653 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.843648 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-8cwcf\" (UID: \"8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf" Jul 06 19:08:42.843747 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.843667 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-8cwcf\" (UID: \"8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf" Jul 06 19:08:42.843747 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.843697 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/501bccb8-ee67-46e1-bf1b-e547c0b835fe-root\") pod \"node-exporter-22twp\" (UID: \"501bccb8-ee67-46e1-bf1b-e547c0b835fe\") " pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:42.843747 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.843718 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff5z4\" (UniqueName: \"kubernetes.io/projected/8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9-kube-api-access-ff5z4\") pod \"kube-state-metrics-7c9dbb8b7d-8cwcf\" (UID: \"8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf" Jul 06 19:08:42.843854 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.843762 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/501bccb8-ee67-46e1-bf1b-e547c0b835fe-node-exporter-accelerators-collector-config\") pod \"node-exporter-22twp\" (UID: \"501bccb8-ee67-46e1-bf1b-e547c0b835fe\") " pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:42.843854 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.843789 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/501bccb8-ee67-46e1-bf1b-e547c0b835fe-node-exporter-wtmp\") pod \"node-exporter-22twp\" (UID: \"501bccb8-ee67-46e1-bf1b-e547c0b835fe\") " pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:42.909060 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.909015 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:42.944255 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.944230 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/501bccb8-ee67-46e1-bf1b-e547c0b835fe-node-exporter-accelerators-collector-config\") pod \"node-exporter-22twp\" (UID: \"501bccb8-ee67-46e1-bf1b-e547c0b835fe\") " pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:42.944397 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.944265 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/501bccb8-ee67-46e1-bf1b-e547c0b835fe-node-exporter-wtmp\") pod \"node-exporter-22twp\" (UID: \"501bccb8-ee67-46e1-bf1b-e547c0b835fe\") " pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:42.944397 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.944297 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/501bccb8-ee67-46e1-bf1b-e547c0b835fe-sys\") pod \"node-exporter-22twp\" (UID: \"501bccb8-ee67-46e1-bf1b-e547c0b835fe\") " pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:42.944397 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.944319 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmkqk\" (UniqueName: \"kubernetes.io/projected/501bccb8-ee67-46e1-bf1b-e547c0b835fe-kube-api-access-nmkqk\") pod \"node-exporter-22twp\" (UID: \"501bccb8-ee67-46e1-bf1b-e547c0b835fe\") " pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:42.944397 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.944338 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-8cwcf\" (UID: \"8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf" Jul 06 19:08:42.944397 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.944359 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-8cwcf\" (UID: \"8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf" Jul 06 19:08:42.944397 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.944384 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/501bccb8-ee67-46e1-bf1b-e547c0b835fe-node-exporter-tls\") pod \"node-exporter-22twp\" (UID: \"501bccb8-ee67-46e1-bf1b-e547c0b835fe\") " pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:42.944397 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.944400 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-8cwcf\" (UID: \"8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf" Jul 06 19:08:42.944742 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.944433 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/501bccb8-ee67-46e1-bf1b-e547c0b835fe-metrics-client-ca\") pod \"node-exporter-22twp\" (UID: \"501bccb8-ee67-46e1-bf1b-e547c0b835fe\") " pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:42.944742 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.944459 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/501bccb8-ee67-46e1-bf1b-e547c0b835fe-node-exporter-textfile\") pod \"node-exporter-22twp\" (UID: \"501bccb8-ee67-46e1-bf1b-e547c0b835fe\") " pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:42.944742 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.944447 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/501bccb8-ee67-46e1-bf1b-e547c0b835fe-sys\") pod \"node-exporter-22twp\" (UID: \"501bccb8-ee67-46e1-bf1b-e547c0b835fe\") " pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:42.944742 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.944490 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/501bccb8-ee67-46e1-bf1b-e547c0b835fe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-22twp\" (UID: \"501bccb8-ee67-46e1-bf1b-e547c0b835fe\") " pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:42.944742 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.944533 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-8cwcf\" (UID: \"8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf" Jul 06 19:08:42.944742 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.944562 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-8cwcf\" (UID: \"8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf" Jul 06 19:08:42.944742 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.944586 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/501bccb8-ee67-46e1-bf1b-e547c0b835fe-root\") pod \"node-exporter-22twp\" (UID: \"501bccb8-ee67-46e1-bf1b-e547c0b835fe\") " pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:42.944742 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.944608 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff5z4\" (UniqueName: \"kubernetes.io/projected/8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9-kube-api-access-ff5z4\") pod \"kube-state-metrics-7c9dbb8b7d-8cwcf\" (UID: \"8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf" Jul 06 19:08:42.945202 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.944777 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-8cwcf\" (UID: \"8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf" Jul 06 19:08:42.945202 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.944961 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/501bccb8-ee67-46e1-bf1b-e547c0b835fe-node-exporter-accelerators-collector-config\") pod \"node-exporter-22twp\" (UID: \"501bccb8-ee67-46e1-bf1b-e547c0b835fe\") " pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:42.945202 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.945024 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/501bccb8-ee67-46e1-bf1b-e547c0b835fe-root\") pod \"node-exporter-22twp\" (UID: \"501bccb8-ee67-46e1-bf1b-e547c0b835fe\") " pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:42.945202 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.945043 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/501bccb8-ee67-46e1-bf1b-e547c0b835fe-metrics-client-ca\") pod \"node-exporter-22twp\" (UID: \"501bccb8-ee67-46e1-bf1b-e547c0b835fe\") " pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:42.945202 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.945080 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/501bccb8-ee67-46e1-bf1b-e547c0b835fe-node-exporter-textfile\") pod \"node-exporter-22twp\" (UID: \"501bccb8-ee67-46e1-bf1b-e547c0b835fe\") " pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:42.945202 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.945121 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/501bccb8-ee67-46e1-bf1b-e547c0b835fe-node-exporter-wtmp\") pod \"node-exporter-22twp\" (UID: \"501bccb8-ee67-46e1-bf1b-e547c0b835fe\") " pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:42.945658 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.945629 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-8cwcf\" (UID: \"8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf" Jul 06 19:08:42.945731 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.945676 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-8cwcf\" (UID: \"8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf" Jul 06 19:08:42.947104 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.947072 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/501bccb8-ee67-46e1-bf1b-e547c0b835fe-node-exporter-tls\") pod \"node-exporter-22twp\" (UID: \"501bccb8-ee67-46e1-bf1b-e547c0b835fe\") " pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:42.947214 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.947126 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/501bccb8-ee67-46e1-bf1b-e547c0b835fe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-22twp\" (UID: \"501bccb8-ee67-46e1-bf1b-e547c0b835fe\") " pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:42.947214 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.947142 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-8cwcf\" (UID: \"8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf" Jul 06 19:08:42.947214 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.947140 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-8cwcf\" (UID: \"8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf" Jul 06 19:08:42.965667 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.965611 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff5z4\" (UniqueName: \"kubernetes.io/projected/8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9-kube-api-access-ff5z4\") pod \"kube-state-metrics-7c9dbb8b7d-8cwcf\" (UID: \"8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf" Jul 06 19:08:42.968555 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:42.968537 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmkqk\" (UniqueName: \"kubernetes.io/projected/501bccb8-ee67-46e1-bf1b-e547c0b835fe-kube-api-access-nmkqk\") pod \"node-exporter-22twp\" (UID: \"501bccb8-ee67-46e1-bf1b-e547c0b835fe\") " pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:43.007433 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:43.007395 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:43.072776 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:43.072745 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-22twp" Jul 06 19:08:43.082633 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:08:43.082609 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod501bccb8_ee67_46e1_bf1b_e547c0b835fe.slice/crio-7ae633f2db183ad59f8ce01c4c3b02bef15ccd1c74a46a531bfc014855660040 WatchSource:0}: Error finding container 7ae633f2db183ad59f8ce01c4c3b02bef15ccd1c74a46a531bfc014855660040: Status 404 returned error can't find the container with id 7ae633f2db183ad59f8ce01c4c3b02bef15ccd1c74a46a531bfc014855660040 Jul 06 19:08:43.115661 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:43.115632 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:43.119549 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:43.119532 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf" Jul 06 19:08:43.179592 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:43.179562 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-22twp" event={"ID":"501bccb8-ee67-46e1-bf1b-e547c0b835fe","Type":"ContainerStarted","Data":"7ae633f2db183ad59f8ce01c4c3b02bef15ccd1c74a46a531bfc014855660040"} Jul 06 19:08:43.234506 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:43.234425 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:43.263895 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:43.263867 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf"] Jul 06 19:08:43.267553 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:08:43.267526 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f6d1a22_f103_4c84_8ec5_bfe548e5d5c9.slice/crio-f5fccb343cb012c94fa1a41f644b1abddb85f9d6166ef98199494b7e001e5fbf WatchSource:0}: Error finding container f5fccb343cb012c94fa1a41f644b1abddb85f9d6166ef98199494b7e001e5fbf: Status 404 returned error can't find the container with id f5fccb343cb012c94fa1a41f644b1abddb85f9d6166ef98199494b7e001e5fbf Jul 06 19:08:43.329405 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:43.329370 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:43.478871 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:43.478819 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:43.788511 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:43.788466 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:43.963663 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:43.963562 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:44.190526 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:44.190479 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-22twp" event={"ID":"501bccb8-ee67-46e1-bf1b-e547c0b835fe","Type":"ContainerStarted","Data":"71bcb7d0f88634a50911d36e78b649bd5bcf4ab92fdb02feafab0b1fde9cc946"} Jul 06 19:08:44.191868 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:44.191800 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf" event={"ID":"8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9","Type":"ContainerStarted","Data":"f5fccb343cb012c94fa1a41f644b1abddb85f9d6166ef98199494b7e001e5fbf"} Jul 06 19:08:44.234269 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:44.234234 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:45.197491 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:45.197455 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf" event={"ID":"8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9","Type":"ContainerStarted","Data":"1daada833f0ce9f76345a5becd64ab473f77b70d354faa09c66c44070afde1a4"} Jul 06 19:08:45.197976 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:45.197522 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf" event={"ID":"8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9","Type":"ContainerStarted","Data":"75e1a15afb1011d9b052ae2d762dca4f0372f915fe645dd98b3c9363534b8e10"} Jul 06 19:08:45.197976 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:45.197548 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf" event={"ID":"8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9","Type":"ContainerStarted","Data":"c46491602169dde6f33171a291dccdbaca529edab223a65ef14ef0f55d492729"} Jul 06 19:08:45.198943 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:45.198921 2578 generic.go:356] "Generic (PLEG): container finished" podID="501bccb8-ee67-46e1-bf1b-e547c0b835fe" containerID="71bcb7d0f88634a50911d36e78b649bd5bcf4ab92fdb02feafab0b1fde9cc946" exitCode=0 Jul 06 19:08:45.199040 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:45.198956 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-22twp" event={"ID":"501bccb8-ee67-46e1-bf1b-e547c0b835fe","Type":"ContainerDied","Data":"71bcb7d0f88634a50911d36e78b649bd5bcf4ab92fdb02feafab0b1fde9cc946"} Jul 06 19:08:45.276545 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:45.276497 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8cwcf" podStartSLOduration=2.199802384 podStartE2EDuration="3.276481483s" totalImagesPullingTime="1.076679099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:08:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:45.230718696 +0000 UTC m=+90.085804286" watchObservedRunningTime="2026-07-06 19:08:45.276481483 +0000 UTC m=+90.131567070" Jul 06 19:08:45.977518 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:45.977484 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:46.201073 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:46.201037 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:46.204471 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:46.204441 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-22twp" event={"ID":"501bccb8-ee67-46e1-bf1b-e547c0b835fe","Type":"ContainerStarted","Data":"e1231fc8db381a860ce6087bd3f4042c40f2827a700147c52097464e230162ae"} Jul 06 19:08:46.204606 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:46.204529 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-22twp" event={"ID":"501bccb8-ee67-46e1-bf1b-e547c0b835fe","Type":"ContainerStarted","Data":"a39f1505a0236c7e0005e7fbeac79b6f35f5f62f7ecf71c2c370021658d0410c"} Jul 06 19:08:46.252478 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:46.252388 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-22twp" podStartSLOduration=3.368876971 podStartE2EDuration="4.252372489s" totalImagesPullingTime="810.47676ms" totalInitContainerRuntime="73.018758ms" isStatefulPod=true podCreationTimestamp="2026-07-06 19:08:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:46.252038338 +0000 UTC m=+91.107123925" watchObservedRunningTime="2026-07-06 19:08:46.252372489 +0000 UTC m=+91.107458074" Jul 06 19:08:46.324220 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:46.324185 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:46.581035 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:46.580953 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:46.659074 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:46.659041 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:47.522211 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.522175 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:47.567319 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.567285 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5d656d5c74-vps6g"] Jul 06 19:08:47.569579 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.569561 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" Jul 06 19:08:47.574038 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.574020 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 06 19:08:47.574719 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.574702 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 19:08:47.577775 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.577753 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 06 19:08:47.579563 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.579544 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bt1gjqr9elpk\"" Jul 06 19:08:47.579954 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.579941 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 06 19:08:47.580298 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.580285 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vp7zb\"" Jul 06 19:08:47.683576 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.683548 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56z75\" (UniqueName: \"kubernetes.io/projected/2369f1c8-b673-4dcd-a1bb-b9d57764c2bc-kube-api-access-56z75\") pod \"metrics-server-5d656d5c74-vps6g\" (UID: \"2369f1c8-b673-4dcd-a1bb-b9d57764c2bc\") " pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" Jul 06 19:08:47.683576 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.683579 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2369f1c8-b673-4dcd-a1bb-b9d57764c2bc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d656d5c74-vps6g\" (UID: \"2369f1c8-b673-4dcd-a1bb-b9d57764c2bc\") " pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" Jul 06 19:08:47.683834 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.683606 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2369f1c8-b673-4dcd-a1bb-b9d57764c2bc-metrics-server-audit-profiles\") pod \"metrics-server-5d656d5c74-vps6g\" (UID: \"2369f1c8-b673-4dcd-a1bb-b9d57764c2bc\") " pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" Jul 06 19:08:47.683834 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.683690 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2369f1c8-b673-4dcd-a1bb-b9d57764c2bc-audit-log\") pod \"metrics-server-5d656d5c74-vps6g\" (UID: \"2369f1c8-b673-4dcd-a1bb-b9d57764c2bc\") " pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" Jul 06 19:08:47.683834 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.683744 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2369f1c8-b673-4dcd-a1bb-b9d57764c2bc-secret-metrics-server-tls\") pod \"metrics-server-5d656d5c74-vps6g\" (UID: \"2369f1c8-b673-4dcd-a1bb-b9d57764c2bc\") " pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" Jul 06 19:08:47.683834 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.683772 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2369f1c8-b673-4dcd-a1bb-b9d57764c2bc-client-ca-bundle\") pod \"metrics-server-5d656d5c74-vps6g\" (UID: \"2369f1c8-b673-4dcd-a1bb-b9d57764c2bc\") " pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" Jul 06 19:08:47.683834 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.683827 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2369f1c8-b673-4dcd-a1bb-b9d57764c2bc-secret-metrics-server-client-certs\") pod \"metrics-server-5d656d5c74-vps6g\" (UID: \"2369f1c8-b673-4dcd-a1bb-b9d57764c2bc\") " pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" Jul 06 19:08:47.686850 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.686812 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5d656d5c74-vps6g"] Jul 06 19:08:47.701344 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.701316 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-7q2rm"] Jul 06 19:08:47.704047 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.704027 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7q2rm" Jul 06 19:08:47.707762 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.707732 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 06 19:08:47.707930 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.707912 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hq9tp\"" Jul 06 19:08:47.729363 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.729337 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-7q2rm"] Jul 06 19:08:47.784609 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.784526 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56z75\" (UniqueName: \"kubernetes.io/projected/2369f1c8-b673-4dcd-a1bb-b9d57764c2bc-kube-api-access-56z75\") pod \"metrics-server-5d656d5c74-vps6g\" (UID: \"2369f1c8-b673-4dcd-a1bb-b9d57764c2bc\") " pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" Jul 06 19:08:47.784609 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.784559 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2369f1c8-b673-4dcd-a1bb-b9d57764c2bc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d656d5c74-vps6g\" (UID: \"2369f1c8-b673-4dcd-a1bb-b9d57764c2bc\") " pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" Jul 06 19:08:47.784609 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.784583 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2369f1c8-b673-4dcd-a1bb-b9d57764c2bc-metrics-server-audit-profiles\") pod \"metrics-server-5d656d5c74-vps6g\" (UID: \"2369f1c8-b673-4dcd-a1bb-b9d57764c2bc\") " pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" Jul 06 19:08:47.784609 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.784607 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2369f1c8-b673-4dcd-a1bb-b9d57764c2bc-audit-log\") pod \"metrics-server-5d656d5c74-vps6g\" (UID: \"2369f1c8-b673-4dcd-a1bb-b9d57764c2bc\") " pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" Jul 06 19:08:47.784969 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.784634 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2369f1c8-b673-4dcd-a1bb-b9d57764c2bc-secret-metrics-server-tls\") pod \"metrics-server-5d656d5c74-vps6g\" (UID: \"2369f1c8-b673-4dcd-a1bb-b9d57764c2bc\") " pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" Jul 06 19:08:47.784969 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.784651 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2369f1c8-b673-4dcd-a1bb-b9d57764c2bc-client-ca-bundle\") pod \"metrics-server-5d656d5c74-vps6g\" (UID: \"2369f1c8-b673-4dcd-a1bb-b9d57764c2bc\") " pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" Jul 06 19:08:47.784969 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.784673 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bc6ce303-aeb1-4294-8526-44585cf2e67d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-7q2rm\" (UID: \"bc6ce303-aeb1-4294-8526-44585cf2e67d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7q2rm" Jul 06 19:08:47.784969 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.784704 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w64x7\" (UniqueName: \"kubernetes.io/projected/bc6ce303-aeb1-4294-8526-44585cf2e67d-kube-api-access-w64x7\") pod \"monitoring-plugin-d5dcff7cf-7q2rm\" (UID: \"bc6ce303-aeb1-4294-8526-44585cf2e67d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7q2rm" Jul 06 19:08:47.784969 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.784802 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2369f1c8-b673-4dcd-a1bb-b9d57764c2bc-secret-metrics-server-client-certs\") pod \"metrics-server-5d656d5c74-vps6g\" (UID: \"2369f1c8-b673-4dcd-a1bb-b9d57764c2bc\") " pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" Jul 06 19:08:47.785217 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.785105 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2369f1c8-b673-4dcd-a1bb-b9d57764c2bc-audit-log\") pod \"metrics-server-5d656d5c74-vps6g\" (UID: \"2369f1c8-b673-4dcd-a1bb-b9d57764c2bc\") " pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" Jul 06 19:08:47.785400 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.785378 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2369f1c8-b673-4dcd-a1bb-b9d57764c2bc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d656d5c74-vps6g\" (UID: \"2369f1c8-b673-4dcd-a1bb-b9d57764c2bc\") " pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" Jul 06 19:08:47.785631 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.785612 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2369f1c8-b673-4dcd-a1bb-b9d57764c2bc-metrics-server-audit-profiles\") pod \"metrics-server-5d656d5c74-vps6g\" (UID: \"2369f1c8-b673-4dcd-a1bb-b9d57764c2bc\") " pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" Jul 06 19:08:47.787132 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.787113 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2369f1c8-b673-4dcd-a1bb-b9d57764c2bc-secret-metrics-server-tls\") pod \"metrics-server-5d656d5c74-vps6g\" (UID: \"2369f1c8-b673-4dcd-a1bb-b9d57764c2bc\") " pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" Jul 06 19:08:47.787520 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.787501 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2369f1c8-b673-4dcd-a1bb-b9d57764c2bc-secret-metrics-server-client-certs\") pod \"metrics-server-5d656d5c74-vps6g\" (UID: \"2369f1c8-b673-4dcd-a1bb-b9d57764c2bc\") " pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" Jul 06 19:08:47.787611 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.787588 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2369f1c8-b673-4dcd-a1bb-b9d57764c2bc-client-ca-bundle\") pod \"metrics-server-5d656d5c74-vps6g\" (UID: \"2369f1c8-b673-4dcd-a1bb-b9d57764c2bc\") " pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" Jul 06 19:08:47.797291 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.797269 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56z75\" (UniqueName: \"kubernetes.io/projected/2369f1c8-b673-4dcd-a1bb-b9d57764c2bc-kube-api-access-56z75\") pod \"metrics-server-5d656d5c74-vps6g\" (UID: \"2369f1c8-b673-4dcd-a1bb-b9d57764c2bc\") " pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" Jul 06 19:08:47.878645 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.878613 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" Jul 06 19:08:47.885684 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.885651 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bc6ce303-aeb1-4294-8526-44585cf2e67d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-7q2rm\" (UID: \"bc6ce303-aeb1-4294-8526-44585cf2e67d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7q2rm" Jul 06 19:08:47.885818 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.885707 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w64x7\" (UniqueName: \"kubernetes.io/projected/bc6ce303-aeb1-4294-8526-44585cf2e67d-kube-api-access-w64x7\") pod \"monitoring-plugin-d5dcff7cf-7q2rm\" (UID: \"bc6ce303-aeb1-4294-8526-44585cf2e67d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7q2rm" Jul 06 19:08:47.885818 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:47.885799 2578 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 06 19:08:47.885969 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:08:47.885893 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc6ce303-aeb1-4294-8526-44585cf2e67d-monitoring-plugin-cert podName:bc6ce303-aeb1-4294-8526-44585cf2e67d nodeName:}" failed. No retries permitted until 2026-07-06 19:08:48.385872172 +0000 UTC m=+93.240957739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/bc6ce303-aeb1-4294-8526-44585cf2e67d-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-7q2rm" (UID: "bc6ce303-aeb1-4294-8526-44585cf2e67d") : secret "monitoring-plugin-cert" not found Jul 06 19:08:47.896964 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:47.896938 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w64x7\" (UniqueName: \"kubernetes.io/projected/bc6ce303-aeb1-4294-8526-44585cf2e67d-kube-api-access-w64x7\") pod \"monitoring-plugin-d5dcff7cf-7q2rm\" (UID: \"bc6ce303-aeb1-4294-8526-44585cf2e67d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7q2rm" Jul 06 19:08:48.036880 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:48.036850 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5d656d5c74-vps6g"] Jul 06 19:08:48.038990 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:08:48.038969 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2369f1c8_b673_4dcd_a1bb_b9d57764c2bc.slice/crio-5ab1ce9af40d2dd36d2ffefa9f94877620444370daa2e1cc384566f47a65cb5a WatchSource:0}: Error finding container 5ab1ce9af40d2dd36d2ffefa9f94877620444370daa2e1cc384566f47a65cb5a: Status 404 returned error can't find the container with id 5ab1ce9af40d2dd36d2ffefa9f94877620444370daa2e1cc384566f47a65cb5a Jul 06 19:08:48.208305 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:48.208270 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:48.217222 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:48.217191 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" event={"ID":"2369f1c8-b673-4dcd-a1bb-b9d57764c2bc","Type":"ContainerStarted","Data":"5ab1ce9af40d2dd36d2ffefa9f94877620444370daa2e1cc384566f47a65cb5a"} Jul 06 19:08:48.386980 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:48.386947 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57484589cb-nlmd5"] Jul 06 19:08:48.391978 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:48.391950 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bc6ce303-aeb1-4294-8526-44585cf2e67d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-7q2rm\" (UID: \"bc6ce303-aeb1-4294-8526-44585cf2e67d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7q2rm" Jul 06 19:08:48.392315 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:48.392293 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:08:48.394235 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:48.394216 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bc6ce303-aeb1-4294-8526-44585cf2e67d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-7q2rm\" (UID: \"bc6ce303-aeb1-4294-8526-44585cf2e67d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7q2rm" Jul 06 19:08:48.597174 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:48.597132 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:48.614734 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:48.614706 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7q2rm" Jul 06 19:08:48.719624 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:48.719594 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:48.788299 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:48.788268 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-7q2rm"] Jul 06 19:08:48.792417 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:08:48.792389 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc6ce303_aeb1_4294_8526_44585cf2e67d.slice/crio-f5310812b761fac01de5a4209c45e24dc06e4aede932101ec146c91c9d6b42ad WatchSource:0}: Error finding container f5310812b761fac01de5a4209c45e24dc06e4aede932101ec146c91c9d6b42ad: Status 404 returned error can't find the container with id f5310812b761fac01de5a4209c45e24dc06e4aede932101ec146c91c9d6b42ad Jul 06 19:08:49.222229 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:49.222198 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7q2rm" event={"ID":"bc6ce303-aeb1-4294-8526-44585cf2e67d","Type":"ContainerStarted","Data":"f5310812b761fac01de5a4209c45e24dc06e4aede932101ec146c91c9d6b42ad"} Jul 06 19:08:49.804120 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:49.804075 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:50.229381 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:50.229349 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" event={"ID":"2369f1c8-b673-4dcd-a1bb-b9d57764c2bc","Type":"ContainerStarted","Data":"39214d119b02a132f41bd6a51a5e3f231b0a8c32055460934c07855c45296b54"} Jul 06 19:08:50.230801 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:50.230777 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7q2rm" event={"ID":"bc6ce303-aeb1-4294-8526-44585cf2e67d","Type":"ContainerStarted","Data":"7b877ae25d028521a122a3858556d5ba836a148d9ddb7563d84b33572caf78f1"} Jul 06 19:08:50.230927 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:50.230869 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7q2rm" Jul 06 19:08:50.235643 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:50.235620 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7q2rm" Jul 06 19:08:50.484553 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:50.484420 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" podStartSLOduration=2.3088534960000002 podStartE2EDuration="3.484401905s" totalImagesPullingTime="1.175548409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:50.396620745 +0000 UTC m=+95.251706332" watchObservedRunningTime="2026-07-06 19:08:50.484401905 +0000 UTC m=+95.339487491" Jul 06 19:08:50.485035 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:50.485000 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7q2rm" podStartSLOduration=2.329159565 podStartE2EDuration="3.484990679s" totalImagesPullingTime="1.155831114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:50.484583927 +0000 UTC m=+95.339669513" watchObservedRunningTime="2026-07-06 19:08:50.484990679 +0000 UTC m=+95.340076265" Jul 06 19:08:50.647341 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:50.647306 2578 scope.go:117] "RemoveContainer" containerID="b5ac33eed5ad37f22b006fb3df840e7d770b092bc618dbcda1d9a754e3a8adc3" Jul 06 19:08:51.236536 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:51.236508 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hcl4d_a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6/console-operator/2.log" Jul 06 19:08:51.236946 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:51.236631 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" event={"ID":"a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6","Type":"ContainerStarted","Data":"c3b05b8c973eddb98d3961f77e8e08a8194488bcf2c968c875f97d00f212ae57"} Jul 06 19:08:51.237281 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:51.237255 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" Jul 06 19:08:51.242041 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:51.242021 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" Jul 06 19:08:51.394343 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:51.394285 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-hcl4d" podStartSLOduration=49.376058705 podStartE2EDuration="55.394267769s" totalImagesPullingTime="6.018209064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:51.323391206 +0000 UTC m=+96.178476792" watchObservedRunningTime="2026-07-06 19:08:51.394267769 +0000 UTC m=+96.249353354" Jul 06 19:08:51.534223 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:51.534147 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-n9pl5"] Jul 06 19:08:51.536214 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:51.536198 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-n9pl5" Jul 06 19:08:51.555984 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:51.555958 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-n9pl5"] Jul 06 19:08:51.571131 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:51.571111 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 19:08:51.571131 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:51.571132 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-2cgvs\"" Jul 06 19:08:51.571399 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:51.571385 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 19:08:51.609004 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:51.608971 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:51.625184 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:51.625160 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdhhl\" (UniqueName: \"kubernetes.io/projected/0abdfb63-00b2-444f-916a-421844e78d67-kube-api-access-bdhhl\") pod \"downloads-685bfb5f64-n9pl5\" (UID: \"0abdfb63-00b2-444f-916a-421844e78d67\") " pod="openshift-console/downloads-685bfb5f64-n9pl5" Jul 06 19:08:51.702121 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:51.702087 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:51.726527 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:51.726496 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdhhl\" (UniqueName: \"kubernetes.io/projected/0abdfb63-00b2-444f-916a-421844e78d67-kube-api-access-bdhhl\") pod \"downloads-685bfb5f64-n9pl5\" (UID: \"0abdfb63-00b2-444f-916a-421844e78d67\") " pod="openshift-console/downloads-685bfb5f64-n9pl5" Jul 06 19:08:51.746590 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:51.746561 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdhhl\" (UniqueName: \"kubernetes.io/projected/0abdfb63-00b2-444f-916a-421844e78d67-kube-api-access-bdhhl\") pod \"downloads-685bfb5f64-n9pl5\" (UID: \"0abdfb63-00b2-444f-916a-421844e78d67\") " pod="openshift-console/downloads-685bfb5f64-n9pl5" Jul 06 19:08:51.814747 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:51.814663 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:51.844601 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:51.844573 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-n9pl5" Jul 06 19:08:52.017388 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:08:52.017360 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0abdfb63_00b2_444f_916a_421844e78d67.slice/crio-a52576582f0e395d28377b7cf59073169f53c0b1b5fb972b48c6a51b68edee46 WatchSource:0}: Error finding container a52576582f0e395d28377b7cf59073169f53c0b1b5fb972b48c6a51b68edee46: Status 404 returned error can't find the container with id a52576582f0e395d28377b7cf59073169f53c0b1b5fb972b48c6a51b68edee46 Jul 06 19:08:52.020606 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:52.020587 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-n9pl5"] Jul 06 19:08:52.071700 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:52.071628 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:52.192408 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:52.192377 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:52.242116 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:52.242079 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-n9pl5" event={"ID":"0abdfb63-00b2-444f-916a-421844e78d67","Type":"ContainerStarted","Data":"a52576582f0e395d28377b7cf59073169f53c0b1b5fb972b48c6a51b68edee46"} Jul 06 19:08:52.538006 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:52.537969 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:53.151307 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:53.151272 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:53.321919 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:53.321887 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:53.451982 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:53.451890 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:55.091072 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:55.091048 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-q4cm4" Jul 06 19:08:55.221867 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:55.221813 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:55.280777 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:55.280745 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:55.571717 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:55.571631 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:55.676075 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:55.676016 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:57.128904 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:57.128872 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:08:57.229156 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:08:57.229123 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:00.582857 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:00.582794 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:00.744338 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:00.744303 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:00.792379 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:00.792345 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c4dbf48f9-g4lqq"] Jul 06 19:09:00.948492 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:00.948457 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c4dbf48f9-g4lqq"] Jul 06 19:09:00.948693 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:00.948578 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c4dbf48f9-g4lqq" Jul 06 19:09:00.955441 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:00.955360 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 19:09:00.955441 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:00.955394 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 19:09:00.955441 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:00.955408 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2gtw9\"" Jul 06 19:09:00.955441 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:00.955400 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 19:09:00.955769 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:00.955400 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 19:09:00.955769 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:00.955360 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 19:09:01.009651 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:01.009617 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-console-serving-cert\") pod \"console-7c4dbf48f9-g4lqq\" (UID: \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\") " pod="openshift-console/console-7c4dbf48f9-g4lqq" Jul 06 19:09:01.009852 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:01.009696 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-console-oauth-config\") pod \"console-7c4dbf48f9-g4lqq\" (UID: \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\") " pod="openshift-console/console-7c4dbf48f9-g4lqq" Jul 06 19:09:01.009852 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:01.009739 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-oauth-serving-cert\") pod \"console-7c4dbf48f9-g4lqq\" (UID: \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\") " pod="openshift-console/console-7c4dbf48f9-g4lqq" Jul 06 19:09:01.009956 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:01.009861 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-service-ca\") pod \"console-7c4dbf48f9-g4lqq\" (UID: \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\") " pod="openshift-console/console-7c4dbf48f9-g4lqq" Jul 06 19:09:01.009956 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:01.009929 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-console-config\") pod \"console-7c4dbf48f9-g4lqq\" (UID: \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\") " pod="openshift-console/console-7c4dbf48f9-g4lqq" Jul 06 19:09:01.010064 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:01.009964 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrn2k\" (UniqueName: \"kubernetes.io/projected/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-kube-api-access-qrn2k\") pod \"console-7c4dbf48f9-g4lqq\" (UID: \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\") " pod="openshift-console/console-7c4dbf48f9-g4lqq" Jul 06 19:09:01.110747 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:01.110717 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-service-ca\") pod \"console-7c4dbf48f9-g4lqq\" (UID: \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\") " pod="openshift-console/console-7c4dbf48f9-g4lqq" Jul 06 19:09:01.110946 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:01.110779 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-console-config\") pod \"console-7c4dbf48f9-g4lqq\" (UID: \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\") " pod="openshift-console/console-7c4dbf48f9-g4lqq" Jul 06 19:09:01.110946 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:01.110812 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrn2k\" (UniqueName: \"kubernetes.io/projected/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-kube-api-access-qrn2k\") pod \"console-7c4dbf48f9-g4lqq\" (UID: \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\") " pod="openshift-console/console-7c4dbf48f9-g4lqq" Jul 06 19:09:01.110946 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:01.110878 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-console-serving-cert\") pod \"console-7c4dbf48f9-g4lqq\" (UID: \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\") " pod="openshift-console/console-7c4dbf48f9-g4lqq" Jul 06 19:09:01.110946 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:01.110902 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-console-oauth-config\") pod \"console-7c4dbf48f9-g4lqq\" (UID: \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\") " pod="openshift-console/console-7c4dbf48f9-g4lqq" Jul 06 19:09:01.110946 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:01.110923 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-oauth-serving-cert\") pod \"console-7c4dbf48f9-g4lqq\" (UID: \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\") " pod="openshift-console/console-7c4dbf48f9-g4lqq" Jul 06 19:09:01.111571 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:01.111543 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-service-ca\") pod \"console-7c4dbf48f9-g4lqq\" (UID: \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\") " pod="openshift-console/console-7c4dbf48f9-g4lqq" Jul 06 19:09:01.111678 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:01.111585 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-console-config\") pod \"console-7c4dbf48f9-g4lqq\" (UID: \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\") " pod="openshift-console/console-7c4dbf48f9-g4lqq" Jul 06 19:09:01.111678 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:01.111652 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-oauth-serving-cert\") pod \"console-7c4dbf48f9-g4lqq\" (UID: \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\") " pod="openshift-console/console-7c4dbf48f9-g4lqq" Jul 06 19:09:01.113661 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:01.113634 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-console-oauth-config\") pod \"console-7c4dbf48f9-g4lqq\" (UID: \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\") " pod="openshift-console/console-7c4dbf48f9-g4lqq" Jul 06 19:09:01.113876 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:01.113832 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-console-serving-cert\") pod \"console-7c4dbf48f9-g4lqq\" (UID: \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\") " pod="openshift-console/console-7c4dbf48f9-g4lqq" Jul 06 19:09:01.121633 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:01.121608 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrn2k\" (UniqueName: \"kubernetes.io/projected/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-kube-api-access-qrn2k\") pod \"console-7c4dbf48f9-g4lqq\" (UID: \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\") " pod="openshift-console/console-7c4dbf48f9-g4lqq" Jul 06 19:09:01.260706 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:01.260613 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c4dbf48f9-g4lqq" Jul 06 19:09:01.463927 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:01.463896 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c4dbf48f9-g4lqq"] Jul 06 19:09:01.467762 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:09:01.467734 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3b0f70f_b9c2_4487_9cbc_e7c6936bdf94.slice/crio-1941f49ec450a6d4a8603fdc9240226a733f9b3af0079de7d39e75e4d5ff017b WatchSource:0}: Error finding container 1941f49ec450a6d4a8603fdc9240226a733f9b3af0079de7d39e75e4d5ff017b: Status 404 returned error can't find the container with id 1941f49ec450a6d4a8603fdc9240226a733f9b3af0079de7d39e75e4d5ff017b Jul 06 19:09:02.288782 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:02.288746 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c4dbf48f9-g4lqq" event={"ID":"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94","Type":"ContainerStarted","Data":"1941f49ec450a6d4a8603fdc9240226a733f9b3af0079de7d39e75e4d5ff017b"} Jul 06 19:09:04.167596 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.167539 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:04.174087 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.174061 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bd4c58948-wfkxl"] Jul 06 19:09:04.205277 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.205243 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:09:04.211773 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.211708 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bd4c58948-wfkxl"] Jul 06 19:09:04.217862 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.217815 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 19:09:04.286052 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.286015 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:04.339915 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.339878 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2aca569e-c786-4d1e-b098-ca64eb5e0552-trusted-ca-bundle\") pod \"console-bd4c58948-wfkxl\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:09:04.340088 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.339954 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2aca569e-c786-4d1e-b098-ca64eb5e0552-oauth-serving-cert\") pod \"console-bd4c58948-wfkxl\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:09:04.340151 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.340099 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2aca569e-c786-4d1e-b098-ca64eb5e0552-console-serving-cert\") pod \"console-bd4c58948-wfkxl\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:09:04.340151 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.340139 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2aca569e-c786-4d1e-b098-ca64eb5e0552-service-ca\") pod \"console-bd4c58948-wfkxl\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:09:04.340259 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.340170 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2aca569e-c786-4d1e-b098-ca64eb5e0552-console-oauth-config\") pod \"console-bd4c58948-wfkxl\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:09:04.340259 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.340214 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2aca569e-c786-4d1e-b098-ca64eb5e0552-console-config\") pod \"console-bd4c58948-wfkxl\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:09:04.340259 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.340239 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fzbj\" (UniqueName: \"kubernetes.io/projected/2aca569e-c786-4d1e-b098-ca64eb5e0552-kube-api-access-5fzbj\") pod \"console-bd4c58948-wfkxl\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:09:04.440966 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.440878 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2aca569e-c786-4d1e-b098-ca64eb5e0552-oauth-serving-cert\") pod \"console-bd4c58948-wfkxl\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:09:04.441131 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.440977 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2aca569e-c786-4d1e-b098-ca64eb5e0552-console-serving-cert\") pod \"console-bd4c58948-wfkxl\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:09:04.441131 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.441004 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2aca569e-c786-4d1e-b098-ca64eb5e0552-service-ca\") pod \"console-bd4c58948-wfkxl\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:09:04.441131 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.441035 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2aca569e-c786-4d1e-b098-ca64eb5e0552-console-oauth-config\") pod \"console-bd4c58948-wfkxl\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:09:04.441131 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.441061 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2aca569e-c786-4d1e-b098-ca64eb5e0552-console-config\") pod \"console-bd4c58948-wfkxl\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:09:04.441131 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.441083 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fzbj\" (UniqueName: \"kubernetes.io/projected/2aca569e-c786-4d1e-b098-ca64eb5e0552-kube-api-access-5fzbj\") pod \"console-bd4c58948-wfkxl\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:09:04.441131 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.441117 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2aca569e-c786-4d1e-b098-ca64eb5e0552-trusted-ca-bundle\") pod \"console-bd4c58948-wfkxl\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:09:04.441757 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.441730 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2aca569e-c786-4d1e-b098-ca64eb5e0552-oauth-serving-cert\") pod \"console-bd4c58948-wfkxl\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:09:04.441913 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.441755 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2aca569e-c786-4d1e-b098-ca64eb5e0552-service-ca\") pod \"console-bd4c58948-wfkxl\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:09:04.441913 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.441828 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2aca569e-c786-4d1e-b098-ca64eb5e0552-console-config\") pod \"console-bd4c58948-wfkxl\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:09:04.442122 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.442103 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2aca569e-c786-4d1e-b098-ca64eb5e0552-trusted-ca-bundle\") pod \"console-bd4c58948-wfkxl\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:09:04.443967 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.443945 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2aca569e-c786-4d1e-b098-ca64eb5e0552-console-oauth-config\") pod \"console-bd4c58948-wfkxl\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:09:04.444085 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.444068 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2aca569e-c786-4d1e-b098-ca64eb5e0552-console-serving-cert\") pod \"console-bd4c58948-wfkxl\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:09:04.455631 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.455609 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fzbj\" (UniqueName: \"kubernetes.io/projected/2aca569e-c786-4d1e-b098-ca64eb5e0552-kube-api-access-5fzbj\") pod \"console-bd4c58948-wfkxl\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:09:04.519220 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:04.519184 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:09:05.078619 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:05.078557 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:05.231433 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:05.231386 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:06.856736 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:06.856695 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:07.023950 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:07.023917 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:07.127585 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:07.127450 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:07.879640 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:07.879606 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" Jul 06 19:09:07.880136 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:07.879705 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" Jul 06 19:09:08.752705 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:08.752663 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:08.853498 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:08.853421 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:08.914456 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:08.914420 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bd4c58948-wfkxl"] Jul 06 19:09:08.917990 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:09:08.917959 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aca569e_c786_4d1e_b098_ca64eb5e0552.slice/crio-352d2e755580c5dc69757f89a81a5ea112020c90e8097f53c2b97d3dd8b930a6 WatchSource:0}: Error finding container 352d2e755580c5dc69757f89a81a5ea112020c90e8097f53c2b97d3dd8b930a6: Status 404 returned error can't find the container with id 352d2e755580c5dc69757f89a81a5ea112020c90e8097f53c2b97d3dd8b930a6 Jul 06 19:09:09.324656 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:09.324573 2578 generic.go:356] "Generic (PLEG): container finished" podID="edde0b2e-410b-4d1e-86c6-c927402a1c83" containerID="045f0305c6020aa9effe563f069980662aa8b45c673c1cbcbff8e934f9f24cc9" exitCode=0 Jul 06 19:09:09.324823 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:09.324678 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-v2klg" event={"ID":"edde0b2e-410b-4d1e-86c6-c927402a1c83","Type":"ContainerDied","Data":"045f0305c6020aa9effe563f069980662aa8b45c673c1cbcbff8e934f9f24cc9"} Jul 06 19:09:09.325179 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:09.325132 2578 scope.go:117] "RemoveContainer" containerID="045f0305c6020aa9effe563f069980662aa8b45c673c1cbcbff8e934f9f24cc9" Jul 06 19:09:09.329187 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:09.329160 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-n9pl5" event={"ID":"0abdfb63-00b2-444f-916a-421844e78d67","Type":"ContainerStarted","Data":"13e0cdb328e65631f2bd0b93950ddd757b09b1897e54b22f154f840edee43267"} Jul 06 19:09:09.329634 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:09.329613 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-n9pl5" Jul 06 19:09:09.333442 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:09.333389 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd4c58948-wfkxl" event={"ID":"2aca569e-c786-4d1e-b098-ca64eb5e0552","Type":"ContainerStarted","Data":"352d2e755580c5dc69757f89a81a5ea112020c90e8097f53c2b97d3dd8b930a6"} Jul 06 19:09:09.338259 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:09.338242 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-n9pl5" Jul 06 19:09:09.410746 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:09.410120 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-n9pl5" podStartSLOduration=1.5797071649999999 podStartE2EDuration="18.410098539s" totalImagesPullingTime="16.830391374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:08:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:09:09.407212566 +0000 UTC m=+114.262298154" watchObservedRunningTime="2026-07-06 19:09:09.410098539 +0000 UTC m=+114.265184126" Jul 06 19:09:09.746526 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:09.746047 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:09.813531 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:09.813405 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:10.361147 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:10.361029 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-v2klg" event={"ID":"edde0b2e-410b-4d1e-86c6-c927402a1c83","Type":"ContainerStarted","Data":"aea41acbce86ad97413d58c195251b53ef9a597c881da46cf96daba7fcb10d27"} Jul 06 19:09:11.538163 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:11.538130 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-85k7k_49397d03-e891-4f65-bcc3-a17b8302ae95/cluster-monitoring-operator/0.log" Jul 06 19:09:11.746260 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:11.746220 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-8cwcf_8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9/kube-state-metrics/0.log" Jul 06 19:09:11.924026 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:11.923935 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-8cwcf_8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9/kube-rbac-proxy-main/0.log" Jul 06 19:09:12.094692 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:12.094656 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:12.123561 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:12.123528 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-8cwcf_8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9/kube-rbac-proxy-self/0.log" Jul 06 19:09:12.174946 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:12.174802 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:12.328357 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:12.328319 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5d656d5c74-vps6g_2369f1c8-b673-4dcd-a1bb-b9d57764c2bc/metrics-server/0.log" Jul 06 19:09:12.525074 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:12.525006 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-7q2rm_bc6ce303-aeb1-4294-8526-44585cf2e67d/monitoring-plugin/0.log" Jul 06 19:09:12.735404 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:12.735383 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-22twp_501bccb8-ee67-46e1-bf1b-e547c0b835fe/init-textfile/0.log" Jul 06 19:09:12.924606 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:12.924528 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-22twp_501bccb8-ee67-46e1-bf1b-e547c0b835fe/node-exporter/0.log" Jul 06 19:09:13.123550 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.123510 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-22twp_501bccb8-ee67-46e1-bf1b-e547c0b835fe/kube-rbac-proxy/0.log" Jul 06 19:09:13.378354 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.378051 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c4dbf48f9-g4lqq" event={"ID":"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94","Type":"ContainerStarted","Data":"8a2447b53cb3e54ae4e33413f189485ea210739add9f5f5bf727410ab21b69f1"} Jul 06 19:09:13.379936 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.379903 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd4c58948-wfkxl" event={"ID":"2aca569e-c786-4d1e-b098-ca64eb5e0552","Type":"ContainerStarted","Data":"070e21917c943bcc633336ceca706145c302f44541ee65f6d388f961de1cef15"} Jul 06 19:09:13.406874 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.406782 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c4dbf48f9-g4lqq" podStartSLOduration=2.268513539 podStartE2EDuration="13.406755589s" totalImagesPullingTime="11.13824205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:09:13.398854778 +0000 UTC m=+118.253940359" watchObservedRunningTime="2026-07-06 19:09:13.406755589 +0000 UTC m=+118.261841176" Jul 06 19:09:13.408698 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.408664 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-57484589cb-nlmd5" podUID="23d26b44-20fe-4f81-9812-a92ebc94e3e1" containerName="registry" containerID="cri-o://10579e435a29c866a23c50f42b29d9c989e77228c5a11ad7cd69354ec2a8cb46" gracePeriod=30 Jul 06 19:09:13.427665 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.427616 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bd4c58948-wfkxl" podStartSLOduration=5.636010913 podStartE2EDuration="9.427599173s" totalImagesPullingTime="3.79158826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:09:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:09:13.426049471 +0000 UTC m=+118.281135059" watchObservedRunningTime="2026-07-06 19:09:13.427599173 +0000 UTC m=+118.282684759" Jul 06 19:09:13.710156 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.710126 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:09:13.772831 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.772800 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:13.832635 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.832598 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-tls\") pod \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " Jul 06 19:09:13.832808 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.832691 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23d26b44-20fe-4f81-9812-a92ebc94e3e1-installation-pull-secrets\") pod \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " Jul 06 19:09:13.832892 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.832874 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-bound-sa-token\") pod \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " Jul 06 19:09:13.832949 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.832906 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23d26b44-20fe-4f81-9812-a92ebc94e3e1-image-registry-private-configuration\") pod \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " Jul 06 19:09:13.832949 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.832936 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23d26b44-20fe-4f81-9812-a92ebc94e3e1-trusted-ca\") pod \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " Jul 06 19:09:13.833061 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.832980 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-certificates\") pod \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " Jul 06 19:09:13.833061 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.833006 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jqhb\" (UniqueName: \"kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-kube-api-access-4jqhb\") pod \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " Jul 06 19:09:13.833061 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.833052 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23d26b44-20fe-4f81-9812-a92ebc94e3e1-ca-trust-extracted\") pod \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\" (UID: \"23d26b44-20fe-4f81-9812-a92ebc94e3e1\") " Jul 06 19:09:13.833623 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.833532 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23d26b44-20fe-4f81-9812-a92ebc94e3e1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "23d26b44-20fe-4f81-9812-a92ebc94e3e1" (UID: "23d26b44-20fe-4f81-9812-a92ebc94e3e1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:09:13.833895 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.833853 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "23d26b44-20fe-4f81-9812-a92ebc94e3e1" (UID: "23d26b44-20fe-4f81-9812-a92ebc94e3e1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:09:13.835984 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.835902 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23d26b44-20fe-4f81-9812-a92ebc94e3e1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "23d26b44-20fe-4f81-9812-a92ebc94e3e1" (UID: "23d26b44-20fe-4f81-9812-a92ebc94e3e1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:09:13.837059 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.836999 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "23d26b44-20fe-4f81-9812-a92ebc94e3e1" (UID: "23d26b44-20fe-4f81-9812-a92ebc94e3e1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:09:13.837157 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.837044 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23d26b44-20fe-4f81-9812-a92ebc94e3e1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "23d26b44-20fe-4f81-9812-a92ebc94e3e1" (UID: "23d26b44-20fe-4f81-9812-a92ebc94e3e1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:09:13.837157 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.837093 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "23d26b44-20fe-4f81-9812-a92ebc94e3e1" (UID: "23d26b44-20fe-4f81-9812-a92ebc94e3e1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:09:13.837611 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.837580 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-kube-api-access-4jqhb" (OuterVolumeSpecName: "kube-api-access-4jqhb") pod "23d26b44-20fe-4f81-9812-a92ebc94e3e1" (UID: "23d26b44-20fe-4f81-9812-a92ebc94e3e1"). InnerVolumeSpecName "kube-api-access-4jqhb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:09:13.845208 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.844461 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23d26b44-20fe-4f81-9812-a92ebc94e3e1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "23d26b44-20fe-4f81-9812-a92ebc94e3e1" (UID: "23d26b44-20fe-4f81-9812-a92ebc94e3e1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:09:13.934276 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.934197 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23d26b44-20fe-4f81-9812-a92ebc94e3e1-installation-pull-secrets\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:09:13.934276 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.934236 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-bound-sa-token\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:09:13.934276 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.934253 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23d26b44-20fe-4f81-9812-a92ebc94e3e1-image-registry-private-configuration\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:09:13.934492 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.934288 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23d26b44-20fe-4f81-9812-a92ebc94e3e1-trusted-ca\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:09:13.934492 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.934299 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-certificates\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:09:13.934492 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.934308 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jqhb\" (UniqueName: \"kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-kube-api-access-4jqhb\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:09:13.934492 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.934316 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23d26b44-20fe-4f81-9812-a92ebc94e3e1-ca-trust-extracted\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:09:13.934492 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:13.934327 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23d26b44-20fe-4f81-9812-a92ebc94e3e1-registry-tls\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:09:14.388321 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:14.388289 2578 generic.go:356] "Generic (PLEG): container finished" podID="23d26b44-20fe-4f81-9812-a92ebc94e3e1" containerID="10579e435a29c866a23c50f42b29d9c989e77228c5a11ad7cd69354ec2a8cb46" exitCode=0 Jul 06 19:09:14.388514 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:14.388344 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57484589cb-nlmd5" Jul 06 19:09:14.388514 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:14.388375 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57484589cb-nlmd5" event={"ID":"23d26b44-20fe-4f81-9812-a92ebc94e3e1","Type":"ContainerDied","Data":"10579e435a29c866a23c50f42b29d9c989e77228c5a11ad7cd69354ec2a8cb46"} Jul 06 19:09:14.388514 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:14.388436 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57484589cb-nlmd5" event={"ID":"23d26b44-20fe-4f81-9812-a92ebc94e3e1","Type":"ContainerDied","Data":"0145265a9a8c1710a5494a2d4f48546729e377586609d59a7ea2e9f807be1e5e"} Jul 06 19:09:14.388514 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:14.388463 2578 scope.go:117] "RemoveContainer" containerID="10579e435a29c866a23c50f42b29d9c989e77228c5a11ad7cd69354ec2a8cb46" Jul 06 19:09:14.398236 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:14.398213 2578 scope.go:117] "RemoveContainer" containerID="10579e435a29c866a23c50f42b29d9c989e77228c5a11ad7cd69354ec2a8cb46" Jul 06 19:09:14.398523 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:09:14.398497 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10579e435a29c866a23c50f42b29d9c989e77228c5a11ad7cd69354ec2a8cb46\": container with ID starting with 10579e435a29c866a23c50f42b29d9c989e77228c5a11ad7cd69354ec2a8cb46 not found: ID does not exist" containerID="10579e435a29c866a23c50f42b29d9c989e77228c5a11ad7cd69354ec2a8cb46" Jul 06 19:09:14.398611 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:14.398530 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10579e435a29c866a23c50f42b29d9c989e77228c5a11ad7cd69354ec2a8cb46"} err="failed to get container status \"10579e435a29c866a23c50f42b29d9c989e77228c5a11ad7cd69354ec2a8cb46\": rpc error: code = NotFound desc = could not find container \"10579e435a29c866a23c50f42b29d9c989e77228c5a11ad7cd69354ec2a8cb46\": container with ID starting with 10579e435a29c866a23c50f42b29d9c989e77228c5a11ad7cd69354ec2a8cb46 not found: ID does not exist" Jul 06 19:09:14.415861 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:14.415811 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57484589cb-nlmd5"] Jul 06 19:09:14.419297 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:14.419273 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-57484589cb-nlmd5"] Jul 06 19:09:14.519626 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:14.519591 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:09:14.519813 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:14.519655 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:09:14.525334 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:14.525308 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:09:15.398069 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:15.398040 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:09:15.473731 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:15.473694 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c4dbf48f9-g4lqq"] Jul 06 19:09:15.629041 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:15.629005 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:15.653564 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:15.653477 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23d26b44-20fe-4f81-9812-a92ebc94e3e1" path="/var/lib/kubelet/pods/23d26b44-20fe-4f81-9812-a92ebc94e3e1/volumes" Jul 06 19:09:15.732302 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:15.732262 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:15.810344 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:15.810313 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:16.592597 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:16.592558 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:16.656168 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:16.656133 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:19.130181 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:19.130153 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hcl4d_a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6/console-operator/2.log" Jul 06 19:09:19.324753 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:19.324719 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hcl4d_a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6/console-operator/3.log" Jul 06 19:09:19.410739 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:19.410663 2578 generic.go:356] "Generic (PLEG): container finished" podID="35e1dc35-17cd-44db-ba5b-28b57c3763d4" containerID="d717cfb687dee6dd0fa56ba042894b8bca0bec37a2110be2e97b5f253dcac579" exitCode=0 Jul 06 19:09:19.410946 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:19.410737 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7cdw9" event={"ID":"35e1dc35-17cd-44db-ba5b-28b57c3763d4","Type":"ContainerDied","Data":"d717cfb687dee6dd0fa56ba042894b8bca0bec37a2110be2e97b5f253dcac579"} Jul 06 19:09:19.411105 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:19.411089 2578 scope.go:117] "RemoveContainer" containerID="d717cfb687dee6dd0fa56ba042894b8bca0bec37a2110be2e97b5f253dcac579" Jul 06 19:09:19.533486 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:19.533457 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c4dbf48f9-g4lqq_b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94/console/0.log" Jul 06 19:09:19.734743 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:19.734674 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-bd4c58948-wfkxl_2aca569e-c786-4d1e-b098-ca64eb5e0552/console/0.log" Jul 06 19:09:19.931937 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:19.931907 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-n9pl5_0abdfb63-00b2-444f-916a-421844e78d67/download-server/0.log" Jul 06 19:09:20.416355 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:20.416321 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7cdw9" event={"ID":"35e1dc35-17cd-44db-ba5b-28b57c3763d4","Type":"ContainerStarted","Data":"5b9d70c00aba7ef1aa9fc1aacf122486331c0360b39a9e58d17737ada8b35f30"} Jul 06 19:09:21.261385 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:21.261350 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c4dbf48f9-g4lqq" Jul 06 19:09:27.106448 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:27.106407 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:27.210698 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:27.210653 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:27.884284 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:27.884257 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" Jul 06 19:09:27.887947 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:27.887927 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5d656d5c74-vps6g" Jul 06 19:09:29.457406 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:29.457372 2578 generic.go:356] "Generic (PLEG): container finished" podID="c7c4f9b5-959b-481b-bf82-acc2dd175d1e" containerID="a899553b8586f32b7b1709f1705e36ac0894c9ed504cb2dd3c778ec8b508c657" exitCode=0 Jul 06 19:09:29.457777 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:29.457429 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9nlp9" event={"ID":"c7c4f9b5-959b-481b-bf82-acc2dd175d1e","Type":"ContainerDied","Data":"a899553b8586f32b7b1709f1705e36ac0894c9ed504cb2dd3c778ec8b508c657"} Jul 06 19:09:29.457777 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:29.457730 2578 scope.go:117] "RemoveContainer" containerID="a899553b8586f32b7b1709f1705e36ac0894c9ed504cb2dd3c778ec8b508c657" Jul 06 19:09:30.463659 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:30.463622 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9nlp9" event={"ID":"c7c4f9b5-959b-481b-bf82-acc2dd175d1e","Type":"ContainerStarted","Data":"67b480b3e73a1c7f49f0e6fa872c280daa835ae02c6b20f1c7d46cb4ceaa564b"} Jul 06 19:09:39.864430 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:39.864394 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:40.501222 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:40.501152 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7c4dbf48f9-g4lqq" podUID="b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94" containerName="console" containerID="cri-o://8a2447b53cb3e54ae4e33413f189485ea210739add9f5f5bf727410ab21b69f1" gracePeriod=15 Jul 06 19:09:40.787323 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:40.787291 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c4dbf48f9-g4lqq" Jul 06 19:09:40.868685 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:40.868652 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-oauth-serving-cert\") pod \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\" (UID: \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\") " Jul 06 19:09:40.869175 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:40.868710 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrn2k\" (UniqueName: \"kubernetes.io/projected/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-kube-api-access-qrn2k\") pod \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\" (UID: \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\") " Jul 06 19:09:40.869175 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:40.868763 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-console-oauth-config\") pod \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\" (UID: \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\") " Jul 06 19:09:40.869175 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:40.868790 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-service-ca\") pod \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\" (UID: \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\") " Jul 06 19:09:40.869175 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:40.868827 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-console-serving-cert\") pod \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\" (UID: \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\") " Jul 06 19:09:40.869175 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:40.868881 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-console-config\") pod \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\" (UID: \"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94\") " Jul 06 19:09:40.869175 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:40.869163 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94" (UID: "b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:09:40.869402 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:40.869259 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-service-ca" (OuterVolumeSpecName: "service-ca") pod "b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94" (UID: "b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:09:40.869402 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:40.869361 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-console-config" (OuterVolumeSpecName: "console-config") pod "b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94" (UID: "b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:09:40.871240 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:40.871211 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94" (UID: "b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:09:40.871466 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:40.871444 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94" (UID: "b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:09:40.871466 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:40.871450 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-kube-api-access-qrn2k" (OuterVolumeSpecName: "kube-api-access-qrn2k") pod "b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94" (UID: "b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94"). InnerVolumeSpecName "kube-api-access-qrn2k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:09:40.969808 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:40.969770 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-oauth-serving-cert\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:09:40.969808 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:40.969801 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrn2k\" (UniqueName: \"kubernetes.io/projected/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-kube-api-access-qrn2k\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:09:40.969808 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:40.969813 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-console-oauth-config\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:09:40.970074 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:40.969825 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-service-ca\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:09:40.970074 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:40.969889 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-console-serving-cert\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:09:40.970074 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:40.969924 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94-console-config\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:09:41.505558 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:41.505525 2578 generic.go:356] "Generic (PLEG): container finished" podID="b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94" containerID="8a2447b53cb3e54ae4e33413f189485ea210739add9f5f5bf727410ab21b69f1" exitCode=0 Jul 06 19:09:41.505753 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:41.505568 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c4dbf48f9-g4lqq" Jul 06 19:09:41.505753 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:41.505613 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c4dbf48f9-g4lqq" event={"ID":"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94","Type":"ContainerDied","Data":"8a2447b53cb3e54ae4e33413f189485ea210739add9f5f5bf727410ab21b69f1"} Jul 06 19:09:41.505753 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:41.505695 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c4dbf48f9-g4lqq" event={"ID":"b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94","Type":"ContainerDied","Data":"1941f49ec450a6d4a8603fdc9240226a733f9b3af0079de7d39e75e4d5ff017b"} Jul 06 19:09:41.505753 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:41.505725 2578 scope.go:117] "RemoveContainer" containerID="8a2447b53cb3e54ae4e33413f189485ea210739add9f5f5bf727410ab21b69f1" Jul 06 19:09:41.514389 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:41.514373 2578 scope.go:117] "RemoveContainer" containerID="8a2447b53cb3e54ae4e33413f189485ea210739add9f5f5bf727410ab21b69f1" Jul 06 19:09:41.514663 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:09:41.514643 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a2447b53cb3e54ae4e33413f189485ea210739add9f5f5bf727410ab21b69f1\": container with ID starting with 8a2447b53cb3e54ae4e33413f189485ea210739add9f5f5bf727410ab21b69f1 not found: ID does not exist" containerID="8a2447b53cb3e54ae4e33413f189485ea210739add9f5f5bf727410ab21b69f1" Jul 06 19:09:41.514709 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:41.514671 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a2447b53cb3e54ae4e33413f189485ea210739add9f5f5bf727410ab21b69f1"} err="failed to get container status \"8a2447b53cb3e54ae4e33413f189485ea210739add9f5f5bf727410ab21b69f1\": rpc error: code = NotFound desc = could not find container \"8a2447b53cb3e54ae4e33413f189485ea210739add9f5f5bf727410ab21b69f1\": container with ID starting with 8a2447b53cb3e54ae4e33413f189485ea210739add9f5f5bf727410ab21b69f1 not found: ID does not exist" Jul 06 19:09:41.539350 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:41.539325 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c4dbf48f9-g4lqq"] Jul 06 19:09:41.543574 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:41.543551 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c4dbf48f9-g4lqq"] Jul 06 19:09:41.652407 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:41.652377 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94" path="/var/lib/kubelet/pods/b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94/volumes" Jul 06 19:09:42.526553 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:42.526521 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:59.603894 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:59.603857 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:59.726876 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:09:59.726822 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:08.829906 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:08.829802 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69854bbc7c-khg86"] Jul 06 19:10:08.830351 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:08.830159 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23d26b44-20fe-4f81-9812-a92ebc94e3e1" containerName="registry" Jul 06 19:10:08.830351 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:08.830173 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="23d26b44-20fe-4f81-9812-a92ebc94e3e1" containerName="registry" Jul 06 19:10:08.830351 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:08.830183 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94" containerName="console" Jul 06 19:10:08.830351 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:08.830192 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94" containerName="console" Jul 06 19:10:08.830351 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:08.830257 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="23d26b44-20fe-4f81-9812-a92ebc94e3e1" containerName="registry" Jul 06 19:10:08.830351 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:08.830268 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3b0f70f-b9c2-4487-9cbc-e7c6936bdf94" containerName="console" Jul 06 19:10:08.832765 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:08.832744 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:10:08.847676 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:08.847650 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69854bbc7c-khg86"] Jul 06 19:10:08.957890 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:08.957824 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:09.016756 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.016723 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf20e78d-5b40-4f30-8e37-aa4234beeb88-console-serving-cert\") pod \"console-69854bbc7c-khg86\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:10:09.016756 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.016756 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf20e78d-5b40-4f30-8e37-aa4234beeb88-console-oauth-config\") pod \"console-69854bbc7c-khg86\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:10:09.016990 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.016798 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5f8s\" (UniqueName: \"kubernetes.io/projected/cf20e78d-5b40-4f30-8e37-aa4234beeb88-kube-api-access-q5f8s\") pod \"console-69854bbc7c-khg86\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:10:09.016990 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.016818 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf20e78d-5b40-4f30-8e37-aa4234beeb88-console-config\") pod \"console-69854bbc7c-khg86\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:10:09.016990 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.016860 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf20e78d-5b40-4f30-8e37-aa4234beeb88-trusted-ca-bundle\") pod \"console-69854bbc7c-khg86\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:10:09.016990 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.016897 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf20e78d-5b40-4f30-8e37-aa4234beeb88-service-ca\") pod \"console-69854bbc7c-khg86\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:10:09.016990 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.016918 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf20e78d-5b40-4f30-8e37-aa4234beeb88-oauth-serving-cert\") pod \"console-69854bbc7c-khg86\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:10:09.049479 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.049439 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:09.117322 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.117289 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5f8s\" (UniqueName: \"kubernetes.io/projected/cf20e78d-5b40-4f30-8e37-aa4234beeb88-kube-api-access-q5f8s\") pod \"console-69854bbc7c-khg86\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:10:09.117322 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.117327 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf20e78d-5b40-4f30-8e37-aa4234beeb88-console-config\") pod \"console-69854bbc7c-khg86\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:10:09.117538 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.117381 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf20e78d-5b40-4f30-8e37-aa4234beeb88-trusted-ca-bundle\") pod \"console-69854bbc7c-khg86\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:10:09.117538 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.117408 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf20e78d-5b40-4f30-8e37-aa4234beeb88-service-ca\") pod \"console-69854bbc7c-khg86\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:10:09.117538 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.117442 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf20e78d-5b40-4f30-8e37-aa4234beeb88-oauth-serving-cert\") pod \"console-69854bbc7c-khg86\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:10:09.117538 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.117504 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf20e78d-5b40-4f30-8e37-aa4234beeb88-console-serving-cert\") pod \"console-69854bbc7c-khg86\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:10:09.117538 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.117533 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf20e78d-5b40-4f30-8e37-aa4234beeb88-console-oauth-config\") pod \"console-69854bbc7c-khg86\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:10:09.118273 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.118247 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf20e78d-5b40-4f30-8e37-aa4234beeb88-oauth-serving-cert\") pod \"console-69854bbc7c-khg86\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:10:09.118273 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.118261 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf20e78d-5b40-4f30-8e37-aa4234beeb88-service-ca\") pod \"console-69854bbc7c-khg86\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:10:09.118429 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.118391 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf20e78d-5b40-4f30-8e37-aa4234beeb88-console-config\") pod \"console-69854bbc7c-khg86\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:10:09.118429 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.118420 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf20e78d-5b40-4f30-8e37-aa4234beeb88-trusted-ca-bundle\") pod \"console-69854bbc7c-khg86\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:10:09.120041 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.120021 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf20e78d-5b40-4f30-8e37-aa4234beeb88-console-serving-cert\") pod \"console-69854bbc7c-khg86\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:10:09.120123 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.120070 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf20e78d-5b40-4f30-8e37-aa4234beeb88-console-oauth-config\") pod \"console-69854bbc7c-khg86\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:10:09.128811 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.128783 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5f8s\" (UniqueName: \"kubernetes.io/projected/cf20e78d-5b40-4f30-8e37-aa4234beeb88-kube-api-access-q5f8s\") pod \"console-69854bbc7c-khg86\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:10:09.142657 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.142638 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:10:09.292628 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.292589 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69854bbc7c-khg86"] Jul 06 19:10:09.297597 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:10:09.297563 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf20e78d_5b40_4f30_8e37_aa4234beeb88.slice/crio-198e561086068930e255512019c18772b7b92de8544af592862789118d402b45 WatchSource:0}: Error finding container 198e561086068930e255512019c18772b7b92de8544af592862789118d402b45: Status 404 returned error can't find the container with id 198e561086068930e255512019c18772b7b92de8544af592862789118d402b45 Jul 06 19:10:09.613574 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.613539 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69854bbc7c-khg86" event={"ID":"cf20e78d-5b40-4f30-8e37-aa4234beeb88","Type":"ContainerStarted","Data":"1b6168a58f0b85ef13849e7402b7d22eff1a6e58bfe61dc12bea458605df5fd1"} Jul 06 19:10:09.613742 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.613586 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69854bbc7c-khg86" event={"ID":"cf20e78d-5b40-4f30-8e37-aa4234beeb88","Type":"ContainerStarted","Data":"198e561086068930e255512019c18772b7b92de8544af592862789118d402b45"} Jul 06 19:10:09.624814 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.624785 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:09.658499 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.658452 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69854bbc7c-khg86" podStartSLOduration=1.6584352230000001 podStartE2EDuration="1.658435223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:09.656546049 +0000 UTC m=+174.511631634" watchObservedRunningTime="2026-07-06 19:10:09.658435223 +0000 UTC m=+174.513520808" Jul 06 19:10:09.742335 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:09.742290 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:12.956672 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:12.956636 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:13.064209 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:13.064174 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:19.143725 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:19.143685 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:10:19.144269 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:19.143757 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:10:19.148548 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:19.148524 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:10:19.661079 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:19.661055 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:10:20.565310 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:20.565279 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bd4c58948-wfkxl"] Jul 06 19:10:45.589683 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:45.589646 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-bd4c58948-wfkxl" podUID="2aca569e-c786-4d1e-b098-ca64eb5e0552" containerName="console" containerID="cri-o://070e21917c943bcc633336ceca706145c302f44541ee65f6d388f961de1cef15" gracePeriod=15 Jul 06 19:10:45.756602 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:45.756301 2578 generic.go:356] "Generic (PLEG): container finished" podID="2aca569e-c786-4d1e-b098-ca64eb5e0552" containerID="070e21917c943bcc633336ceca706145c302f44541ee65f6d388f961de1cef15" exitCode=0 Jul 06 19:10:45.756602 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:45.756368 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd4c58948-wfkxl" event={"ID":"2aca569e-c786-4d1e-b098-ca64eb5e0552","Type":"ContainerDied","Data":"070e21917c943bcc633336ceca706145c302f44541ee65f6d388f961de1cef15"} Jul 06 19:10:45.847222 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:45.847165 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:10:45.924720 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:45.924684 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2aca569e-c786-4d1e-b098-ca64eb5e0552-console-config\") pod \"2aca569e-c786-4d1e-b098-ca64eb5e0552\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " Jul 06 19:10:45.924720 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:45.924727 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2aca569e-c786-4d1e-b098-ca64eb5e0552-oauth-serving-cert\") pod \"2aca569e-c786-4d1e-b098-ca64eb5e0552\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " Jul 06 19:10:45.924993 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:45.924763 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2aca569e-c786-4d1e-b098-ca64eb5e0552-service-ca\") pod \"2aca569e-c786-4d1e-b098-ca64eb5e0552\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " Jul 06 19:10:45.924993 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:45.924789 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2aca569e-c786-4d1e-b098-ca64eb5e0552-console-oauth-config\") pod \"2aca569e-c786-4d1e-b098-ca64eb5e0552\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " Jul 06 19:10:45.924993 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:45.924817 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2aca569e-c786-4d1e-b098-ca64eb5e0552-console-serving-cert\") pod \"2aca569e-c786-4d1e-b098-ca64eb5e0552\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " Jul 06 19:10:45.924993 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:45.924863 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2aca569e-c786-4d1e-b098-ca64eb5e0552-trusted-ca-bundle\") pod \"2aca569e-c786-4d1e-b098-ca64eb5e0552\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " Jul 06 19:10:45.924993 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:45.924878 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fzbj\" (UniqueName: \"kubernetes.io/projected/2aca569e-c786-4d1e-b098-ca64eb5e0552-kube-api-access-5fzbj\") pod \"2aca569e-c786-4d1e-b098-ca64eb5e0552\" (UID: \"2aca569e-c786-4d1e-b098-ca64eb5e0552\") " Jul 06 19:10:45.925243 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:45.925213 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2aca569e-c786-4d1e-b098-ca64eb5e0552-console-config" (OuterVolumeSpecName: "console-config") pod "2aca569e-c786-4d1e-b098-ca64eb5e0552" (UID: "2aca569e-c786-4d1e-b098-ca64eb5e0552"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:10:45.925320 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:45.925286 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2aca569e-c786-4d1e-b098-ca64eb5e0552-service-ca" (OuterVolumeSpecName: "service-ca") pod "2aca569e-c786-4d1e-b098-ca64eb5e0552" (UID: "2aca569e-c786-4d1e-b098-ca64eb5e0552"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:10:45.925365 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:45.925310 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2aca569e-c786-4d1e-b098-ca64eb5e0552-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2aca569e-c786-4d1e-b098-ca64eb5e0552" (UID: "2aca569e-c786-4d1e-b098-ca64eb5e0552"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:10:45.925365 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:45.925303 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2aca569e-c786-4d1e-b098-ca64eb5e0552-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2aca569e-c786-4d1e-b098-ca64eb5e0552" (UID: "2aca569e-c786-4d1e-b098-ca64eb5e0552"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:10:45.927054 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:45.927026 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2aca569e-c786-4d1e-b098-ca64eb5e0552-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2aca569e-c786-4d1e-b098-ca64eb5e0552" (UID: "2aca569e-c786-4d1e-b098-ca64eb5e0552"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:10:45.927161 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:45.927105 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2aca569e-c786-4d1e-b098-ca64eb5e0552-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2aca569e-c786-4d1e-b098-ca64eb5e0552" (UID: "2aca569e-c786-4d1e-b098-ca64eb5e0552"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:10:45.927161 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:45.927128 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2aca569e-c786-4d1e-b098-ca64eb5e0552-kube-api-access-5fzbj" (OuterVolumeSpecName: "kube-api-access-5fzbj") pod "2aca569e-c786-4d1e-b098-ca64eb5e0552" (UID: "2aca569e-c786-4d1e-b098-ca64eb5e0552"). InnerVolumeSpecName "kube-api-access-5fzbj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:10:46.025477 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:46.025445 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2aca569e-c786-4d1e-b098-ca64eb5e0552-console-oauth-config\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:10:46.025477 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:46.025470 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2aca569e-c786-4d1e-b098-ca64eb5e0552-console-serving-cert\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:10:46.025477 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:46.025481 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2aca569e-c786-4d1e-b098-ca64eb5e0552-trusted-ca-bundle\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:10:46.025687 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:46.025490 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fzbj\" (UniqueName: \"kubernetes.io/projected/2aca569e-c786-4d1e-b098-ca64eb5e0552-kube-api-access-5fzbj\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:10:46.025687 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:46.025500 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2aca569e-c786-4d1e-b098-ca64eb5e0552-console-config\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:10:46.025687 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:46.025508 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2aca569e-c786-4d1e-b098-ca64eb5e0552-oauth-serving-cert\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:10:46.025687 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:46.025518 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2aca569e-c786-4d1e-b098-ca64eb5e0552-service-ca\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:10:46.761109 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:46.761075 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd4c58948-wfkxl" Jul 06 19:10:46.761109 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:46.761097 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd4c58948-wfkxl" event={"ID":"2aca569e-c786-4d1e-b098-ca64eb5e0552","Type":"ContainerDied","Data":"352d2e755580c5dc69757f89a81a5ea112020c90e8097f53c2b97d3dd8b930a6"} Jul 06 19:10:46.761538 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:10:46.761145 2578 scope.go:117] "RemoveContainer" containerID="070e21917c943bcc633336ceca706145c302f44541ee65f6d388f961de1cef15" Jul 06 19:10:51.059164 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:10:51.059121 2578 controller.go:195] "Failed to update lease" err="Put \"https://a06eb29c6688947bbb0840c3f81c4b84-6076937c993464f2.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-136-29.ec2.internal?timeout=10s\": context deadline exceeded" Jul 06 19:11:01.059738 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:11:01.059695 2578 controller.go:195] "Failed to update lease" err="Put \"https://a06eb29c6688947bbb0840c3f81c4b84-6076937c993464f2.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-136-29.ec2.internal?timeout=10s\": context deadline exceeded" Jul 06 19:11:11.060057 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:11:11.060015 2578 controller.go:195] "Failed to update lease" err="Put \"https://a06eb29c6688947bbb0840c3f81c4b84-6076937c993464f2.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-136-29.ec2.internal?timeout=10s\": context deadline exceeded" Jul 06 19:11:15.077212 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.077160 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-29.ec2.internal" podUID="8d3790303dbdd7a7168052dca674a531" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Jul 06 19:11:15.994069 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994023 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xhq2g\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.994069 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994050 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.994069 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:11:15.994044 2578 controller.go:195] "Failed to update lease" err="Put \"https://a06eb29c6688947bbb0840c3f81c4b84-6076937c993464f2.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-136-29.ec2.internal?timeout=10s\": http2: client connection lost" Jul 06 19:11:15.994069 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994080 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.994464 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994103 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mgxwp\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.994464 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994146 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.994464 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994162 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hq9tp\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.994464 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994161 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.994464 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994182 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"default-dockercfg-2cgvs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.994464 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994198 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-dockercfg-bnhnb\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.994464 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994216 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.994464 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994224 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.994464 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994237 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.994464 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994249 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.994464 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994250 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vp7zb\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.994464 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994267 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"service-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.994464 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994278 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pvztv\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.994464 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994305 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ncs5h\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.994464 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994315 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"console-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.994464 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994323 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.994464 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994342 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.994464 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994347 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.995534 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994361 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-agent\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.995534 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994350 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.995534 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994390 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h9nbv\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.995534 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994399 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.995534 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994415 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.995534 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994420 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.995534 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994438 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.995534 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994451 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.995534 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994460 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.995534 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994462 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.995534 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994481 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"console-dockercfg-2gtw9\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.995534 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994502 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.995534 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994507 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.995534 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994504 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-r2jbq\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.995534 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994526 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.995534 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994543 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.995534 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994558 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.995534 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994563 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kvrq8\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996239 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994586 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zktjv\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996239 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994591 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996239 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994595 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996239 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994565 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996239 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994562 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996239 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994603 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996239 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994626 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996239 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994635 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996239 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994648 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996239 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994638 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996239 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994664 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"console-oauth-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996239 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994672 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996239 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994682 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996239 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994683 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996239 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994696 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996239 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994703 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qw6dn\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996239 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994712 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996239 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994723 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996754 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994737 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996754 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994743 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996754 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994750 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lns9g\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996754 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994754 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996754 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994754 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996754 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994770 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996754 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994788 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-ddpw8\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996754 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994803 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"original-pull-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996754 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994810 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996754 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994861 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996754 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994869 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996754 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994873 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-96jv4\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996754 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994867 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996754 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994882 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996754 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994894 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.996754 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994906 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997262 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:11:15.994813 2578 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://a06eb29c6688947bbb0840c3f81c4b84-6076937c993464f2.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/kube-system/events\": http2: client connection lost" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-136-29.ec2.internal.18bfc9164cd09f84 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-136-29.ec2.internal,UID:8d3790303dbdd7a7168052dca674a531,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Unhealthy,Message:Liveness probe failed: Get \"https://172.20.0.1:6443/version\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers),Source:EventSource{Component:kubelet,Host:ip-10-0-136-29.ec2.internal,},FirstTimestamp:2026-07-06 19:11:15.077209988 +0000 UTC m=+239.932295569,LastTimestamp:2026-07-06 19:11:15.077209988 +0000 UTC m=+239.932295569,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-29.ec2.internal,}" Jul 06 19:11:15.997262 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994926 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997262 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994933 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-rrdv4\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997262 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994937 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997262 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994929 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997262 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994929 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997262 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994928 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997262 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994957 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997262 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994960 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997262 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994957 2578 reflector.go:571] "Warning: watch ended with error" reflector="pkg/kubelet/config/apiserver.go:66" type="*v1.Pod" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997262 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994976 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997262 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994980 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997262 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994987 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bf7v6\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997262 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994992 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997262 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994999 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997262 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.994993 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"default-dockercfg-lqlgm\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997846 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995011 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997846 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995011 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997846 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995019 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997846 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995035 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x5dnh\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997846 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995028 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pkgcg\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997846 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995045 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997846 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995036 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997846 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995055 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997846 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995055 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997846 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995066 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997846 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995066 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997846 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995082 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mmqkr\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997846 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995087 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"router-dockercfg-sw4bq\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997846 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995092 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-server-bt1gjqr9elpk\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997846 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995107 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997846 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995111 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jlcxl\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997846 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995113 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.997846 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995119 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.998385 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995106 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.998385 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995137 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"operator-dockercfg-jdbzp\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.998385 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995108 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.998385 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995147 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.998385 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995140 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.998385 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995154 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.998385 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995164 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.998385 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995149 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.998385 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995173 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.998385 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995176 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"console-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.998385 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995176 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-dockercfg-59swk\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.998385 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995189 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-trvfv\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.998385 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995148 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.998385 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995184 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.998385 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995191 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.998385 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995191 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.998385 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995191 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.998385 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995206 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:15.998916 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:15.995208 2578 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-c5wxw\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 19:11:23.253304 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.253271 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 19:11:23.360319 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.360277 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 19:11:23.360319 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.360313 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 19:11:23.360583 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.360329 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 19:11:23.360583 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.360405 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 19:11:23.360583 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.360278 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hq9tp\"" Jul 06 19:11:23.360583 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.360436 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:11:23.361339 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.361320 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 06 19:11:23.361442 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.361317 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 06 19:11:23.364920 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.364905 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 06 19:11:23.367054 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.367041 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 19:11:23.367620 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.367602 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-r2jbq\"" Jul 06 19:11:23.438738 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.438707 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 19:11:23.438960 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.438878 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 19:11:23.439369 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.439348 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 06 19:11:23.439483 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.439394 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:11:23.439554 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.439537 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:11:23.439603 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.439552 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 06 19:11:23.439858 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.439824 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:11:23.512093 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.512009 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ncs5h\"" Jul 06 19:11:23.569428 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.569399 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 19:11:23.569593 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.569525 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 19:11:23.569633 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.569605 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 06 19:11:23.728369 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.728340 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 19:11:23.733542 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.733525 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 06 19:11:23.743728 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.743701 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 19:11:23.744434 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.744358 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 19:11:23.744849 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.744806 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-sw4bq\"" Jul 06 19:11:23.746069 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.746042 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-trvfv\"" Jul 06 19:11:23.747018 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.746994 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 19:11:23.747174 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.747152 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 19:11:23.747546 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.747523 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qw6dn\"" Jul 06 19:11:23.747687 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.747670 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h9nbv\"" Jul 06 19:11:23.747827 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.747809 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 06 19:11:23.748039 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.748024 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-96jv4\"" Jul 06 19:11:23.748288 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.748274 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 19:11:23.748398 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.748379 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 19:11:23.748609 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.748594 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 19:11:23.748724 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.748705 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 06 19:11:23.748923 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.748906 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:11:23.749014 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.748918 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-rrdv4\"" Jul 06 19:11:23.749147 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.749132 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 19:11:23.749249 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.748611 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lqlgm\"" Jul 06 19:11:23.749320 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.749306 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-59swk\"" Jul 06 19:11:23.749595 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.749579 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 19:11:23.749867 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.749834 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 19:11:23.749964 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.749861 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 19:11:23.750085 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.750069 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 19:11:23.750275 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.750252 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 06 19:11:23.750555 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.750540 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 06 19:11:23.750798 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.750608 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 19:11:23.750991 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.750973 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bt1gjqr9elpk\"" Jul 06 19:11:23.751081 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.750638 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-ddpw8\"" Jul 06 19:11:23.751204 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.751187 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 19:11:23.751300 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.751074 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x5dnh\"" Jul 06 19:11:23.751456 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.751130 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 19:11:23.751557 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.751193 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 19:11:23.751610 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.751593 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 19:11:23.751680 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.750792 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 19:11:23.781339 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.781256 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 19:11:23.794631 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.794609 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 19:11:23.801710 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.801689 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 06 19:11:23.801829 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.801697 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 06 19:11:23.802631 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.802616 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 19:11:23.802675 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.802625 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 06 19:11:23.802675 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.802632 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:11:23.803541 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.803529 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 19:11:23.806299 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.806283 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:11:23.809175 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.809157 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:11:23.809276 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.809194 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 19:11:23.809466 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.809452 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 19:11:23.809716 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.809701 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 19:11:23.809790 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.809703 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 06 19:11:23.809963 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.809950 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 19:11:23.811568 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.811553 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 06 19:11:23.811926 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.811913 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 19:11:23.813806 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.813790 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 19:11:23.889370 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.889338 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 19:11:23.889545 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.889443 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 19:11:23.889545 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.889484 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 06 19:11:23.889673 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.889633 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zktjv\"" Jul 06 19:11:23.889673 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.889667 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 19:11:23.889781 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.889676 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 19:11:23.889832 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.889780 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-c5wxw\"" Jul 06 19:11:23.890122 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.890100 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lns9g\"" Jul 06 19:11:23.890231 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.890182 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 19:11:23.890231 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.890209 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bnhnb\"" Jul 06 19:11:23.890231 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.890219 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xhq2g\"" Jul 06 19:11:23.890398 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.890306 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 06 19:11:23.890398 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.890353 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 06 19:11:23.890497 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.890409 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 19:11:23.890553 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.890500 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2gtw9\"" Jul 06 19:11:23.890553 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.890514 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 06 19:11:23.890708 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.890688 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pkgcg\"" Jul 06 19:11:23.890799 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.890703 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 19:11:23.890799 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.890714 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kvrq8\"" Jul 06 19:11:23.890926 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.890901 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 19:11:23.891078 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.891062 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:11:23.910887 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.910866 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 19:11:23.957613 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.957588 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 06 19:11:23.960367 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.960346 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mgxwp\"" Jul 06 19:11:23.960627 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.960614 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jlcxl\"" Jul 06 19:11:23.960687 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.960642 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-2cgvs\"" Jul 06 19:11:23.960769 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.960618 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-jdbzp\"" Jul 06 19:11:23.960769 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.960693 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:11:23.961022 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.960998 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 06 19:11:23.961255 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.961235 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bf7v6\"" Jul 06 19:11:23.961709 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.961538 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:11:23.961901 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:23.961880 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 19:11:24.090651 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:24.090628 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 06 19:11:24.099958 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:24.099937 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 19:11:24.100747 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:24.100732 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 19:11:24.100789 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:24.100734 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vp7zb\"" Jul 06 19:11:24.119801 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:24.119777 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 06 19:11:24.119801 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:24.119794 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 19:11:24.143086 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:24.143061 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pvztv\"" Jul 06 19:11:24.237283 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:24.237253 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 19:11:24.240191 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:24.240167 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 19:11:24.240682 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:24.240663 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 19:11:24.240782 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:24.240698 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 06 19:11:24.262362 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:24.262338 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 06 19:11:24.400358 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:24.400282 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 19:11:24.463064 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:24.463034 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 19:11:24.464258 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:24.464241 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 19:11:25.311565 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:25.311532 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mmqkr\"" Jul 06 19:11:26.315728 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:26.315693 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bd4c58948-wfkxl"] Jul 06 19:11:26.463572 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:26.463539 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bd4c58948-wfkxl"] Jul 06 19:11:27.652258 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:27.652226 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2aca569e-c786-4d1e-b098-ca64eb5e0552" path="/var/lib/kubelet/pods/2aca569e-c786-4d1e-b098-ca64eb5e0552/volumes" Jul 06 19:11:49.286871 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:49.286766 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:11:49.427484 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:11:49.427409 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:12:13.110757 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:12:13.110718 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:12:13.209351 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:12:13.209320 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:12:15.512499 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:12:15.512466 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hcl4d_a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6/console-operator/2.log" Jul 06 19:12:15.517032 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:12:15.517009 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hcl4d_a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6/console-operator/2.log" Jul 06 19:12:15.523807 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:12:15.523784 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 19:13:06.283462 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:06.283422 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:07.498073 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:07.497962 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:08.596002 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:08.595965 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:10.421494 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:10.421456 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:10.533210 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:10.533175 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:10.846094 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:10.846066 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:10.939623 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:10.939588 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:11.014968 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:11.014933 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:11.859898 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:11.859867 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp"] Jul 06 19:13:11.860280 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:11.860160 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2aca569e-c786-4d1e-b098-ca64eb5e0552" containerName="console" Jul 06 19:13:11.860280 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:11.860172 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2aca569e-c786-4d1e-b098-ca64eb5e0552" containerName="console" Jul 06 19:13:11.860280 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:11.860229 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2aca569e-c786-4d1e-b098-ca64eb5e0552" containerName="console" Jul 06 19:13:11.862068 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:11.862053 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp" Jul 06 19:13:11.877880 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:13:11.877819 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-lrxnr\" is forbidden: User \"system:node:ip-10-0-136-29.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-marketplace\": no relationship found between node 'ip-10-0-136-29.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lrxnr\"" type="*v1.Secret" Jul 06 19:13:11.878238 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:13:11.878209 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp\" is forbidden: User \"system:node:ip-10-0-136-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-marketplace\": no relationship found between node 'ip-10-0-136-29.ec2.internal' and this object" podUID="a8376fb3-6a3b-4c94-b66c-3bb588ef3f66" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp" Jul 06 19:13:11.878358 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:13:11.878236 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-136-29.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-marketplace\": no relationship found between node 'ip-10-0-136-29.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 06 19:13:11.878358 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:13:11.878236 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-136-29.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-marketplace\": no relationship found between node 'ip-10-0-136-29.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 06 19:13:11.919715 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:11.919686 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8376fb3-6a3b-4c94-b66c-3bb588ef3f66-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp\" (UID: \"a8376fb3-6a3b-4c94-b66c-3bb588ef3f66\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp" Jul 06 19:13:11.919858 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:11.919731 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpkxv\" (UniqueName: \"kubernetes.io/projected/a8376fb3-6a3b-4c94-b66c-3bb588ef3f66-kube-api-access-vpkxv\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp\" (UID: \"a8376fb3-6a3b-4c94-b66c-3bb588ef3f66\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp" Jul 06 19:13:11.919918 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:11.919834 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8376fb3-6a3b-4c94-b66c-3bb588ef3f66-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp\" (UID: \"a8376fb3-6a3b-4c94-b66c-3bb588ef3f66\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp" Jul 06 19:13:11.920821 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:11.920800 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp"] Jul 06 19:13:12.020728 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:12.020698 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8376fb3-6a3b-4c94-b66c-3bb588ef3f66-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp\" (UID: \"a8376fb3-6a3b-4c94-b66c-3bb588ef3f66\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp" Jul 06 19:13:12.020728 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:12.020729 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpkxv\" (UniqueName: \"kubernetes.io/projected/a8376fb3-6a3b-4c94-b66c-3bb588ef3f66-kube-api-access-vpkxv\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp\" (UID: \"a8376fb3-6a3b-4c94-b66c-3bb588ef3f66\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp" Jul 06 19:13:12.020977 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:12.020771 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8376fb3-6a3b-4c94-b66c-3bb588ef3f66-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp\" (UID: \"a8376fb3-6a3b-4c94-b66c-3bb588ef3f66\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp" Jul 06 19:13:12.021092 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:12.021072 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8376fb3-6a3b-4c94-b66c-3bb588ef3f66-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp\" (UID: \"a8376fb3-6a3b-4c94-b66c-3bb588ef3f66\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp" Jul 06 19:13:12.021145 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:12.021100 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8376fb3-6a3b-4c94-b66c-3bb588ef3f66-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp\" (UID: \"a8376fb3-6a3b-4c94-b66c-3bb588ef3f66\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp" Jul 06 19:13:12.785348 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:12.785314 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 19:13:12.984303 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:12.984272 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lrxnr\"" Jul 06 19:13:13.035157 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:13:13.035127 2578 projected.go:291] Couldn't get configMap openshift-marketplace/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jul 06 19:13:13.035157 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:13:13.035163 2578 projected.go:196] Error preparing data for projected volume kube-api-access-vpkxv for pod openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp: failed to sync configmap cache: timed out waiting for the condition Jul 06 19:13:13.035416 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:13:13.035260 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8376fb3-6a3b-4c94-b66c-3bb588ef3f66-kube-api-access-vpkxv podName:a8376fb3-6a3b-4c94-b66c-3bb588ef3f66 nodeName:}" failed. No retries permitted until 2026-07-06 19:13:13.535238549 +0000 UTC m=+358.390324113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vpkxv" (UniqueName: "kubernetes.io/projected/a8376fb3-6a3b-4c94-b66c-3bb588ef3f66-kube-api-access-vpkxv") pod "74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp" (UID: "a8376fb3-6a3b-4c94-b66c-3bb588ef3f66") : failed to sync configmap cache: timed out waiting for the condition Jul 06 19:13:13.372908 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:13.372881 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 19:13:13.635676 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:13.635594 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpkxv\" (UniqueName: \"kubernetes.io/projected/a8376fb3-6a3b-4c94-b66c-3bb588ef3f66-kube-api-access-vpkxv\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp\" (UID: \"a8376fb3-6a3b-4c94-b66c-3bb588ef3f66\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp" Jul 06 19:13:13.638120 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:13.638099 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpkxv\" (UniqueName: \"kubernetes.io/projected/a8376fb3-6a3b-4c94-b66c-3bb588ef3f66-kube-api-access-vpkxv\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp\" (UID: \"a8376fb3-6a3b-4c94-b66c-3bb588ef3f66\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp" Jul 06 19:13:13.670950 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:13.670916 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp" Jul 06 19:13:13.806347 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:13.806290 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp"] Jul 06 19:13:13.809067 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:13:13.809034 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8376fb3_6a3b_4c94_b66c_3bb588ef3f66.slice/crio-246c79a608898a17044a968d5ddd294fb26ed8832c133bf1e69d6ee9f427e62c WatchSource:0}: Error finding container 246c79a608898a17044a968d5ddd294fb26ed8832c133bf1e69d6ee9f427e62c: Status 404 returned error can't find the container with id 246c79a608898a17044a968d5ddd294fb26ed8832c133bf1e69d6ee9f427e62c Jul 06 19:13:13.811143 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:13.811123 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:13:14.319460 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:14.319428 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp" event={"ID":"a8376fb3-6a3b-4c94-b66c-3bb588ef3f66","Type":"ContainerStarted","Data":"246c79a608898a17044a968d5ddd294fb26ed8832c133bf1e69d6ee9f427e62c"} Jul 06 19:13:24.360197 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:24.360161 2578 generic.go:356] "Generic (PLEG): container finished" podID="a8376fb3-6a3b-4c94-b66c-3bb588ef3f66" containerID="b22232a13736de19b015876ebf6dc37b8435742f39d1be588a414201ba5fda0a" exitCode=0 Jul 06 19:13:24.360569 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:24.360219 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp" event={"ID":"a8376fb3-6a3b-4c94-b66c-3bb588ef3f66","Type":"ContainerDied","Data":"b22232a13736de19b015876ebf6dc37b8435742f39d1be588a414201ba5fda0a"} Jul 06 19:13:27.374248 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:27.374215 2578 generic.go:356] "Generic (PLEG): container finished" podID="a8376fb3-6a3b-4c94-b66c-3bb588ef3f66" containerID="d9622c0000c6bcb574e693e25539e275e38b3308a2991672a287bb729f2908fb" exitCode=0 Jul 06 19:13:27.374671 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:27.374307 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp" event={"ID":"a8376fb3-6a3b-4c94-b66c-3bb588ef3f66","Type":"ContainerDied","Data":"d9622c0000c6bcb574e693e25539e275e38b3308a2991672a287bb729f2908fb"} Jul 06 19:13:30.883028 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:30.882979 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:30.958179 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:30.958147 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:36.529142 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:36.529110 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:37.418387 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:37.418346 2578 generic.go:356] "Generic (PLEG): container finished" podID="a8376fb3-6a3b-4c94-b66c-3bb588ef3f66" containerID="930d877b90bfb5506ebc93c196e29a57b53a3e0b86678d806afbf9a785a06018" exitCode=0 Jul 06 19:13:37.418645 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:37.418425 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp" event={"ID":"a8376fb3-6a3b-4c94-b66c-3bb588ef3f66","Type":"ContainerDied","Data":"930d877b90bfb5506ebc93c196e29a57b53a3e0b86678d806afbf9a785a06018"} Jul 06 19:13:38.540430 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:38.540404 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp" Jul 06 19:13:38.644726 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:38.644685 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpkxv\" (UniqueName: \"kubernetes.io/projected/a8376fb3-6a3b-4c94-b66c-3bb588ef3f66-kube-api-access-vpkxv\") pod \"a8376fb3-6a3b-4c94-b66c-3bb588ef3f66\" (UID: \"a8376fb3-6a3b-4c94-b66c-3bb588ef3f66\") " Jul 06 19:13:38.644964 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:38.644743 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8376fb3-6a3b-4c94-b66c-3bb588ef3f66-bundle\") pod \"a8376fb3-6a3b-4c94-b66c-3bb588ef3f66\" (UID: \"a8376fb3-6a3b-4c94-b66c-3bb588ef3f66\") " Jul 06 19:13:38.644964 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:38.644788 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8376fb3-6a3b-4c94-b66c-3bb588ef3f66-util\") pod \"a8376fb3-6a3b-4c94-b66c-3bb588ef3f66\" (UID: \"a8376fb3-6a3b-4c94-b66c-3bb588ef3f66\") " Jul 06 19:13:38.645602 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:38.645567 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8376fb3-6a3b-4c94-b66c-3bb588ef3f66-bundle" (OuterVolumeSpecName: "bundle") pod "a8376fb3-6a3b-4c94-b66c-3bb588ef3f66" (UID: "a8376fb3-6a3b-4c94-b66c-3bb588ef3f66"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:13:38.646977 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:38.646955 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8376fb3-6a3b-4c94-b66c-3bb588ef3f66-kube-api-access-vpkxv" (OuterVolumeSpecName: "kube-api-access-vpkxv") pod "a8376fb3-6a3b-4c94-b66c-3bb588ef3f66" (UID: "a8376fb3-6a3b-4c94-b66c-3bb588ef3f66"). InnerVolumeSpecName "kube-api-access-vpkxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:13:38.650165 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:38.650142 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8376fb3-6a3b-4c94-b66c-3bb588ef3f66-util" (OuterVolumeSpecName: "util") pod "a8376fb3-6a3b-4c94-b66c-3bb588ef3f66" (UID: "a8376fb3-6a3b-4c94-b66c-3bb588ef3f66"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:13:38.746182 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:38.746103 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8376fb3-6a3b-4c94-b66c-3bb588ef3f66-bundle\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:13:38.746182 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:38.746129 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8376fb3-6a3b-4c94-b66c-3bb588ef3f66-util\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:13:38.746182 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:38.746138 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpkxv\" (UniqueName: \"kubernetes.io/projected/a8376fb3-6a3b-4c94-b66c-3bb588ef3f66-kube-api-access-vpkxv\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:13:39.427463 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:39.427430 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp" Jul 06 19:13:39.427463 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:39.427440 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wv7cp" event={"ID":"a8376fb3-6a3b-4c94-b66c-3bb588ef3f66","Type":"ContainerDied","Data":"246c79a608898a17044a968d5ddd294fb26ed8832c133bf1e69d6ee9f427e62c"} Jul 06 19:13:39.427672 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:39.427507 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="246c79a608898a17044a968d5ddd294fb26ed8832c133bf1e69d6ee9f427e62c" Jul 06 19:13:43.056637 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:43.056603 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:43.224501 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:43.224466 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:45.439132 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:45.439096 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc"] Jul 06 19:13:45.439506 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:45.439391 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8376fb3-6a3b-4c94-b66c-3bb588ef3f66" containerName="util" Jul 06 19:13:45.439506 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:45.439404 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8376fb3-6a3b-4c94-b66c-3bb588ef3f66" containerName="util" Jul 06 19:13:45.439506 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:45.439427 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8376fb3-6a3b-4c94-b66c-3bb588ef3f66" containerName="pull" Jul 06 19:13:45.439506 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:45.439432 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8376fb3-6a3b-4c94-b66c-3bb588ef3f66" containerName="pull" Jul 06 19:13:45.439506 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:45.439438 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8376fb3-6a3b-4c94-b66c-3bb588ef3f66" containerName="extract" Jul 06 19:13:45.439506 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:45.439443 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8376fb3-6a3b-4c94-b66c-3bb588ef3f66" containerName="extract" Jul 06 19:13:45.439506 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:45.439509 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8376fb3-6a3b-4c94-b66c-3bb588ef3f66" containerName="extract" Jul 06 19:13:45.442246 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:45.442227 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc" Jul 06 19:13:45.445583 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:45.445550 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 06 19:13:45.445700 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:45.445587 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 06 19:13:45.445700 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:45.445596 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 06 19:13:45.446084 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:45.445690 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-krc9r\"" Jul 06 19:13:45.480556 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:45.480531 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc"] Jul 06 19:13:45.604002 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:45.603969 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/e64a4294-d75d-4e88-8538-178da2a235b2-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc\" (UID: \"e64a4294-d75d-4e88-8538-178da2a235b2\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc" Jul 06 19:13:45.604171 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:45.604011 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvbc6\" (UniqueName: \"kubernetes.io/projected/e64a4294-d75d-4e88-8538-178da2a235b2-kube-api-access-vvbc6\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc\" (UID: \"e64a4294-d75d-4e88-8538-178da2a235b2\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc" Jul 06 19:13:45.705237 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:45.705145 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/e64a4294-d75d-4e88-8538-178da2a235b2-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc\" (UID: \"e64a4294-d75d-4e88-8538-178da2a235b2\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc" Jul 06 19:13:45.705237 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:45.705223 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvbc6\" (UniqueName: \"kubernetes.io/projected/e64a4294-d75d-4e88-8538-178da2a235b2-kube-api-access-vvbc6\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc\" (UID: \"e64a4294-d75d-4e88-8538-178da2a235b2\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc" Jul 06 19:13:45.707571 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:45.707546 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/e64a4294-d75d-4e88-8538-178da2a235b2-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc\" (UID: \"e64a4294-d75d-4e88-8538-178da2a235b2\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc" Jul 06 19:13:45.739056 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:45.739026 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvbc6\" (UniqueName: \"kubernetes.io/projected/e64a4294-d75d-4e88-8538-178da2a235b2-kube-api-access-vvbc6\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc\" (UID: \"e64a4294-d75d-4e88-8538-178da2a235b2\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc" Jul 06 19:13:45.757277 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:45.757253 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc" Jul 06 19:13:45.919513 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:45.919490 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc"] Jul 06 19:13:45.922173 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:13:45.922146 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode64a4294_d75d_4e88_8538_178da2a235b2.slice/crio-60938323fec14c8775bc688d9792295c65f2fbe8c26d30f917a96b0351cc5298 WatchSource:0}: Error finding container 60938323fec14c8775bc688d9792295c65f2fbe8c26d30f917a96b0351cc5298: Status 404 returned error can't find the container with id 60938323fec14c8775bc688d9792295c65f2fbe8c26d30f917a96b0351cc5298 Jul 06 19:13:46.460507 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:46.460475 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc" event={"ID":"e64a4294-d75d-4e88-8538-178da2a235b2","Type":"ContainerStarted","Data":"60938323fec14c8775bc688d9792295c65f2fbe8c26d30f917a96b0351cc5298"} Jul 06 19:13:49.165271 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:49.165232 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:49.480657 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:49.480560 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc" event={"ID":"e64a4294-d75d-4e88-8538-178da2a235b2","Type":"ContainerStarted","Data":"a5b9431557d388527015211f0fba9ff45d890aa09fc4f7e36265dcb5c58d2ad7"} Jul 06 19:13:49.480657 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:49.480617 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc" Jul 06 19:13:49.546562 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:49.546516 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc" podStartSLOduration=1.891392764 podStartE2EDuration="4.546499203s" totalImagesPullingTime="2.655106439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:13:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:13:49.543807587 +0000 UTC m=+394.398893174" watchObservedRunningTime="2026-07-06 19:13:49.546499203 +0000 UTC m=+394.401584788" Jul 06 19:13:49.596468 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:49.596439 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:49.670424 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:49.670394 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-6kx9x"] Jul 06 19:13:49.672773 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:49.672758 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-6kx9x" Jul 06 19:13:49.675639 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:49.675619 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 06 19:13:49.675768 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:49.675702 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 06 19:13:49.676326 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:49.676311 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-km8vd\"" Jul 06 19:13:49.694561 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:49.694531 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-6kx9x"] Jul 06 19:13:49.826879 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:49.826774 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:49.843570 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:49.843529 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95pjz\" (UniqueName: \"kubernetes.io/projected/e7b93ee2-ec62-4f00-93a4-7ea4d818f586-kube-api-access-95pjz\") pod \"keda-operator-68bff59c-6kx9x\" (UID: \"e7b93ee2-ec62-4f00-93a4-7ea4d818f586\") " pod="openshift-keda/keda-operator-68bff59c-6kx9x" Jul 06 19:13:49.843711 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:49.843591 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e7b93ee2-ec62-4f00-93a4-7ea4d818f586-certificates\") pod \"keda-operator-68bff59c-6kx9x\" (UID: \"e7b93ee2-ec62-4f00-93a4-7ea4d818f586\") " pod="openshift-keda/keda-operator-68bff59c-6kx9x" Jul 06 19:13:49.843711 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:49.843668 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/e7b93ee2-ec62-4f00-93a4-7ea4d818f586-cabundle0\") pod \"keda-operator-68bff59c-6kx9x\" (UID: \"e7b93ee2-ec62-4f00-93a4-7ea4d818f586\") " pod="openshift-keda/keda-operator-68bff59c-6kx9x" Jul 06 19:13:49.944956 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:49.944920 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e7b93ee2-ec62-4f00-93a4-7ea4d818f586-certificates\") pod \"keda-operator-68bff59c-6kx9x\" (UID: \"e7b93ee2-ec62-4f00-93a4-7ea4d818f586\") " pod="openshift-keda/keda-operator-68bff59c-6kx9x" Jul 06 19:13:49.945092 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:49.944981 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/e7b93ee2-ec62-4f00-93a4-7ea4d818f586-cabundle0\") pod \"keda-operator-68bff59c-6kx9x\" (UID: \"e7b93ee2-ec62-4f00-93a4-7ea4d818f586\") " pod="openshift-keda/keda-operator-68bff59c-6kx9x" Jul 06 19:13:49.945092 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:49.945052 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95pjz\" (UniqueName: \"kubernetes.io/projected/e7b93ee2-ec62-4f00-93a4-7ea4d818f586-kube-api-access-95pjz\") pod \"keda-operator-68bff59c-6kx9x\" (UID: \"e7b93ee2-ec62-4f00-93a4-7ea4d818f586\") " pod="openshift-keda/keda-operator-68bff59c-6kx9x" Jul 06 19:13:49.945092 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:13:49.945067 2578 secret.go:281] references non-existent secret key: ca.crt Jul 06 19:13:49.945092 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:13:49.945089 2578 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 06 19:13:49.945275 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:13:49.945099 2578 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-6kx9x: references non-existent secret key: ca.crt Jul 06 19:13:49.945275 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:13:49.945168 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7b93ee2-ec62-4f00-93a4-7ea4d818f586-certificates podName:e7b93ee2-ec62-4f00-93a4-7ea4d818f586 nodeName:}" failed. No retries permitted until 2026-07-06 19:13:50.445151884 +0000 UTC m=+395.300237448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/e7b93ee2-ec62-4f00-93a4-7ea4d818f586-certificates") pod "keda-operator-68bff59c-6kx9x" (UID: "e7b93ee2-ec62-4f00-93a4-7ea4d818f586") : references non-existent secret key: ca.crt Jul 06 19:13:49.945719 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:49.945699 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/e7b93ee2-ec62-4f00-93a4-7ea4d818f586-cabundle0\") pod \"keda-operator-68bff59c-6kx9x\" (UID: \"e7b93ee2-ec62-4f00-93a4-7ea4d818f586\") " pod="openshift-keda/keda-operator-68bff59c-6kx9x" Jul 06 19:13:49.959698 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:49.959672 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95pjz\" (UniqueName: \"kubernetes.io/projected/e7b93ee2-ec62-4f00-93a4-7ea4d818f586-kube-api-access-95pjz\") pod \"keda-operator-68bff59c-6kx9x\" (UID: \"e7b93ee2-ec62-4f00-93a4-7ea4d818f586\") " pod="openshift-keda/keda-operator-68bff59c-6kx9x" Jul 06 19:13:50.425142 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:50.425104 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:50.449356 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:50.449327 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e7b93ee2-ec62-4f00-93a4-7ea4d818f586-certificates\") pod \"keda-operator-68bff59c-6kx9x\" (UID: \"e7b93ee2-ec62-4f00-93a4-7ea4d818f586\") " pod="openshift-keda/keda-operator-68bff59c-6kx9x" Jul 06 19:13:50.449488 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:13:50.449472 2578 secret.go:281] references non-existent secret key: ca.crt Jul 06 19:13:50.449528 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:13:50.449493 2578 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 06 19:13:50.449528 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:13:50.449501 2578 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-6kx9x: references non-existent secret key: ca.crt Jul 06 19:13:50.449590 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:13:50.449548 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7b93ee2-ec62-4f00-93a4-7ea4d818f586-certificates podName:e7b93ee2-ec62-4f00-93a4-7ea4d818f586 nodeName:}" failed. No retries permitted until 2026-07-06 19:13:51.449533883 +0000 UTC m=+396.304619448 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/e7b93ee2-ec62-4f00-93a4-7ea4d818f586-certificates") pod "keda-operator-68bff59c-6kx9x" (UID: "e7b93ee2-ec62-4f00-93a4-7ea4d818f586") : references non-existent secret key: ca.crt Jul 06 19:13:50.521748 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:50.521715 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:50.538449 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:50.538400 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-2nfvb"] Jul 06 19:13:50.540933 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:50.540915 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-2nfvb" Jul 06 19:13:50.543290 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:50.543274 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 06 19:13:50.565293 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:50.565267 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-2nfvb"] Jul 06 19:13:50.650741 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:50.650710 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xjx8\" (UniqueName: \"kubernetes.io/projected/9de03cc9-d6d5-4e78-9808-a31a925b9098-kube-api-access-7xjx8\") pod \"keda-metrics-apiserver-559f75f947-2nfvb\" (UID: \"9de03cc9-d6d5-4e78-9808-a31a925b9098\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-2nfvb" Jul 06 19:13:50.650946 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:50.650753 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9de03cc9-d6d5-4e78-9808-a31a925b9098-certificates\") pod \"keda-metrics-apiserver-559f75f947-2nfvb\" (UID: \"9de03cc9-d6d5-4e78-9808-a31a925b9098\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-2nfvb" Jul 06 19:13:50.650946 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:50.650866 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/9de03cc9-d6d5-4e78-9808-a31a925b9098-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-2nfvb\" (UID: \"9de03cc9-d6d5-4e78-9808-a31a925b9098\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-2nfvb" Jul 06 19:13:50.751807 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:50.751729 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/9de03cc9-d6d5-4e78-9808-a31a925b9098-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-2nfvb\" (UID: \"9de03cc9-d6d5-4e78-9808-a31a925b9098\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-2nfvb" Jul 06 19:13:50.751807 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:50.751783 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xjx8\" (UniqueName: \"kubernetes.io/projected/9de03cc9-d6d5-4e78-9808-a31a925b9098-kube-api-access-7xjx8\") pod \"keda-metrics-apiserver-559f75f947-2nfvb\" (UID: \"9de03cc9-d6d5-4e78-9808-a31a925b9098\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-2nfvb" Jul 06 19:13:50.752044 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:50.751810 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9de03cc9-d6d5-4e78-9808-a31a925b9098-certificates\") pod \"keda-metrics-apiserver-559f75f947-2nfvb\" (UID: \"9de03cc9-d6d5-4e78-9808-a31a925b9098\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-2nfvb" Jul 06 19:13:50.752100 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:50.752088 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/9de03cc9-d6d5-4e78-9808-a31a925b9098-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-2nfvb\" (UID: \"9de03cc9-d6d5-4e78-9808-a31a925b9098\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-2nfvb" Jul 06 19:13:50.754363 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:50.754333 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9de03cc9-d6d5-4e78-9808-a31a925b9098-certificates\") pod \"keda-metrics-apiserver-559f75f947-2nfvb\" (UID: \"9de03cc9-d6d5-4e78-9808-a31a925b9098\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-2nfvb" Jul 06 19:13:50.754767 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:50.754739 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:50.776168 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:50.776140 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xjx8\" (UniqueName: \"kubernetes.io/projected/9de03cc9-d6d5-4e78-9808-a31a925b9098-kube-api-access-7xjx8\") pod \"keda-metrics-apiserver-559f75f947-2nfvb\" (UID: \"9de03cc9-d6d5-4e78-9808-a31a925b9098\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-2nfvb" Jul 06 19:13:50.853611 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:50.853582 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-2nfvb" Jul 06 19:13:50.886762 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:50.886724 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:50.992754 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:50.992727 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:51.004712 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:51.004694 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-2nfvb"] Jul 06 19:13:51.006871 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:13:51.006849 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9de03cc9_d6d5_4e78_9808_a31a925b9098.slice/crio-38641bbe9944f88c557a5fb654f1175b3af7a66cafaabcf13299994ab7fccd32 WatchSource:0}: Error finding container 38641bbe9944f88c557a5fb654f1175b3af7a66cafaabcf13299994ab7fccd32: Status 404 returned error can't find the container with id 38641bbe9944f88c557a5fb654f1175b3af7a66cafaabcf13299994ab7fccd32 Jul 06 19:13:51.102717 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:51.102685 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:51.420247 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:51.420215 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:51.457644 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:51.457613 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e7b93ee2-ec62-4f00-93a4-7ea4d818f586-certificates\") pod \"keda-operator-68bff59c-6kx9x\" (UID: \"e7b93ee2-ec62-4f00-93a4-7ea4d818f586\") " pod="openshift-keda/keda-operator-68bff59c-6kx9x" Jul 06 19:13:51.460167 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:51.460143 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e7b93ee2-ec62-4f00-93a4-7ea4d818f586-certificates\") pod \"keda-operator-68bff59c-6kx9x\" (UID: \"e7b93ee2-ec62-4f00-93a4-7ea4d818f586\") " pod="openshift-keda/keda-operator-68bff59c-6kx9x" Jul 06 19:13:51.483106 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:51.483079 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-6kx9x" Jul 06 19:13:51.494961 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:51.494934 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-2nfvb" event={"ID":"9de03cc9-d6d5-4e78-9808-a31a925b9098","Type":"ContainerStarted","Data":"38641bbe9944f88c557a5fb654f1175b3af7a66cafaabcf13299994ab7fccd32"} Jul 06 19:13:51.642093 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:51.642041 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-6kx9x"] Jul 06 19:13:51.644634 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:13:51.644599 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7b93ee2_ec62_4f00_93a4_7ea4d818f586.slice/crio-c248d6ee6871f21a3cf3ee009f549ec140a34747952cfed5eb0fd4d7d5108d76 WatchSource:0}: Error finding container c248d6ee6871f21a3cf3ee009f549ec140a34747952cfed5eb0fd4d7d5108d76: Status 404 returned error can't find the container with id c248d6ee6871f21a3cf3ee009f549ec140a34747952cfed5eb0fd4d7d5108d76 Jul 06 19:13:51.709313 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:51.709205 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:51.835729 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:51.835680 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:51.945374 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:51.945345 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:52.501617 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:52.501585 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-6kx9x" event={"ID":"e7b93ee2-ec62-4f00-93a4-7ea4d818f586","Type":"ContainerStarted","Data":"c248d6ee6871f21a3cf3ee009f549ec140a34747952cfed5eb0fd4d7d5108d76"} Jul 06 19:13:54.512155 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:54.512120 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-2nfvb" event={"ID":"9de03cc9-d6d5-4e78-9808-a31a925b9098","Type":"ContainerStarted","Data":"62c45db78604679334f12860233272fb035418fbcfb78d0c380cf38a280eba0c"} Jul 06 19:13:54.512538 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:54.512177 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-2nfvb" Jul 06 19:13:54.543498 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:54.543451 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-2nfvb" podStartSLOduration=1.498120776 podStartE2EDuration="4.543432095s" totalImagesPullingTime="3.045311319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:13:54.54123517 +0000 UTC m=+399.396320759" watchObservedRunningTime="2026-07-06 19:13:54.543432095 +0000 UTC m=+399.398517682" Jul 06 19:13:56.525097 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:56.525051 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-6kx9x" event={"ID":"e7b93ee2-ec62-4f00-93a4-7ea4d818f586","Type":"ContainerStarted","Data":"c2e05a356de50fb228ceb64a6f4fe55d22ed8074593f67f9201238351ce5ade3"} Jul 06 19:13:56.525584 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:56.525165 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-6kx9x" Jul 06 19:13:56.562167 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:13:56.562122 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-6kx9x" podStartSLOduration=3.268371243 podStartE2EDuration="7.562106215s" totalImagesPullingTime="4.293734972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:13:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:13:56.558061165 +0000 UTC m=+401.413146751" watchObservedRunningTime="2026-07-06 19:13:56.562106215 +0000 UTC m=+401.417191800" Jul 06 19:14:00.943810 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:00.943776 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78688bb47f-bvhj6"] Jul 06 19:14:00.946275 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:00.946258 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78688bb47f-bvhj6" Jul 06 19:14:00.966267 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:00.966243 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78688bb47f-bvhj6"] Jul 06 19:14:01.038452 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:01.038419 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10ef8b22-b69c-46af-a185-4e7fce285c70-console-config\") pod \"console-78688bb47f-bvhj6\" (UID: \"10ef8b22-b69c-46af-a185-4e7fce285c70\") " pod="openshift-console/console-78688bb47f-bvhj6" Jul 06 19:14:01.038619 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:01.038458 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10ef8b22-b69c-46af-a185-4e7fce285c70-service-ca\") pod \"console-78688bb47f-bvhj6\" (UID: \"10ef8b22-b69c-46af-a185-4e7fce285c70\") " pod="openshift-console/console-78688bb47f-bvhj6" Jul 06 19:14:01.038619 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:01.038492 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnxg4\" (UniqueName: \"kubernetes.io/projected/10ef8b22-b69c-46af-a185-4e7fce285c70-kube-api-access-dnxg4\") pod \"console-78688bb47f-bvhj6\" (UID: \"10ef8b22-b69c-46af-a185-4e7fce285c70\") " pod="openshift-console/console-78688bb47f-bvhj6" Jul 06 19:14:01.038619 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:01.038580 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10ef8b22-b69c-46af-a185-4e7fce285c70-trusted-ca-bundle\") pod \"console-78688bb47f-bvhj6\" (UID: \"10ef8b22-b69c-46af-a185-4e7fce285c70\") " pod="openshift-console/console-78688bb47f-bvhj6" Jul 06 19:14:01.038736 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:01.038617 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10ef8b22-b69c-46af-a185-4e7fce285c70-oauth-serving-cert\") pod \"console-78688bb47f-bvhj6\" (UID: \"10ef8b22-b69c-46af-a185-4e7fce285c70\") " pod="openshift-console/console-78688bb47f-bvhj6" Jul 06 19:14:01.038736 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:01.038686 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10ef8b22-b69c-46af-a185-4e7fce285c70-console-serving-cert\") pod \"console-78688bb47f-bvhj6\" (UID: \"10ef8b22-b69c-46af-a185-4e7fce285c70\") " pod="openshift-console/console-78688bb47f-bvhj6" Jul 06 19:14:01.038736 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:01.038706 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10ef8b22-b69c-46af-a185-4e7fce285c70-console-oauth-config\") pod \"console-78688bb47f-bvhj6\" (UID: \"10ef8b22-b69c-46af-a185-4e7fce285c70\") " pod="openshift-console/console-78688bb47f-bvhj6" Jul 06 19:14:01.139743 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:01.139708 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10ef8b22-b69c-46af-a185-4e7fce285c70-console-serving-cert\") pod \"console-78688bb47f-bvhj6\" (UID: \"10ef8b22-b69c-46af-a185-4e7fce285c70\") " pod="openshift-console/console-78688bb47f-bvhj6" Jul 06 19:14:01.139743 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:01.139741 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10ef8b22-b69c-46af-a185-4e7fce285c70-console-oauth-config\") pod \"console-78688bb47f-bvhj6\" (UID: \"10ef8b22-b69c-46af-a185-4e7fce285c70\") " pod="openshift-console/console-78688bb47f-bvhj6" Jul 06 19:14:01.139983 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:01.139766 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10ef8b22-b69c-46af-a185-4e7fce285c70-console-config\") pod \"console-78688bb47f-bvhj6\" (UID: \"10ef8b22-b69c-46af-a185-4e7fce285c70\") " pod="openshift-console/console-78688bb47f-bvhj6" Jul 06 19:14:01.139983 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:01.139787 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10ef8b22-b69c-46af-a185-4e7fce285c70-service-ca\") pod \"console-78688bb47f-bvhj6\" (UID: \"10ef8b22-b69c-46af-a185-4e7fce285c70\") " pod="openshift-console/console-78688bb47f-bvhj6" Jul 06 19:14:01.139983 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:01.139907 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnxg4\" (UniqueName: \"kubernetes.io/projected/10ef8b22-b69c-46af-a185-4e7fce285c70-kube-api-access-dnxg4\") pod \"console-78688bb47f-bvhj6\" (UID: \"10ef8b22-b69c-46af-a185-4e7fce285c70\") " pod="openshift-console/console-78688bb47f-bvhj6" Jul 06 19:14:01.139983 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:01.139966 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10ef8b22-b69c-46af-a185-4e7fce285c70-trusted-ca-bundle\") pod \"console-78688bb47f-bvhj6\" (UID: \"10ef8b22-b69c-46af-a185-4e7fce285c70\") " pod="openshift-console/console-78688bb47f-bvhj6" Jul 06 19:14:01.140209 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:01.139991 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10ef8b22-b69c-46af-a185-4e7fce285c70-oauth-serving-cert\") pod \"console-78688bb47f-bvhj6\" (UID: \"10ef8b22-b69c-46af-a185-4e7fce285c70\") " pod="openshift-console/console-78688bb47f-bvhj6" Jul 06 19:14:01.140566 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:01.140540 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10ef8b22-b69c-46af-a185-4e7fce285c70-console-config\") pod \"console-78688bb47f-bvhj6\" (UID: \"10ef8b22-b69c-46af-a185-4e7fce285c70\") " pod="openshift-console/console-78688bb47f-bvhj6" Jul 06 19:14:01.140753 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:01.140583 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10ef8b22-b69c-46af-a185-4e7fce285c70-service-ca\") pod \"console-78688bb47f-bvhj6\" (UID: \"10ef8b22-b69c-46af-a185-4e7fce285c70\") " pod="openshift-console/console-78688bb47f-bvhj6" Jul 06 19:14:01.140753 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:01.140664 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10ef8b22-b69c-46af-a185-4e7fce285c70-oauth-serving-cert\") pod \"console-78688bb47f-bvhj6\" (UID: \"10ef8b22-b69c-46af-a185-4e7fce285c70\") " pod="openshift-console/console-78688bb47f-bvhj6" Jul 06 19:14:01.140927 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:01.140831 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10ef8b22-b69c-46af-a185-4e7fce285c70-trusted-ca-bundle\") pod \"console-78688bb47f-bvhj6\" (UID: \"10ef8b22-b69c-46af-a185-4e7fce285c70\") " pod="openshift-console/console-78688bb47f-bvhj6" Jul 06 19:14:01.142329 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:01.142305 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10ef8b22-b69c-46af-a185-4e7fce285c70-console-serving-cert\") pod \"console-78688bb47f-bvhj6\" (UID: \"10ef8b22-b69c-46af-a185-4e7fce285c70\") " pod="openshift-console/console-78688bb47f-bvhj6" Jul 06 19:14:01.142441 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:01.142333 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10ef8b22-b69c-46af-a185-4e7fce285c70-console-oauth-config\") pod \"console-78688bb47f-bvhj6\" (UID: \"10ef8b22-b69c-46af-a185-4e7fce285c70\") " pod="openshift-console/console-78688bb47f-bvhj6" Jul 06 19:14:01.154690 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:01.154661 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnxg4\" (UniqueName: \"kubernetes.io/projected/10ef8b22-b69c-46af-a185-4e7fce285c70-kube-api-access-dnxg4\") pod \"console-78688bb47f-bvhj6\" (UID: \"10ef8b22-b69c-46af-a185-4e7fce285c70\") " pod="openshift-console/console-78688bb47f-bvhj6" Jul 06 19:14:01.177079 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:01.177043 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:01.255864 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:01.255746 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78688bb47f-bvhj6" Jul 06 19:14:01.399617 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:01.399588 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78688bb47f-bvhj6"] Jul 06 19:14:01.402724 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:14:01.402701 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10ef8b22_b69c_46af_a185_4e7fce285c70.slice/crio-c115ad24262dfa09d1e3e6a9895526db3670e987827f184018ab809c7a97f8c6 WatchSource:0}: Error finding container c115ad24262dfa09d1e3e6a9895526db3670e987827f184018ab809c7a97f8c6: Status 404 returned error can't find the container with id c115ad24262dfa09d1e3e6a9895526db3670e987827f184018ab809c7a97f8c6 Jul 06 19:14:01.548099 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:01.547631 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78688bb47f-bvhj6" event={"ID":"10ef8b22-b69c-46af-a185-4e7fce285c70","Type":"ContainerStarted","Data":"a6efe6cd17a27aa4df76773285c0e4ec837830811d04f02449a1d3c97fe2c260"} Jul 06 19:14:01.548099 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:01.547691 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78688bb47f-bvhj6" event={"ID":"10ef8b22-b69c-46af-a185-4e7fce285c70","Type":"ContainerStarted","Data":"c115ad24262dfa09d1e3e6a9895526db3670e987827f184018ab809c7a97f8c6"} Jul 06 19:14:01.577488 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:01.577432 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78688bb47f-bvhj6" podStartSLOduration=1.57741552 podStartE2EDuration="1.57741552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:14:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:14:01.57514182 +0000 UTC m=+406.430227420" watchObservedRunningTime="2026-07-06 19:14:01.57741552 +0000 UTC m=+406.432501106" Jul 06 19:14:05.522212 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:05.522179 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-2nfvb" Jul 06 19:14:10.488470 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:10.488437 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc" Jul 06 19:14:11.255875 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:11.255824 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78688bb47f-bvhj6" Jul 06 19:14:11.256047 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:11.255897 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78688bb47f-bvhj6" Jul 06 19:14:11.260727 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:11.260706 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78688bb47f-bvhj6" Jul 06 19:14:11.592924 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:11.592902 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78688bb47f-bvhj6" Jul 06 19:14:11.723811 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:11.723773 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69854bbc7c-khg86"] Jul 06 19:14:11.935347 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:11.935265 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:12.034539 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:12.034504 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:12.124873 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:12.124829 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:17.531511 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:17.531478 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-6kx9x" Jul 06 19:14:35.543258 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:35.543221 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:36.745754 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:36.745712 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-69854bbc7c-khg86" podUID="cf20e78d-5b40-4f30-8e37-aa4234beeb88" containerName="console" containerID="cri-o://1b6168a58f0b85ef13849e7402b7d22eff1a6e58bfe61dc12bea458605df5fd1" gracePeriod=15 Jul 06 19:14:36.984997 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:36.984972 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:14:37.144995 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.144969 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf20e78d-5b40-4f30-8e37-aa4234beeb88-oauth-serving-cert\") pod \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " Jul 06 19:14:37.145168 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.145011 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf20e78d-5b40-4f30-8e37-aa4234beeb88-console-oauth-config\") pod \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " Jul 06 19:14:37.145168 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.145042 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf20e78d-5b40-4f30-8e37-aa4234beeb88-service-ca\") pod \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " Jul 06 19:14:37.145168 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.145081 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf20e78d-5b40-4f30-8e37-aa4234beeb88-console-config\") pod \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " Jul 06 19:14:37.145168 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.145105 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf20e78d-5b40-4f30-8e37-aa4234beeb88-console-serving-cert\") pod \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " Jul 06 19:14:37.145168 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.145132 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5f8s\" (UniqueName: \"kubernetes.io/projected/cf20e78d-5b40-4f30-8e37-aa4234beeb88-kube-api-access-q5f8s\") pod \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " Jul 06 19:14:37.145168 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.145160 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf20e78d-5b40-4f30-8e37-aa4234beeb88-trusted-ca-bundle\") pod \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\" (UID: \"cf20e78d-5b40-4f30-8e37-aa4234beeb88\") " Jul 06 19:14:37.145506 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.145466 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf20e78d-5b40-4f30-8e37-aa4234beeb88-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cf20e78d-5b40-4f30-8e37-aa4234beeb88" (UID: "cf20e78d-5b40-4f30-8e37-aa4234beeb88"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:14:37.145649 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.145623 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf20e78d-5b40-4f30-8e37-aa4234beeb88-service-ca" (OuterVolumeSpecName: "service-ca") pod "cf20e78d-5b40-4f30-8e37-aa4234beeb88" (UID: "cf20e78d-5b40-4f30-8e37-aa4234beeb88"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:14:37.145708 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.145629 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf20e78d-5b40-4f30-8e37-aa4234beeb88-console-config" (OuterVolumeSpecName: "console-config") pod "cf20e78d-5b40-4f30-8e37-aa4234beeb88" (UID: "cf20e78d-5b40-4f30-8e37-aa4234beeb88"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:14:37.145708 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.145679 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf20e78d-5b40-4f30-8e37-aa4234beeb88-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cf20e78d-5b40-4f30-8e37-aa4234beeb88" (UID: "cf20e78d-5b40-4f30-8e37-aa4234beeb88"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:14:37.147317 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.147296 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf20e78d-5b40-4f30-8e37-aa4234beeb88-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cf20e78d-5b40-4f30-8e37-aa4234beeb88" (UID: "cf20e78d-5b40-4f30-8e37-aa4234beeb88"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:14:37.147416 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.147336 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf20e78d-5b40-4f30-8e37-aa4234beeb88-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cf20e78d-5b40-4f30-8e37-aa4234beeb88" (UID: "cf20e78d-5b40-4f30-8e37-aa4234beeb88"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:14:37.147416 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.147363 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf20e78d-5b40-4f30-8e37-aa4234beeb88-kube-api-access-q5f8s" (OuterVolumeSpecName: "kube-api-access-q5f8s") pod "cf20e78d-5b40-4f30-8e37-aa4234beeb88" (UID: "cf20e78d-5b40-4f30-8e37-aa4234beeb88"). InnerVolumeSpecName "kube-api-access-q5f8s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:14:37.245906 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.245878 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf20e78d-5b40-4f30-8e37-aa4234beeb88-console-config\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:14:37.245906 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.245902 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf20e78d-5b40-4f30-8e37-aa4234beeb88-console-serving-cert\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:14:37.246059 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.245913 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5f8s\" (UniqueName: \"kubernetes.io/projected/cf20e78d-5b40-4f30-8e37-aa4234beeb88-kube-api-access-q5f8s\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:14:37.246059 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.245923 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf20e78d-5b40-4f30-8e37-aa4234beeb88-trusted-ca-bundle\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:14:37.246059 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.245931 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf20e78d-5b40-4f30-8e37-aa4234beeb88-oauth-serving-cert\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:14:37.246059 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.245939 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf20e78d-5b40-4f30-8e37-aa4234beeb88-console-oauth-config\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:14:37.246059 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.245947 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf20e78d-5b40-4f30-8e37-aa4234beeb88-service-ca\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:14:37.699704 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.699672 2578 generic.go:356] "Generic (PLEG): container finished" podID="cf20e78d-5b40-4f30-8e37-aa4234beeb88" containerID="1b6168a58f0b85ef13849e7402b7d22eff1a6e58bfe61dc12bea458605df5fd1" exitCode=0 Jul 06 19:14:37.699868 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.699715 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69854bbc7c-khg86" Jul 06 19:14:37.699868 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.699766 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69854bbc7c-khg86" event={"ID":"cf20e78d-5b40-4f30-8e37-aa4234beeb88","Type":"ContainerDied","Data":"1b6168a58f0b85ef13849e7402b7d22eff1a6e58bfe61dc12bea458605df5fd1"} Jul 06 19:14:37.699868 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.699810 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69854bbc7c-khg86" event={"ID":"cf20e78d-5b40-4f30-8e37-aa4234beeb88","Type":"ContainerDied","Data":"198e561086068930e255512019c18772b7b92de8544af592862789118d402b45"} Jul 06 19:14:37.699868 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.699831 2578 scope.go:117] "RemoveContainer" containerID="1b6168a58f0b85ef13849e7402b7d22eff1a6e58bfe61dc12bea458605df5fd1" Jul 06 19:14:37.707855 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.707824 2578 scope.go:117] "RemoveContainer" containerID="1b6168a58f0b85ef13849e7402b7d22eff1a6e58bfe61dc12bea458605df5fd1" Jul 06 19:14:37.708105 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:14:37.708087 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b6168a58f0b85ef13849e7402b7d22eff1a6e58bfe61dc12bea458605df5fd1\": container with ID starting with 1b6168a58f0b85ef13849e7402b7d22eff1a6e58bfe61dc12bea458605df5fd1 not found: ID does not exist" containerID="1b6168a58f0b85ef13849e7402b7d22eff1a6e58bfe61dc12bea458605df5fd1" Jul 06 19:14:37.708149 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.708113 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b6168a58f0b85ef13849e7402b7d22eff1a6e58bfe61dc12bea458605df5fd1"} err="failed to get container status \"1b6168a58f0b85ef13849e7402b7d22eff1a6e58bfe61dc12bea458605df5fd1\": rpc error: code = NotFound desc = could not find container \"1b6168a58f0b85ef13849e7402b7d22eff1a6e58bfe61dc12bea458605df5fd1\": container with ID starting with 1b6168a58f0b85ef13849e7402b7d22eff1a6e58bfe61dc12bea458605df5fd1 not found: ID does not exist" Jul 06 19:14:37.725136 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.725112 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69854bbc7c-khg86"] Jul 06 19:14:37.728748 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:37.728722 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69854bbc7c-khg86"] Jul 06 19:14:39.651967 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:39.651931 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf20e78d-5b40-4f30-8e37-aa4234beeb88" path="/var/lib/kubelet/pods/cf20e78d-5b40-4f30-8e37-aa4234beeb88/volumes" Jul 06 19:14:48.714301 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:14:48.714269 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:12.852279 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:12.852245 2578 generic.go:356] "Generic (PLEG): container finished" podID="e64a4294-d75d-4e88-8538-178da2a235b2" containerID="a5b9431557d388527015211f0fba9ff45d890aa09fc4f7e36265dcb5c58d2ad7" exitCode=1 Jul 06 19:15:12.852755 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:12.852316 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc" event={"ID":"e64a4294-d75d-4e88-8538-178da2a235b2","Type":"ContainerDied","Data":"a5b9431557d388527015211f0fba9ff45d890aa09fc4f7e36265dcb5c58d2ad7"} Jul 06 19:15:12.852755 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:12.852707 2578 scope.go:117] "RemoveContainer" containerID="a5b9431557d388527015211f0fba9ff45d890aa09fc4f7e36265dcb5c58d2ad7" Jul 06 19:15:12.854064 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:12.853877 2578 generic.go:356] "Generic (PLEG): container finished" podID="e7b93ee2-ec62-4f00-93a4-7ea4d818f586" containerID="c2e05a356de50fb228ceb64a6f4fe55d22ed8074593f67f9201238351ce5ade3" exitCode=1 Jul 06 19:15:12.854064 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:12.853953 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-6kx9x" event={"ID":"e7b93ee2-ec62-4f00-93a4-7ea4d818f586","Type":"ContainerDied","Data":"c2e05a356de50fb228ceb64a6f4fe55d22ed8074593f67f9201238351ce5ade3"} Jul 06 19:15:12.854269 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:12.854255 2578 scope.go:117] "RemoveContainer" containerID="c2e05a356de50fb228ceb64a6f4fe55d22ed8074593f67f9201238351ce5ade3" Jul 06 19:15:13.861167 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:13.861134 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc" event={"ID":"e64a4294-d75d-4e88-8538-178da2a235b2","Type":"ContainerStarted","Data":"c00ca35937e54bb5652b77b2b3ae0d77d9adbbebc38e79cd8c7deb667acef364"} Jul 06 19:15:13.861602 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:13.861368 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc" Jul 06 19:15:13.862987 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:13.862964 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-6kx9x" event={"ID":"e7b93ee2-ec62-4f00-93a4-7ea4d818f586","Type":"ContainerStarted","Data":"4e399e800a3425584e49c00e2d7361b04f334a3c506b22317bf688877985c31d"} Jul 06 19:15:13.863174 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:13.863156 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-6kx9x" Jul 06 19:15:15.077956 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:15.077904 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-29.ec2.internal" podUID="8d3790303dbdd7a7168052dca674a531" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": context deadline exceeded" Jul 06 19:15:21.075737 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:15:21.075705 2578 request.go:1196] "Unexpected error when reading response body" err="net/http: request canceled (Client.Timeout or context cancellation while reading body)" Jul 06 19:15:21.076228 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:15:21.075768 2578 controller.go:195] "Failed to update lease" err="unexpected error when reading response body. Please retry. Original error: net/http: request canceled (Client.Timeout or context cancellation while reading body)" Jul 06 19:15:22.083807 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:15:22.083772 2578 controller.go:195] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"ip-10-0-136-29.ec2.internal\": the object has been modified; please apply your changes to the latest version and try again" Jul 06 19:15:31.479398 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:31.479361 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:34.873094 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:34.873062 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-6kx9x" Jul 06 19:15:35.912016 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:35.911981 2578 patch_prober.go:28] interesting pod/custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc container/custom-metrics-autoscaler-operator namespace/openshift-keda: Readiness probe status=failure output="Get \"http://10.132.0.27:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 06 19:15:35.912402 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:35.912050 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc" podUID="e64a4294-d75d-4e88-8538-178da2a235b2" containerName="custom-metrics-autoscaler-operator" probeResult="failure" output="Get \"http://10.132.0.27:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 06 19:15:40.984736 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:40.984702 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:41.120016 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:41.119986 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:44.872610 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:44.872580 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4qrzc" Jul 06 19:15:57.092879 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:57.092827 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:57.310348 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:57.310319 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:57.578290 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:57.578195 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:58.414165 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:58.414131 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:58.648160 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:58.648123 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:58.747805 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:58.747719 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:58.946268 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:58.946229 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:59.064538 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:59.064450 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:59.172897 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:59.172867 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:59.321335 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:59.321241 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:59.412035 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:15:59.412001 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:00.095397 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:00.095363 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:00.170213 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:00.170172 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:00.271980 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:00.271932 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:02.584746 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:02.584711 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:11.957417 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:11.957383 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:17.477894 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.477856 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-5559f5dd8-8hjlp"] Jul 06 19:16:17.478431 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.478160 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf20e78d-5b40-4f30-8e37-aa4234beeb88" containerName="console" Jul 06 19:16:17.478431 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.478171 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf20e78d-5b40-4f30-8e37-aa4234beeb88" containerName="console" Jul 06 19:16:17.478431 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.478234 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf20e78d-5b40-4f30-8e37-aa4234beeb88" containerName="console" Jul 06 19:16:17.481284 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.481268 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5559f5dd8-8hjlp" Jul 06 19:16:17.504523 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.504496 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-sjsgb"] Jul 06 19:16:17.507629 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.507613 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-sjsgb" Jul 06 19:16:17.510913 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.510897 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-tshl6\"" Jul 06 19:16:17.510913 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.510906 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 06 19:16:17.514796 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.514778 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 06 19:16:17.514893 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.514805 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-gr7jb\"" Jul 06 19:16:17.520580 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.520561 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 06 19:16:17.520930 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.520912 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 06 19:16:17.591915 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.591878 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a1f5eb3-f595-47bd-b5b8-fe5c34435710-cert\") pod \"llmisvc-controller-manager-67d95fdc48-sjsgb\" (UID: \"2a1f5eb3-f595-47bd-b5b8-fe5c34435710\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-sjsgb" Jul 06 19:16:17.592104 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.591923 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfx94\" (UniqueName: \"kubernetes.io/projected/17ad8caf-4fc2-47a3-81ee-f0080e722b0e-kube-api-access-tfx94\") pod \"kserve-controller-manager-5559f5dd8-8hjlp\" (UID: \"17ad8caf-4fc2-47a3-81ee-f0080e722b0e\") " pod="kserve/kserve-controller-manager-5559f5dd8-8hjlp" Jul 06 19:16:17.592104 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.592014 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17ad8caf-4fc2-47a3-81ee-f0080e722b0e-cert\") pod \"kserve-controller-manager-5559f5dd8-8hjlp\" (UID: \"17ad8caf-4fc2-47a3-81ee-f0080e722b0e\") " pod="kserve/kserve-controller-manager-5559f5dd8-8hjlp" Jul 06 19:16:17.592104 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.592047 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b4c9\" (UniqueName: \"kubernetes.io/projected/2a1f5eb3-f595-47bd-b5b8-fe5c34435710-kube-api-access-8b4c9\") pod \"llmisvc-controller-manager-67d95fdc48-sjsgb\" (UID: \"2a1f5eb3-f595-47bd-b5b8-fe5c34435710\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-sjsgb" Jul 06 19:16:17.597784 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.597747 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-5559f5dd8-8hjlp"] Jul 06 19:16:17.599857 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.599822 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-sjsgb"] Jul 06 19:16:17.692915 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.692879 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a1f5eb3-f595-47bd-b5b8-fe5c34435710-cert\") pod \"llmisvc-controller-manager-67d95fdc48-sjsgb\" (UID: \"2a1f5eb3-f595-47bd-b5b8-fe5c34435710\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-sjsgb" Jul 06 19:16:17.693126 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.692927 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfx94\" (UniqueName: \"kubernetes.io/projected/17ad8caf-4fc2-47a3-81ee-f0080e722b0e-kube-api-access-tfx94\") pod \"kserve-controller-manager-5559f5dd8-8hjlp\" (UID: \"17ad8caf-4fc2-47a3-81ee-f0080e722b0e\") " pod="kserve/kserve-controller-manager-5559f5dd8-8hjlp" Jul 06 19:16:17.693126 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.692993 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17ad8caf-4fc2-47a3-81ee-f0080e722b0e-cert\") pod \"kserve-controller-manager-5559f5dd8-8hjlp\" (UID: \"17ad8caf-4fc2-47a3-81ee-f0080e722b0e\") " pod="kserve/kserve-controller-manager-5559f5dd8-8hjlp" Jul 06 19:16:17.693126 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.693024 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b4c9\" (UniqueName: \"kubernetes.io/projected/2a1f5eb3-f595-47bd-b5b8-fe5c34435710-kube-api-access-8b4c9\") pod \"llmisvc-controller-manager-67d95fdc48-sjsgb\" (UID: \"2a1f5eb3-f595-47bd-b5b8-fe5c34435710\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-sjsgb" Jul 06 19:16:17.695322 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.695298 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17ad8caf-4fc2-47a3-81ee-f0080e722b0e-cert\") pod \"kserve-controller-manager-5559f5dd8-8hjlp\" (UID: \"17ad8caf-4fc2-47a3-81ee-f0080e722b0e\") " pod="kserve/kserve-controller-manager-5559f5dd8-8hjlp" Jul 06 19:16:17.695438 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.695334 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a1f5eb3-f595-47bd-b5b8-fe5c34435710-cert\") pod \"llmisvc-controller-manager-67d95fdc48-sjsgb\" (UID: \"2a1f5eb3-f595-47bd-b5b8-fe5c34435710\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-sjsgb" Jul 06 19:16:17.717792 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.717758 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b4c9\" (UniqueName: \"kubernetes.io/projected/2a1f5eb3-f595-47bd-b5b8-fe5c34435710-kube-api-access-8b4c9\") pod \"llmisvc-controller-manager-67d95fdc48-sjsgb\" (UID: \"2a1f5eb3-f595-47bd-b5b8-fe5c34435710\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-sjsgb" Jul 06 19:16:17.724351 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.724328 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfx94\" (UniqueName: \"kubernetes.io/projected/17ad8caf-4fc2-47a3-81ee-f0080e722b0e-kube-api-access-tfx94\") pod \"kserve-controller-manager-5559f5dd8-8hjlp\" (UID: \"17ad8caf-4fc2-47a3-81ee-f0080e722b0e\") " pod="kserve/kserve-controller-manager-5559f5dd8-8hjlp" Jul 06 19:16:17.791095 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.791027 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5559f5dd8-8hjlp" Jul 06 19:16:17.816254 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.816227 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-sjsgb" Jul 06 19:16:17.976278 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.976168 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-5559f5dd8-8hjlp"] Jul 06 19:16:17.978889 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:16:17.978862 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17ad8caf_4fc2_47a3_81ee_f0080e722b0e.slice/crio-6056370e5df289900a3c6cd98a427a44b7032431ef67b9b1e45d5c0c45d00282 WatchSource:0}: Error finding container 6056370e5df289900a3c6cd98a427a44b7032431ef67b9b1e45d5c0c45d00282: Status 404 returned error can't find the container with id 6056370e5df289900a3c6cd98a427a44b7032431ef67b9b1e45d5c0c45d00282 Jul 06 19:16:17.982608 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:16:17.982582 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2a1f5eb3_f595_47bd_b5b8_fe5c34435710.slice/crio-5d9cbb0817bbe69c663ad46aa1873db1ca0da4fb1eeac7a6a78c87ea9c369f0e WatchSource:0}: Error finding container 5d9cbb0817bbe69c663ad46aa1873db1ca0da4fb1eeac7a6a78c87ea9c369f0e: Status 404 returned error can't find the container with id 5d9cbb0817bbe69c663ad46aa1873db1ca0da4fb1eeac7a6a78c87ea9c369f0e Jul 06 19:16:17.987164 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:17.987145 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-sjsgb"] Jul 06 19:16:18.140603 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:18.140564 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-sjsgb" event={"ID":"2a1f5eb3-f595-47bd-b5b8-fe5c34435710","Type":"ContainerStarted","Data":"5d9cbb0817bbe69c663ad46aa1873db1ca0da4fb1eeac7a6a78c87ea9c369f0e"} Jul 06 19:16:18.141674 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:18.141648 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5559f5dd8-8hjlp" event={"ID":"17ad8caf-4fc2-47a3-81ee-f0080e722b0e","Type":"ContainerStarted","Data":"6056370e5df289900a3c6cd98a427a44b7032431ef67b9b1e45d5c0c45d00282"} Jul 06 19:16:22.163072 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:22.163036 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5559f5dd8-8hjlp" event={"ID":"17ad8caf-4fc2-47a3-81ee-f0080e722b0e","Type":"ContainerStarted","Data":"91dfc65f19532aa7f6e4a10e4d0d5e1958267c7eea0e1294a91f08bb807cc494"} Jul 06 19:16:22.163531 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:22.163102 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-5559f5dd8-8hjlp" Jul 06 19:16:22.164525 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:22.164503 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-sjsgb" event={"ID":"2a1f5eb3-f595-47bd-b5b8-fe5c34435710","Type":"ContainerStarted","Data":"d041596cb6857ce7f07462edb7e0770612e16694115ccc916c8425cb0e9c7b56"} Jul 06 19:16:22.164639 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:22.164622 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-sjsgb" Jul 06 19:16:26.862484 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:26.862426 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-67d95fdc48-sjsgb" podStartSLOduration=6.483210054 podStartE2EDuration="9.862410318s" totalImagesPullingTime="3.379200264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:16:26.861352149 +0000 UTC m=+551.716437735" watchObservedRunningTime="2026-07-06 19:16:26.862410318 +0000 UTC m=+551.717495958" Jul 06 19:16:26.863003 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:26.862940 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-5559f5dd8-8hjlp" podStartSLOduration=6.43369373 podStartE2EDuration="9.862933577s" totalImagesPullingTime="3.429239847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:16:24.325888779 +0000 UTC m=+549.180974365" watchObservedRunningTime="2026-07-06 19:16:26.862933577 +0000 UTC m=+551.718019218" Jul 06 19:16:53.171775 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:53.171745 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-sjsgb" Jul 06 19:16:53.174774 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:53.174755 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-5559f5dd8-8hjlp" Jul 06 19:16:55.443119 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:55.443092 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-5559f5dd8-8hjlp"] Jul 06 19:16:55.443562 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:55.443259 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/kserve-controller-manager-5559f5dd8-8hjlp" podUID="17ad8caf-4fc2-47a3-81ee-f0080e722b0e" containerName="manager" containerID="cri-o://91dfc65f19532aa7f6e4a10e4d0d5e1958267c7eea0e1294a91f08bb807cc494" gracePeriod=10 Jul 06 19:16:55.548812 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:55.548777 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-5559f5dd8-nmclz"] Jul 06 19:16:55.551081 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:55.551055 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5559f5dd8-nmclz" Jul 06 19:16:55.605690 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:55.605648 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghwxr\" (UniqueName: \"kubernetes.io/projected/737d7104-b339-4656-a00c-f681a3378f67-kube-api-access-ghwxr\") pod \"kserve-controller-manager-5559f5dd8-nmclz\" (UID: \"737d7104-b339-4656-a00c-f681a3378f67\") " pod="kserve/kserve-controller-manager-5559f5dd8-nmclz" Jul 06 19:16:55.605894 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:55.605739 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/737d7104-b339-4656-a00c-f681a3378f67-cert\") pod \"kserve-controller-manager-5559f5dd8-nmclz\" (UID: \"737d7104-b339-4656-a00c-f681a3378f67\") " pod="kserve/kserve-controller-manager-5559f5dd8-nmclz" Jul 06 19:16:55.606904 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:55.606880 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-5559f5dd8-nmclz"] Jul 06 19:16:55.699516 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:55.699461 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5559f5dd8-8hjlp" Jul 06 19:16:55.706941 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:55.706917 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghwxr\" (UniqueName: \"kubernetes.io/projected/737d7104-b339-4656-a00c-f681a3378f67-kube-api-access-ghwxr\") pod \"kserve-controller-manager-5559f5dd8-nmclz\" (UID: \"737d7104-b339-4656-a00c-f681a3378f67\") " pod="kserve/kserve-controller-manager-5559f5dd8-nmclz" Jul 06 19:16:55.707065 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:55.706962 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/737d7104-b339-4656-a00c-f681a3378f67-cert\") pod \"kserve-controller-manager-5559f5dd8-nmclz\" (UID: \"737d7104-b339-4656-a00c-f681a3378f67\") " pod="kserve/kserve-controller-manager-5559f5dd8-nmclz" Jul 06 19:16:55.709307 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:55.709278 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/737d7104-b339-4656-a00c-f681a3378f67-cert\") pod \"kserve-controller-manager-5559f5dd8-nmclz\" (UID: \"737d7104-b339-4656-a00c-f681a3378f67\") " pod="kserve/kserve-controller-manager-5559f5dd8-nmclz" Jul 06 19:16:55.718414 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:55.718395 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghwxr\" (UniqueName: \"kubernetes.io/projected/737d7104-b339-4656-a00c-f681a3378f67-kube-api-access-ghwxr\") pod \"kserve-controller-manager-5559f5dd8-nmclz\" (UID: \"737d7104-b339-4656-a00c-f681a3378f67\") " pod="kserve/kserve-controller-manager-5559f5dd8-nmclz" Jul 06 19:16:55.807712 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:55.807678 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17ad8caf-4fc2-47a3-81ee-f0080e722b0e-cert\") pod \"17ad8caf-4fc2-47a3-81ee-f0080e722b0e\" (UID: \"17ad8caf-4fc2-47a3-81ee-f0080e722b0e\") " Jul 06 19:16:55.807884 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:55.807790 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfx94\" (UniqueName: \"kubernetes.io/projected/17ad8caf-4fc2-47a3-81ee-f0080e722b0e-kube-api-access-tfx94\") pod \"17ad8caf-4fc2-47a3-81ee-f0080e722b0e\" (UID: \"17ad8caf-4fc2-47a3-81ee-f0080e722b0e\") " Jul 06 19:16:55.814518 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:55.814479 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17ad8caf-4fc2-47a3-81ee-f0080e722b0e-cert" (OuterVolumeSpecName: "cert") pod "17ad8caf-4fc2-47a3-81ee-f0080e722b0e" (UID: "17ad8caf-4fc2-47a3-81ee-f0080e722b0e"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:16:55.814518 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:55.814483 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17ad8caf-4fc2-47a3-81ee-f0080e722b0e-kube-api-access-tfx94" (OuterVolumeSpecName: "kube-api-access-tfx94") pod "17ad8caf-4fc2-47a3-81ee-f0080e722b0e" (UID: "17ad8caf-4fc2-47a3-81ee-f0080e722b0e"). InnerVolumeSpecName "kube-api-access-tfx94". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:16:55.861174 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:55.861142 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5559f5dd8-nmclz" Jul 06 19:16:55.908737 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:55.908701 2578 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17ad8caf-4fc2-47a3-81ee-f0080e722b0e-cert\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:16:55.908909 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:55.908740 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfx94\" (UniqueName: \"kubernetes.io/projected/17ad8caf-4fc2-47a3-81ee-f0080e722b0e-kube-api-access-tfx94\") on node \"ip-10-0-136-29.ec2.internal\" DevicePath \"\"" Jul 06 19:16:56.026862 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:56.026823 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-5559f5dd8-nmclz"] Jul 06 19:16:56.028803 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:16:56.028776 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod737d7104_b339_4656_a00c_f681a3378f67.slice/crio-7ef17751cbd58922500536e0e4f102d6c3f34412ee44e8669ef943a4bec78490 WatchSource:0}: Error finding container 7ef17751cbd58922500536e0e4f102d6c3f34412ee44e8669ef943a4bec78490: Status 404 returned error can't find the container with id 7ef17751cbd58922500536e0e4f102d6c3f34412ee44e8669ef943a4bec78490 Jul 06 19:16:56.321449 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:56.321374 2578 generic.go:356] "Generic (PLEG): container finished" podID="17ad8caf-4fc2-47a3-81ee-f0080e722b0e" containerID="91dfc65f19532aa7f6e4a10e4d0d5e1958267c7eea0e1294a91f08bb807cc494" exitCode=0 Jul 06 19:16:56.321449 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:56.321441 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5559f5dd8-8hjlp" Jul 06 19:16:56.321681 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:56.321464 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5559f5dd8-8hjlp" event={"ID":"17ad8caf-4fc2-47a3-81ee-f0080e722b0e","Type":"ContainerDied","Data":"91dfc65f19532aa7f6e4a10e4d0d5e1958267c7eea0e1294a91f08bb807cc494"} Jul 06 19:16:56.321681 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:56.321519 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5559f5dd8-8hjlp" event={"ID":"17ad8caf-4fc2-47a3-81ee-f0080e722b0e","Type":"ContainerDied","Data":"6056370e5df289900a3c6cd98a427a44b7032431ef67b9b1e45d5c0c45d00282"} Jul 06 19:16:56.321681 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:56.321553 2578 scope.go:117] "RemoveContainer" containerID="91dfc65f19532aa7f6e4a10e4d0d5e1958267c7eea0e1294a91f08bb807cc494" Jul 06 19:16:56.322609 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:56.322593 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5559f5dd8-nmclz" event={"ID":"737d7104-b339-4656-a00c-f681a3378f67","Type":"ContainerStarted","Data":"7ef17751cbd58922500536e0e4f102d6c3f34412ee44e8669ef943a4bec78490"} Jul 06 19:16:56.334372 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:56.334356 2578 scope.go:117] "RemoveContainer" containerID="91dfc65f19532aa7f6e4a10e4d0d5e1958267c7eea0e1294a91f08bb807cc494" Jul 06 19:16:56.334611 ip-10-0-136-29 kubenswrapper[2578]: E0706 19:16:56.334594 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91dfc65f19532aa7f6e4a10e4d0d5e1958267c7eea0e1294a91f08bb807cc494\": container with ID starting with 91dfc65f19532aa7f6e4a10e4d0d5e1958267c7eea0e1294a91f08bb807cc494 not found: ID does not exist" containerID="91dfc65f19532aa7f6e4a10e4d0d5e1958267c7eea0e1294a91f08bb807cc494" Jul 06 19:16:56.334656 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:56.334618 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91dfc65f19532aa7f6e4a10e4d0d5e1958267c7eea0e1294a91f08bb807cc494"} err="failed to get container status \"91dfc65f19532aa7f6e4a10e4d0d5e1958267c7eea0e1294a91f08bb807cc494\": rpc error: code = NotFound desc = could not find container \"91dfc65f19532aa7f6e4a10e4d0d5e1958267c7eea0e1294a91f08bb807cc494\": container with ID starting with 91dfc65f19532aa7f6e4a10e4d0d5e1958267c7eea0e1294a91f08bb807cc494 not found: ID does not exist" Jul 06 19:16:56.367209 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:56.367186 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-5559f5dd8-8hjlp"] Jul 06 19:16:56.375519 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:56.375501 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-5559f5dd8-8hjlp"] Jul 06 19:16:57.328968 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:57.328934 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5559f5dd8-nmclz" event={"ID":"737d7104-b339-4656-a00c-f681a3378f67","Type":"ContainerStarted","Data":"f3f4d46405a9128e0b955b3073d1ebdb25f52e0a12fe08c7315737f30b575fcf"} Jul 06 19:16:57.329356 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:57.329055 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-5559f5dd8-nmclz" Jul 06 19:16:57.367947 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:57.367897 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-5559f5dd8-nmclz" podStartSLOduration=2.06085264 podStartE2EDuration="2.367881777s" totalImagesPullingTime="307.029137ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:16:57.366731776 +0000 UTC m=+582.221817362" watchObservedRunningTime="2026-07-06 19:16:57.367881777 +0000 UTC m=+582.222967372" Jul 06 19:16:57.653621 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:16:57.653587 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17ad8caf-4fc2-47a3-81ee-f0080e722b0e" path="/var/lib/kubelet/pods/17ad8caf-4fc2-47a3-81ee-f0080e722b0e/volumes" Jul 06 19:17:07.598056 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:17:07.598020 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:15.541946 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:17:15.541915 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hcl4d_a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6/console-operator/2.log" Jul 06 19:17:15.543075 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:17:15.543030 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hcl4d_a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6/console-operator/2.log" Jul 06 19:17:28.338596 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:17:28.338563 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-5559f5dd8-nmclz" Jul 06 19:17:29.631766 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:17:29.631734 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:29.749676 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:17:29.749639 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:29.824168 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:17:29.824134 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:30.291958 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:17:30.291928 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:30.972044 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:17:30.972012 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:31.064236 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:17:31.064207 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:39.366110 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:17:39.366028 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:54.538634 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:17:54.538599 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:19:10.901876 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:19:10.901783 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:19:12.239374 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:19:12.239342 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:19:25.172566 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:19:25.172531 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:19:25.301636 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:19:25.301602 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:19:39.604178 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:19:39.603785 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:19:39.709413 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:19:39.709378 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:19:53.253152 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:19:53.253110 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:19:53.444564 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:19:53.444522 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:19:53.530733 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:19:53.530646 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:19:56.550144 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:19:56.550110 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-56hnl_38637c2e-e315-4bf4-89c8-e081abdb8502/global-pull-secret-syncer/0.log" Jul 06 19:19:57.076580 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:19:57.076551 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" Jul 06 19:19:57.304024 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:19:57.303995 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-29.ec2.internal_8d3790303dbdd7a7168052dca674a531/haproxy/0.log" Jul 06 19:19:59.536729 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:19:59.536695 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:19:59.610532 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:19:59.610481 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drlkn_06412cf4-7f2f-421a-a09b-b83409783de8/konnectivity-agent/0.log" limit=1024 Jul 06 19:20:00.995592 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:00.995534 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-85k7k_49397d03-e891-4f65-bcc3-a17b8302ae95/cluster-monitoring-operator/0.log" Jul 06 19:20:01.059907 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:01.059794 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-8cwcf_8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9/kube-state-metrics/0.log" Jul 06 19:20:01.117960 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:01.117933 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-8cwcf_8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9/kube-rbac-proxy-main/0.log" Jul 06 19:20:01.176125 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:01.176098 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-8cwcf_8f6d1a22-f103-4c84-8ec5-bfe548e5d5c9/kube-rbac-proxy-self/0.log" Jul 06 19:20:01.268631 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:01.268604 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5d656d5c74-vps6g_2369f1c8-b673-4dcd-a1bb-b9d57764c2bc/metrics-server/0.log" Jul 06 19:20:01.330608 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:01.330528 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-7q2rm_bc6ce303-aeb1-4294-8526-44585cf2e67d/monitoring-plugin/0.log" Jul 06 19:20:01.390550 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:01.390525 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-22twp_501bccb8-ee67-46e1-bf1b-e547c0b835fe/node-exporter/0.log" Jul 06 19:20:01.430153 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:01.430127 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-22twp_501bccb8-ee67-46e1-bf1b-e547c0b835fe/kube-rbac-proxy/0.log" Jul 06 19:20:01.468701 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:01.468675 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-22twp_501bccb8-ee67-46e1-bf1b-e547c0b835fe/init-textfile/0.log" Jul 06 19:20:04.675437 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:04.675405 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-czgnz/perf-node-gather-daemonset-n69st"] Jul 06 19:20:04.675819 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:04.675733 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17ad8caf-4fc2-47a3-81ee-f0080e722b0e" containerName="manager" Jul 06 19:20:04.675819 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:04.675743 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="17ad8caf-4fc2-47a3-81ee-f0080e722b0e" containerName="manager" Jul 06 19:20:04.675819 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:04.675805 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="17ad8caf-4fc2-47a3-81ee-f0080e722b0e" containerName="manager" Jul 06 19:20:04.678755 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:04.678738 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-czgnz/perf-node-gather-daemonset-n69st" Jul 06 19:20:04.684615 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:04.684586 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-czgnz/perf-node-gather-daemonset-n69st"] Jul 06 19:20:04.685660 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:04.685646 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-czgnz\"/\"openshift-service-ca.crt\"" Jul 06 19:20:04.686570 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:04.686543 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-czgnz\"/\"kube-root-ca.crt\"" Jul 06 19:20:04.686670 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:04.686622 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-czgnz\"/\"default-dockercfg-dsnx8\"" Jul 06 19:20:04.785271 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:04.785229 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8cf934ce-1404-4393-b99d-f3f352fb88ef-lib-modules\") pod \"perf-node-gather-daemonset-n69st\" (UID: \"8cf934ce-1404-4393-b99d-f3f352fb88ef\") " pod="openshift-must-gather-czgnz/perf-node-gather-daemonset-n69st" Jul 06 19:20:04.785476 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:04.785313 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptxxb\" (UniqueName: \"kubernetes.io/projected/8cf934ce-1404-4393-b99d-f3f352fb88ef-kube-api-access-ptxxb\") pod \"perf-node-gather-daemonset-n69st\" (UID: \"8cf934ce-1404-4393-b99d-f3f352fb88ef\") " pod="openshift-must-gather-czgnz/perf-node-gather-daemonset-n69st" Jul 06 19:20:04.785476 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:04.785351 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8cf934ce-1404-4393-b99d-f3f352fb88ef-podres\") pod \"perf-node-gather-daemonset-n69st\" (UID: \"8cf934ce-1404-4393-b99d-f3f352fb88ef\") " pod="openshift-must-gather-czgnz/perf-node-gather-daemonset-n69st" Jul 06 19:20:04.785476 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:04.785405 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8cf934ce-1404-4393-b99d-f3f352fb88ef-proc\") pod \"perf-node-gather-daemonset-n69st\" (UID: \"8cf934ce-1404-4393-b99d-f3f352fb88ef\") " pod="openshift-must-gather-czgnz/perf-node-gather-daemonset-n69st" Jul 06 19:20:04.785476 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:04.785437 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cf934ce-1404-4393-b99d-f3f352fb88ef-sys\") pod \"perf-node-gather-daemonset-n69st\" (UID: \"8cf934ce-1404-4393-b99d-f3f352fb88ef\") " pod="openshift-must-gather-czgnz/perf-node-gather-daemonset-n69st" Jul 06 19:20:04.886088 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:04.886051 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cf934ce-1404-4393-b99d-f3f352fb88ef-sys\") pod \"perf-node-gather-daemonset-n69st\" (UID: \"8cf934ce-1404-4393-b99d-f3f352fb88ef\") " pod="openshift-must-gather-czgnz/perf-node-gather-daemonset-n69st" Jul 06 19:20:04.886088 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:04.886091 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8cf934ce-1404-4393-b99d-f3f352fb88ef-lib-modules\") pod \"perf-node-gather-daemonset-n69st\" (UID: \"8cf934ce-1404-4393-b99d-f3f352fb88ef\") " pod="openshift-must-gather-czgnz/perf-node-gather-daemonset-n69st" Jul 06 19:20:04.886305 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:04.886138 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptxxb\" (UniqueName: \"kubernetes.io/projected/8cf934ce-1404-4393-b99d-f3f352fb88ef-kube-api-access-ptxxb\") pod \"perf-node-gather-daemonset-n69st\" (UID: \"8cf934ce-1404-4393-b99d-f3f352fb88ef\") " pod="openshift-must-gather-czgnz/perf-node-gather-daemonset-n69st" Jul 06 19:20:04.886305 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:04.886166 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8cf934ce-1404-4393-b99d-f3f352fb88ef-podres\") pod \"perf-node-gather-daemonset-n69st\" (UID: \"8cf934ce-1404-4393-b99d-f3f352fb88ef\") " pod="openshift-must-gather-czgnz/perf-node-gather-daemonset-n69st" Jul 06 19:20:04.886305 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:04.886187 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cf934ce-1404-4393-b99d-f3f352fb88ef-sys\") pod \"perf-node-gather-daemonset-n69st\" (UID: \"8cf934ce-1404-4393-b99d-f3f352fb88ef\") " pod="openshift-must-gather-czgnz/perf-node-gather-daemonset-n69st" Jul 06 19:20:04.886305 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:04.886206 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8cf934ce-1404-4393-b99d-f3f352fb88ef-proc\") pod \"perf-node-gather-daemonset-n69st\" (UID: \"8cf934ce-1404-4393-b99d-f3f352fb88ef\") " pod="openshift-must-gather-czgnz/perf-node-gather-daemonset-n69st" Jul 06 19:20:04.886305 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:04.886258 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8cf934ce-1404-4393-b99d-f3f352fb88ef-proc\") pod \"perf-node-gather-daemonset-n69st\" (UID: \"8cf934ce-1404-4393-b99d-f3f352fb88ef\") " pod="openshift-must-gather-czgnz/perf-node-gather-daemonset-n69st" Jul 06 19:20:04.886305 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:04.886301 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8cf934ce-1404-4393-b99d-f3f352fb88ef-lib-modules\") pod \"perf-node-gather-daemonset-n69st\" (UID: \"8cf934ce-1404-4393-b99d-f3f352fb88ef\") " pod="openshift-must-gather-czgnz/perf-node-gather-daemonset-n69st" Jul 06 19:20:04.886497 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:04.886302 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8cf934ce-1404-4393-b99d-f3f352fb88ef-podres\") pod \"perf-node-gather-daemonset-n69st\" (UID: \"8cf934ce-1404-4393-b99d-f3f352fb88ef\") " pod="openshift-must-gather-czgnz/perf-node-gather-daemonset-n69st" Jul 06 19:20:04.901260 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:04.901224 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hcl4d_a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6/console-operator/2.log" Jul 06 19:20:04.902925 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:04.902790 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptxxb\" (UniqueName: \"kubernetes.io/projected/8cf934ce-1404-4393-b99d-f3f352fb88ef-kube-api-access-ptxxb\") pod \"perf-node-gather-daemonset-n69st\" (UID: \"8cf934ce-1404-4393-b99d-f3f352fb88ef\") " pod="openshift-must-gather-czgnz/perf-node-gather-daemonset-n69st" Jul 06 19:20:04.909919 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:04.909833 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hcl4d_a0de7d5e-4fbd-43c1-a8d6-9c0741fdbfa6/console-operator/3.log" Jul 06 19:20:04.989184 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:04.989093 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-czgnz/perf-node-gather-daemonset-n69st" Jul 06 19:20:05.135097 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:05.135076 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-czgnz/perf-node-gather-daemonset-n69st"] Jul 06 19:20:05.137876 ip-10-0-136-29 kubenswrapper[2578]: W0706 19:20:05.137853 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8cf934ce_1404_4393_b99d_f3f352fb88ef.slice/crio-c9666d0e0b948a12f4551c7c62bee4ac4f5956cc2f9d8d2ffc9ac6a4e5601624 WatchSource:0}: Error finding container c9666d0e0b948a12f4551c7c62bee4ac4f5956cc2f9d8d2ffc9ac6a4e5601624: Status 404 returned error can't find the container with id c9666d0e0b948a12f4551c7c62bee4ac4f5956cc2f9d8d2ffc9ac6a4e5601624 Jul 06 19:20:05.154829 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:05.154799 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-czgnz/perf-node-gather-daemonset-n69st" event={"ID":"8cf934ce-1404-4393-b99d-f3f352fb88ef","Type":"ContainerStarted","Data":"c9666d0e0b948a12f4551c7c62bee4ac4f5956cc2f9d8d2ffc9ac6a4e5601624"} Jul 06 19:20:05.408217 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:05.408184 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-78688bb47f-bvhj6_10ef8b22-b69c-46af-a185-4e7fce285c70/console/0.log" Jul 06 19:20:05.473723 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:05.473695 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-n9pl5_0abdfb63-00b2-444f-916a-421844e78d67/download-server/0.log" Jul 06 19:20:06.044982 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:06.044951 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-zfhbl_e70f9aa5-7890-4e6e-8a24-74323e9bc819/volume-data-source-validator/0.log" Jul 06 19:20:06.160902 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:06.160866 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-czgnz/perf-node-gather-daemonset-n69st" event={"ID":"8cf934ce-1404-4393-b99d-f3f352fb88ef","Type":"ContainerStarted","Data":"d78e84568a2b3c8f0493bd2df04effbc2ec95a525204574f15c0d1f0581d4cf1"} Jul 06 19:20:06.161081 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:06.160951 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-czgnz/perf-node-gather-daemonset-n69st" Jul 06 19:20:06.179002 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:06.178954 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-czgnz/perf-node-gather-daemonset-n69st" podStartSLOduration=2.178939445 podStartE2EDuration="2.178939445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:20:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:20:06.176613496 +0000 UTC m=+771.031699081" watchObservedRunningTime="2026-07-06 19:20:06.178939445 +0000 UTC m=+771.034025035" Jul 06 19:20:07.165986 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:07.165950 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r9h8k_b9e40546-7e20-4cba-858a-cb9a0635815c/dns/0.log" Jul 06 19:20:07.218808 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:07.218778 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r9h8k_b9e40546-7e20-4cba-858a-cb9a0635815c/kube-rbac-proxy/0.log" Jul 06 19:20:07.336520 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:07.336493 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gjvsc_24f3c199-698c-4a41-b391-9aa34578da40/dns-node-resolver/0.log" Jul 06 19:20:08.011996 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:08.011969 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sc2cl_ff4d48d8-20fe-4762-bd9e-9fa53deb24df/node-ca/0.log" Jul 06 19:20:09.029926 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:09.029897 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7d89958d75-2chxs_517eef3e-b288-4ece-83c5-10ecf912d99d/router/0.log" Jul 06 19:20:09.529361 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:09.529334 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-q24rz_58497cf0-3338-4a5f-9d84-898a69488e36/serve-healthcheck-canary/0.log" Jul 06 19:20:10.030973 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:10.030940 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-v2klg_edde0b2e-410b-4d1e-86c6-c927402a1c83/insights-operator/0.log" Jul 06 19:20:10.035031 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:10.035012 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-v2klg_edde0b2e-410b-4d1e-86c6-c927402a1c83/insights-operator/1.log" Jul 06 19:20:10.318154 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:10.318079 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hjkpn_bbbe3018-f456-4857-ab4f-68e07472bb0c/kube-rbac-proxy/0.log" Jul 06 19:20:10.351015 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:10.350984 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hjkpn_bbbe3018-f456-4857-ab4f-68e07472bb0c/exporter/0.log" Jul 06 19:20:10.386247 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:10.386223 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hjkpn_bbbe3018-f456-4857-ab4f-68e07472bb0c/extractor/0.log" Jul 06 19:20:12.174951 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:12.174924 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-czgnz/perf-node-gather-daemonset-n69st" Jul 06 19:20:12.747025 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:12.746996 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-5559f5dd8-nmclz_737d7104-b339-4656-a00c-f681a3378f67/manager/0.log" Jul 06 19:20:12.804270 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:12.804245 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-sjsgb_2a1f5eb3-f595-47bd-b5b8-fe5c34435710/manager/0.log" Jul 06 19:20:17.687339 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:17.687299 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-9nlp9_c7c4f9b5-959b-481b-bf82-acc2dd175d1e/kube-storage-version-migrator-operator/1.log" Jul 06 19:20:17.688988 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:17.688958 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-9nlp9_c7c4f9b5-959b-481b-bf82-acc2dd175d1e/kube-storage-version-migrator-operator/0.log" Jul 06 19:20:18.545325 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:18.545298 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9slzb_d6877b4b-db74-4525-afab-b8cd5da25885/kube-multus-additional-cni-plugins/0.log" Jul 06 19:20:18.574126 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:18.574096 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9slzb_d6877b4b-db74-4525-afab-b8cd5da25885/egress-router-binary-copy/0.log" Jul 06 19:20:18.599674 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:18.599645 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9slzb_d6877b4b-db74-4525-afab-b8cd5da25885/cni-plugins/0.log" Jul 06 19:20:18.627022 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:18.626997 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9slzb_d6877b4b-db74-4525-afab-b8cd5da25885/bond-cni-plugin/0.log" Jul 06 19:20:18.664823 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:18.664795 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9slzb_d6877b4b-db74-4525-afab-b8cd5da25885/routeoverride-cni/0.log" Jul 06 19:20:18.691974 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:18.691952 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9slzb_d6877b4b-db74-4525-afab-b8cd5da25885/whereabouts-cni-bincopy/0.log" Jul 06 19:20:18.716217 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:18.716192 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9slzb_d6877b4b-db74-4525-afab-b8cd5da25885/whereabouts-cni/0.log" Jul 06 19:20:19.220636 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:19.220607 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-slbwt_78e35a02-e9a1-4f86-b9b2-c6b68912f3a0/kube-multus/0.log" Jul 06 19:20:19.365784 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:19.365756 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qx7rr_40e3ecd3-e42e-46d6-858c-ca3c21710c7a/network-metrics-daemon/0.log" Jul 06 19:20:19.391054 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:19.391028 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qx7rr_40e3ecd3-e42e-46d6-858c-ca3c21710c7a/kube-rbac-proxy/0.log" Jul 06 19:20:20.714734 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:20.714699 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxfxf_6f50399f-0464-42ab-a086-28fe26616279/ovn-controller/0.log" Jul 06 19:20:20.735532 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:20.735505 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxfxf_6f50399f-0464-42ab-a086-28fe26616279/ovn-acl-logging/0.log" Jul 06 19:20:20.763152 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:20.763132 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxfxf_6f50399f-0464-42ab-a086-28fe26616279/kube-rbac-proxy-node/0.log" Jul 06 19:20:20.787816 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:20.787795 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxfxf_6f50399f-0464-42ab-a086-28fe26616279/kube-rbac-proxy-ovn-metrics/0.log" Jul 06 19:20:20.806959 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:20.806935 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxfxf_6f50399f-0464-42ab-a086-28fe26616279/northd/0.log" Jul 06 19:20:20.833316 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:20.833298 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxfxf_6f50399f-0464-42ab-a086-28fe26616279/nbdb/0.log" Jul 06 19:20:20.868144 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:20.868122 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxfxf_6f50399f-0464-42ab-a086-28fe26616279/sbdb/0.log" Jul 06 19:20:20.933795 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:20.933767 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxfxf_6f50399f-0464-42ab-a086-28fe26616279/ovnkube-controller/0.log" Jul 06 19:20:22.052062 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:22.051976 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-989f8b8dc-p7q47_288531d2-d4e0-4d19-b849-c30d8faf6a12/check-endpoints/0.log" Jul 06 19:20:22.235061 ip-10-0-136-29 kubenswrapper[2578]: I0706 19:20:22.235030 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-q4cm4_4c53b7be-5d92-4555-a03e-37d50ecb15c4/network-check-target-container/0.log"