Jul 27 16:24:24.674449 ip-10-0-143-40 systemd[1]: Starting Kubernetes Kubelet... Jul 27 16:24:25.073018 ip-10-0-143-40 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 16:24:25.073018 ip-10-0-143-40 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 27 16:24:25.073018 ip-10-0-143-40 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 16:24:25.073018 ip-10-0-143-40 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 27 16:24:25.073018 ip-10-0-143-40 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 16:24:25.074222 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.074035 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 27 16:24:25.078712 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078693 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 16:24:25.078712 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078711 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 16:24:25.078712 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078715 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 16:24:25.078814 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078718 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 16:24:25.078814 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078723 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 16:24:25.078814 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078726 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 16:24:25.078814 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078729 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 16:24:25.078814 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078732 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 27 16:24:25.078814 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078736 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 16:24:25.078814 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078739 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 16:24:25.078814 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078742 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 16:24:25.078814 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078745 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 16:24:25.078814 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078750 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 16:24:25.078814 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078754 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 16:24:25.078814 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078757 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 16:24:25.078814 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078766 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 16:24:25.078814 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078770 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 16:24:25.078814 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078773 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 16:24:25.078814 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078776 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 16:24:25.078814 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078778 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 16:24:25.078814 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078781 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 16:24:25.078814 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078784 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 16:24:25.079295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078787 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 16:24:25.079295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078790 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 16:24:25.079295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078793 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 16:24:25.079295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078798 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 16:24:25.079295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078802 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 16:24:25.079295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078807 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 16:24:25.079295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078810 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 16:24:25.079295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078812 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 16:24:25.079295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078815 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 16:24:25.079295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078818 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 16:24:25.079295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078821 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 16:24:25.079295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078824 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 16:24:25.079295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078827 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 16:24:25.079295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078830 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 16:24:25.079295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078833 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 16:24:25.079295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078836 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 16:24:25.079295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078851 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 16:24:25.079295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078855 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 16:24:25.079295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078859 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 16:24:25.079754 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078864 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 16:24:25.079754 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078868 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 16:24:25.079754 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078882 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 16:24:25.079754 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078885 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 16:24:25.079754 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078888 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 16:24:25.079754 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078891 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 16:24:25.079754 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078894 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 16:24:25.079754 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078897 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 16:24:25.079754 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078899 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 16:24:25.079754 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078902 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 16:24:25.079754 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078905 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 16:24:25.079754 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078907 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 16:24:25.079754 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078909 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 16:24:25.079754 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078912 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 16:24:25.079754 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078915 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 16:24:25.079754 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078918 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 16:24:25.079754 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078921 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 16:24:25.079754 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078924 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 16:24:25.079754 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078926 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 16:24:25.079754 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078929 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 16:24:25.080301 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078932 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 16:24:25.080301 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078934 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 16:24:25.080301 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078937 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 16:24:25.080301 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078940 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 16:24:25.080301 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078942 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 16:24:25.080301 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078945 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 16:24:25.080301 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078948 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 16:24:25.080301 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078951 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 16:24:25.080301 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078953 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 16:24:25.080301 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078956 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 16:24:25.080301 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078958 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 16:24:25.080301 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078961 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 16:24:25.080301 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078964 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 16:24:25.080301 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078966 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 16:24:25.080301 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078969 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 16:24:25.080301 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078972 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 16:24:25.080301 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078974 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 16:24:25.080301 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078977 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 16:24:25.080301 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078979 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 16:24:25.080301 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078982 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 16:24:25.080783 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078985 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 16:24:25.080783 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078988 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 16:24:25.080783 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078993 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 16:24:25.080783 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078996 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 16:24:25.080783 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.078999 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 16:24:25.080783 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079002 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 16:24:25.080783 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079004 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 16:24:25.080783 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079007 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 16:24:25.080783 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079012 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 16:24:25.080783 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079015 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 16:24:25.080783 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079019 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 16:24:25.080783 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079022 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 16:24:25.080783 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079025 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 16:24:25.080783 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079028 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 16:24:25.080783 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079031 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 16:24:25.080783 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079033 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 16:24:25.080783 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079036 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 16:24:25.080783 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079039 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 16:24:25.080783 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079767 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 16:24:25.080783 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079774 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 16:24:25.081298 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079777 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 16:24:25.081298 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079779 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 27 16:24:25.081298 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079783 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 16:24:25.081298 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079787 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 16:24:25.081298 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079791 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 16:24:25.081298 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079795 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 16:24:25.081298 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079797 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 16:24:25.081298 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079801 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 16:24:25.081298 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079804 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 16:24:25.081298 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079806 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 16:24:25.081298 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079809 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 16:24:25.081298 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079812 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 16:24:25.081298 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079816 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 16:24:25.081298 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079819 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 16:24:25.081298 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079822 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 16:24:25.081298 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079825 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 16:24:25.081298 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079828 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 16:24:25.081298 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079830 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 16:24:25.081298 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079833 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 16:24:25.081298 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079837 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 16:24:25.081804 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079858 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 16:24:25.081804 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079863 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 16:24:25.081804 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079867 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 16:24:25.081804 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079871 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 16:24:25.081804 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079875 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 16:24:25.081804 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079880 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 16:24:25.081804 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079883 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 16:24:25.081804 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079886 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 16:24:25.081804 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079889 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 16:24:25.081804 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079892 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 16:24:25.081804 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079894 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 16:24:25.081804 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079897 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 16:24:25.081804 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079900 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 16:24:25.081804 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079902 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 16:24:25.081804 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079906 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 16:24:25.081804 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079909 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 16:24:25.081804 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079911 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 16:24:25.081804 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079914 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 16:24:25.081804 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079918 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 16:24:25.082295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079922 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 16:24:25.082295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079925 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 16:24:25.082295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079927 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 16:24:25.082295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079930 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 16:24:25.082295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079933 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 16:24:25.082295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079935 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 16:24:25.082295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079940 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 16:24:25.082295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079942 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 16:24:25.082295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079945 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 16:24:25.082295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079948 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 16:24:25.082295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079951 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 16:24:25.082295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079954 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 16:24:25.082295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079957 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 16:24:25.082295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079960 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 16:24:25.082295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079963 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 16:24:25.082295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079966 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 16:24:25.082295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079968 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 16:24:25.082295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079971 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 16:24:25.082295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079974 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 16:24:25.082295 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079976 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 16:24:25.082838 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079979 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 16:24:25.082838 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079981 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 16:24:25.082838 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079984 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 16:24:25.082838 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079986 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 16:24:25.082838 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079989 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 16:24:25.082838 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079991 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 16:24:25.082838 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079994 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 16:24:25.082838 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079997 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 16:24:25.082838 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.079999 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 16:24:25.082838 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080002 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 16:24:25.082838 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080004 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 16:24:25.082838 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080007 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 16:24:25.082838 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080009 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 16:24:25.082838 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080012 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 16:24:25.082838 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080014 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 16:24:25.082838 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080017 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 16:24:25.082838 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080019 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 16:24:25.082838 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080022 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 16:24:25.082838 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080024 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 16:24:25.082838 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080027 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 16:24:25.083348 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080031 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 16:24:25.083348 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080034 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 16:24:25.083348 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080036 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 16:24:25.083348 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080039 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 16:24:25.083348 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080042 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 16:24:25.083348 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080044 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 16:24:25.083348 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080047 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 16:24:25.083348 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080049 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 16:24:25.083348 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080052 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 16:24:25.083348 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080055 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 16:24:25.083348 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080123 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 16:24:25.083348 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080128 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 16:24:25.083348 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080131 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 16:24:25.083348 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080134 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 16:24:25.083348 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080137 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 16:24:25.083348 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080140 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 16:24:25.083348 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080143 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 16:24:25.083348 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080145 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 16:24:25.083348 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080589 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 16:24:25.083348 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080595 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 16:24:25.083822 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080598 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 16:24:25.083822 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080601 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 16:24:25.083822 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080604 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 16:24:25.083822 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080607 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 16:24:25.083822 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080610 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 16:24:25.083822 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080613 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 16:24:25.083822 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080615 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 16:24:25.083822 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080618 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 16:24:25.083822 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080621 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 16:24:25.083822 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080623 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 16:24:25.083822 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080625 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 16:24:25.083822 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080629 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 16:24:25.083822 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080633 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 16:24:25.083822 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080637 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 16:24:25.083822 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080641 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 16:24:25.083822 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080644 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 16:24:25.083822 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080648 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 16:24:25.083822 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080651 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 16:24:25.083822 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080654 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 16:24:25.084297 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080657 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 16:24:25.084297 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080660 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 16:24:25.084297 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080663 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 16:24:25.084297 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080665 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 16:24:25.084297 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080668 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 16:24:25.084297 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080670 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 16:24:25.084297 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080673 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 16:24:25.084297 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080675 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 16:24:25.084297 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080678 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 16:24:25.084297 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080681 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 16:24:25.084297 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080683 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 16:24:25.084297 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080686 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 16:24:25.084297 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080689 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 16:24:25.084297 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080691 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 16:24:25.084297 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080694 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 16:24:25.084297 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080697 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 16:24:25.084297 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080699 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 16:24:25.084297 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080703 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 16:24:25.084297 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080707 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 16:24:25.084751 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080710 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 16:24:25.084751 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080713 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 16:24:25.084751 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080716 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 16:24:25.084751 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080718 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 16:24:25.084751 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080721 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 16:24:25.084751 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080723 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 16:24:25.084751 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080727 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 16:24:25.084751 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080730 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 16:24:25.084751 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080733 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 27 16:24:25.084751 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080736 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 16:24:25.084751 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080739 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 16:24:25.084751 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080741 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 16:24:25.084751 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080744 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 16:24:25.084751 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080747 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 16:24:25.084751 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080749 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 16:24:25.084751 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080752 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 16:24:25.084751 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080754 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 16:24:25.084751 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080757 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 16:24:25.084751 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080759 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 16:24:25.084751 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080762 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 16:24:25.085239 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080764 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 16:24:25.085239 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080767 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 16:24:25.085239 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080769 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 16:24:25.085239 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080772 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 16:24:25.085239 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080774 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 16:24:25.085239 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080777 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 16:24:25.085239 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080780 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 16:24:25.085239 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080782 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 16:24:25.085239 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080785 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 16:24:25.085239 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080787 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 16:24:25.085239 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080790 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 16:24:25.085239 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080793 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 16:24:25.085239 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080795 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 16:24:25.085239 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080798 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 16:24:25.085239 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080801 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 16:24:25.085239 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080803 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 16:24:25.085239 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080806 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 16:24:25.085239 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080809 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 16:24:25.085239 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080811 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 16:24:25.085239 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080818 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 16:24:25.085716 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080820 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 16:24:25.085716 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080823 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 16:24:25.085716 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080825 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 16:24:25.085716 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080828 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 16:24:25.085716 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080830 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 16:24:25.085716 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080833 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 16:24:25.085716 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080835 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 16:24:25.085716 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080838 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 16:24:25.085716 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080855 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 16:24:25.085716 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080858 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 16:24:25.085716 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080860 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 16:24:25.085716 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080863 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 16:24:25.085716 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080865 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 16:24:25.085716 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080868 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 16:24:25.085716 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080871 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 16:24:25.085716 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080874 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 16:24:25.085716 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080876 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 16:24:25.085716 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080879 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 16:24:25.085716 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.080884 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 16:24:25.085716 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.080960 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 27 16:24:25.086299 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.080968 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 27 16:24:25.086299 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.080975 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 27 16:24:25.086299 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.080980 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 27 16:24:25.086299 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.080984 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 27 16:24:25.086299 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.080988 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 27 16:24:25.086299 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.080992 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 27 16:24:25.086299 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.080996 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 27 16:24:25.086299 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081000 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 27 16:24:25.086299 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081003 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 27 16:24:25.086299 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081007 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 27 16:24:25.086299 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081010 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 27 16:24:25.086299 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081014 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 27 16:24:25.086299 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081017 2578 flags.go:64] FLAG: --cgroup-root="" Jul 27 16:24:25.086299 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081021 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 27 16:24:25.086299 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081024 2578 flags.go:64] FLAG: --client-ca-file="" Jul 27 16:24:25.086299 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081027 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 27 16:24:25.086299 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081030 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 27 16:24:25.086299 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081034 2578 flags.go:64] FLAG: --cluster-domain="" Jul 27 16:24:25.086299 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081037 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 27 16:24:25.086299 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081040 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 27 16:24:25.086299 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081043 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 27 16:24:25.086299 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081047 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 27 16:24:25.086299 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081051 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 27 16:24:25.086299 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081054 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 27 16:24:25.086889 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081057 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 27 16:24:25.086889 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081061 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 27 16:24:25.086889 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081064 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 27 16:24:25.086889 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081067 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 27 16:24:25.086889 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081070 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 27 16:24:25.086889 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081073 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 27 16:24:25.086889 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081078 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 27 16:24:25.086889 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081082 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 27 16:24:25.086889 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081086 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 27 16:24:25.086889 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081088 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 27 16:24:25.086889 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081091 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 27 16:24:25.086889 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081095 2578 flags.go:64] FLAG: --enable-server="true" Jul 27 16:24:25.086889 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081098 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 27 16:24:25.086889 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081103 2578 flags.go:64] FLAG: --event-burst="100" Jul 27 16:24:25.086889 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081106 2578 flags.go:64] FLAG: --event-qps="50" Jul 27 16:24:25.086889 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081109 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 27 16:24:25.086889 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081113 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 27 16:24:25.086889 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081116 2578 flags.go:64] FLAG: --eviction-hard="" Jul 27 16:24:25.086889 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081120 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 27 16:24:25.086889 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081124 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 27 16:24:25.086889 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081127 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 27 16:24:25.086889 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081132 2578 flags.go:64] FLAG: --eviction-soft="" Jul 27 16:24:25.086889 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081135 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 27 16:24:25.086889 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081138 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 27 16:24:25.086889 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081141 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 27 16:24:25.087537 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081144 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 27 16:24:25.087537 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081147 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 27 16:24:25.087537 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081150 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 27 16:24:25.087537 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081153 2578 flags.go:64] FLAG: --feature-gates="" Jul 27 16:24:25.087537 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081157 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 27 16:24:25.087537 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081160 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 27 16:24:25.087537 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081163 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 27 16:24:25.087537 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081167 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 27 16:24:25.087537 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081170 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 27 16:24:25.087537 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081173 2578 flags.go:64] FLAG: --help="false" Jul 27 16:24:25.087537 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081176 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-143-40.ec2.internal" Jul 27 16:24:25.087537 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081179 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 27 16:24:25.087537 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081182 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 27 16:24:25.087537 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081186 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 27 16:24:25.087537 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081190 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 27 16:24:25.087537 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081194 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 27 16:24:25.087537 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081197 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 27 16:24:25.087537 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081200 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 27 16:24:25.087537 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081203 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 27 16:24:25.087537 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081206 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 27 16:24:25.087537 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081209 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 27 16:24:25.087537 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081212 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 27 16:24:25.087537 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081215 2578 flags.go:64] FLAG: --kube-reserved="" Jul 27 16:24:25.087537 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081217 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 27 16:24:25.088180 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081220 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 27 16:24:25.088180 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081223 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 27 16:24:25.088180 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081226 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 27 16:24:25.088180 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081229 2578 flags.go:64] FLAG: --lock-file="" Jul 27 16:24:25.088180 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081232 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 27 16:24:25.088180 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081235 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 27 16:24:25.088180 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081238 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 27 16:24:25.088180 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081244 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 27 16:24:25.088180 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081247 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 27 16:24:25.088180 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081250 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 27 16:24:25.088180 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081253 2578 flags.go:64] FLAG: --logging-format="text" Jul 27 16:24:25.088180 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081256 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 27 16:24:25.088180 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081259 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 27 16:24:25.088180 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081262 2578 flags.go:64] FLAG: --manifest-url="" Jul 27 16:24:25.088180 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081265 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 27 16:24:25.088180 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081269 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 27 16:24:25.088180 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081272 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 27 16:24:25.088180 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081277 2578 flags.go:64] FLAG: --max-pods="110" Jul 27 16:24:25.088180 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081280 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 27 16:24:25.088180 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081283 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 27 16:24:25.088180 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081286 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 27 16:24:25.088180 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081289 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 27 16:24:25.088180 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081292 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 27 16:24:25.088180 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081296 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 27 16:24:25.088180 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081299 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 27 16:24:25.088798 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081306 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 27 16:24:25.088798 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081310 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 27 16:24:25.088798 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081314 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 27 16:24:25.088798 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081318 2578 flags.go:64] FLAG: --pod-cidr="" Jul 27 16:24:25.088798 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081321 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 27 16:24:25.088798 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081327 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 27 16:24:25.088798 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081330 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 27 16:24:25.088798 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081334 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 27 16:24:25.088798 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081337 2578 flags.go:64] FLAG: --port="10250" Jul 27 16:24:25.088798 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081340 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 27 16:24:25.088798 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081343 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08f7b300f60faf3e4" Jul 27 16:24:25.088798 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081346 2578 flags.go:64] FLAG: --qos-reserved="" Jul 27 16:24:25.088798 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081349 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 27 16:24:25.088798 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081352 2578 flags.go:64] FLAG: --register-node="true" Jul 27 16:24:25.088798 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081355 2578 flags.go:64] FLAG: --register-with-taints="" Jul 27 16:24:25.088798 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081364 2578 flags.go:64] FLAG: --registry-burst="10" Jul 27 16:24:25.088798 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081367 2578 flags.go:64] FLAG: --registry-qps="5" Jul 27 16:24:25.088798 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081369 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 27 16:24:25.088798 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081372 2578 flags.go:64] FLAG: --reserved-memory="" Jul 27 16:24:25.088798 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081376 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 27 16:24:25.088798 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081380 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 27 16:24:25.088798 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081383 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 27 16:24:25.088798 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081386 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 27 16:24:25.088798 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081389 2578 flags.go:64] FLAG: --runonce="false" Jul 27 16:24:25.088798 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081392 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 27 16:24:25.089566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081395 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 27 16:24:25.089566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081398 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 27 16:24:25.089566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081401 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 27 16:24:25.089566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081404 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 27 16:24:25.089566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081408 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 27 16:24:25.089566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081411 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 27 16:24:25.089566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081414 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 27 16:24:25.089566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081417 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 27 16:24:25.089566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081420 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 27 16:24:25.089566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081423 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 27 16:24:25.089566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081427 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 27 16:24:25.089566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081431 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 27 16:24:25.089566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081434 2578 flags.go:64] FLAG: --system-cgroups="" Jul 27 16:24:25.089566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081436 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 27 16:24:25.089566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081442 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 27 16:24:25.089566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081445 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 27 16:24:25.089566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081448 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 27 16:24:25.089566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081452 2578 flags.go:64] FLAG: --tls-min-version="" Jul 27 16:24:25.089566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081455 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 27 16:24:25.089566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081458 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 27 16:24:25.089566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081461 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 27 16:24:25.089566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081465 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 27 16:24:25.089566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081468 2578 flags.go:64] FLAG: --v="2" Jul 27 16:24:25.089566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081472 2578 flags.go:64] FLAG: --version="false" Jul 27 16:24:25.089566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081476 2578 flags.go:64] FLAG: --vmodule="" Jul 27 16:24:25.090543 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081480 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 27 16:24:25.090543 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.081483 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 27 16:24:25.090543 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081683 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 16:24:25.090543 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081690 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 16:24:25.090543 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081693 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 16:24:25.090543 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081696 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 16:24:25.090543 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081700 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 16:24:25.090543 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081703 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 16:24:25.090543 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081706 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 16:24:25.090543 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081709 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 16:24:25.090543 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081713 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 16:24:25.090543 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081716 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 16:24:25.090543 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081719 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 16:24:25.090543 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081722 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 16:24:25.090543 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081726 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 16:24:25.090543 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081728 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 16:24:25.090543 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081731 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 16:24:25.090543 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081735 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 16:24:25.090543 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081738 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 16:24:25.090543 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081741 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 16:24:25.091212 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081744 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 16:24:25.091212 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081746 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 16:24:25.091212 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081749 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 16:24:25.091212 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081752 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 16:24:25.091212 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081755 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 16:24:25.091212 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081758 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 16:24:25.091212 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081760 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 16:24:25.091212 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081763 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 16:24:25.091212 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081766 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 16:24:25.091212 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081775 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 16:24:25.091212 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081778 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 16:24:25.091212 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081781 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 16:24:25.091212 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081783 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 16:24:25.091212 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081786 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 16:24:25.091212 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081788 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 16:24:25.091212 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081791 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 16:24:25.091212 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081794 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 16:24:25.091212 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081797 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 16:24:25.091212 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081799 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 16:24:25.091212 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081802 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 16:24:25.091704 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081804 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 16:24:25.091704 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081807 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 16:24:25.091704 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081812 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 16:24:25.091704 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081817 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 16:24:25.091704 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081820 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 16:24:25.091704 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081822 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 16:24:25.091704 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081825 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 16:24:25.091704 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081827 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 16:24:25.091704 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081830 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 16:24:25.091704 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081834 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 16:24:25.091704 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081837 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 16:24:25.091704 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081852 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 16:24:25.091704 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081856 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 16:24:25.091704 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081859 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 27 16:24:25.091704 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081863 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 16:24:25.091704 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081866 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 16:24:25.091704 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081869 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 16:24:25.091704 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081872 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 16:24:25.091704 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081875 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 16:24:25.091704 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081878 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 16:24:25.092223 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081880 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 16:24:25.092223 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081883 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 16:24:25.092223 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081892 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 16:24:25.092223 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081895 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 16:24:25.092223 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081898 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 16:24:25.092223 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081901 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 16:24:25.092223 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081903 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 16:24:25.092223 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081906 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 16:24:25.092223 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081909 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 16:24:25.092223 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081911 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 16:24:25.092223 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081914 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 16:24:25.092223 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081917 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 16:24:25.092223 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081919 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 16:24:25.092223 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081922 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 16:24:25.092223 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081926 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 16:24:25.092223 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081929 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 16:24:25.092223 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081932 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 16:24:25.092223 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081934 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 16:24:25.092223 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081937 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 16:24:25.092223 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081939 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 16:24:25.092746 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081942 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 16:24:25.092746 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081946 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 16:24:25.092746 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081949 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 16:24:25.092746 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081952 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 16:24:25.092746 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081954 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 16:24:25.092746 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081957 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 16:24:25.092746 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081960 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 16:24:25.092746 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081962 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 16:24:25.092746 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081966 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 16:24:25.092746 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081970 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 16:24:25.092746 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081973 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 16:24:25.092746 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081977 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 16:24:25.092746 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081980 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 16:24:25.092746 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081982 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 16:24:25.092746 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081986 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 16:24:25.092746 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081994 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 16:24:25.092746 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.081998 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 16:24:25.092746 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.082000 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 16:24:25.092746 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.082003 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 16:24:25.093224 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.082006 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 16:24:25.093224 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.082008 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 16:24:25.093224 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.082633 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 16:24:25.093224 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.091220 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 27 16:24:25.093224 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.091237 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 27 16:24:25.093224 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.091257 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 27 16:24:25.093224 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.091263 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 27 16:24:25.093224 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091323 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 16:24:25.093224 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091328 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 16:24:25.093224 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091332 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 16:24:25.093224 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091335 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 16:24:25.093224 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091339 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 16:24:25.093224 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091342 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 16:24:25.093224 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091345 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 16:24:25.093579 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091348 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 16:24:25.093579 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091351 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 16:24:25.093579 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091353 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 16:24:25.093579 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091356 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 16:24:25.093579 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091361 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 16:24:25.093579 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091364 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 16:24:25.093579 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091368 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 16:24:25.093579 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091371 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 16:24:25.093579 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091374 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 16:24:25.093579 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091377 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 16:24:25.093579 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091380 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 16:24:25.093579 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091383 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 16:24:25.093579 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091386 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 16:24:25.093579 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091389 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 16:24:25.093579 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091392 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 16:24:25.093579 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091395 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 16:24:25.093579 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091398 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 16:24:25.093579 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091400 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 16:24:25.093579 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091403 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 16:24:25.093579 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091406 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 16:24:25.094093 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091408 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 16:24:25.094093 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091411 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 27 16:24:25.094093 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091415 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 16:24:25.094093 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091418 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 16:24:25.094093 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091421 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 16:24:25.094093 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091424 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 16:24:25.094093 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091427 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 16:24:25.094093 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091429 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 16:24:25.094093 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091432 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 16:24:25.094093 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091435 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 16:24:25.094093 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091437 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 16:24:25.094093 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091440 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 16:24:25.094093 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091442 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 16:24:25.094093 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091445 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 16:24:25.094093 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091448 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 16:24:25.094093 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091451 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 16:24:25.094093 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091455 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 16:24:25.094093 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091458 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 16:24:25.094093 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091461 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 16:24:25.094555 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091464 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 16:24:25.094555 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091467 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 16:24:25.094555 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091470 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 16:24:25.094555 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091473 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 16:24:25.094555 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091475 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 16:24:25.094555 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091478 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 16:24:25.094555 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091480 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 16:24:25.094555 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091483 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 16:24:25.094555 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091486 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 16:24:25.094555 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091488 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 16:24:25.094555 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091491 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 16:24:25.094555 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091493 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 16:24:25.094555 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091496 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 16:24:25.094555 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091498 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 16:24:25.094555 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091501 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 16:24:25.094555 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091505 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 16:24:25.094555 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091508 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 16:24:25.094555 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091511 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 16:24:25.094555 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091513 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 16:24:25.094555 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091516 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 16:24:25.095048 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091519 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 16:24:25.095048 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091521 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 16:24:25.095048 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091524 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 16:24:25.095048 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091527 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 16:24:25.095048 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091529 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 16:24:25.095048 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091533 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 16:24:25.095048 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091537 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 16:24:25.095048 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091540 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 16:24:25.095048 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091543 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 16:24:25.095048 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091546 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 16:24:25.095048 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091549 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 16:24:25.095048 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091551 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 16:24:25.095048 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091554 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 16:24:25.095048 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091557 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 16:24:25.095048 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091560 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 16:24:25.095048 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091563 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 16:24:25.095048 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091565 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 16:24:25.095048 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091568 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 16:24:25.095048 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091571 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 16:24:25.095504 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091573 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 16:24:25.095504 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091576 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 16:24:25.095504 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091579 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 16:24:25.095504 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091581 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 16:24:25.095504 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091584 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 16:24:25.095504 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091587 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 16:24:25.095504 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091589 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 16:24:25.095504 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091592 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 16:24:25.095504 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091595 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 16:24:25.095504 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091598 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 16:24:25.095504 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091600 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 16:24:25.095504 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091603 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 16:24:25.095504 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091606 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 16:24:25.095504 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091608 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 16:24:25.095504 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.091613 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 16:24:25.095935 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091733 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 16:24:25.095935 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091739 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 27 16:24:25.095935 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091743 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 16:24:25.095935 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091745 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 16:24:25.095935 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091748 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 16:24:25.095935 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091751 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 16:24:25.095935 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091754 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 16:24:25.095935 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091757 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 16:24:25.095935 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091760 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 16:24:25.095935 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091762 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 16:24:25.095935 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091765 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 16:24:25.095935 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091768 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 16:24:25.095935 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091771 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 16:24:25.095935 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091774 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 16:24:25.095935 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091777 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 16:24:25.095935 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091780 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 16:24:25.095935 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091782 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 16:24:25.095935 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091785 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 16:24:25.095935 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091787 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 16:24:25.095935 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091790 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 16:24:25.096426 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091792 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 16:24:25.096426 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091795 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 16:24:25.096426 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091798 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 16:24:25.096426 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091802 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 16:24:25.096426 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091805 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 16:24:25.096426 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091808 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 16:24:25.096426 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091811 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 16:24:25.096426 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091814 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 16:24:25.096426 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091817 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 16:24:25.096426 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091820 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 16:24:25.096426 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091823 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 16:24:25.096426 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091826 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 16:24:25.096426 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091830 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 16:24:25.096426 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091833 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 16:24:25.096426 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091836 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 16:24:25.096426 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091858 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 16:24:25.096426 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091863 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 16:24:25.096426 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091866 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 16:24:25.096426 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091869 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 16:24:25.096952 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091872 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 16:24:25.096952 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091875 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 16:24:25.096952 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091878 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 16:24:25.096952 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091881 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 16:24:25.096952 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091883 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 16:24:25.096952 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091886 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 16:24:25.096952 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091889 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 16:24:25.096952 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091892 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 16:24:25.096952 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091895 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 16:24:25.096952 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091898 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 16:24:25.096952 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091901 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 16:24:25.096952 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091903 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 16:24:25.096952 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091906 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 16:24:25.096952 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091909 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 16:24:25.096952 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091911 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 16:24:25.096952 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091914 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 16:24:25.096952 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091917 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 16:24:25.096952 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091920 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 16:24:25.096952 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091922 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 16:24:25.096952 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091926 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 16:24:25.097438 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091928 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 16:24:25.097438 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091931 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 16:24:25.097438 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091934 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 16:24:25.097438 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091936 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 16:24:25.097438 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091939 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 16:24:25.097438 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091942 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 16:24:25.097438 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091944 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 16:24:25.097438 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091961 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 16:24:25.097438 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091964 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 16:24:25.097438 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091967 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 16:24:25.097438 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091969 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 16:24:25.097438 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091972 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 16:24:25.097438 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091975 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 16:24:25.097438 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091978 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 16:24:25.097438 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091981 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 16:24:25.097438 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091983 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 16:24:25.097438 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091986 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 16:24:25.097438 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091989 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 16:24:25.097438 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091993 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 16:24:25.098026 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.091996 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 16:24:25.098026 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.092000 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 16:24:25.098026 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.092003 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 16:24:25.098026 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.092006 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 16:24:25.098026 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.092009 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 16:24:25.098026 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.092011 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 16:24:25.098026 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.092014 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 16:24:25.098026 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.092017 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 16:24:25.098026 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.092019 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 16:24:25.098026 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.092022 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 16:24:25.098026 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.092025 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 16:24:25.098026 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.092028 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 16:24:25.098026 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.092030 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 16:24:25.098026 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.092034 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 16:24:25.098026 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.092036 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 16:24:25.098026 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.092039 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 16:24:25.098026 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.092041 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 16:24:25.098026 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.092044 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 16:24:25.098026 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.092047 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 16:24:25.098026 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.092049 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 16:24:25.098526 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:25.092052 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 16:24:25.098526 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.092057 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 16:24:25.098526 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.092204 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 27 16:24:25.098526 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.096506 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 27 16:24:25.098526 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.097867 2578 server.go:1019] "Starting client certificate rotation" Jul 27 16:24:25.098526 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.097988 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 16:24:25.098526 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.098024 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 16:24:25.100559 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.100544 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 16:24:25.101764 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.101748 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 16:24:25.113737 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.113718 2578 log.go:25] "Validated CRI v1 runtime API" Jul 27 16:24:25.116473 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.116458 2578 log.go:25] "Validated CRI v1 image API" Jul 27 16:24:25.117275 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.117260 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 27 16:24:25.120532 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.120508 2578 fs.go:135] Filesystem UUIDs: map[56167ad8-b338-46c2-a98c-72b2c6a28130:/dev/nvme0n1p3 6a409113-6599-4d48-a522-fcbd061a66c1:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 27 16:24:25.120600 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.120531 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 27 16:24:25.124043 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.124028 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 16:24:25.126524 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.126419 2578 manager.go:216] Machine: {Timestamp:2026-07-27 16:24:25.12502479 +0000 UTC m=+0.334874652 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3114069 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24a7b2fc6c51240310e2b9859a69bb SystemUUID:ec24a7b2-fc6c-5124-0310-e2b9859a69bb BootID:39465fa1-58cc-4186-b74f-abcd6804d357 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ee:eb:5b:02:97 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ee:eb:5b:02:97 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:47:28:28:8d:e7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 27 16:24:25.126524 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.126525 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 27 16:24:25.126629 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.126608 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 27 16:24:25.127680 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.127658 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 27 16:24:25.127813 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.127684 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-40.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 27 16:24:25.128361 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.128351 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 27 16:24:25.128392 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.128364 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 27 16:24:25.128392 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.128372 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 16:24:25.129161 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.129150 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 16:24:25.129966 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.129955 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 27 16:24:25.131744 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.131732 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 27 16:24:25.132185 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.132165 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 27 16:24:25.132258 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.132215 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 27 16:24:25.132258 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.132230 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 27 16:24:25.132258 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.132250 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 27 16:24:25.132401 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.132267 2578 kubelet.go:398] "Adding apiserver pod source" Jul 27 16:24:25.132401 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.132280 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 27 16:24:25.132756 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.132731 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 16:24:25.132887 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.132763 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 16:24:25.135264 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.135246 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 27 16:24:25.136998 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.136984 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 27 16:24:25.137047 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.137015 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 27 16:24:25.138573 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.138553 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 27 16:24:25.138652 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.138578 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 27 16:24:25.138652 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.138588 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 27 16:24:25.138652 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.138596 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 27 16:24:25.138652 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.138609 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 27 16:24:25.138652 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.138618 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 27 16:24:25.138652 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.138631 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 27 16:24:25.138652 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.138640 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 27 16:24:25.138652 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.138650 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 27 16:24:25.138890 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.138659 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 27 16:24:25.138890 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.138687 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 27 16:24:25.138890 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.138697 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 27 16:24:25.139404 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.139391 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 27 16:24:25.139434 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.139404 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 27 16:24:25.142721 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.142708 2578 server.go:1268] "Started kubelet" Jul 27 16:24:25.142833 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.142800 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 27 16:24:25.142909 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.142804 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 27 16:24:25.142960 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.142932 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 27 16:24:25.143685 ip-10-0-143-40 systemd[1]: Started Kubernetes Kubelet. Jul 27 16:24:25.143939 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:25.143693 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 27 16:24:25.143939 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:25.143800 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-40.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 27 16:24:25.143939 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.143892 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-40.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 27 16:24:25.144089 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.144064 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 27 16:24:25.147078 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.147060 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 27 16:24:25.149009 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:25.148091 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-40.ec2.internal.18c6322b99b423e6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-40.ec2.internal,UID:ip-10-0-143-40.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-40.ec2.internal,},FirstTimestamp:2026-07-27 16:24:25.142682598 +0000 UTC m=+0.352532461,LastTimestamp:2026-07-27 16:24:25.142682598 +0000 UTC m=+0.352532461,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-40.ec2.internal,}" Jul 27 16:24:25.149173 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:25.149155 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 27 16:24:25.152824 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.152808 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 27 16:24:25.152824 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.152810 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 27 16:24:25.153011 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:25.152905 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-40.ec2.internal\" not found" Jul 27 16:24:25.153548 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.153531 2578 factory.go:55] Registering systemd factory Jul 27 16:24:25.153548 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.153550 2578 factory.go:223] Registration of the systemd container factory successfully Jul 27 16:24:25.153694 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.153616 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 27 16:24:25.153694 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.153618 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 27 16:24:25.153694 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.153641 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 27 16:24:25.153828 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.153745 2578 factory.go:153] Registering CRI-O factory Jul 27 16:24:25.153828 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.153759 2578 factory.go:223] Registration of the crio container factory successfully Jul 27 16:24:25.153828 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.153810 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 27 16:24:25.153994 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.153747 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 27 16:24:25.153994 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.153949 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 27 16:24:25.153994 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.153836 2578 factory.go:103] Registering Raw factory Jul 27 16:24:25.153994 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.153980 2578 manager.go:1196] Started watching for new ooms in manager Jul 27 16:24:25.154464 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.154451 2578 manager.go:349] Starting recovery of all containers Jul 27 16:24:25.156441 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:25.156413 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 27 16:24:25.156570 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:25.156527 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-40.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 27 16:24:25.166622 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.166604 2578 manager.go:354] Recovery completed Jul 27 16:24:25.170875 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.170862 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 16:24:25.173269 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.173250 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-40.ec2.internal" event="NodeHasSufficientMemory" Jul 27 16:24:25.173345 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.173300 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-40.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 16:24:25.173345 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.173313 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-40.ec2.internal" event="NodeHasSufficientPID" Jul 27 16:24:25.173886 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.173867 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 27 16:24:25.173886 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.173884 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 27 16:24:25.174039 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.173889 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 16:24:25.174039 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.173906 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 27 16:24:25.174661 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.174646 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-40.ec2.internal" event="NodeHasSufficientMemory" Jul 27 16:24:25.174725 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.174678 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-40.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 16:24:25.174725 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.174694 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-40.ec2.internal" event="NodeHasSufficientPID" Jul 27 16:24:25.175614 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.175602 2578 policy_none.go:49] "None policy: Start" Jul 27 16:24:25.175674 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.175617 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 27 16:24:25.175674 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.175628 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 27 16:24:25.176574 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.176563 2578 policy_none.go:47] "Start" Jul 27 16:24:25.183266 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:25.183191 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-40.ec2.internal.18c6322b9b871a58 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-40.ec2.internal,UID:ip-10-0-143-40.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-40.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-40.ec2.internal,},FirstTimestamp:2026-07-27 16:24:25.173285464 +0000 UTC m=+0.383135326,LastTimestamp:2026-07-27 16:24:25.173285464 +0000 UTC m=+0.383135326,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-40.ec2.internal,}" Jul 27 16:24:25.186048 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.186033 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bnk68" Jul 27 16:24:25.197782 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.197747 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bnk68" Jul 27 16:24:25.197922 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:25.197811 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-40.ec2.internal.18c6322b9b8766e4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-40.ec2.internal,UID:ip-10-0-143-40.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-40.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-40.ec2.internal,},FirstTimestamp:2026-07-27 16:24:25.17330506 +0000 UTC m=+0.383154923,LastTimestamp:2026-07-27 16:24:25.17330506 +0000 UTC m=+0.383154923,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-40.ec2.internal,}" Jul 27 16:24:25.216892 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.216684 2578 manager.go:337] "Starting Device Plugin manager" Jul 27 16:24:25.217007 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:25.216929 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 27 16:24:25.217007 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.216945 2578 server.go:87] "Starting device plugin registration server" Jul 27 16:24:25.217303 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.217288 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 27 16:24:25.217338 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.217306 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 27 16:24:25.218211 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.218179 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 27 16:24:25.218358 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:25.218274 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 27 16:24:25.218358 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.218296 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 27 16:24:25.218358 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.218306 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 27 16:24:25.218500 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:25.218361 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-40.ec2.internal\" not found" Jul 27 16:24:25.319013 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.318976 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 16:24:25.320331 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.320301 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-40.ec2.internal" event="NodeHasSufficientMemory" Jul 27 16:24:25.320459 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.320339 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-40.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 16:24:25.320459 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.320349 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-40.ec2.internal" event="NodeHasSufficientPID" Jul 27 16:24:25.320459 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.320388 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-40.ec2.internal" Jul 27 16:24:25.331568 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.331490 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-40.ec2.internal" Jul 27 16:24:25.331568 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:25.331529 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-40.ec2.internal\": node \"ip-10-0-143-40.ec2.internal\" not found" Jul 27 16:24:25.354974 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:25.354946 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-40.ec2.internal\" not found" Jul 27 16:24:25.370335 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.370292 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 27 16:24:25.371586 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.371564 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 27 16:24:25.371656 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.371617 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 27 16:24:25.371656 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.371647 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 27 16:24:25.371729 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:25.371693 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 27 16:24:25.374799 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.374777 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 16:24:25.457014 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:25.456969 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-40.ec2.internal\" not found" Jul 27 16:24:25.472910 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.472881 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-40.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-40.ec2.internal"] Jul 27 16:24:25.472995 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.472969 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 16:24:25.474068 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.474048 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-40.ec2.internal" event="NodeHasSufficientMemory" Jul 27 16:24:25.474182 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.474081 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-40.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 16:24:25.474182 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.474104 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-40.ec2.internal" event="NodeHasSufficientPID" Jul 27 16:24:25.475331 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.475317 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 16:24:25.475443 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.475429 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-40.ec2.internal" Jul 27 16:24:25.475493 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.475460 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 16:24:25.476152 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.476134 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-40.ec2.internal" event="NodeHasSufficientMemory" Jul 27 16:24:25.476238 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.476166 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-40.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 16:24:25.476238 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.476169 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-40.ec2.internal" event="NodeHasSufficientMemory" Jul 27 16:24:25.476238 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.476181 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-40.ec2.internal" event="NodeHasSufficientPID" Jul 27 16:24:25.476238 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.476194 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-40.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 16:24:25.476238 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.476206 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-40.ec2.internal" event="NodeHasSufficientPID" Jul 27 16:24:25.477308 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.477294 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-40.ec2.internal" Jul 27 16:24:25.477359 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.477320 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 16:24:25.478046 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.478025 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-40.ec2.internal" event="NodeHasSufficientMemory" Jul 27 16:24:25.478141 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.478050 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-40.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 16:24:25.478141 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.478063 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-40.ec2.internal" event="NodeHasSufficientPID" Jul 27 16:24:25.503862 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:25.503821 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-40.ec2.internal\" not found" node="ip-10-0-143-40.ec2.internal" Jul 27 16:24:25.507545 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:25.507524 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-40.ec2.internal\" not found" node="ip-10-0-143-40.ec2.internal" Jul 27 16:24:25.557106 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:25.557073 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-40.ec2.internal\" not found" Jul 27 16:24:25.557232 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.557114 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9963d2b8aa04417f23f458975070b2b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-40.ec2.internal\" (UID: \"9963d2b8aa04417f23f458975070b2b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-40.ec2.internal" Jul 27 16:24:25.557232 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.557143 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9963d2b8aa04417f23f458975070b2b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-40.ec2.internal\" (UID: \"9963d2b8aa04417f23f458975070b2b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-40.ec2.internal" Jul 27 16:24:25.557232 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.557161 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5707262778505577d5d82f3e1320d33c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-40.ec2.internal\" (UID: \"5707262778505577d5d82f3e1320d33c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-40.ec2.internal" Jul 27 16:24:25.657330 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:25.657237 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-40.ec2.internal\" not found" Jul 27 16:24:25.657330 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.657312 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9963d2b8aa04417f23f458975070b2b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-40.ec2.internal\" (UID: \"9963d2b8aa04417f23f458975070b2b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-40.ec2.internal" Jul 27 16:24:25.657516 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.657342 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5707262778505577d5d82f3e1320d33c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-40.ec2.internal\" (UID: \"5707262778505577d5d82f3e1320d33c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-40.ec2.internal" Jul 27 16:24:25.657516 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.657359 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9963d2b8aa04417f23f458975070b2b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-40.ec2.internal\" (UID: \"9963d2b8aa04417f23f458975070b2b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-40.ec2.internal" Jul 27 16:24:25.657516 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.657408 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9963d2b8aa04417f23f458975070b2b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-40.ec2.internal\" (UID: \"9963d2b8aa04417f23f458975070b2b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-40.ec2.internal" Jul 27 16:24:25.657516 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.657411 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9963d2b8aa04417f23f458975070b2b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-40.ec2.internal\" (UID: \"9963d2b8aa04417f23f458975070b2b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-40.ec2.internal" Jul 27 16:24:25.657516 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.657429 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5707262778505577d5d82f3e1320d33c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-40.ec2.internal\" (UID: \"5707262778505577d5d82f3e1320d33c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-40.ec2.internal" Jul 27 16:24:25.758007 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:25.757962 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-40.ec2.internal\" not found" Jul 27 16:24:25.809068 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.809030 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-40.ec2.internal" Jul 27 16:24:25.810573 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:25.810550 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-40.ec2.internal" Jul 27 16:24:25.859167 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:25.859127 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-40.ec2.internal\" not found" Jul 27 16:24:25.959761 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:25.959668 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-40.ec2.internal\" not found" Jul 27 16:24:26.060162 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:26.060123 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-40.ec2.internal\" not found" Jul 27 16:24:26.070195 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.070167 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 16:24:26.098853 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.098816 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 27 16:24:26.099371 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.099018 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 27 16:24:26.099371 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.099048 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 27 16:24:26.135015 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.134975 2578 apiserver.go:52] "Watching apiserver" Jul 27 16:24:26.153014 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.152973 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 27 16:24:26.153014 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.152992 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-40.ec2.internal" Jul 27 16:24:26.158045 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.158022 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 27 16:24:26.159224 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.159202 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-r89j2","openshift-cluster-node-tuning-operator/tuned-cpjj4","openshift-multus/network-metrics-daemon-ttj4w","openshift-ovn-kubernetes/ovnkube-node-pzzjg","kube-system/global-pull-secret-syncer-qgww4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4","openshift-dns/node-resolver-jvxww","openshift-image-registry/node-ca-2v5jv","openshift-multus/multus-additional-cni-plugins-b5qcd","openshift-multus/multus-sf2f9","openshift-network-diagnostics/network-check-target-8pf9l","openshift-network-operator/iptables-alerter-vqvbd"] Jul 27 16:24:26.160675 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.160656 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r89j2" Jul 27 16:24:26.161844 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.161821 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.163005 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.162989 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:26.163091 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:26.163070 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ttj4w" podUID="7d73c7ed-f214-4fae-b194-9bae83a86b47" Jul 27 16:24:26.164883 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.164865 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.166030 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.166013 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:26.166106 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:26.166071 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgww4" podUID="d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d" Jul 27 16:24:26.167136 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.167120 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" Jul 27 16:24:26.168206 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.168189 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jvxww" Jul 27 16:24:26.169141 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.169120 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 27 16:24:26.169230 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.169142 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-47rph\"" Jul 27 16:24:26.169230 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.169124 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-spkfk\"" Jul 27 16:24:26.169230 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.169128 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 27 16:24:26.169230 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.169192 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 27 16:24:26.169230 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.169222 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 27 16:24:26.169598 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.169583 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2v5jv" Jul 27 16:24:26.170889 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.170871 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b5qcd" Jul 27 16:24:26.172222 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.172205 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.173341 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.173329 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:24:26.173398 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:26.173382 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pf9l" podUID="81ef96f6-f835-4c1c-bad7-6a54c5da90c7" Jul 27 16:24:26.174491 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.174475 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vqvbd" Jul 27 16:24:26.174743 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.174721 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vfrsd\"" Jul 27 16:24:26.178458 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.178441 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 27 16:24:26.178647 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.178633 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 27 16:24:26.185209 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.185178 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 27 16:24:26.185348 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.185237 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 27 16:24:26.185348 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.185254 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 27 16:24:26.185348 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.185345 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 27 16:24:26.185519 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.185452 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 27 16:24:26.185519 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.185474 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 27 16:24:26.185622 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.185577 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 27 16:24:26.185678 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.185621 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 27 16:24:26.185765 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.185741 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 27 16:24:26.185875 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.185818 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 27 16:24:26.185875 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.185751 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 27 16:24:26.185875 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.185856 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 27 16:24:26.186014 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.185856 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hvxwl\"" Jul 27 16:24:26.186014 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.185961 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 27 16:24:26.186076 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.186017 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 27 16:24:26.186076 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.185845 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 27 16:24:26.186076 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.186051 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 16:24:26.186076 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.186045 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-92v7b\"" Jul 27 16:24:26.186199 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.186123 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lqcs8\"" Jul 27 16:24:26.186199 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.186125 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mdhdl\"" Jul 27 16:24:26.186199 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.186146 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 27 16:24:26.186290 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.186199 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-40.ec2.internal" Jul 27 16:24:26.186290 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.186216 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 27 16:24:26.186290 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.186018 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 27 16:24:26.186383 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.186289 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 27 16:24:26.186383 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.186343 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kmk72\"" Jul 27 16:24:26.186383 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.186347 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 27 16:24:26.186629 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.186613 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m7n6v\"" Jul 27 16:24:26.187007 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.186988 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-40.ec2.internal"] Jul 27 16:24:26.200571 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.200545 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 27 16:24:26.201275 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.201252 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 16:24:26.201974 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.201934 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 16:19:25 +0000 UTC" deadline="2028-03-07 22:23:21.111447812 +0000 UTC" Jul 27 16:24:26.202059 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.201974 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14141h58m54.909478301s" Jul 27 16:24:26.209902 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.209843 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-40.ec2.internal"] Jul 27 16:24:26.211695 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.211678 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 16:24:26.215359 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.215334 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5gnf8" Jul 27 16:24:26.235718 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.235693 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5gnf8" Jul 27 16:24:26.255397 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.255369 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 27 16:24:26.261320 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.261297 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-log-socket\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.261439 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.261329 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c079aa05-1e43-4257-b459-54127b27d843-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b5qcd\" (UID: \"c079aa05-1e43-4257-b459-54127b27d843\") " pod="openshift-multus/multus-additional-cni-plugins-b5qcd" Jul 27 16:24:26.261439 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.261347 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-host\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.261439 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.261374 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-run-openvswitch\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.261439 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.261400 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-original-pull-secret\") pod \"global-pull-secret-syncer-qgww4\" (UID: \"d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d\") " pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:26.261439 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.261425 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee20c72e-c217-455a-9560-b5ab054cf0f3-host\") pod \"node-ca-2v5jv\" (UID: \"ee20c72e-c217-455a-9560-b5ab054cf0f3\") " pod="openshift-image-registry/node-ca-2v5jv" Jul 27 16:24:26.261680 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.261449 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs\") pod \"network-metrics-daemon-ttj4w\" (UID: \"7d73c7ed-f214-4fae-b194-9bae83a86b47\") " pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:26.261680 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.261472 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-host-kubelet\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.261680 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.261515 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-ovn-node-metrics-cert\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.261680 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.261562 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ab52fbdf-49ab-4128-9355-246e7a45fc91-sys-fs\") pod \"aws-ebs-csi-driver-node-crdb4\" (UID: \"ab52fbdf-49ab-4128-9355-246e7a45fc91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" Jul 27 16:24:26.261680 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.261592 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-host-var-lib-kubelet\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.261680 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.261616 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-run\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.261680 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.261640 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c53359a8-84df-4989-88b1-ae04880c1c4e-tmp\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.261680 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.261657 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-etc-openvswitch\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.261680 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.261672 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-etc-kubernetes\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.261680 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.261689 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-var-lib-kubelet\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.262176 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.261711 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-run-systemd\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.262176 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.261745 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2db67f70-a81c-43c3-bb3c-e42540477f31-hosts-file\") pod \"node-resolver-jvxww\" (UID: \"2db67f70-a81c-43c3-bb3c-e42540477f31\") " pod="openshift-dns/node-resolver-jvxww" Jul 27 16:24:26.262176 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.261781 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c079aa05-1e43-4257-b459-54127b27d843-cnibin\") pod \"multus-additional-cni-plugins-b5qcd\" (UID: \"c079aa05-1e43-4257-b459-54127b27d843\") " pod="openshift-multus/multus-additional-cni-plugins-b5qcd" Jul 27 16:24:26.262176 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.261807 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42f4j\" (UniqueName: \"kubernetes.io/projected/c079aa05-1e43-4257-b459-54127b27d843-kube-api-access-42f4j\") pod \"multus-additional-cni-plugins-b5qcd\" (UID: \"c079aa05-1e43-4257-b459-54127b27d843\") " pod="openshift-multus/multus-additional-cni-plugins-b5qcd" Jul 27 16:24:26.262176 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.261833 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ab52fbdf-49ab-4128-9355-246e7a45fc91-kubelet-dir\") pod \"aws-ebs-csi-driver-node-crdb4\" (UID: \"ab52fbdf-49ab-4128-9355-246e7a45fc91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" Jul 27 16:24:26.262176 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.261874 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbmlz\" (UniqueName: \"kubernetes.io/projected/561fc239-ede6-415f-ae7a-2745af950649-kube-api-access-bbmlz\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.262176 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.261900 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/22ae248d-bc07-48a7-8e01-4c9fa5f1bc99-iptables-alerter-script\") pod \"iptables-alerter-vqvbd\" (UID: \"22ae248d-bc07-48a7-8e01-4c9fa5f1bc99\") " pod="openshift-network-operator/iptables-alerter-vqvbd" Jul 27 16:24:26.262176 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.261918 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.262176 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.261939 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ab52fbdf-49ab-4128-9355-246e7a45fc91-registration-dir\") pod \"aws-ebs-csi-driver-node-crdb4\" (UID: \"ab52fbdf-49ab-4128-9355-246e7a45fc91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" Jul 27 16:24:26.262176 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.261959 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxglw\" (UniqueName: \"kubernetes.io/projected/2db67f70-a81c-43c3-bb3c-e42540477f31-kube-api-access-jxglw\") pod \"node-resolver-jvxww\" (UID: \"2db67f70-a81c-43c3-bb3c-e42540477f31\") " pod="openshift-dns/node-resolver-jvxww" Jul 27 16:24:26.262176 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.261981 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c079aa05-1e43-4257-b459-54127b27d843-os-release\") pod \"multus-additional-cni-plugins-b5qcd\" (UID: \"c079aa05-1e43-4257-b459-54127b27d843\") " pod="openshift-multus/multus-additional-cni-plugins-b5qcd" Jul 27 16:24:26.262176 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262008 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-run-ovn\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.262176 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262029 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ab52fbdf-49ab-4128-9355-246e7a45fc91-socket-dir\") pod \"aws-ebs-csi-driver-node-crdb4\" (UID: \"ab52fbdf-49ab-4128-9355-246e7a45fc91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" Jul 27 16:24:26.262176 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262050 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c079aa05-1e43-4257-b459-54127b27d843-system-cni-dir\") pod \"multus-additional-cni-plugins-b5qcd\" (UID: \"c079aa05-1e43-4257-b459-54127b27d843\") " pod="openshift-multus/multus-additional-cni-plugins-b5qcd" Jul 27 16:24:26.262176 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262066 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c079aa05-1e43-4257-b459-54127b27d843-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b5qcd\" (UID: \"c079aa05-1e43-4257-b459-54127b27d843\") " pod="openshift-multus/multus-additional-cni-plugins-b5qcd" Jul 27 16:24:26.262176 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262081 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-hostroot\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.262840 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262099 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/561fc239-ede6-415f-ae7a-2745af950649-multus-daemon-config\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.262840 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262145 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-etc-sysconfig\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.262840 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262181 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-etc-sysctl-conf\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.262840 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262210 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-var-lib-openvswitch\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.262840 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262239 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/45eeca03-5f0c-4e88-8e51-060a5e5e1e65-konnectivity-ca\") pod \"konnectivity-agent-r89j2\" (UID: \"45eeca03-5f0c-4e88-8e51-060a5e5e1e65\") " pod="kube-system/konnectivity-agent-r89j2" Jul 27 16:24:26.262840 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262263 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-host-slash\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.262840 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262289 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-host-cni-bin\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.262840 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262313 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65tj7\" (UniqueName: \"kubernetes.io/projected/ab52fbdf-49ab-4128-9355-246e7a45fc91-kube-api-access-65tj7\") pod \"aws-ebs-csi-driver-node-crdb4\" (UID: \"ab52fbdf-49ab-4128-9355-246e7a45fc91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" Jul 27 16:24:26.262840 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262346 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2db67f70-a81c-43c3-bb3c-e42540477f31-tmp-dir\") pod \"node-resolver-jvxww\" (UID: \"2db67f70-a81c-43c3-bb3c-e42540477f31\") " pod="openshift-dns/node-resolver-jvxww" Jul 27 16:24:26.262840 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262400 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-etc-modprobe-d\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.262840 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262423 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-etc-kubernetes\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.262840 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262457 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-ovnkube-script-lib\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.262840 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262497 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smzmv\" (UniqueName: \"kubernetes.io/projected/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-kube-api-access-smzmv\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.262840 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262518 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-system-cni-dir\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.262840 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262561 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-host-var-lib-cni-multus\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.262840 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262601 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-etc-systemd\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.263400 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262629 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c53359a8-84df-4989-88b1-ae04880c1c4e-etc-tuned\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.263400 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262655 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdjkc\" (UniqueName: \"kubernetes.io/projected/7d73c7ed-f214-4fae-b194-9bae83a86b47-kube-api-access-xdjkc\") pod \"network-metrics-daemon-ttj4w\" (UID: \"7d73c7ed-f214-4fae-b194-9bae83a86b47\") " pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:26.263400 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262682 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-host-run-netns\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.263400 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262759 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-ovnkube-config\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.263400 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262792 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c079aa05-1e43-4257-b459-54127b27d843-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b5qcd\" (UID: \"c079aa05-1e43-4257-b459-54127b27d843\") " pod="openshift-multus/multus-additional-cni-plugins-b5qcd" Jul 27 16:24:26.263400 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262819 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-os-release\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.263400 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262839 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/561fc239-ede6-415f-ae7a-2745af950649-cni-binary-copy\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.263400 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262909 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-etc-sysctl-d\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.263400 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262935 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7z7h\" (UniqueName: \"kubernetes.io/projected/81ef96f6-f835-4c1c-bad7-6a54c5da90c7-kube-api-access-q7z7h\") pod \"network-check-target-8pf9l\" (UID: \"81ef96f6-f835-4c1c-bad7-6a54c5da90c7\") " pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:24:26.263400 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262960 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-systemd-units\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.263400 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.262991 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c079aa05-1e43-4257-b459-54127b27d843-cni-binary-copy\") pod \"multus-additional-cni-plugins-b5qcd\" (UID: \"c079aa05-1e43-4257-b459-54127b27d843\") " pod="openshift-multus/multus-additional-cni-plugins-b5qcd" Jul 27 16:24:26.263400 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.263016 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-host-run-netns\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.263400 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.263031 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-sys\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.263400 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.263096 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg6t4\" (UniqueName: \"kubernetes.io/projected/ee20c72e-c217-455a-9560-b5ab054cf0f3-kube-api-access-lg6t4\") pod \"node-ca-2v5jv\" (UID: \"ee20c72e-c217-455a-9560-b5ab054cf0f3\") " pod="openshift-image-registry/node-ca-2v5jv" Jul 27 16:24:26.263400 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.263142 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/22ae248d-bc07-48a7-8e01-4c9fa5f1bc99-host-slash\") pod \"iptables-alerter-vqvbd\" (UID: \"22ae248d-bc07-48a7-8e01-4c9fa5f1bc99\") " pod="openshift-network-operator/iptables-alerter-vqvbd" Jul 27 16:24:26.263400 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.263180 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-host-run-ovn-kubernetes\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.263892 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.263198 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-multus-socket-dir-parent\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.263892 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.263214 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-host-var-lib-cni-bin\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.263892 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.263230 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-kubelet-config\") pod \"global-pull-secret-syncer-qgww4\" (UID: \"d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d\") " pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:26.263892 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.263255 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee20c72e-c217-455a-9560-b5ab054cf0f3-serviceca\") pod \"node-ca-2v5jv\" (UID: \"ee20c72e-c217-455a-9560-b5ab054cf0f3\") " pod="openshift-image-registry/node-ca-2v5jv" Jul 27 16:24:26.263892 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.263271 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-host-cni-netd\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.263892 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.263290 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-env-overrides\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.263892 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.263305 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ab52fbdf-49ab-4128-9355-246e7a45fc91-device-dir\") pod \"aws-ebs-csi-driver-node-crdb4\" (UID: \"ab52fbdf-49ab-4128-9355-246e7a45fc91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" Jul 27 16:24:26.263892 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.263336 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-multus-cni-dir\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.263892 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.263370 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-host-run-multus-certs\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.263892 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.263396 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xbk6\" (UniqueName: \"kubernetes.io/projected/c53359a8-84df-4989-88b1-ae04880c1c4e-kube-api-access-6xbk6\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.263892 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.263424 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-dbus\") pod \"global-pull-secret-syncer-qgww4\" (UID: \"d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d\") " pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:26.263892 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.263450 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csr5g\" (UniqueName: \"kubernetes.io/projected/22ae248d-bc07-48a7-8e01-4c9fa5f1bc99-kube-api-access-csr5g\") pod \"iptables-alerter-vqvbd\" (UID: \"22ae248d-bc07-48a7-8e01-4c9fa5f1bc99\") " pod="openshift-network-operator/iptables-alerter-vqvbd" Jul 27 16:24:26.263892 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.263483 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/45eeca03-5f0c-4e88-8e51-060a5e5e1e65-agent-certs\") pod \"konnectivity-agent-r89j2\" (UID: \"45eeca03-5f0c-4e88-8e51-060a5e5e1e65\") " pod="kube-system/konnectivity-agent-r89j2" Jul 27 16:24:26.263892 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.263508 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ab52fbdf-49ab-4128-9355-246e7a45fc91-etc-selinux\") pod \"aws-ebs-csi-driver-node-crdb4\" (UID: \"ab52fbdf-49ab-4128-9355-246e7a45fc91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" Jul 27 16:24:26.263892 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.263531 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-cnibin\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.263892 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.263555 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-host-run-k8s-cni-cncf-io\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.263892 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.263578 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-multus-conf-dir\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.264411 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.263601 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-lib-modules\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.264411 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.263649 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-node-log\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.344197 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:26.344160 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5707262778505577d5d82f3e1320d33c.slice/crio-4a4cb62cc7f66913ff62815785f72efe65619cc64b5d578fa99b7cbbb9d14d57 WatchSource:0}: Error finding container 4a4cb62cc7f66913ff62815785f72efe65619cc64b5d578fa99b7cbbb9d14d57: Status 404 returned error can't find the container with id 4a4cb62cc7f66913ff62815785f72efe65619cc64b5d578fa99b7cbbb9d14d57 Jul 27 16:24:26.344426 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:26.344405 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9963d2b8aa04417f23f458975070b2b7.slice/crio-db0da9c795f6e3959698276e4c999a2835975e94a02f6f1239c6ed6f30507522 WatchSource:0}: Error finding container db0da9c795f6e3959698276e4c999a2835975e94a02f6f1239c6ed6f30507522: Status 404 returned error can't find the container with id db0da9c795f6e3959698276e4c999a2835975e94a02f6f1239c6ed6f30507522 Jul 27 16:24:26.349905 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.349881 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 16:24:26.363948 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.363902 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-host-var-lib-cni-bin\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.364085 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.363962 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-kubelet-config\") pod \"global-pull-secret-syncer-qgww4\" (UID: \"d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d\") " pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:26.364085 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.363988 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee20c72e-c217-455a-9560-b5ab054cf0f3-serviceca\") pod \"node-ca-2v5jv\" (UID: \"ee20c72e-c217-455a-9560-b5ab054cf0f3\") " pod="openshift-image-registry/node-ca-2v5jv" Jul 27 16:24:26.364085 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364019 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-host-var-lib-cni-bin\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.364085 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364040 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-host-cni-netd\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.364085 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364051 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-kubelet-config\") pod \"global-pull-secret-syncer-qgww4\" (UID: \"d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d\") " pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:26.364085 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364065 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-env-overrides\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.364367 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364104 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ab52fbdf-49ab-4128-9355-246e7a45fc91-device-dir\") pod \"aws-ebs-csi-driver-node-crdb4\" (UID: \"ab52fbdf-49ab-4128-9355-246e7a45fc91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" Jul 27 16:24:26.364367 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364124 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-multus-cni-dir\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.364367 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364140 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-host-run-multus-certs\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.364367 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364133 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-host-cni-netd\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.364367 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364185 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-host-run-multus-certs\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.364367 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364219 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ab52fbdf-49ab-4128-9355-246e7a45fc91-device-dir\") pod \"aws-ebs-csi-driver-node-crdb4\" (UID: \"ab52fbdf-49ab-4128-9355-246e7a45fc91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" Jul 27 16:24:26.364367 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364237 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xbk6\" (UniqueName: \"kubernetes.io/projected/c53359a8-84df-4989-88b1-ae04880c1c4e-kube-api-access-6xbk6\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.364367 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364259 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-dbus\") pod \"global-pull-secret-syncer-qgww4\" (UID: \"d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d\") " pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:26.364367 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364278 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csr5g\" (UniqueName: \"kubernetes.io/projected/22ae248d-bc07-48a7-8e01-4c9fa5f1bc99-kube-api-access-csr5g\") pod \"iptables-alerter-vqvbd\" (UID: \"22ae248d-bc07-48a7-8e01-4c9fa5f1bc99\") " pod="openshift-network-operator/iptables-alerter-vqvbd" Jul 27 16:24:26.364367 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364296 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/45eeca03-5f0c-4e88-8e51-060a5e5e1e65-agent-certs\") pod \"konnectivity-agent-r89j2\" (UID: \"45eeca03-5f0c-4e88-8e51-060a5e5e1e65\") " pod="kube-system/konnectivity-agent-r89j2" Jul 27 16:24:26.364367 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364310 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ab52fbdf-49ab-4128-9355-246e7a45fc91-etc-selinux\") pod \"aws-ebs-csi-driver-node-crdb4\" (UID: \"ab52fbdf-49ab-4128-9355-246e7a45fc91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" Jul 27 16:24:26.364367 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364330 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-cnibin\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.364367 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364354 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-multus-cni-dir\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.365031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364366 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-host-run-k8s-cni-cncf-io\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.365031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364395 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-host-run-k8s-cni-cncf-io\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.365031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364417 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-multus-conf-dir\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.365031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364435 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-dbus\") pod \"global-pull-secret-syncer-qgww4\" (UID: \"d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d\") " pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:26.365031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364450 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-lib-modules\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.365031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364478 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-node-log\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.365031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364502 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-log-socket\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.365031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364531 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c079aa05-1e43-4257-b459-54127b27d843-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b5qcd\" (UID: \"c079aa05-1e43-4257-b459-54127b27d843\") " pod="openshift-multus/multus-additional-cni-plugins-b5qcd" Jul 27 16:24:26.365031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364533 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee20c72e-c217-455a-9560-b5ab054cf0f3-serviceca\") pod \"node-ca-2v5jv\" (UID: \"ee20c72e-c217-455a-9560-b5ab054cf0f3\") " pod="openshift-image-registry/node-ca-2v5jv" Jul 27 16:24:26.365031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364549 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-env-overrides\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.365031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364559 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-host\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.365031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364590 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-run-openvswitch\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.365031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364619 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-original-pull-secret\") pod \"global-pull-secret-syncer-qgww4\" (UID: \"d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d\") " pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:26.365031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364658 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-multus-conf-dir\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.365031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364665 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-cnibin\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.365031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364675 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-log-socket\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.365031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364697 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ab52fbdf-49ab-4128-9355-246e7a45fc91-etc-selinux\") pod \"aws-ebs-csi-driver-node-crdb4\" (UID: \"ab52fbdf-49ab-4128-9355-246e7a45fc91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" Jul 27 16:24:26.365031 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:26.364715 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:26.366031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364722 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-node-log\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.366031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364782 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-lib-modules\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.366031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364791 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-host\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.366031 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:26.364835 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-original-pull-secret podName:d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d nodeName:}" failed. No retries permitted until 2026-07-27 16:24:26.864769964 +0000 UTC m=+2.074619834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-original-pull-secret") pod "global-pull-secret-syncer-qgww4" (UID: "d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d") : object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:26.366031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364885 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee20c72e-c217-455a-9560-b5ab054cf0f3-host\") pod \"node-ca-2v5jv\" (UID: \"ee20c72e-c217-455a-9560-b5ab054cf0f3\") " pod="openshift-image-registry/node-ca-2v5jv" Jul 27 16:24:26.366031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364902 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 27 16:24:26.366031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364919 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs\") pod \"network-metrics-daemon-ttj4w\" (UID: \"7d73c7ed-f214-4fae-b194-9bae83a86b47\") " pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:26.366031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364950 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-host-kubelet\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.366031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364973 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee20c72e-c217-455a-9560-b5ab054cf0f3-host\") pod \"node-ca-2v5jv\" (UID: \"ee20c72e-c217-455a-9560-b5ab054cf0f3\") " pod="openshift-image-registry/node-ca-2v5jv" Jul 27 16:24:26.366031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364977 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c079aa05-1e43-4257-b459-54127b27d843-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b5qcd\" (UID: \"c079aa05-1e43-4257-b459-54127b27d843\") " pod="openshift-multus/multus-additional-cni-plugins-b5qcd" Jul 27 16:24:26.366031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.364979 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-ovn-node-metrics-cert\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.366031 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:26.365018 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:26.366031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365024 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ab52fbdf-49ab-4128-9355-246e7a45fc91-sys-fs\") pod \"aws-ebs-csi-driver-node-crdb4\" (UID: \"ab52fbdf-49ab-4128-9355-246e7a45fc91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" Jul 27 16:24:26.366031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365067 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-run-openvswitch\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.366031 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:26.365079 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs podName:7d73c7ed-f214-4fae-b194-9bae83a86b47 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:26.865052953 +0000 UTC m=+2.074902810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs") pod "network-metrics-daemon-ttj4w" (UID: "7d73c7ed-f214-4fae-b194-9bae83a86b47") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:26.366031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365077 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ab52fbdf-49ab-4128-9355-246e7a45fc91-sys-fs\") pod \"aws-ebs-csi-driver-node-crdb4\" (UID: \"ab52fbdf-49ab-4128-9355-246e7a45fc91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" Jul 27 16:24:26.366031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365099 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-host-var-lib-kubelet\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.366884 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365109 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-host-kubelet\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.366884 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365129 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-run\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.366884 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365143 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-host-var-lib-kubelet\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.366884 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365153 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c53359a8-84df-4989-88b1-ae04880c1c4e-tmp\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.366884 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365178 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-etc-openvswitch\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.366884 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-etc-kubernetes\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.366884 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365185 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-run\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.366884 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365220 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-var-lib-kubelet\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.366884 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365249 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-run-systemd\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.366884 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365279 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-etc-openvswitch\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.366884 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365301 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2db67f70-a81c-43c3-bb3c-e42540477f31-hosts-file\") pod \"node-resolver-jvxww\" (UID: \"2db67f70-a81c-43c3-bb3c-e42540477f31\") " pod="openshift-dns/node-resolver-jvxww" Jul 27 16:24:26.366884 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365306 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-etc-kubernetes\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.366884 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365326 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c079aa05-1e43-4257-b459-54127b27d843-cnibin\") pod \"multus-additional-cni-plugins-b5qcd\" (UID: \"c079aa05-1e43-4257-b459-54127b27d843\") " pod="openshift-multus/multus-additional-cni-plugins-b5qcd" Jul 27 16:24:26.366884 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365353 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42f4j\" (UniqueName: \"kubernetes.io/projected/c079aa05-1e43-4257-b459-54127b27d843-kube-api-access-42f4j\") pod \"multus-additional-cni-plugins-b5qcd\" (UID: \"c079aa05-1e43-4257-b459-54127b27d843\") " pod="openshift-multus/multus-additional-cni-plugins-b5qcd" Jul 27 16:24:26.366884 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365371 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-var-lib-kubelet\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.366884 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365383 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ab52fbdf-49ab-4128-9355-246e7a45fc91-kubelet-dir\") pod \"aws-ebs-csi-driver-node-crdb4\" (UID: \"ab52fbdf-49ab-4128-9355-246e7a45fc91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" Jul 27 16:24:26.366884 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365409 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbmlz\" (UniqueName: \"kubernetes.io/projected/561fc239-ede6-415f-ae7a-2745af950649-kube-api-access-bbmlz\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.366884 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365423 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c079aa05-1e43-4257-b459-54127b27d843-cnibin\") pod \"multus-additional-cni-plugins-b5qcd\" (UID: \"c079aa05-1e43-4257-b459-54127b27d843\") " pod="openshift-multus/multus-additional-cni-plugins-b5qcd" Jul 27 16:24:26.367865 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365428 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2db67f70-a81c-43c3-bb3c-e42540477f31-hosts-file\") pod \"node-resolver-jvxww\" (UID: \"2db67f70-a81c-43c3-bb3c-e42540477f31\") " pod="openshift-dns/node-resolver-jvxww" Jul 27 16:24:26.367865 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365436 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/22ae248d-bc07-48a7-8e01-4c9fa5f1bc99-iptables-alerter-script\") pod \"iptables-alerter-vqvbd\" (UID: \"22ae248d-bc07-48a7-8e01-4c9fa5f1bc99\") " pod="openshift-network-operator/iptables-alerter-vqvbd" Jul 27 16:24:26.367865 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365489 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ab52fbdf-49ab-4128-9355-246e7a45fc91-kubelet-dir\") pod \"aws-ebs-csi-driver-node-crdb4\" (UID: \"ab52fbdf-49ab-4128-9355-246e7a45fc91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" Jul 27 16:24:26.367865 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365522 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.367865 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365572 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ab52fbdf-49ab-4128-9355-246e7a45fc91-registration-dir\") pod \"aws-ebs-csi-driver-node-crdb4\" (UID: \"ab52fbdf-49ab-4128-9355-246e7a45fc91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" Jul 27 16:24:26.367865 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365373 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-run-systemd\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.367865 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365631 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ab52fbdf-49ab-4128-9355-246e7a45fc91-registration-dir\") pod \"aws-ebs-csi-driver-node-crdb4\" (UID: \"ab52fbdf-49ab-4128-9355-246e7a45fc91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" Jul 27 16:24:26.367865 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365671 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.367865 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365728 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxglw\" (UniqueName: \"kubernetes.io/projected/2db67f70-a81c-43c3-bb3c-e42540477f31-kube-api-access-jxglw\") pod \"node-resolver-jvxww\" (UID: \"2db67f70-a81c-43c3-bb3c-e42540477f31\") " pod="openshift-dns/node-resolver-jvxww" Jul 27 16:24:26.367865 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365782 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c079aa05-1e43-4257-b459-54127b27d843-os-release\") pod \"multus-additional-cni-plugins-b5qcd\" (UID: \"c079aa05-1e43-4257-b459-54127b27d843\") " pod="openshift-multus/multus-additional-cni-plugins-b5qcd" Jul 27 16:24:26.367865 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365831 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-run-ovn\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.367865 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365884 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ab52fbdf-49ab-4128-9355-246e7a45fc91-socket-dir\") pod \"aws-ebs-csi-driver-node-crdb4\" (UID: \"ab52fbdf-49ab-4128-9355-246e7a45fc91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" Jul 27 16:24:26.367865 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365914 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c079aa05-1e43-4257-b459-54127b27d843-system-cni-dir\") pod \"multus-additional-cni-plugins-b5qcd\" (UID: \"c079aa05-1e43-4257-b459-54127b27d843\") " pod="openshift-multus/multus-additional-cni-plugins-b5qcd" Jul 27 16:24:26.367865 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365963 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c079aa05-1e43-4257-b459-54127b27d843-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b5qcd\" (UID: \"c079aa05-1e43-4257-b459-54127b27d843\") " pod="openshift-multus/multus-additional-cni-plugins-b5qcd" Jul 27 16:24:26.367865 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.365990 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-hostroot\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.367865 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366025 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/22ae248d-bc07-48a7-8e01-4c9fa5f1bc99-iptables-alerter-script\") pod \"iptables-alerter-vqvbd\" (UID: \"22ae248d-bc07-48a7-8e01-4c9fa5f1bc99\") " pod="openshift-network-operator/iptables-alerter-vqvbd" Jul 27 16:24:26.367865 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366016 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/561fc239-ede6-415f-ae7a-2745af950649-multus-daemon-config\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.368763 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366075 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-etc-sysconfig\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.368763 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366104 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-etc-sysctl-conf\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.368763 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366136 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-var-lib-openvswitch\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.368763 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366165 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/45eeca03-5f0c-4e88-8e51-060a5e5e1e65-konnectivity-ca\") pod \"konnectivity-agent-r89j2\" (UID: \"45eeca03-5f0c-4e88-8e51-060a5e5e1e65\") " pod="kube-system/konnectivity-agent-r89j2" Jul 27 16:24:26.368763 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366191 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-host-slash\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.368763 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366240 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-host-cni-bin\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.368763 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366302 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65tj7\" (UniqueName: \"kubernetes.io/projected/ab52fbdf-49ab-4128-9355-246e7a45fc91-kube-api-access-65tj7\") pod \"aws-ebs-csi-driver-node-crdb4\" (UID: \"ab52fbdf-49ab-4128-9355-246e7a45fc91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" Jul 27 16:24:26.368763 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366328 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ab52fbdf-49ab-4128-9355-246e7a45fc91-socket-dir\") pod \"aws-ebs-csi-driver-node-crdb4\" (UID: \"ab52fbdf-49ab-4128-9355-246e7a45fc91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" Jul 27 16:24:26.368763 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366332 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2db67f70-a81c-43c3-bb3c-e42540477f31-tmp-dir\") pod \"node-resolver-jvxww\" (UID: \"2db67f70-a81c-43c3-bb3c-e42540477f31\") " pod="openshift-dns/node-resolver-jvxww" Jul 27 16:24:26.368763 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366387 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-etc-modprobe-d\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.368763 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366417 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-etc-kubernetes\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.368763 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366446 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-ovnkube-script-lib\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.368763 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366500 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smzmv\" (UniqueName: \"kubernetes.io/projected/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-kube-api-access-smzmv\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.368763 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366529 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-system-cni-dir\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.368763 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366561 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-host-var-lib-cni-multus\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.368763 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366590 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-etc-systemd\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.368763 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366630 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c53359a8-84df-4989-88b1-ae04880c1c4e-etc-tuned\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.369388 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366658 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdjkc\" (UniqueName: \"kubernetes.io/projected/7d73c7ed-f214-4fae-b194-9bae83a86b47-kube-api-access-xdjkc\") pod \"network-metrics-daemon-ttj4w\" (UID: \"7d73c7ed-f214-4fae-b194-9bae83a86b47\") " pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:26.369388 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366669 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2db67f70-a81c-43c3-bb3c-e42540477f31-tmp-dir\") pod \"node-resolver-jvxww\" (UID: \"2db67f70-a81c-43c3-bb3c-e42540477f31\") " pod="openshift-dns/node-resolver-jvxww" Jul 27 16:24:26.369388 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366690 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-host-run-netns\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.369388 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366700 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/561fc239-ede6-415f-ae7a-2745af950649-multus-daemon-config\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.369388 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366756 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-etc-sysconfig\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.369388 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366758 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-hostroot\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.369388 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366779 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-ovnkube-config\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.369388 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366799 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c079aa05-1e43-4257-b459-54127b27d843-os-release\") pod \"multus-additional-cni-plugins-b5qcd\" (UID: \"c079aa05-1e43-4257-b459-54127b27d843\") " pod="openshift-multus/multus-additional-cni-plugins-b5qcd" Jul 27 16:24:26.369388 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366815 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c079aa05-1e43-4257-b459-54127b27d843-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b5qcd\" (UID: \"c079aa05-1e43-4257-b459-54127b27d843\") " pod="openshift-multus/multus-additional-cni-plugins-b5qcd" Jul 27 16:24:26.369388 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366834 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c079aa05-1e43-4257-b459-54127b27d843-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b5qcd\" (UID: \"c079aa05-1e43-4257-b459-54127b27d843\") " pod="openshift-multus/multus-additional-cni-plugins-b5qcd" Jul 27 16:24:26.369388 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366846 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-run-ovn\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.369388 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366894 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-etc-sysctl-conf\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.369388 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366894 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c079aa05-1e43-4257-b459-54127b27d843-system-cni-dir\") pod \"multus-additional-cni-plugins-b5qcd\" (UID: \"c079aa05-1e43-4257-b459-54127b27d843\") " pod="openshift-multus/multus-additional-cni-plugins-b5qcd" Jul 27 16:24:26.369388 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366907 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-etc-kubernetes\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.369388 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366845 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-os-release\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.369388 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.366986 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/561fc239-ede6-415f-ae7a-2745af950649-cni-binary-copy\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.369388 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.367013 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-etc-sysctl-d\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.369970 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.367042 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-etc-modprobe-d\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.369970 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.367055 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7z7h\" (UniqueName: \"kubernetes.io/projected/81ef96f6-f835-4c1c-bad7-6a54c5da90c7-kube-api-access-q7z7h\") pod \"network-check-target-8pf9l\" (UID: \"81ef96f6-f835-4c1c-bad7-6a54c5da90c7\") " pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:24:26.369970 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.367083 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-systemd-units\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.369970 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.367096 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-os-release\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.369970 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.367105 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c079aa05-1e43-4257-b459-54127b27d843-cni-binary-copy\") pod \"multus-additional-cni-plugins-b5qcd\" (UID: \"c079aa05-1e43-4257-b459-54127b27d843\") " pod="openshift-multus/multus-additional-cni-plugins-b5qcd" Jul 27 16:24:26.369970 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.367129 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-host-run-netns\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.369970 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.367153 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-sys\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.369970 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.367217 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-sys\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.369970 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.367263 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-host-slash\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.369970 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.367317 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-var-lib-openvswitch\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.369970 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.367300 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-etc-sysctl-d\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.369970 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.367589 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-systemd-units\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.369970 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.367605 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/561fc239-ede6-415f-ae7a-2745af950649-cni-binary-copy\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.369970 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.367612 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c079aa05-1e43-4257-b459-54127b27d843-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b5qcd\" (UID: \"c079aa05-1e43-4257-b459-54127b27d843\") " pod="openshift-multus/multus-additional-cni-plugins-b5qcd" Jul 27 16:24:26.369970 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.367671 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-host-run-netns\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.369970 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.367941 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/45eeca03-5f0c-4e88-8e51-060a5e5e1e65-konnectivity-ca\") pod \"konnectivity-agent-r89j2\" (UID: \"45eeca03-5f0c-4e88-8e51-060a5e5e1e65\") " pod="kube-system/konnectivity-agent-r89j2" Jul 27 16:24:26.369970 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.368170 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c079aa05-1e43-4257-b459-54127b27d843-cni-binary-copy\") pod \"multus-additional-cni-plugins-b5qcd\" (UID: \"c079aa05-1e43-4257-b459-54127b27d843\") " pod="openshift-multus/multus-additional-cni-plugins-b5qcd" Jul 27 16:24:26.369970 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.368212 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-ovnkube-config\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.370560 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.368243 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-host-cni-bin\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.370560 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.368283 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c53359a8-84df-4989-88b1-ae04880c1c4e-etc-systemd\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.370560 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.368334 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-system-cni-dir\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.370560 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.368353 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-host-var-lib-cni-multus\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.370560 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.368424 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-ovnkube-script-lib\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.370560 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.368425 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg6t4\" (UniqueName: \"kubernetes.io/projected/ee20c72e-c217-455a-9560-b5ab054cf0f3-kube-api-access-lg6t4\") pod \"node-ca-2v5jv\" (UID: \"ee20c72e-c217-455a-9560-b5ab054cf0f3\") " pod="openshift-image-registry/node-ca-2v5jv" Jul 27 16:24:26.370560 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.368535 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-host-run-netns\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.370560 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.368592 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/22ae248d-bc07-48a7-8e01-4c9fa5f1bc99-host-slash\") pod \"iptables-alerter-vqvbd\" (UID: \"22ae248d-bc07-48a7-8e01-4c9fa5f1bc99\") " pod="openshift-network-operator/iptables-alerter-vqvbd" Jul 27 16:24:26.370560 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.368624 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-host-run-ovn-kubernetes\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.370560 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.368648 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/22ae248d-bc07-48a7-8e01-4c9fa5f1bc99-host-slash\") pod \"iptables-alerter-vqvbd\" (UID: \"22ae248d-bc07-48a7-8e01-4c9fa5f1bc99\") " pod="openshift-network-operator/iptables-alerter-vqvbd" Jul 27 16:24:26.370560 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.368701 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-host-run-ovn-kubernetes\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.370560 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.368723 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-multus-socket-dir-parent\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.370560 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.368782 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-ovn-node-metrics-cert\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.370560 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.368801 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c53359a8-84df-4989-88b1-ae04880c1c4e-tmp\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.370560 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.368830 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/561fc239-ede6-415f-ae7a-2745af950649-multus-socket-dir-parent\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.370560 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.368843 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/45eeca03-5f0c-4e88-8e51-060a5e5e1e65-agent-certs\") pod \"konnectivity-agent-r89j2\" (UID: \"45eeca03-5f0c-4e88-8e51-060a5e5e1e65\") " pod="kube-system/konnectivity-agent-r89j2" Jul 27 16:24:26.370560 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.370382 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c53359a8-84df-4989-88b1-ae04880c1c4e-etc-tuned\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.375882 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.375811 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-40.ec2.internal" event={"ID":"5707262778505577d5d82f3e1320d33c","Type":"ContainerStarted","Data":"4a4cb62cc7f66913ff62815785f72efe65619cc64b5d578fa99b7cbbb9d14d57"} Jul 27 16:24:26.376953 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.376907 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-40.ec2.internal" event={"ID":"9963d2b8aa04417f23f458975070b2b7","Type":"ContainerStarted","Data":"db0da9c795f6e3959698276e4c999a2835975e94a02f6f1239c6ed6f30507522"} Jul 27 16:24:26.379639 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.379618 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42f4j\" (UniqueName: \"kubernetes.io/projected/c079aa05-1e43-4257-b459-54127b27d843-kube-api-access-42f4j\") pod \"multus-additional-cni-plugins-b5qcd\" (UID: \"c079aa05-1e43-4257-b459-54127b27d843\") " pod="openshift-multus/multus-additional-cni-plugins-b5qcd" Jul 27 16:24:26.387210 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.387182 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csr5g\" (UniqueName: \"kubernetes.io/projected/22ae248d-bc07-48a7-8e01-4c9fa5f1bc99-kube-api-access-csr5g\") pod \"iptables-alerter-vqvbd\" (UID: \"22ae248d-bc07-48a7-8e01-4c9fa5f1bc99\") " pod="openshift-network-operator/iptables-alerter-vqvbd" Jul 27 16:24:26.387890 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.387872 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdjkc\" (UniqueName: \"kubernetes.io/projected/7d73c7ed-f214-4fae-b194-9bae83a86b47-kube-api-access-xdjkc\") pod \"network-metrics-daemon-ttj4w\" (UID: \"7d73c7ed-f214-4fae-b194-9bae83a86b47\") " pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:26.388901 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.388883 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbmlz\" (UniqueName: \"kubernetes.io/projected/561fc239-ede6-415f-ae7a-2745af950649-kube-api-access-bbmlz\") pod \"multus-sf2f9\" (UID: \"561fc239-ede6-415f-ae7a-2745af950649\") " pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.390634 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.390617 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxglw\" (UniqueName: \"kubernetes.io/projected/2db67f70-a81c-43c3-bb3c-e42540477f31-kube-api-access-jxglw\") pod \"node-resolver-jvxww\" (UID: \"2db67f70-a81c-43c3-bb3c-e42540477f31\") " pod="openshift-dns/node-resolver-jvxww" Jul 27 16:24:26.392153 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.392136 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xbk6\" (UniqueName: \"kubernetes.io/projected/c53359a8-84df-4989-88b1-ae04880c1c4e-kube-api-access-6xbk6\") pod \"tuned-cpjj4\" (UID: \"c53359a8-84df-4989-88b1-ae04880c1c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.393445 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.393425 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg6t4\" (UniqueName: \"kubernetes.io/projected/ee20c72e-c217-455a-9560-b5ab054cf0f3-kube-api-access-lg6t4\") pod \"node-ca-2v5jv\" (UID: \"ee20c72e-c217-455a-9560-b5ab054cf0f3\") " pod="openshift-image-registry/node-ca-2v5jv" Jul 27 16:24:26.395455 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.395435 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65tj7\" (UniqueName: \"kubernetes.io/projected/ab52fbdf-49ab-4128-9355-246e7a45fc91-kube-api-access-65tj7\") pod \"aws-ebs-csi-driver-node-crdb4\" (UID: \"ab52fbdf-49ab-4128-9355-246e7a45fc91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" Jul 27 16:24:26.396718 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:26.396699 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 16:24:26.396718 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:26.396719 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 16:24:26.396834 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:26.396729 2578 projected.go:196] Error preparing data for projected volume kube-api-access-q7z7h for pod openshift-network-diagnostics/network-check-target-8pf9l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:26.396834 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:26.396783 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81ef96f6-f835-4c1c-bad7-6a54c5da90c7-kube-api-access-q7z7h podName:81ef96f6-f835-4c1c-bad7-6a54c5da90c7 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:26.89676513 +0000 UTC m=+2.106614986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q7z7h" (UniqueName: "kubernetes.io/projected/81ef96f6-f835-4c1c-bad7-6a54c5da90c7-kube-api-access-q7z7h") pod "network-check-target-8pf9l" (UID: "81ef96f6-f835-4c1c-bad7-6a54c5da90c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:26.398693 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.398676 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smzmv\" (UniqueName: \"kubernetes.io/projected/f7c2ba5c-55aa-4741-87cc-cbb3cd80d949-kube-api-access-smzmv\") pod \"ovnkube-node-pzzjg\" (UID: \"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.505483 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.505388 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r89j2" Jul 27 16:24:26.514444 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:26.514413 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45eeca03_5f0c_4e88_8e51_060a5e5e1e65.slice/crio-57399d452e278474d67bdda89176df09f8d2968d05844dbfa2acf3aa227cc138 WatchSource:0}: Error finding container 57399d452e278474d67bdda89176df09f8d2968d05844dbfa2acf3aa227cc138: Status 404 returned error can't find the container with id 57399d452e278474d67bdda89176df09f8d2968d05844dbfa2acf3aa227cc138 Jul 27 16:24:26.527758 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.527733 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" Jul 27 16:24:26.535966 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:26.535923 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc53359a8_84df_4989_88b1_ae04880c1c4e.slice/crio-4c8f1b7554b9121e8a12950d191139a8aeabe5865c593d1533e24587108049d2 WatchSource:0}: Error finding container 4c8f1b7554b9121e8a12950d191139a8aeabe5865c593d1533e24587108049d2: Status 404 returned error can't find the container with id 4c8f1b7554b9121e8a12950d191139a8aeabe5865c593d1533e24587108049d2 Jul 27 16:24:26.556288 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.556263 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:26.565261 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:26.565230 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7c2ba5c_55aa_4741_87cc_cbb3cd80d949.slice/crio-d9dc31b7aad3c9ee835c1e005621981faf382f559f536a1f2f013c32fc65e727 WatchSource:0}: Error finding container d9dc31b7aad3c9ee835c1e005621981faf382f559f536a1f2f013c32fc65e727: Status 404 returned error can't find the container with id d9dc31b7aad3c9ee835c1e005621981faf382f559f536a1f2f013c32fc65e727 Jul 27 16:24:26.569608 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.569587 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" Jul 27 16:24:26.576882 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.576861 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jvxww" Jul 27 16:24:26.577190 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:26.577164 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab52fbdf_49ab_4128_9355_246e7a45fc91.slice/crio-ad1041b2dd4dc3cb2696ccd7f4a0f0c40d45288af934828b539b10e69266dbd6 WatchSource:0}: Error finding container ad1041b2dd4dc3cb2696ccd7f4a0f0c40d45288af934828b539b10e69266dbd6: Status 404 returned error can't find the container with id ad1041b2dd4dc3cb2696ccd7f4a0f0c40d45288af934828b539b10e69266dbd6 Jul 27 16:24:26.584746 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:26.584700 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2db67f70_a81c_43c3_bb3c_e42540477f31.slice/crio-1d47f37ccea597ef2a6c05d10b9473de1e6bd3225475d2d373cc598d51101024 WatchSource:0}: Error finding container 1d47f37ccea597ef2a6c05d10b9473de1e6bd3225475d2d373cc598d51101024: Status 404 returned error can't find the container with id 1d47f37ccea597ef2a6c05d10b9473de1e6bd3225475d2d373cc598d51101024 Jul 27 16:24:26.593879 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.593429 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2v5jv" Jul 27 16:24:26.601150 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:26.601124 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee20c72e_c217_455a_9560_b5ab054cf0f3.slice/crio-fc8bb30f9374d18f11181d3b352c2d20a6430d04d882b8920f3bc968f722e1e0 WatchSource:0}: Error finding container fc8bb30f9374d18f11181d3b352c2d20a6430d04d882b8920f3bc968f722e1e0: Status 404 returned error can't find the container with id fc8bb30f9374d18f11181d3b352c2d20a6430d04d882b8920f3bc968f722e1e0 Jul 27 16:24:26.627605 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.627574 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b5qcd" Jul 27 16:24:26.632742 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.632708 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 16:24:26.635522 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:26.635499 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc079aa05_1e43_4257_b459_54127b27d843.slice/crio-c20fbc3289baa6efae4f8f00931bb896f315a4445b3cc02218d3a0fe1dcfddd2 WatchSource:0}: Error finding container c20fbc3289baa6efae4f8f00931bb896f315a4445b3cc02218d3a0fe1dcfddd2: Status 404 returned error can't find the container with id c20fbc3289baa6efae4f8f00931bb896f315a4445b3cc02218d3a0fe1dcfddd2 Jul 27 16:24:26.635888 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.635862 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 16:24:26.651677 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.651655 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sf2f9" Jul 27 16:24:26.657411 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.657392 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vqvbd" Jul 27 16:24:26.660072 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:26.660047 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod561fc239_ede6_415f_ae7a_2745af950649.slice/crio-44157cb9bbb1031b95e564ff6241c3df901a8091bd7d50695f5e1b0f4708a663 WatchSource:0}: Error finding container 44157cb9bbb1031b95e564ff6241c3df901a8091bd7d50695f5e1b0f4708a663: Status 404 returned error can't find the container with id 44157cb9bbb1031b95e564ff6241c3df901a8091bd7d50695f5e1b0f4708a663 Jul 27 16:24:26.665097 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:24:26.665071 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22ae248d_bc07_48a7_8e01_4c9fa5f1bc99.slice/crio-1863f64c01da484a12880fcc29bfb619078f027069c3627b13b026f75a5455ee WatchSource:0}: Error finding container 1863f64c01da484a12880fcc29bfb619078f027069c3627b13b026f75a5455ee: Status 404 returned error can't find the container with id 1863f64c01da484a12880fcc29bfb619078f027069c3627b13b026f75a5455ee Jul 27 16:24:26.872499 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.872403 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-original-pull-secret\") pod \"global-pull-secret-syncer-qgww4\" (UID: \"d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d\") " pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:26.872499 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.872438 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs\") pod \"network-metrics-daemon-ttj4w\" (UID: \"7d73c7ed-f214-4fae-b194-9bae83a86b47\") " pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:26.872687 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:26.872552 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:26.872687 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:26.872608 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs podName:7d73c7ed-f214-4fae-b194-9bae83a86b47 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:27.872591122 +0000 UTC m=+3.082440978 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs") pod "network-metrics-daemon-ttj4w" (UID: "7d73c7ed-f214-4fae-b194-9bae83a86b47") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:26.872687 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:26.872552 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:26.872795 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:26.872698 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-original-pull-secret podName:d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d nodeName:}" failed. No retries permitted until 2026-07-27 16:24:27.872679534 +0000 UTC m=+3.082529386 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-original-pull-secret") pod "global-pull-secret-syncer-qgww4" (UID: "d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d") : object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:26.972906 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:26.972843 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7z7h\" (UniqueName: \"kubernetes.io/projected/81ef96f6-f835-4c1c-bad7-6a54c5da90c7-kube-api-access-q7z7h\") pod \"network-check-target-8pf9l\" (UID: \"81ef96f6-f835-4c1c-bad7-6a54c5da90c7\") " pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:24:26.973083 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:26.973026 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 16:24:26.973083 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:26.973048 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 16:24:26.973083 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:26.973061 2578 projected.go:196] Error preparing data for projected volume kube-api-access-q7z7h for pod openshift-network-diagnostics/network-check-target-8pf9l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:26.973226 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:26.973124 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81ef96f6-f835-4c1c-bad7-6a54c5da90c7-kube-api-access-q7z7h podName:81ef96f6-f835-4c1c-bad7-6a54c5da90c7 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:27.973104097 +0000 UTC m=+3.182953956 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-q7z7h" (UniqueName: "kubernetes.io/projected/81ef96f6-f835-4c1c-bad7-6a54c5da90c7-kube-api-access-q7z7h") pod "network-check-target-8pf9l" (UID: "81ef96f6-f835-4c1c-bad7-6a54c5da90c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:27.044004 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:27.043970 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 16:24:27.237970 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:27.237772 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 16:19:26 +0000 UTC" deadline="2028-05-12 04:04:57.633382714 +0000 UTC" Jul 27 16:24:27.237970 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:27.237835 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15707h40m30.395551483s" Jul 27 16:24:27.375444 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:27.374765 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:27.375444 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:27.374932 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgww4" podUID="d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d" Jul 27 16:24:27.384356 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:27.384319 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2v5jv" event={"ID":"ee20c72e-c217-455a-9560-b5ab054cf0f3","Type":"ContainerStarted","Data":"fc8bb30f9374d18f11181d3b352c2d20a6430d04d882b8920f3bc968f722e1e0"} Jul 27 16:24:27.387758 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:27.387714 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jvxww" event={"ID":"2db67f70-a81c-43c3-bb3c-e42540477f31","Type":"ContainerStarted","Data":"1d47f37ccea597ef2a6c05d10b9473de1e6bd3225475d2d373cc598d51101024"} Jul 27 16:24:27.389915 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:27.389874 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" event={"ID":"ab52fbdf-49ab-4128-9355-246e7a45fc91","Type":"ContainerStarted","Data":"ad1041b2dd4dc3cb2696ccd7f4a0f0c40d45288af934828b539b10e69266dbd6"} Jul 27 16:24:27.393743 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:27.393587 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" event={"ID":"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949","Type":"ContainerStarted","Data":"d9dc31b7aad3c9ee835c1e005621981faf382f559f536a1f2f013c32fc65e727"} Jul 27 16:24:27.398019 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:27.397973 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vqvbd" event={"ID":"22ae248d-bc07-48a7-8e01-4c9fa5f1bc99","Type":"ContainerStarted","Data":"1863f64c01da484a12880fcc29bfb619078f027069c3627b13b026f75a5455ee"} Jul 27 16:24:27.404435 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:27.404391 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sf2f9" event={"ID":"561fc239-ede6-415f-ae7a-2745af950649","Type":"ContainerStarted","Data":"44157cb9bbb1031b95e564ff6241c3df901a8091bd7d50695f5e1b0f4708a663"} Jul 27 16:24:27.415693 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:27.415644 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5qcd" event={"ID":"c079aa05-1e43-4257-b459-54127b27d843","Type":"ContainerStarted","Data":"c20fbc3289baa6efae4f8f00931bb896f315a4445b3cc02218d3a0fe1dcfddd2"} Jul 27 16:24:27.419542 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:27.419496 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" event={"ID":"c53359a8-84df-4989-88b1-ae04880c1c4e","Type":"ContainerStarted","Data":"4c8f1b7554b9121e8a12950d191139a8aeabe5865c593d1533e24587108049d2"} Jul 27 16:24:27.422767 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:27.422724 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r89j2" event={"ID":"45eeca03-5f0c-4e88-8e51-060a5e5e1e65","Type":"ContainerStarted","Data":"57399d452e278474d67bdda89176df09f8d2968d05844dbfa2acf3aa227cc138"} Jul 27 16:24:27.882699 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:27.882650 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-original-pull-secret\") pod \"global-pull-secret-syncer-qgww4\" (UID: \"d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d\") " pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:27.882902 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:27.882723 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs\") pod \"network-metrics-daemon-ttj4w\" (UID: \"7d73c7ed-f214-4fae-b194-9bae83a86b47\") " pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:27.887618 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:27.887580 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:27.887778 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:27.887699 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-original-pull-secret podName:d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d nodeName:}" failed. No retries permitted until 2026-07-27 16:24:29.887672517 +0000 UTC m=+5.097522382 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-original-pull-secret") pod "global-pull-secret-syncer-qgww4" (UID: "d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d") : object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:27.888177 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:27.888142 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:27.888275 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:27.888229 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs podName:7d73c7ed-f214-4fae-b194-9bae83a86b47 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:29.8882103 +0000 UTC m=+5.098060160 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs") pod "network-metrics-daemon-ttj4w" (UID: "7d73c7ed-f214-4fae-b194-9bae83a86b47") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:27.983795 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:27.983752 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7z7h\" (UniqueName: \"kubernetes.io/projected/81ef96f6-f835-4c1c-bad7-6a54c5da90c7-kube-api-access-q7z7h\") pod \"network-check-target-8pf9l\" (UID: \"81ef96f6-f835-4c1c-bad7-6a54c5da90c7\") " pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:24:27.984016 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:27.983955 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 16:24:27.984016 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:27.983978 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 16:24:27.984016 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:27.983992 2578 projected.go:196] Error preparing data for projected volume kube-api-access-q7z7h for pod openshift-network-diagnostics/network-check-target-8pf9l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:27.984186 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:27.984060 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81ef96f6-f835-4c1c-bad7-6a54c5da90c7-kube-api-access-q7z7h podName:81ef96f6-f835-4c1c-bad7-6a54c5da90c7 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:29.984039668 +0000 UTC m=+5.193889522 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-q7z7h" (UniqueName: "kubernetes.io/projected/81ef96f6-f835-4c1c-bad7-6a54c5da90c7-kube-api-access-q7z7h") pod "network-check-target-8pf9l" (UID: "81ef96f6-f835-4c1c-bad7-6a54c5da90c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:28.239478 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:28.238640 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 16:19:26 +0000 UTC" deadline="2028-01-20 08:05:21.153171886 +0000 UTC" Jul 27 16:24:28.239478 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:28.238706 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12999h40m52.914470304s" Jul 27 16:24:28.373565 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:28.372809 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:28.373565 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:28.372865 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:24:28.373565 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:28.372983 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ttj4w" podUID="7d73c7ed-f214-4fae-b194-9bae83a86b47" Jul 27 16:24:28.373565 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:28.373489 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pf9l" podUID="81ef96f6-f835-4c1c-bad7-6a54c5da90c7" Jul 27 16:24:29.275574 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:29.275482 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 16:24:29.372092 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:29.372062 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:29.372285 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:29.372192 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgww4" podUID="d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d" Jul 27 16:24:29.900706 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:29.900656 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-original-pull-secret\") pod \"global-pull-secret-syncer-qgww4\" (UID: \"d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d\") " pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:29.900706 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:29.900713 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs\") pod \"network-metrics-daemon-ttj4w\" (UID: \"7d73c7ed-f214-4fae-b194-9bae83a86b47\") " pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:29.901031 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:29.900844 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:29.901031 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:29.900927 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs podName:7d73c7ed-f214-4fae-b194-9bae83a86b47 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:33.900905591 +0000 UTC m=+9.110755443 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs") pod "network-metrics-daemon-ttj4w" (UID: "7d73c7ed-f214-4fae-b194-9bae83a86b47") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:29.901151 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:29.901043 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:29.901151 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:29.901111 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-original-pull-secret podName:d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d nodeName:}" failed. No retries permitted until 2026-07-27 16:24:33.901091493 +0000 UTC m=+9.110941350 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-original-pull-secret") pod "global-pull-secret-syncer-qgww4" (UID: "d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d") : object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:30.001904 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:30.001849 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7z7h\" (UniqueName: \"kubernetes.io/projected/81ef96f6-f835-4c1c-bad7-6a54c5da90c7-kube-api-access-q7z7h\") pod \"network-check-target-8pf9l\" (UID: \"81ef96f6-f835-4c1c-bad7-6a54c5da90c7\") " pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:24:30.002178 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:30.002158 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 16:24:30.002264 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:30.002186 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 16:24:30.002264 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:30.002200 2578 projected.go:196] Error preparing data for projected volume kube-api-access-q7z7h for pod openshift-network-diagnostics/network-check-target-8pf9l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:30.002264 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:30.002262 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81ef96f6-f835-4c1c-bad7-6a54c5da90c7-kube-api-access-q7z7h podName:81ef96f6-f835-4c1c-bad7-6a54c5da90c7 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:34.002242945 +0000 UTC m=+9.212092796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-q7z7h" (UniqueName: "kubernetes.io/projected/81ef96f6-f835-4c1c-bad7-6a54c5da90c7-kube-api-access-q7z7h") pod "network-check-target-8pf9l" (UID: "81ef96f6-f835-4c1c-bad7-6a54c5da90c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:30.372952 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:30.372835 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:24:30.373460 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:30.373010 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pf9l" podUID="81ef96f6-f835-4c1c-bad7-6a54c5da90c7" Jul 27 16:24:30.373460 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:30.373426 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:30.373578 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:30.373538 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ttj4w" podUID="7d73c7ed-f214-4fae-b194-9bae83a86b47" Jul 27 16:24:31.373697 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:31.373067 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:31.373697 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:31.373267 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgww4" podUID="d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d" Jul 27 16:24:32.372928 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:32.372893 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:24:32.373122 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:32.373029 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pf9l" podUID="81ef96f6-f835-4c1c-bad7-6a54c5da90c7" Jul 27 16:24:32.373285 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:32.373266 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:32.373443 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:32.373424 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ttj4w" podUID="7d73c7ed-f214-4fae-b194-9bae83a86b47" Jul 27 16:24:33.372370 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:33.372334 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:33.372734 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:33.372458 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgww4" podUID="d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d" Jul 27 16:24:33.937640 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:33.937599 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-original-pull-secret\") pod \"global-pull-secret-syncer-qgww4\" (UID: \"d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d\") " pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:33.937640 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:33.937656 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs\") pod \"network-metrics-daemon-ttj4w\" (UID: \"7d73c7ed-f214-4fae-b194-9bae83a86b47\") " pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:33.937934 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:33.937825 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:33.937934 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:33.937901 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs podName:7d73c7ed-f214-4fae-b194-9bae83a86b47 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:41.937870532 +0000 UTC m=+17.147720401 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs") pod "network-metrics-daemon-ttj4w" (UID: "7d73c7ed-f214-4fae-b194-9bae83a86b47") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:33.938299 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:33.938197 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:33.938299 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:33.938276 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-original-pull-secret podName:d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d nodeName:}" failed. No retries permitted until 2026-07-27 16:24:41.938256473 +0000 UTC m=+17.148106330 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-original-pull-secret") pod "global-pull-secret-syncer-qgww4" (UID: "d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d") : object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:34.038205 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:34.038156 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7z7h\" (UniqueName: \"kubernetes.io/projected/81ef96f6-f835-4c1c-bad7-6a54c5da90c7-kube-api-access-q7z7h\") pod \"network-check-target-8pf9l\" (UID: \"81ef96f6-f835-4c1c-bad7-6a54c5da90c7\") " pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:24:34.038412 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:34.038363 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 16:24:34.038412 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:34.038391 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 16:24:34.038412 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:34.038407 2578 projected.go:196] Error preparing data for projected volume kube-api-access-q7z7h for pod openshift-network-diagnostics/network-check-target-8pf9l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:34.038597 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:34.038483 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81ef96f6-f835-4c1c-bad7-6a54c5da90c7-kube-api-access-q7z7h podName:81ef96f6-f835-4c1c-bad7-6a54c5da90c7 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:42.038460419 +0000 UTC m=+17.248310292 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-q7z7h" (UniqueName: "kubernetes.io/projected/81ef96f6-f835-4c1c-bad7-6a54c5da90c7-kube-api-access-q7z7h") pod "network-check-target-8pf9l" (UID: "81ef96f6-f835-4c1c-bad7-6a54c5da90c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:34.372203 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:34.372111 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:34.372392 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:34.372287 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ttj4w" podUID="7d73c7ed-f214-4fae-b194-9bae83a86b47" Jul 27 16:24:34.372392 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:34.372362 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:24:34.372831 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:34.372436 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pf9l" podUID="81ef96f6-f835-4c1c-bad7-6a54c5da90c7" Jul 27 16:24:35.373843 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:35.373750 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:35.374326 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:35.373877 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgww4" podUID="d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d" Jul 27 16:24:36.372826 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:36.372743 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:36.373003 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:36.372907 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ttj4w" podUID="7d73c7ed-f214-4fae-b194-9bae83a86b47" Jul 27 16:24:36.373311 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:36.373289 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:24:36.373414 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:36.373393 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pf9l" podUID="81ef96f6-f835-4c1c-bad7-6a54c5da90c7" Jul 27 16:24:37.372758 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:37.372719 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:37.373259 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:37.372831 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgww4" podUID="d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d" Jul 27 16:24:38.371828 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:38.371798 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:24:38.371997 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:38.371834 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:38.371997 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:38.371948 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pf9l" podUID="81ef96f6-f835-4c1c-bad7-6a54c5da90c7" Jul 27 16:24:38.372085 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:38.372043 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ttj4w" podUID="7d73c7ed-f214-4fae-b194-9bae83a86b47" Jul 27 16:24:39.372401 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:39.372361 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:39.372891 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:39.372501 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgww4" podUID="d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d" Jul 27 16:24:40.372921 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:40.372882 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:24:40.373400 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:40.372891 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:40.373400 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:40.373008 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pf9l" podUID="81ef96f6-f835-4c1c-bad7-6a54c5da90c7" Jul 27 16:24:40.373400 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:40.373129 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ttj4w" podUID="7d73c7ed-f214-4fae-b194-9bae83a86b47" Jul 27 16:24:41.371955 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:41.371914 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:41.372151 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:41.372055 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgww4" podUID="d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d" Jul 27 16:24:42.000105 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:42.000056 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-original-pull-secret\") pod \"global-pull-secret-syncer-qgww4\" (UID: \"d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d\") " pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:42.000105 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:42.000104 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs\") pod \"network-metrics-daemon-ttj4w\" (UID: \"7d73c7ed-f214-4fae-b194-9bae83a86b47\") " pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:42.000695 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:42.000237 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:42.000695 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:42.000237 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:42.000695 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:42.000324 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs podName:7d73c7ed-f214-4fae-b194-9bae83a86b47 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:58.000300294 +0000 UTC m=+33.210150169 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs") pod "network-metrics-daemon-ttj4w" (UID: "7d73c7ed-f214-4fae-b194-9bae83a86b47") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:42.000695 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:42.000362 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-original-pull-secret podName:d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d nodeName:}" failed. No retries permitted until 2026-07-27 16:24:58.000343367 +0000 UTC m=+33.210193241 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-original-pull-secret") pod "global-pull-secret-syncer-qgww4" (UID: "d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d") : object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:42.101245 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:42.101206 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7z7h\" (UniqueName: \"kubernetes.io/projected/81ef96f6-f835-4c1c-bad7-6a54c5da90c7-kube-api-access-q7z7h\") pod \"network-check-target-8pf9l\" (UID: \"81ef96f6-f835-4c1c-bad7-6a54c5da90c7\") " pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:24:42.101430 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:42.101407 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 16:24:42.101484 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:42.101437 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 16:24:42.101484 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:42.101452 2578 projected.go:196] Error preparing data for projected volume kube-api-access-q7z7h for pod openshift-network-diagnostics/network-check-target-8pf9l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:42.101548 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:42.101516 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81ef96f6-f835-4c1c-bad7-6a54c5da90c7-kube-api-access-q7z7h podName:81ef96f6-f835-4c1c-bad7-6a54c5da90c7 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:58.101496054 +0000 UTC m=+33.311345908 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-q7z7h" (UniqueName: "kubernetes.io/projected/81ef96f6-f835-4c1c-bad7-6a54c5da90c7-kube-api-access-q7z7h") pod "network-check-target-8pf9l" (UID: "81ef96f6-f835-4c1c-bad7-6a54c5da90c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:42.372772 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:42.372681 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:42.372772 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:42.372726 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:24:42.373004 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:42.372810 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ttj4w" podUID="7d73c7ed-f214-4fae-b194-9bae83a86b47" Jul 27 16:24:42.373004 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:42.372947 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pf9l" podUID="81ef96f6-f835-4c1c-bad7-6a54c5da90c7" Jul 27 16:24:43.372533 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:43.372496 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:43.372917 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:43.372639 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgww4" podUID="d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d" Jul 27 16:24:44.372223 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:44.372173 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:44.372223 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:44.372209 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:24:44.372445 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:44.372325 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ttj4w" podUID="7d73c7ed-f214-4fae-b194-9bae83a86b47" Jul 27 16:24:44.372502 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:44.372450 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pf9l" podUID="81ef96f6-f835-4c1c-bad7-6a54c5da90c7" Jul 27 16:24:45.372664 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:45.372633 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:45.373130 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:45.372733 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgww4" podUID="d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d" Jul 27 16:24:46.372890 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:46.372831 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:24:46.373283 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:46.372831 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:46.373283 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:46.372993 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pf9l" podUID="81ef96f6-f835-4c1c-bad7-6a54c5da90c7" Jul 27 16:24:46.373283 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:46.373043 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ttj4w" podUID="7d73c7ed-f214-4fae-b194-9bae83a86b47" Jul 27 16:24:47.372202 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:47.371910 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:47.372347 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:47.372283 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgww4" podUID="d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d" Jul 27 16:24:47.469346 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:47.469309 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sf2f9" event={"ID":"561fc239-ede6-415f-ae7a-2745af950649","Type":"ContainerStarted","Data":"20e208ed0a55f958d701f586baf085ecb58f5daecabc4544fa82ea1cc7f05bd3"} Jul 27 16:24:47.470740 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:47.470709 2578 generic.go:356] "Generic (PLEG): container finished" podID="c079aa05-1e43-4257-b459-54127b27d843" containerID="cc587daf654ba17079cae4c2435cd69fbc30756759d0583cce92edab6623d33c" exitCode=0 Jul 27 16:24:47.470824 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:47.470777 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5qcd" event={"ID":"c079aa05-1e43-4257-b459-54127b27d843","Type":"ContainerDied","Data":"cc587daf654ba17079cae4c2435cd69fbc30756759d0583cce92edab6623d33c"} Jul 27 16:24:47.472403 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:47.472377 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" event={"ID":"c53359a8-84df-4989-88b1-ae04880c1c4e","Type":"ContainerStarted","Data":"4da0bf3024adeccf759980a85893e07dd1eacd7821265a28564c56a52a55f6d2"} Jul 27 16:24:47.474023 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:47.473994 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r89j2" event={"ID":"45eeca03-5f0c-4e88-8e51-060a5e5e1e65","Type":"ContainerStarted","Data":"9d2a97e2168b0654198b91d3d12c0e085f9c8a27045a9346a335cf0b774e79c7"} Jul 27 16:24:47.475196 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:47.475173 2578 generic.go:356] "Generic (PLEG): container finished" podID="9963d2b8aa04417f23f458975070b2b7" containerID="a3e1216e2a92a43f7b364f05119738713c3b00e5268b1e3f1da2644327b2dbbe" exitCode=0 Jul 27 16:24:47.475332 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:47.475244 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-40.ec2.internal" event={"ID":"9963d2b8aa04417f23f458975070b2b7","Type":"ContainerDied","Data":"a3e1216e2a92a43f7b364f05119738713c3b00e5268b1e3f1da2644327b2dbbe"} Jul 27 16:24:47.476531 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:47.476512 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2v5jv" event={"ID":"ee20c72e-c217-455a-9560-b5ab054cf0f3","Type":"ContainerStarted","Data":"65573ce59607ce5f2c433060a3a47296574d997fb2fb7fbf179c26b8950b7461"} Jul 27 16:24:47.477746 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:47.477728 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jvxww" event={"ID":"2db67f70-a81c-43c3-bb3c-e42540477f31","Type":"ContainerStarted","Data":"ede59705dea20fade8ec71c1f95d0d45003d08ac2f1620330a1f00f9fe64af8c"} Jul 27 16:24:47.478950 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:47.478931 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" event={"ID":"ab52fbdf-49ab-4128-9355-246e7a45fc91","Type":"ContainerStarted","Data":"dd8aaf9395f3434e923b156a8946230fefe6d7ba0cb48b6aa1486c88c1c347d2"} Jul 27 16:24:47.480647 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:47.480631 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" event={"ID":"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949","Type":"ContainerStarted","Data":"0c163ededf6338e91363dfe98a5e75af1087d52c223a8d4d115be21cdf3fa0a5"} Jul 27 16:24:47.480715 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:47.480681 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" event={"ID":"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949","Type":"ContainerStarted","Data":"9caaf3a54bd794df53b1e0aa343806a10ba9f54a55ca0a9f6b9a19426b1b65b5"} Jul 27 16:24:47.480759 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:47.480726 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" event={"ID":"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949","Type":"ContainerStarted","Data":"eaa964889d5d10bd60cab71f1cb3cd56aa7e6634f11de8aa994fa15ab12f956e"} Jul 27 16:24:47.481909 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:47.481891 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-40.ec2.internal" event={"ID":"5707262778505577d5d82f3e1320d33c","Type":"ContainerStarted","Data":"874724fb22e970fbd54542a051185ef5422dff478714215ec579da364a82f7f7"} Jul 27 16:24:47.492678 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:47.492640 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sf2f9" podStartSLOduration=1.462693433 podStartE2EDuration="21.49262816s" totalImagesPullingTime="20.029934727s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:24:47.492573226 +0000 UTC m=+22.702423098" watchObservedRunningTime="2026-07-27 16:24:47.49262816 +0000 UTC m=+22.702478032" Jul 27 16:24:47.562937 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:47.562652 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r89j2" podStartSLOduration=9.572871668 podStartE2EDuration="21.562633516s" totalImagesPullingTime="11.989761848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:24:47.562508244 +0000 UTC m=+22.772358115" watchObservedRunningTime="2026-07-27 16:24:47.562633516 +0000 UTC m=+22.772483391" Jul 27 16:24:47.591364 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:47.591319 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cpjj4" podStartSLOduration=1.449612077 podStartE2EDuration="21.591302951s" totalImagesPullingTime="20.141690874s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:24:47.590754875 +0000 UTC m=+22.800604750" watchObservedRunningTime="2026-07-27 16:24:47.591302951 +0000 UTC m=+22.801152823" Jul 27 16:24:47.620353 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:47.620312 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2v5jv" podStartSLOduration=1.544713389 podStartE2EDuration="21.620295998s" totalImagesPullingTime="20.075582609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:24:47.619732293 +0000 UTC m=+22.829582174" watchObservedRunningTime="2026-07-27 16:24:47.620295998 +0000 UTC m=+22.830145892" Jul 27 16:24:47.640373 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:47.640329 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-40.ec2.internal" podStartSLOduration=21.64031395 podStartE2EDuration="21.64031395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:24:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:24:47.639497558 +0000 UTC m=+22.849347432" watchObservedRunningTime="2026-07-27 16:24:47.64031395 +0000 UTC m=+22.850163821" Jul 27 16:24:47.660877 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:47.660822 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jvxww" podStartSLOduration=1.569393185 podStartE2EDuration="21.660807067s" totalImagesPullingTime="20.091413882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:24:47.660665994 +0000 UTC m=+22.870515865" watchObservedRunningTime="2026-07-27 16:24:47.660807067 +0000 UTC m=+22.870656939" Jul 27 16:24:48.372914 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:48.372885 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:48.373121 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:48.372922 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:24:48.373121 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:48.373031 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ttj4w" podUID="7d73c7ed-f214-4fae-b194-9bae83a86b47" Jul 27 16:24:48.373249 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:48.373129 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pf9l" podUID="81ef96f6-f835-4c1c-bad7-6a54c5da90c7" Jul 27 16:24:48.485412 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:48.485313 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r89j2" Jul 27 16:24:48.486109 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:48.486081 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vqvbd" event={"ID":"22ae248d-bc07-48a7-8e01-4c9fa5f1bc99","Type":"ContainerStarted","Data":"05f3f816cd1bc20a06bd4c67d725be05b6b4fd91448a9ec0f0c488784fd342c0"} Jul 27 16:24:48.486219 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:48.486185 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r89j2" Jul 27 16:24:48.488747 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:48.488679 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-40.ec2.internal" event={"ID":"9963d2b8aa04417f23f458975070b2b7","Type":"ContainerStarted","Data":"3647458125cfedc8b3b04366f8356a2bd13eabf683ca4afc41011643372a6dc7"} Jul 27 16:24:48.491992 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:48.491966 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" event={"ID":"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949","Type":"ContainerStarted","Data":"6ed14a97dff2d32d56646b38b6e2eddaae597c3ac163b08666c18104b42b82d0"} Jul 27 16:24:48.492078 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:48.492049 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" event={"ID":"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949","Type":"ContainerStarted","Data":"03e9ef6d7be649b608938d649b45e31167e20f31d2fdcaf7b556dababd2e9a4b"} Jul 27 16:24:48.492130 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:48.492098 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" event={"ID":"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949","Type":"ContainerStarted","Data":"05548c0294d3950949cb88976f9739b80a0e4915f8f839f7ad1727924d8e9161"} Jul 27 16:24:48.492923 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:48.492896 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r89j2" Jul 27 16:24:48.493584 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:48.493566 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r89j2" Jul 27 16:24:48.506127 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:48.506083 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vqvbd" podStartSLOduration=2.494930198 podStartE2EDuration="22.506064595s" totalImagesPullingTime="20.011134397s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:24:48.50594562 +0000 UTC m=+23.715795493" watchObservedRunningTime="2026-07-27 16:24:48.506064595 +0000 UTC m=+23.715914468" Jul 27 16:24:48.555309 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:48.555251 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-40.ec2.internal" podStartSLOduration=22.555227844 podStartE2EDuration="22.555227844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:24:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:24:48.537756919 +0000 UTC m=+23.747606790" watchObservedRunningTime="2026-07-27 16:24:48.555227844 +0000 UTC m=+23.765077719" Jul 27 16:24:48.559507 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:48.559483 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 27 16:24:49.230736 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:49.230626 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T16:24:48.559499376Z","UUID":"ec4d4105-deaa-4e75-9c6a-aebcec27f0a9","Handler":null,"Name":"","Endpoint":""} Jul 27 16:24:49.232297 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:49.232236 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 27 16:24:49.232297 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:49.232298 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 27 16:24:49.372878 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:49.372834 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:49.373056 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:49.372967 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgww4" podUID="d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d" Jul 27 16:24:49.496878 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:49.496772 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" event={"ID":"ab52fbdf-49ab-4128-9355-246e7a45fc91","Type":"ContainerStarted","Data":"e897b47b2961156a85c6e2adf5ef3cac051e725619dc013cfec96e694412bb84"} Jul 27 16:24:50.372039 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:50.372011 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:50.372039 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:50.372034 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:24:50.372330 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:50.372132 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ttj4w" podUID="7d73c7ed-f214-4fae-b194-9bae83a86b47" Jul 27 16:24:50.372330 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:50.372245 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pf9l" podUID="81ef96f6-f835-4c1c-bad7-6a54c5da90c7" Jul 27 16:24:50.503194 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:50.503149 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" event={"ID":"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949","Type":"ContainerStarted","Data":"434d8da9566e6765776355bb72e06241b00948146393340ac12d9f82d3550a78"} Jul 27 16:24:51.372058 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:51.372028 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:51.372236 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:51.372145 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgww4" podUID="d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d" Jul 27 16:24:52.372752 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:52.372580 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:52.373338 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:52.372630 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:24:52.373338 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:52.372838 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ttj4w" podUID="7d73c7ed-f214-4fae-b194-9bae83a86b47" Jul 27 16:24:52.373338 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:52.372928 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pf9l" podUID="81ef96f6-f835-4c1c-bad7-6a54c5da90c7" Jul 27 16:24:52.510458 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:52.510424 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" event={"ID":"ab52fbdf-49ab-4128-9355-246e7a45fc91","Type":"ContainerStarted","Data":"27877620e529b8e0d56a1bfedbace1f5fdf6a8329a5c3a4c97575d2d5ee50f23"} Jul 27 16:24:52.514179 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:52.514150 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" event={"ID":"f7c2ba5c-55aa-4741-87cc-cbb3cd80d949","Type":"ContainerStarted","Data":"67c7b4e163a27150d9edff9bca7b65674185e7150231697627c79be5b607f145"} Jul 27 16:24:52.514403 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:52.514384 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:52.514551 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:52.514464 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:52.516164 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:52.516140 2578 generic.go:356] "Generic (PLEG): container finished" podID="c079aa05-1e43-4257-b459-54127b27d843" containerID="32e52b43035871b8b4db078afdc488d9e006695dfdf90dfb7b6da73657b9dd37" exitCode=0 Jul 27 16:24:52.516255 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:52.516176 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5qcd" event={"ID":"c079aa05-1e43-4257-b459-54127b27d843","Type":"ContainerDied","Data":"32e52b43035871b8b4db078afdc488d9e006695dfdf90dfb7b6da73657b9dd37"} Jul 27 16:24:52.529964 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:52.529920 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdb4" podStartSLOduration=2.131451259 podStartE2EDuration="26.52990132s" totalImagesPullingTime="24.398450061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:24:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:24:52.529369168 +0000 UTC m=+27.739219040" watchObservedRunningTime="2026-07-27 16:24:52.52990132 +0000 UTC m=+27.739751220" Jul 27 16:24:52.530517 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:52.530501 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:52.558854 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:52.558793 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" podStartSLOduration=6.040266723 podStartE2EDuration="26.558778939s" totalImagesPullingTime="20.518512216s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:24:52.558387851 +0000 UTC m=+27.768237722" watchObservedRunningTime="2026-07-27 16:24:52.558778939 +0000 UTC m=+27.768628811" Jul 27 16:24:53.372373 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:53.372334 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:53.372585 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:53.372469 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgww4" podUID="d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d" Jul 27 16:24:53.519352 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:53.519264 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:53.534681 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:53.534655 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:24:54.084234 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:54.084004 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qgww4"] Jul 27 16:24:54.084388 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:54.084288 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:54.084456 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:54.084399 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgww4" podUID="d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d" Jul 27 16:24:54.086219 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:54.086196 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8pf9l"] Jul 27 16:24:54.086338 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:54.086290 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:24:54.086389 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:54.086378 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pf9l" podUID="81ef96f6-f835-4c1c-bad7-6a54c5da90c7" Jul 27 16:24:54.086965 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:54.086938 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ttj4w"] Jul 27 16:24:54.087074 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:54.087061 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:54.087178 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:54.087157 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ttj4w" podUID="7d73c7ed-f214-4fae-b194-9bae83a86b47" Jul 27 16:24:54.523290 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:54.523201 2578 generic.go:356] "Generic (PLEG): container finished" podID="c079aa05-1e43-4257-b459-54127b27d843" containerID="fd232d98f0ec020641d9dbd1ea9a7042aeb1eda00579248636106a3496393dbc" exitCode=0 Jul 27 16:24:54.523723 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:54.523289 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5qcd" event={"ID":"c079aa05-1e43-4257-b459-54127b27d843","Type":"ContainerDied","Data":"fd232d98f0ec020641d9dbd1ea9a7042aeb1eda00579248636106a3496393dbc"} Jul 27 16:24:55.374974 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:55.374952 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:24:55.375122 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:55.375040 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pf9l" podUID="81ef96f6-f835-4c1c-bad7-6a54c5da90c7" Jul 27 16:24:56.372394 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:56.372318 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:56.372753 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:56.372331 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:56.372753 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:56.372473 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ttj4w" podUID="7d73c7ed-f214-4fae-b194-9bae83a86b47" Jul 27 16:24:56.372753 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:56.372581 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgww4" podUID="d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d" Jul 27 16:24:56.531347 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:56.531177 2578 generic.go:356] "Generic (PLEG): container finished" podID="c079aa05-1e43-4257-b459-54127b27d843" containerID="a1a120a38506e735be70d2084948b320ebb4713252e57a0d9a3042b0680d0a8b" exitCode=0 Jul 27 16:24:56.531511 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:56.531258 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5qcd" event={"ID":"c079aa05-1e43-4257-b459-54127b27d843","Type":"ContainerDied","Data":"a1a120a38506e735be70d2084948b320ebb4713252e57a0d9a3042b0680d0a8b"} Jul 27 16:24:57.372837 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:57.372807 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:24:57.373326 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:57.372948 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pf9l" podUID="81ef96f6-f835-4c1c-bad7-6a54c5da90c7" Jul 27 16:24:58.015858 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:58.015804 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-original-pull-secret\") pod \"global-pull-secret-syncer-qgww4\" (UID: \"d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d\") " pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:58.016048 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:58.015881 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs\") pod \"network-metrics-daemon-ttj4w\" (UID: \"7d73c7ed-f214-4fae-b194-9bae83a86b47\") " pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:58.016048 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:58.015984 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:58.016048 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:58.015986 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:58.016199 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:58.016053 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs podName:7d73c7ed-f214-4fae-b194-9bae83a86b47 nodeName:}" failed. No retries permitted until 2026-07-27 16:25:30.016033431 +0000 UTC m=+65.225883294 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs") pod "network-metrics-daemon-ttj4w" (UID: "7d73c7ed-f214-4fae-b194-9bae83a86b47") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:58.016199 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:58.016073 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-original-pull-secret podName:d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d nodeName:}" failed. No retries permitted until 2026-07-27 16:25:30.016063194 +0000 UTC m=+65.225913050 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-original-pull-secret") pod "global-pull-secret-syncer-qgww4" (UID: "d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d") : object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:58.116789 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:58.116744 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7z7h\" (UniqueName: \"kubernetes.io/projected/81ef96f6-f835-4c1c-bad7-6a54c5da90c7-kube-api-access-q7z7h\") pod \"network-check-target-8pf9l\" (UID: \"81ef96f6-f835-4c1c-bad7-6a54c5da90c7\") " pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:24:58.116975 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:58.116941 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 16:24:58.116975 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:58.116962 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 16:24:58.116975 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:58.116972 2578 projected.go:196] Error preparing data for projected volume kube-api-access-q7z7h for pod openshift-network-diagnostics/network-check-target-8pf9l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:58.117116 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:58.117026 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81ef96f6-f835-4c1c-bad7-6a54c5da90c7-kube-api-access-q7z7h podName:81ef96f6-f835-4c1c-bad7-6a54c5da90c7 nodeName:}" failed. No retries permitted until 2026-07-27 16:25:30.117011784 +0000 UTC m=+65.326861635 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-q7z7h" (UniqueName: "kubernetes.io/projected/81ef96f6-f835-4c1c-bad7-6a54c5da90c7-kube-api-access-q7z7h") pod "network-check-target-8pf9l" (UID: "81ef96f6-f835-4c1c-bad7-6a54c5da90c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:58.372959 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:58.372921 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:24:58.373420 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:58.372934 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:24:58.373420 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:58.373039 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgww4" podUID="d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d" Jul 27 16:24:58.373420 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:58.373158 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ttj4w" podUID="7d73c7ed-f214-4fae-b194-9bae83a86b47" Jul 27 16:24:59.375623 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:24:59.375599 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:24:59.376043 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:24:59.375704 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pf9l" podUID="81ef96f6-f835-4c1c-bad7-6a54c5da90c7" Jul 27 16:25:00.372027 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.371863 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:25:00.372027 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.371874 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:25:00.372027 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:00.371980 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ttj4w" podUID="7d73c7ed-f214-4fae-b194-9bae83a86b47" Jul 27 16:25:00.372027 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:00.372013 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgww4" podUID="d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d" Jul 27 16:25:00.543813 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.543786 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5qcd" event={"ID":"c079aa05-1e43-4257-b459-54127b27d843","Type":"ContainerStarted","Data":"35a35e0442b0a8ae48b0de44e821b30e8db7da7d20a59a12b042c42068a69964"} Jul 27 16:25:00.617696 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.617666 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-40.ec2.internal" event="NodeReady" Jul 27 16:25:00.617879 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.617792 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 27 16:25:00.658344 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.658259 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9ff648bc7-9pq7k"] Jul 27 16:25:00.661029 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.661007 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:00.663470 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.663449 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kc6vj\"" Jul 27 16:25:00.663999 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.663985 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 27 16:25:00.664556 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.664539 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 27 16:25:00.665225 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.665115 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 27 16:25:00.670381 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.670356 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-n424n"] Jul 27 16:25:00.670866 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.670829 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 27 16:25:00.672225 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.672205 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n424n" Jul 27 16:25:00.676015 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.675996 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 27 16:25:00.676196 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.676182 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 27 16:25:00.676273 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.676236 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pc959\"" Jul 27 16:25:00.681821 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.681802 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5nzhx"] Jul 27 16:25:00.683483 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.683465 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9ff648bc7-9pq7k"] Jul 27 16:25:00.683572 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.683543 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5nzhx" Jul 27 16:25:00.685664 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.685636 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 27 16:25:00.685869 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.685837 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 27 16:25:00.686327 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.686312 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 27 16:25:00.686388 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.686361 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rks8d\"" Jul 27 16:25:00.690637 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.690616 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n424n"] Jul 27 16:25:00.703031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.703010 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5nzhx"] Jul 27 16:25:00.735298 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.735261 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87a7e98f-c108-4469-ac83-bcb91660a1e6-installation-pull-secrets\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:00.735298 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.735292 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-bound-sa-token\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:00.735508 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.735327 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87a7e98f-c108-4469-ac83-bcb91660a1e6-ca-trust-extracted\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:00.735508 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.735354 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dvjr\" (UniqueName: \"kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-kube-api-access-9dvjr\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:00.735508 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.735410 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87a7e98f-c108-4469-ac83-bcb91660a1e6-image-registry-private-configuration\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:00.735508 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.735435 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87a7e98f-c108-4469-ac83-bcb91660a1e6-trusted-ca\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:00.735508 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.735464 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-certificates\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:00.735508 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.735490 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:00.836711 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.836676 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-tmp-dir\") pod \"dns-default-n424n\" (UID: \"4c5b7b1c-57c2-4d71-b2f9-0d25b9988896\") " pod="openshift-dns/dns-default-n424n" Jul 27 16:25:00.836711 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.836714 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:00.836992 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.836733 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x282s\" (UniqueName: \"kubernetes.io/projected/e03109a1-5d54-4c1f-b015-7fd714bc4856-kube-api-access-x282s\") pod \"ingress-canary-5nzhx\" (UID: \"e03109a1-5d54-4c1f-b015-7fd714bc4856\") " pod="openshift-ingress-canary/ingress-canary-5nzhx" Jul 27 16:25:00.836992 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.836787 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls\") pod \"dns-default-n424n\" (UID: \"4c5b7b1c-57c2-4d71-b2f9-0d25b9988896\") " pod="openshift-dns/dns-default-n424n" Jul 27 16:25:00.836992 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.836815 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e03109a1-5d54-4c1f-b015-7fd714bc4856-cert\") pod \"ingress-canary-5nzhx\" (UID: \"e03109a1-5d54-4c1f-b015-7fd714bc4856\") " pod="openshift-ingress-canary/ingress-canary-5nzhx" Jul 27 16:25:00.836992 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:00.836821 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 16:25:00.836992 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:00.836832 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9ff648bc7-9pq7k: secret "image-registry-tls" not found Jul 27 16:25:00.836992 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.836870 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87a7e98f-c108-4469-ac83-bcb91660a1e6-installation-pull-secrets\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:00.836992 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:00.836893 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls podName:87a7e98f-c108-4469-ac83-bcb91660a1e6 nodeName:}" failed. No retries permitted until 2026-07-27 16:25:01.336879778 +0000 UTC m=+36.546729627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls") pod "image-registry-9ff648bc7-9pq7k" (UID: "87a7e98f-c108-4469-ac83-bcb91660a1e6") : secret "image-registry-tls" not found Jul 27 16:25:00.836992 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.836938 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-bound-sa-token\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:00.837372 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.837002 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87a7e98f-c108-4469-ac83-bcb91660a1e6-ca-trust-extracted\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:00.837372 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.837032 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dvjr\" (UniqueName: \"kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-kube-api-access-9dvjr\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:00.837372 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.837064 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-config-volume\") pod \"dns-default-n424n\" (UID: \"4c5b7b1c-57c2-4d71-b2f9-0d25b9988896\") " pod="openshift-dns/dns-default-n424n" Jul 27 16:25:00.837372 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.837091 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59xw8\" (UniqueName: \"kubernetes.io/projected/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-kube-api-access-59xw8\") pod \"dns-default-n424n\" (UID: \"4c5b7b1c-57c2-4d71-b2f9-0d25b9988896\") " pod="openshift-dns/dns-default-n424n" Jul 27 16:25:00.837372 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.837136 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87a7e98f-c108-4469-ac83-bcb91660a1e6-image-registry-private-configuration\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:00.837372 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.837191 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87a7e98f-c108-4469-ac83-bcb91660a1e6-trusted-ca\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:00.837372 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.837241 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-certificates\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:00.837777 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.837397 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87a7e98f-c108-4469-ac83-bcb91660a1e6-ca-trust-extracted\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:00.838129 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.838107 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87a7e98f-c108-4469-ac83-bcb91660a1e6-trusted-ca\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:00.838561 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.838539 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-certificates\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:00.840942 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.840922 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87a7e98f-c108-4469-ac83-bcb91660a1e6-image-registry-private-configuration\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:00.840942 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.840931 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87a7e98f-c108-4469-ac83-bcb91660a1e6-installation-pull-secrets\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:00.847067 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.847042 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-bound-sa-token\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:00.847169 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.847144 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dvjr\" (UniqueName: \"kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-kube-api-access-9dvjr\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:00.937877 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.937769 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-tmp-dir\") pod \"dns-default-n424n\" (UID: \"4c5b7b1c-57c2-4d71-b2f9-0d25b9988896\") " pod="openshift-dns/dns-default-n424n" Jul 27 16:25:00.937877 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.937813 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x282s\" (UniqueName: \"kubernetes.io/projected/e03109a1-5d54-4c1f-b015-7fd714bc4856-kube-api-access-x282s\") pod \"ingress-canary-5nzhx\" (UID: \"e03109a1-5d54-4c1f-b015-7fd714bc4856\") " pod="openshift-ingress-canary/ingress-canary-5nzhx" Jul 27 16:25:00.937877 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.937835 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls\") pod \"dns-default-n424n\" (UID: \"4c5b7b1c-57c2-4d71-b2f9-0d25b9988896\") " pod="openshift-dns/dns-default-n424n" Jul 27 16:25:00.937877 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.937865 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e03109a1-5d54-4c1f-b015-7fd714bc4856-cert\") pod \"ingress-canary-5nzhx\" (UID: \"e03109a1-5d54-4c1f-b015-7fd714bc4856\") " pod="openshift-ingress-canary/ingress-canary-5nzhx" Jul 27 16:25:00.938179 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.937916 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-config-volume\") pod \"dns-default-n424n\" (UID: \"4c5b7b1c-57c2-4d71-b2f9-0d25b9988896\") " pod="openshift-dns/dns-default-n424n" Jul 27 16:25:00.938179 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.937933 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59xw8\" (UniqueName: \"kubernetes.io/projected/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-kube-api-access-59xw8\") pod \"dns-default-n424n\" (UID: \"4c5b7b1c-57c2-4d71-b2f9-0d25b9988896\") " pod="openshift-dns/dns-default-n424n" Jul 27 16:25:00.938179 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:00.937966 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 16:25:00.938179 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:00.938040 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls podName:4c5b7b1c-57c2-4d71-b2f9-0d25b9988896 nodeName:}" failed. No retries permitted until 2026-07-27 16:25:01.438017961 +0000 UTC m=+36.647867830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls") pod "dns-default-n424n" (UID: "4c5b7b1c-57c2-4d71-b2f9-0d25b9988896") : secret "dns-default-metrics-tls" not found Jul 27 16:25:00.938179 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.938160 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-tmp-dir\") pod \"dns-default-n424n\" (UID: \"4c5b7b1c-57c2-4d71-b2f9-0d25b9988896\") " pod="openshift-dns/dns-default-n424n" Jul 27 16:25:00.938569 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.938544 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-config-volume\") pod \"dns-default-n424n\" (UID: \"4c5b7b1c-57c2-4d71-b2f9-0d25b9988896\") " pod="openshift-dns/dns-default-n424n" Jul 27 16:25:00.940287 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.940269 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e03109a1-5d54-4c1f-b015-7fd714bc4856-cert\") pod \"ingress-canary-5nzhx\" (UID: \"e03109a1-5d54-4c1f-b015-7fd714bc4856\") " pod="openshift-ingress-canary/ingress-canary-5nzhx" Jul 27 16:25:00.947299 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.947279 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x282s\" (UniqueName: \"kubernetes.io/projected/e03109a1-5d54-4c1f-b015-7fd714bc4856-kube-api-access-x282s\") pod \"ingress-canary-5nzhx\" (UID: \"e03109a1-5d54-4c1f-b015-7fd714bc4856\") " pod="openshift-ingress-canary/ingress-canary-5nzhx" Jul 27 16:25:00.948626 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.948608 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59xw8\" (UniqueName: \"kubernetes.io/projected/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-kube-api-access-59xw8\") pod \"dns-default-n424n\" (UID: \"4c5b7b1c-57c2-4d71-b2f9-0d25b9988896\") " pod="openshift-dns/dns-default-n424n" Jul 27 16:25:00.993027 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:00.992995 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5nzhx" Jul 27 16:25:01.125586 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:01.125556 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5nzhx"] Jul 27 16:25:01.130167 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:25:01.130021 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode03109a1_5d54_4c1f_b015_7fd714bc4856.slice/crio-0b7f8290845a4bc2eb9725b607ca8adaf8811600c0a7d750d5312e237bce732d WatchSource:0}: Error finding container 0b7f8290845a4bc2eb9725b607ca8adaf8811600c0a7d750d5312e237bce732d: Status 404 returned error can't find the container with id 0b7f8290845a4bc2eb9725b607ca8adaf8811600c0a7d750d5312e237bce732d Jul 27 16:25:01.340960 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:01.340936 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:01.341134 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:01.341108 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 16:25:01.341134 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:01.341129 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9ff648bc7-9pq7k: secret "image-registry-tls" not found Jul 27 16:25:01.341238 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:01.341198 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls podName:87a7e98f-c108-4469-ac83-bcb91660a1e6 nodeName:}" failed. No retries permitted until 2026-07-27 16:25:02.341177889 +0000 UTC m=+37.551027755 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls") pod "image-registry-9ff648bc7-9pq7k" (UID: "87a7e98f-c108-4469-ac83-bcb91660a1e6") : secret "image-registry-tls" not found Jul 27 16:25:01.375415 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:01.375391 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:25:01.377883 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:01.377861 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 16:25:01.378043 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:01.377958 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 16:25:01.378600 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:01.378584 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8qptk\"" Jul 27 16:25:01.441960 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:01.441922 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls\") pod \"dns-default-n424n\" (UID: \"4c5b7b1c-57c2-4d71-b2f9-0d25b9988896\") " pod="openshift-dns/dns-default-n424n" Jul 27 16:25:01.442097 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:01.442071 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 16:25:01.442154 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:01.442135 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls podName:4c5b7b1c-57c2-4d71-b2f9-0d25b9988896 nodeName:}" failed. No retries permitted until 2026-07-27 16:25:02.442119731 +0000 UTC m=+37.651969581 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls") pod "dns-default-n424n" (UID: "4c5b7b1c-57c2-4d71-b2f9-0d25b9988896") : secret "dns-default-metrics-tls" not found Jul 27 16:25:01.548715 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:01.548687 2578 generic.go:356] "Generic (PLEG): container finished" podID="c079aa05-1e43-4257-b459-54127b27d843" containerID="35a35e0442b0a8ae48b0de44e821b30e8db7da7d20a59a12b042c42068a69964" exitCode=0 Jul 27 16:25:01.549301 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:01.548763 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5qcd" event={"ID":"c079aa05-1e43-4257-b459-54127b27d843","Type":"ContainerDied","Data":"35a35e0442b0a8ae48b0de44e821b30e8db7da7d20a59a12b042c42068a69964"} Jul 27 16:25:01.549990 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:01.549965 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5nzhx" event={"ID":"e03109a1-5d54-4c1f-b015-7fd714bc4856","Type":"ContainerStarted","Data":"0b7f8290845a4bc2eb9725b607ca8adaf8811600c0a7d750d5312e237bce732d"} Jul 27 16:25:02.349778 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:02.349738 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:02.349963 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:02.349941 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 16:25:02.350031 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:02.349968 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9ff648bc7-9pq7k: secret "image-registry-tls" not found Jul 27 16:25:02.350084 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:02.350051 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls podName:87a7e98f-c108-4469-ac83-bcb91660a1e6 nodeName:}" failed. No retries permitted until 2026-07-27 16:25:04.350027576 +0000 UTC m=+39.559877428 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls") pod "image-registry-9ff648bc7-9pq7k" (UID: "87a7e98f-c108-4469-ac83-bcb91660a1e6") : secret "image-registry-tls" not found Jul 27 16:25:02.371961 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:02.371926 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:25:02.372131 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:02.371964 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:25:02.374239 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:02.374213 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 16:25:02.374367 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:02.374244 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 16:25:02.374367 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:02.374298 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rrtwx\"" Jul 27 16:25:02.450682 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:02.450643 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls\") pod \"dns-default-n424n\" (UID: \"4c5b7b1c-57c2-4d71-b2f9-0d25b9988896\") " pod="openshift-dns/dns-default-n424n" Jul 27 16:25:02.450830 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:02.450800 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 16:25:02.450930 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:02.450917 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls podName:4c5b7b1c-57c2-4d71-b2f9-0d25b9988896 nodeName:}" failed. No retries permitted until 2026-07-27 16:25:04.450896093 +0000 UTC m=+39.660745946 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls") pod "dns-default-n424n" (UID: "4c5b7b1c-57c2-4d71-b2f9-0d25b9988896") : secret "dns-default-metrics-tls" not found Jul 27 16:25:02.555752 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:02.555715 2578 generic.go:356] "Generic (PLEG): container finished" podID="c079aa05-1e43-4257-b459-54127b27d843" containerID="514a2a6c70efbeb31e43d24e10a46a692feb1d79bca17cf2d3f9716441104155" exitCode=0 Jul 27 16:25:02.556157 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:02.555792 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5qcd" event={"ID":"c079aa05-1e43-4257-b459-54127b27d843","Type":"ContainerDied","Data":"514a2a6c70efbeb31e43d24e10a46a692feb1d79bca17cf2d3f9716441104155"} Jul 27 16:25:03.563040 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:03.563002 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5qcd" event={"ID":"c079aa05-1e43-4257-b459-54127b27d843","Type":"ContainerStarted","Data":"86a7b38651438ebc21f443a91941aef76630fa1bb9848cc70c431cd75fdd73f6"} Jul 27 16:25:03.592416 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:03.592367 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-b5qcd" podStartSLOduration=7.258080689 podStartE2EDuration="37.592350386s" totalImagesPullingTime="30.334269697s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:24:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:25:03.590166299 +0000 UTC m=+38.800016197" watchObservedRunningTime="2026-07-27 16:25:03.592350386 +0000 UTC m=+38.802200257" Jul 27 16:25:04.365259 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:04.365065 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:04.365440 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:04.365221 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 16:25:04.365440 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:04.365334 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9ff648bc7-9pq7k: secret "image-registry-tls" not found Jul 27 16:25:04.365440 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:04.365432 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls podName:87a7e98f-c108-4469-ac83-bcb91660a1e6 nodeName:}" failed. No retries permitted until 2026-07-27 16:25:08.365415197 +0000 UTC m=+43.575265047 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls") pod "image-registry-9ff648bc7-9pq7k" (UID: "87a7e98f-c108-4469-ac83-bcb91660a1e6") : secret "image-registry-tls" not found Jul 27 16:25:04.466215 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:04.466177 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls\") pod \"dns-default-n424n\" (UID: \"4c5b7b1c-57c2-4d71-b2f9-0d25b9988896\") " pod="openshift-dns/dns-default-n424n" Jul 27 16:25:04.466377 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:04.466353 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 16:25:04.466450 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:04.466438 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls podName:4c5b7b1c-57c2-4d71-b2f9-0d25b9988896 nodeName:}" failed. No retries permitted until 2026-07-27 16:25:08.466417083 +0000 UTC m=+43.676266947 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls") pod "dns-default-n424n" (UID: "4c5b7b1c-57c2-4d71-b2f9-0d25b9988896") : secret "dns-default-metrics-tls" not found Jul 27 16:25:04.567593 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:04.567559 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5nzhx" event={"ID":"e03109a1-5d54-4c1f-b015-7fd714bc4856","Type":"ContainerStarted","Data":"71ee56aff4d9a7682f13aa9b895ff73ba75f015e159e839ad5c28856ab14f4a7"} Jul 27 16:25:04.585057 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:04.584987 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5nzhx" podStartSLOduration=1.875872912 podStartE2EDuration="4.584971996s" totalImagesPullingTime="2.709099084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:25:04.584766679 +0000 UTC m=+39.794616551" watchObservedRunningTime="2026-07-27 16:25:04.584971996 +0000 UTC m=+39.794821868" Jul 27 16:25:08.393593 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:08.393551 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:08.394073 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:08.393683 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 16:25:08.394073 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:08.393695 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9ff648bc7-9pq7k: secret "image-registry-tls" not found Jul 27 16:25:08.394073 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:08.393745 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls podName:87a7e98f-c108-4469-ac83-bcb91660a1e6 nodeName:}" failed. No retries permitted until 2026-07-27 16:25:16.39373117 +0000 UTC m=+51.603581020 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls") pod "image-registry-9ff648bc7-9pq7k" (UID: "87a7e98f-c108-4469-ac83-bcb91660a1e6") : secret "image-registry-tls" not found Jul 27 16:25:08.494922 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:08.494889 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls\") pod \"dns-default-n424n\" (UID: \"4c5b7b1c-57c2-4d71-b2f9-0d25b9988896\") " pod="openshift-dns/dns-default-n424n" Jul 27 16:25:08.495030 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:08.495003 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 16:25:08.495081 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:08.495053 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls podName:4c5b7b1c-57c2-4d71-b2f9-0d25b9988896 nodeName:}" failed. No retries permitted until 2026-07-27 16:25:16.495039938 +0000 UTC m=+51.704889789 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls") pod "dns-default-n424n" (UID: "4c5b7b1c-57c2-4d71-b2f9-0d25b9988896") : secret "dns-default-metrics-tls" not found Jul 27 16:25:16.455723 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:16.455683 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:16.456211 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:16.455833 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 16:25:16.456211 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:16.455868 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9ff648bc7-9pq7k: secret "image-registry-tls" not found Jul 27 16:25:16.456211 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:16.455931 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls podName:87a7e98f-c108-4469-ac83-bcb91660a1e6 nodeName:}" failed. No retries permitted until 2026-07-27 16:25:32.45591235 +0000 UTC m=+67.665762209 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls") pod "image-registry-9ff648bc7-9pq7k" (UID: "87a7e98f-c108-4469-ac83-bcb91660a1e6") : secret "image-registry-tls" not found Jul 27 16:25:16.556805 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:16.556770 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls\") pod \"dns-default-n424n\" (UID: \"4c5b7b1c-57c2-4d71-b2f9-0d25b9988896\") " pod="openshift-dns/dns-default-n424n" Jul 27 16:25:16.556987 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:16.556964 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 16:25:16.557072 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:16.557061 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls podName:4c5b7b1c-57c2-4d71-b2f9-0d25b9988896 nodeName:}" failed. No retries permitted until 2026-07-27 16:25:32.55703679 +0000 UTC m=+67.766886643 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls") pod "dns-default-n424n" (UID: "4c5b7b1c-57c2-4d71-b2f9-0d25b9988896") : secret "dns-default-metrics-tls" not found Jul 27 16:25:25.542583 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:25.542551 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pzzjg" Jul 27 16:25:30.060711 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:30.060670 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-original-pull-secret\") pod \"global-pull-secret-syncer-qgww4\" (UID: \"d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d\") " pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:25:30.060711 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:30.060713 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs\") pod \"network-metrics-daemon-ttj4w\" (UID: \"7d73c7ed-f214-4fae-b194-9bae83a86b47\") " pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:25:30.064796 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:30.064776 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 16:25:30.064873 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:30.064797 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 16:25:30.071620 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:30.071599 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 27 16:25:30.071710 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:30.071684 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs podName:7d73c7ed-f214-4fae-b194-9bae83a86b47 nodeName:}" failed. No retries permitted until 2026-07-27 16:26:34.071666833 +0000 UTC m=+129.281516682 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs") pod "network-metrics-daemon-ttj4w" (UID: "7d73c7ed-f214-4fae-b194-9bae83a86b47") : secret "metrics-daemon-secret" not found Jul 27 16:25:30.075424 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:30.075403 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d-original-pull-secret\") pod \"global-pull-secret-syncer-qgww4\" (UID: \"d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d\") " pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:25:30.162128 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:30.162092 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7z7h\" (UniqueName: \"kubernetes.io/projected/81ef96f6-f835-4c1c-bad7-6a54c5da90c7-kube-api-access-q7z7h\") pod \"network-check-target-8pf9l\" (UID: \"81ef96f6-f835-4c1c-bad7-6a54c5da90c7\") " pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:25:30.164528 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:30.164507 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 16:25:30.175113 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:30.175089 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 16:25:30.186081 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:30.186056 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7z7h\" (UniqueName: \"kubernetes.io/projected/81ef96f6-f835-4c1c-bad7-6a54c5da90c7-kube-api-access-q7z7h\") pod \"network-check-target-8pf9l\" (UID: \"81ef96f6-f835-4c1c-bad7-6a54c5da90c7\") " pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:25:30.283466 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:30.283433 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgww4" Jul 27 16:25:30.408964 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:30.408821 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qgww4"] Jul 27 16:25:30.411375 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:25:30.411349 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd581df3a_c6fa_49b7_a6a5_11b5d9f30f9d.slice/crio-55a6b28e68f2a11411d537c363d8c860a8f61f186dc78f350cac5d709f9a0067 WatchSource:0}: Error finding container 55a6b28e68f2a11411d537c363d8c860a8f61f186dc78f350cac5d709f9a0067: Status 404 returned error can't find the container with id 55a6b28e68f2a11411d537c363d8c860a8f61f186dc78f350cac5d709f9a0067 Jul 27 16:25:30.486549 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:30.486522 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8qptk\"" Jul 27 16:25:30.495252 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:30.495223 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:25:30.614571 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:30.614499 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8pf9l"] Jul 27 16:25:30.617337 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:25:30.617311 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81ef96f6_f835_4c1c_bad7_6a54c5da90c7.slice/crio-5c68b6de89b745eeec88274efe1969f2a9888f8fe7ee6dc302a17d5e03d54283 WatchSource:0}: Error finding container 5c68b6de89b745eeec88274efe1969f2a9888f8fe7ee6dc302a17d5e03d54283: Status 404 returned error can't find the container with id 5c68b6de89b745eeec88274efe1969f2a9888f8fe7ee6dc302a17d5e03d54283 Jul 27 16:25:30.628504 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:30.628477 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qgww4" event={"ID":"d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d","Type":"ContainerStarted","Data":"55a6b28e68f2a11411d537c363d8c860a8f61f186dc78f350cac5d709f9a0067"} Jul 27 16:25:30.629566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:30.629542 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8pf9l" event={"ID":"81ef96f6-f835-4c1c-bad7-6a54c5da90c7","Type":"ContainerStarted","Data":"5c68b6de89b745eeec88274efe1969f2a9888f8fe7ee6dc302a17d5e03d54283"} Jul 27 16:25:32.480645 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:32.480614 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:25:32.481116 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:32.480744 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 16:25:32.481116 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:32.480757 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9ff648bc7-9pq7k: secret "image-registry-tls" not found Jul 27 16:25:32.481116 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:32.480810 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls podName:87a7e98f-c108-4469-ac83-bcb91660a1e6 nodeName:}" failed. No retries permitted until 2026-07-27 16:26:04.480795215 +0000 UTC m=+99.690645065 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls") pod "image-registry-9ff648bc7-9pq7k" (UID: "87a7e98f-c108-4469-ac83-bcb91660a1e6") : secret "image-registry-tls" not found Jul 27 16:25:32.581177 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:32.581139 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls\") pod \"dns-default-n424n\" (UID: \"4c5b7b1c-57c2-4d71-b2f9-0d25b9988896\") " pod="openshift-dns/dns-default-n424n" Jul 27 16:25:32.581356 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:32.581291 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 16:25:32.581429 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:25:32.581360 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls podName:4c5b7b1c-57c2-4d71-b2f9-0d25b9988896 nodeName:}" failed. No retries permitted until 2026-07-27 16:26:04.581339164 +0000 UTC m=+99.791189027 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls") pod "dns-default-n424n" (UID: "4c5b7b1c-57c2-4d71-b2f9-0d25b9988896") : secret "dns-default-metrics-tls" not found Jul 27 16:25:35.644669 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:35.644631 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8pf9l" event={"ID":"81ef96f6-f835-4c1c-bad7-6a54c5da90c7","Type":"ContainerStarted","Data":"cd934b82ed12feb80be159e12adda3ba4b35dedc32d05d1ee2e32953d6588e6d"} Jul 27 16:25:35.645139 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:35.644720 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:25:35.646177 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:35.646153 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qgww4" event={"ID":"d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d","Type":"ContainerStarted","Data":"28dd37ff77a97800291e04c1e4b4459337a1014d3f78704322b02191955fc6b3"} Jul 27 16:25:35.660673 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:35.660612 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8pf9l" podStartSLOduration=65.078298655 podStartE2EDuration="1m9.660597486s" totalImagesPullingTime="4.582298831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:25:35.660091806 +0000 UTC m=+70.869941668" watchObservedRunningTime="2026-07-27 16:25:35.660597486 +0000 UTC m=+70.870447359" Jul 27 16:25:35.677086 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:25:35.677033 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qgww4" podStartSLOduration=64.884826478 podStartE2EDuration="1m9.677018407s" totalImagesPullingTime="4.792191929s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:25:35.676377601 +0000 UTC m=+70.886227475" watchObservedRunningTime="2026-07-27 16:25:35.677018407 +0000 UTC m=+70.886868278" Jul 27 16:26:04.511198 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:26:04.511150 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:26:04.511654 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:26:04.511267 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 16:26:04.511654 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:26:04.511278 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9ff648bc7-9pq7k: secret "image-registry-tls" not found Jul 27 16:26:04.511654 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:26:04.511337 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls podName:87a7e98f-c108-4469-ac83-bcb91660a1e6 nodeName:}" failed. No retries permitted until 2026-07-27 16:27:08.511323083 +0000 UTC m=+163.721172934 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls") pod "image-registry-9ff648bc7-9pq7k" (UID: "87a7e98f-c108-4469-ac83-bcb91660a1e6") : secret "image-registry-tls" not found Jul 27 16:26:04.611718 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:26:04.611669 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls\") pod \"dns-default-n424n\" (UID: \"4c5b7b1c-57c2-4d71-b2f9-0d25b9988896\") " pod="openshift-dns/dns-default-n424n" Jul 27 16:26:04.611901 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:26:04.611824 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 16:26:04.611948 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:26:04.611918 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls podName:4c5b7b1c-57c2-4d71-b2f9-0d25b9988896 nodeName:}" failed. No retries permitted until 2026-07-27 16:27:08.611901501 +0000 UTC m=+163.821751355 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls") pod "dns-default-n424n" (UID: "4c5b7b1c-57c2-4d71-b2f9-0d25b9988896") : secret "dns-default-metrics-tls" not found Jul 27 16:26:06.652803 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:26:06.652768 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8pf9l" Jul 27 16:26:34.115086 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:26:34.115048 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs\") pod \"network-metrics-daemon-ttj4w\" (UID: \"7d73c7ed-f214-4fae-b194-9bae83a86b47\") " pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:26:34.115558 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:26:34.115164 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 27 16:26:34.115558 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:26:34.115218 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs podName:7d73c7ed-f214-4fae-b194-9bae83a86b47 nodeName:}" failed. No retries permitted until 2026-07-27 16:28:36.115203204 +0000 UTC m=+251.325053054 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs") pod "network-metrics-daemon-ttj4w" (UID: "7d73c7ed-f214-4fae-b194-9bae83a86b47") : secret "metrics-daemon-secret" not found Jul 27 16:27:03.673733 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:27:03.673688 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" podUID="87a7e98f-c108-4469-ac83-bcb91660a1e6" Jul 27 16:27:03.679865 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:27:03.679828 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-n424n" podUID="4c5b7b1c-57c2-4d71-b2f9-0d25b9988896" Jul 27 16:27:03.856865 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:27:03.856756 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n424n" Jul 27 16:27:03.856865 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:27:03.856756 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:27:05.390348 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:27:05.390302 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-ttj4w" podUID="7d73c7ed-f214-4fae-b194-9bae83a86b47" Jul 27 16:27:08.558404 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:27:08.558365 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls\") pod \"image-registry-9ff648bc7-9pq7k\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:27:08.558813 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:27:08.558515 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 16:27:08.558813 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:27:08.558534 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9ff648bc7-9pq7k: secret "image-registry-tls" not found Jul 27 16:27:08.558813 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:27:08.558599 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls podName:87a7e98f-c108-4469-ac83-bcb91660a1e6 nodeName:}" failed. No retries permitted until 2026-07-27 16:29:10.558582622 +0000 UTC m=+285.768432472 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls") pod "image-registry-9ff648bc7-9pq7k" (UID: "87a7e98f-c108-4469-ac83-bcb91660a1e6") : secret "image-registry-tls" not found Jul 27 16:27:08.662881 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:27:08.659985 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 16:27:08.662881 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:27:08.659899 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls\") pod \"dns-default-n424n\" (UID: \"4c5b7b1c-57c2-4d71-b2f9-0d25b9988896\") " pod="openshift-dns/dns-default-n424n" Jul 27 16:27:08.662881 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:27:08.660127 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls podName:4c5b7b1c-57c2-4d71-b2f9-0d25b9988896 nodeName:}" failed. No retries permitted until 2026-07-27 16:29:10.660076229 +0000 UTC m=+285.869926149 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls") pod "dns-default-n424n" (UID: "4c5b7b1c-57c2-4d71-b2f9-0d25b9988896") : secret "dns-default-metrics-tls" not found Jul 27 16:27:19.372524 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:27:19.372435 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:28:16.638896 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.638837 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mfkn4"] Jul 27 16:28:16.640717 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.640695 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mfkn4" Jul 27 16:28:16.649091 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.649071 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 27 16:28:16.649165 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.649108 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 27 16:28:16.649735 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.649718 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 27 16:28:16.649816 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.649722 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xbfhq\"" Jul 27 16:28:16.659413 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.659391 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hnq7z"] Jul 27 16:28:16.661033 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.661014 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-qc2ql"] Jul 27 16:28:16.661140 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.661125 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hnq7z" Jul 27 16:28:16.662791 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.662769 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-2cqxv"] Jul 27 16:28:16.662977 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.662959 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-qc2ql" Jul 27 16:28:16.663669 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:16.663642 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"serving-cert\" is forbidden: User \"system:node:ip-10-0-143-40.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-143-40.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" type="*v1.Secret" Jul 27 16:28:16.663769 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:16.663657 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"service-ca-operator-dockercfg-jtwkn\" is forbidden: User \"system:node:ip-10-0-143-40.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-143-40.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-jtwkn\"" type="*v1.Secret" Jul 27 16:28:16.664138 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.664119 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 27 16:28:16.664923 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.664902 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mfkn4"] Jul 27 16:28:16.665017 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.664946 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-lrhjd"] Jul 27 16:28:16.665017 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.665008 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 27 16:28:16.665132 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.665018 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-2cqxv" Jul 27 16:28:16.665132 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.665087 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 27 16:28:16.665235 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.665141 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 27 16:28:16.665474 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.665455 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 27 16:28:16.665715 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.665684 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 27 16:28:16.666610 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.666593 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 27 16:28:16.666689 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.666594 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-qm78r\"" Jul 27 16:28:16.666987 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.666972 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-lrhjd" Jul 27 16:28:16.667926 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.667907 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 27 16:28:16.668440 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.668423 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 27 16:28:16.669148 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.669128 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-frs74\"" Jul 27 16:28:16.671331 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.671314 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 27 16:28:16.671541 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.671521 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 27 16:28:16.671646 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.671599 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-x2php\"" Jul 27 16:28:16.673402 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.673386 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 27 16:28:16.677969 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.677951 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 27 16:28:16.679952 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.679932 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hnq7z"] Jul 27 16:28:16.683291 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.683244 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-qc2ql"] Jul 27 16:28:16.684343 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.684324 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-2cqxv"] Jul 27 16:28:16.692935 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.692913 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-lrhjd"] Jul 27 16:28:16.738958 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.738925 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/66de2422-6d67-4573-84f6-213a2c7f9e0b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-mfkn4\" (UID: \"66de2422-6d67-4573-84f6-213a2c7f9e0b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mfkn4" Jul 27 16:28:16.738958 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.738965 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n55fm\" (UniqueName: \"kubernetes.io/projected/66de2422-6d67-4573-84f6-213a2c7f9e0b-kube-api-access-n55fm\") pod \"cluster-samples-operator-6748489656-mfkn4\" (UID: \"66de2422-6d67-4573-84f6-213a2c7f9e0b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mfkn4" Jul 27 16:28:16.840143 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.840103 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f7ba4530-6cc8-463f-9ac7-e9572867a152-serving-cert\") pod \"console-operator-584dcb6b54-2cqxv\" (UID: \"f7ba4530-6cc8-463f-9ac7-e9572867a152\") " pod="openshift-console-operator/console-operator-584dcb6b54-2cqxv" Jul 27 16:28:16.840333 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.840152 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hwl8\" (UniqueName: \"kubernetes.io/projected/3d8558c5-3631-46a8-aa4d-c2b2ed981e3c-kube-api-access-5hwl8\") pod \"network-check-source-7d88cb55d8-lrhjd\" (UID: \"3d8558c5-3631-46a8-aa4d-c2b2ed981e3c\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-lrhjd" Jul 27 16:28:16.840333 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.840186 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/66de2422-6d67-4573-84f6-213a2c7f9e0b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-mfkn4\" (UID: \"66de2422-6d67-4573-84f6-213a2c7f9e0b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mfkn4" Jul 27 16:28:16.840333 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.840206 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32b6b148-9234-4492-a6dc-b6723f680477-serving-cert\") pod \"insights-operator-5885fdb759-qc2ql\" (UID: \"32b6b148-9234-4492-a6dc-b6723f680477\") " pod="openshift-insights/insights-operator-5885fdb759-qc2ql" Jul 27 16:28:16.840333 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.840242 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9mbq\" (UniqueName: \"kubernetes.io/projected/c46477cd-3c0c-4b54-a4ab-936b49966349-kube-api-access-s9mbq\") pod \"service-ca-operator-5d6c75f84f-hnq7z\" (UID: \"c46477cd-3c0c-4b54-a4ab-936b49966349\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hnq7z" Jul 27 16:28:16.840333 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.840288 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n55fm\" (UniqueName: \"kubernetes.io/projected/66de2422-6d67-4573-84f6-213a2c7f9e0b-kube-api-access-n55fm\") pod \"cluster-samples-operator-6748489656-mfkn4\" (UID: \"66de2422-6d67-4573-84f6-213a2c7f9e0b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mfkn4" Jul 27 16:28:16.840333 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.840327 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4qvz\" (UniqueName: \"kubernetes.io/projected/32b6b148-9234-4492-a6dc-b6723f680477-kube-api-access-z4qvz\") pod \"insights-operator-5885fdb759-qc2ql\" (UID: \"32b6b148-9234-4492-a6dc-b6723f680477\") " pod="openshift-insights/insights-operator-5885fdb759-qc2ql" Jul 27 16:28:16.840620 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:16.840290 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 16:28:16.840620 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.840351 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32b6b148-9234-4492-a6dc-b6723f680477-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-qc2ql\" (UID: \"32b6b148-9234-4492-a6dc-b6723f680477\") " pod="openshift-insights/insights-operator-5885fdb759-qc2ql" Jul 27 16:28:16.840620 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.840375 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32b6b148-9234-4492-a6dc-b6723f680477-service-ca-bundle\") pod \"insights-operator-5885fdb759-qc2ql\" (UID: \"32b6b148-9234-4492-a6dc-b6723f680477\") " pod="openshift-insights/insights-operator-5885fdb759-qc2ql" Jul 27 16:28:16.840620 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.840395 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/32b6b148-9234-4492-a6dc-b6723f680477-snapshots\") pod \"insights-operator-5885fdb759-qc2ql\" (UID: \"32b6b148-9234-4492-a6dc-b6723f680477\") " pod="openshift-insights/insights-operator-5885fdb759-qc2ql" Jul 27 16:28:16.840620 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:16.840417 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66de2422-6d67-4573-84f6-213a2c7f9e0b-samples-operator-tls podName:66de2422-6d67-4573-84f6-213a2c7f9e0b nodeName:}" failed. No retries permitted until 2026-07-27 16:28:17.34039307 +0000 UTC m=+232.550242924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/66de2422-6d67-4573-84f6-213a2c7f9e0b-samples-operator-tls") pod "cluster-samples-operator-6748489656-mfkn4" (UID: "66de2422-6d67-4573-84f6-213a2c7f9e0b") : secret "samples-operator-tls" not found Jul 27 16:28:16.840620 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.840455 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dth2g\" (UniqueName: \"kubernetes.io/projected/f7ba4530-6cc8-463f-9ac7-e9572867a152-kube-api-access-dth2g\") pod \"console-operator-584dcb6b54-2cqxv\" (UID: \"f7ba4530-6cc8-463f-9ac7-e9572867a152\") " pod="openshift-console-operator/console-operator-584dcb6b54-2cqxv" Jul 27 16:28:16.840620 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.840528 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c46477cd-3c0c-4b54-a4ab-936b49966349-serving-cert\") pod \"service-ca-operator-5d6c75f84f-hnq7z\" (UID: \"c46477cd-3c0c-4b54-a4ab-936b49966349\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hnq7z" Jul 27 16:28:16.840620 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.840545 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c46477cd-3c0c-4b54-a4ab-936b49966349-config\") pod \"service-ca-operator-5d6c75f84f-hnq7z\" (UID: \"c46477cd-3c0c-4b54-a4ab-936b49966349\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hnq7z" Jul 27 16:28:16.840620 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.840574 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32b6b148-9234-4492-a6dc-b6723f680477-tmp\") pod \"insights-operator-5885fdb759-qc2ql\" (UID: \"32b6b148-9234-4492-a6dc-b6723f680477\") " pod="openshift-insights/insights-operator-5885fdb759-qc2ql" Jul 27 16:28:16.840620 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.840590 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f7ba4530-6cc8-463f-9ac7-e9572867a152-config\") pod \"console-operator-584dcb6b54-2cqxv\" (UID: \"f7ba4530-6cc8-463f-9ac7-e9572867a152\") " pod="openshift-console-operator/console-operator-584dcb6b54-2cqxv" Jul 27 16:28:16.840620 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.840604 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f7ba4530-6cc8-463f-9ac7-e9572867a152-trusted-ca\") pod \"console-operator-584dcb6b54-2cqxv\" (UID: \"f7ba4530-6cc8-463f-9ac7-e9572867a152\") " pod="openshift-console-operator/console-operator-584dcb6b54-2cqxv" Jul 27 16:28:16.852154 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.852131 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n55fm\" (UniqueName: \"kubernetes.io/projected/66de2422-6d67-4573-84f6-213a2c7f9e0b-kube-api-access-n55fm\") pod \"cluster-samples-operator-6748489656-mfkn4\" (UID: \"66de2422-6d67-4573-84f6-213a2c7f9e0b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mfkn4" Jul 27 16:28:16.941200 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.941110 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c46477cd-3c0c-4b54-a4ab-936b49966349-serving-cert\") pod \"service-ca-operator-5d6c75f84f-hnq7z\" (UID: \"c46477cd-3c0c-4b54-a4ab-936b49966349\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hnq7z" Jul 27 16:28:16.941200 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.941144 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c46477cd-3c0c-4b54-a4ab-936b49966349-config\") pod \"service-ca-operator-5d6c75f84f-hnq7z\" (UID: \"c46477cd-3c0c-4b54-a4ab-936b49966349\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hnq7z" Jul 27 16:28:16.941200 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.941167 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32b6b148-9234-4492-a6dc-b6723f680477-tmp\") pod \"insights-operator-5885fdb759-qc2ql\" (UID: \"32b6b148-9234-4492-a6dc-b6723f680477\") " pod="openshift-insights/insights-operator-5885fdb759-qc2ql" Jul 27 16:28:16.941200 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.941181 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f7ba4530-6cc8-463f-9ac7-e9572867a152-config\") pod \"console-operator-584dcb6b54-2cqxv\" (UID: \"f7ba4530-6cc8-463f-9ac7-e9572867a152\") " pod="openshift-console-operator/console-operator-584dcb6b54-2cqxv" Jul 27 16:28:16.941200 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.941197 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f7ba4530-6cc8-463f-9ac7-e9572867a152-trusted-ca\") pod \"console-operator-584dcb6b54-2cqxv\" (UID: \"f7ba4530-6cc8-463f-9ac7-e9572867a152\") " pod="openshift-console-operator/console-operator-584dcb6b54-2cqxv" Jul 27 16:28:16.941673 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.941221 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f7ba4530-6cc8-463f-9ac7-e9572867a152-serving-cert\") pod \"console-operator-584dcb6b54-2cqxv\" (UID: \"f7ba4530-6cc8-463f-9ac7-e9572867a152\") " pod="openshift-console-operator/console-operator-584dcb6b54-2cqxv" Jul 27 16:28:16.941673 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.941371 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hwl8\" (UniqueName: \"kubernetes.io/projected/3d8558c5-3631-46a8-aa4d-c2b2ed981e3c-kube-api-access-5hwl8\") pod \"network-check-source-7d88cb55d8-lrhjd\" (UID: \"3d8558c5-3631-46a8-aa4d-c2b2ed981e3c\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-lrhjd" Jul 27 16:28:16.941673 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.941437 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32b6b148-9234-4492-a6dc-b6723f680477-serving-cert\") pod \"insights-operator-5885fdb759-qc2ql\" (UID: \"32b6b148-9234-4492-a6dc-b6723f680477\") " pod="openshift-insights/insights-operator-5885fdb759-qc2ql" Jul 27 16:28:16.941673 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.941485 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9mbq\" (UniqueName: \"kubernetes.io/projected/c46477cd-3c0c-4b54-a4ab-936b49966349-kube-api-access-s9mbq\") pod \"service-ca-operator-5d6c75f84f-hnq7z\" (UID: \"c46477cd-3c0c-4b54-a4ab-936b49966349\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hnq7z" Jul 27 16:28:16.941673 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.941516 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4qvz\" (UniqueName: \"kubernetes.io/projected/32b6b148-9234-4492-a6dc-b6723f680477-kube-api-access-z4qvz\") pod \"insights-operator-5885fdb759-qc2ql\" (UID: \"32b6b148-9234-4492-a6dc-b6723f680477\") " pod="openshift-insights/insights-operator-5885fdb759-qc2ql" Jul 27 16:28:16.941673 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.941547 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32b6b148-9234-4492-a6dc-b6723f680477-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-qc2ql\" (UID: \"32b6b148-9234-4492-a6dc-b6723f680477\") " pod="openshift-insights/insights-operator-5885fdb759-qc2ql" Jul 27 16:28:16.941673 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.941569 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32b6b148-9234-4492-a6dc-b6723f680477-service-ca-bundle\") pod \"insights-operator-5885fdb759-qc2ql\" (UID: \"32b6b148-9234-4492-a6dc-b6723f680477\") " pod="openshift-insights/insights-operator-5885fdb759-qc2ql" Jul 27 16:28:16.941673 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.941596 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/32b6b148-9234-4492-a6dc-b6723f680477-snapshots\") pod \"insights-operator-5885fdb759-qc2ql\" (UID: \"32b6b148-9234-4492-a6dc-b6723f680477\") " pod="openshift-insights/insights-operator-5885fdb759-qc2ql" Jul 27 16:28:16.941673 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.941616 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32b6b148-9234-4492-a6dc-b6723f680477-tmp\") pod \"insights-operator-5885fdb759-qc2ql\" (UID: \"32b6b148-9234-4492-a6dc-b6723f680477\") " pod="openshift-insights/insights-operator-5885fdb759-qc2ql" Jul 27 16:28:16.941673 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.941620 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dth2g\" (UniqueName: \"kubernetes.io/projected/f7ba4530-6cc8-463f-9ac7-e9572867a152-kube-api-access-dth2g\") pod \"console-operator-584dcb6b54-2cqxv\" (UID: \"f7ba4530-6cc8-463f-9ac7-e9572867a152\") " pod="openshift-console-operator/console-operator-584dcb6b54-2cqxv" Jul 27 16:28:16.942159 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.941798 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c46477cd-3c0c-4b54-a4ab-936b49966349-config\") pod \"service-ca-operator-5d6c75f84f-hnq7z\" (UID: \"c46477cd-3c0c-4b54-a4ab-936b49966349\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hnq7z" Jul 27 16:28:16.942159 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.941917 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f7ba4530-6cc8-463f-9ac7-e9572867a152-config\") pod \"console-operator-584dcb6b54-2cqxv\" (UID: \"f7ba4530-6cc8-463f-9ac7-e9572867a152\") " pod="openshift-console-operator/console-operator-584dcb6b54-2cqxv" Jul 27 16:28:16.942367 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.942347 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32b6b148-9234-4492-a6dc-b6723f680477-service-ca-bundle\") pod \"insights-operator-5885fdb759-qc2ql\" (UID: \"32b6b148-9234-4492-a6dc-b6723f680477\") " pod="openshift-insights/insights-operator-5885fdb759-qc2ql" Jul 27 16:28:16.942545 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.942508 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/32b6b148-9234-4492-a6dc-b6723f680477-snapshots\") pod \"insights-operator-5885fdb759-qc2ql\" (UID: \"32b6b148-9234-4492-a6dc-b6723f680477\") " pod="openshift-insights/insights-operator-5885fdb759-qc2ql" Jul 27 16:28:16.942545 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.942520 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32b6b148-9234-4492-a6dc-b6723f680477-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-qc2ql\" (UID: \"32b6b148-9234-4492-a6dc-b6723f680477\") " pod="openshift-insights/insights-operator-5885fdb759-qc2ql" Jul 27 16:28:16.942903 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.942887 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f7ba4530-6cc8-463f-9ac7-e9572867a152-trusted-ca\") pod \"console-operator-584dcb6b54-2cqxv\" (UID: \"f7ba4530-6cc8-463f-9ac7-e9572867a152\") " pod="openshift-console-operator/console-operator-584dcb6b54-2cqxv" Jul 27 16:28:16.943894 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.943870 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32b6b148-9234-4492-a6dc-b6723f680477-serving-cert\") pod \"insights-operator-5885fdb759-qc2ql\" (UID: \"32b6b148-9234-4492-a6dc-b6723f680477\") " pod="openshift-insights/insights-operator-5885fdb759-qc2ql" Jul 27 16:28:16.944246 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.944231 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f7ba4530-6cc8-463f-9ac7-e9572867a152-serving-cert\") pod \"console-operator-584dcb6b54-2cqxv\" (UID: \"f7ba4530-6cc8-463f-9ac7-e9572867a152\") " pod="openshift-console-operator/console-operator-584dcb6b54-2cqxv" Jul 27 16:28:16.950535 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.950513 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hwl8\" (UniqueName: \"kubernetes.io/projected/3d8558c5-3631-46a8-aa4d-c2b2ed981e3c-kube-api-access-5hwl8\") pod \"network-check-source-7d88cb55d8-lrhjd\" (UID: \"3d8558c5-3631-46a8-aa4d-c2b2ed981e3c\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-lrhjd" Jul 27 16:28:16.950743 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.950725 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9mbq\" (UniqueName: \"kubernetes.io/projected/c46477cd-3c0c-4b54-a4ab-936b49966349-kube-api-access-s9mbq\") pod \"service-ca-operator-5d6c75f84f-hnq7z\" (UID: \"c46477cd-3c0c-4b54-a4ab-936b49966349\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hnq7z" Jul 27 16:28:16.950813 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.950723 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dth2g\" (UniqueName: \"kubernetes.io/projected/f7ba4530-6cc8-463f-9ac7-e9572867a152-kube-api-access-dth2g\") pod \"console-operator-584dcb6b54-2cqxv\" (UID: \"f7ba4530-6cc8-463f-9ac7-e9572867a152\") " pod="openshift-console-operator/console-operator-584dcb6b54-2cqxv" Jul 27 16:28:16.951260 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.951241 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4qvz\" (UniqueName: \"kubernetes.io/projected/32b6b148-9234-4492-a6dc-b6723f680477-kube-api-access-z4qvz\") pod \"insights-operator-5885fdb759-qc2ql\" (UID: \"32b6b148-9234-4492-a6dc-b6723f680477\") " pod="openshift-insights/insights-operator-5885fdb759-qc2ql" Jul 27 16:28:16.979983 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.979953 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-qc2ql" Jul 27 16:28:16.986524 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.986500 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-2cqxv" Jul 27 16:28:16.992154 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:16.992131 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-lrhjd" Jul 27 16:28:17.135816 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:17.135783 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-qc2ql"] Jul 27 16:28:17.139071 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:28:17.139045 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32b6b148_9234_4492_a6dc_b6723f680477.slice/crio-61fdfca170d73530ecb908902dca0397c33338758d10ee23f498b6b117e61215 WatchSource:0}: Error finding container 61fdfca170d73530ecb908902dca0397c33338758d10ee23f498b6b117e61215: Status 404 returned error can't find the container with id 61fdfca170d73530ecb908902dca0397c33338758d10ee23f498b6b117e61215 Jul 27 16:28:17.345466 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:17.345428 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/66de2422-6d67-4573-84f6-213a2c7f9e0b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-mfkn4\" (UID: \"66de2422-6d67-4573-84f6-213a2c7f9e0b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mfkn4" Jul 27 16:28:17.345627 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:17.345574 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 16:28:17.345671 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:17.345643 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66de2422-6d67-4573-84f6-213a2c7f9e0b-samples-operator-tls podName:66de2422-6d67-4573-84f6-213a2c7f9e0b nodeName:}" failed. No retries permitted until 2026-07-27 16:28:18.345625404 +0000 UTC m=+233.555475259 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/66de2422-6d67-4573-84f6-213a2c7f9e0b-samples-operator-tls") pod "cluster-samples-operator-6748489656-mfkn4" (UID: "66de2422-6d67-4573-84f6-213a2c7f9e0b") : secret "samples-operator-tls" not found Jul 27 16:28:17.346353 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:17.346334 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-lrhjd"] Jul 27 16:28:17.348834 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:17.348810 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-2cqxv"] Jul 27 16:28:17.349062 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:28:17.349040 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d8558c5_3631_46a8_aa4d_c2b2ed981e3c.slice/crio-11696c834b7d519a1012b7cb77b4a5756aeca58c01ccf50bc3fe1193a5797a40 WatchSource:0}: Error finding container 11696c834b7d519a1012b7cb77b4a5756aeca58c01ccf50bc3fe1193a5797a40: Status 404 returned error can't find the container with id 11696c834b7d519a1012b7cb77b4a5756aeca58c01ccf50bc3fe1193a5797a40 Jul 27 16:28:17.351687 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:28:17.351667 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7ba4530_6cc8_463f_9ac7_e9572867a152.slice/crio-d1b96eef05c6e9998c7bb56bc3133173ce14ef6ad3e3bf66050e8d32d5224e06 WatchSource:0}: Error finding container d1b96eef05c6e9998c7bb56bc3133173ce14ef6ad3e3bf66050e8d32d5224e06: Status 404 returned error can't find the container with id d1b96eef05c6e9998c7bb56bc3133173ce14ef6ad3e3bf66050e8d32d5224e06 Jul 27 16:28:17.624439 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:17.624352 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 27 16:28:17.634148 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:17.634117 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c46477cd-3c0c-4b54-a4ab-936b49966349-serving-cert\") pod \"service-ca-operator-5d6c75f84f-hnq7z\" (UID: \"c46477cd-3c0c-4b54-a4ab-936b49966349\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hnq7z" Jul 27 16:28:17.725534 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:17.725499 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-jtwkn\"" Jul 27 16:28:17.872956 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:17.872926 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hnq7z" Jul 27 16:28:18.018458 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:18.018418 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hnq7z"] Jul 27 16:28:18.021856 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:28:18.021801 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc46477cd_3c0c_4b54_a4ab_936b49966349.slice/crio-9f3586126f872fdf6dfb509b814085f347be6d014027d9d4e3a6d4fd7b7bd084 WatchSource:0}: Error finding container 9f3586126f872fdf6dfb509b814085f347be6d014027d9d4e3a6d4fd7b7bd084: Status 404 returned error can't find the container with id 9f3586126f872fdf6dfb509b814085f347be6d014027d9d4e3a6d4fd7b7bd084 Jul 27 16:28:18.036363 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:18.036315 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-lrhjd" event={"ID":"3d8558c5-3631-46a8-aa4d-c2b2ed981e3c","Type":"ContainerStarted","Data":"fbb9baeaf1ca796f4ee49630a9b566931347311c729c58d7f7a60fa465f6445e"} Jul 27 16:28:18.036487 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:18.036374 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-lrhjd" event={"ID":"3d8558c5-3631-46a8-aa4d-c2b2ed981e3c","Type":"ContainerStarted","Data":"11696c834b7d519a1012b7cb77b4a5756aeca58c01ccf50bc3fe1193a5797a40"} Jul 27 16:28:18.038051 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:18.038023 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-2cqxv" event={"ID":"f7ba4530-6cc8-463f-9ac7-e9572867a152","Type":"ContainerStarted","Data":"d1b96eef05c6e9998c7bb56bc3133173ce14ef6ad3e3bf66050e8d32d5224e06"} Jul 27 16:28:18.039272 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:18.039245 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hnq7z" event={"ID":"c46477cd-3c0c-4b54-a4ab-936b49966349","Type":"ContainerStarted","Data":"9f3586126f872fdf6dfb509b814085f347be6d014027d9d4e3a6d4fd7b7bd084"} Jul 27 16:28:18.040533 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:18.040496 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-qc2ql" event={"ID":"32b6b148-9234-4492-a6dc-b6723f680477","Type":"ContainerStarted","Data":"61fdfca170d73530ecb908902dca0397c33338758d10ee23f498b6b117e61215"} Jul 27 16:28:18.054252 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:18.054192 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-lrhjd" podStartSLOduration=2.054176258 podStartE2EDuration="2.054176258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:28:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:28:18.053899545 +0000 UTC m=+233.263749420" watchObservedRunningTime="2026-07-27 16:28:18.054176258 +0000 UTC m=+233.264026130" Jul 27 16:28:18.354722 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:18.354688 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/66de2422-6d67-4573-84f6-213a2c7f9e0b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-mfkn4\" (UID: \"66de2422-6d67-4573-84f6-213a2c7f9e0b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mfkn4" Jul 27 16:28:18.354909 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:18.354885 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 16:28:18.354983 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:18.354974 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66de2422-6d67-4573-84f6-213a2c7f9e0b-samples-operator-tls podName:66de2422-6d67-4573-84f6-213a2c7f9e0b nodeName:}" failed. No retries permitted until 2026-07-27 16:28:20.354951011 +0000 UTC m=+235.564800865 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/66de2422-6d67-4573-84f6-213a2c7f9e0b-samples-operator-tls") pod "cluster-samples-operator-6748489656-mfkn4" (UID: "66de2422-6d67-4573-84f6-213a2c7f9e0b") : secret "samples-operator-tls" not found Jul 27 16:28:20.048712 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:20.048676 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-qc2ql" event={"ID":"32b6b148-9234-4492-a6dc-b6723f680477","Type":"ContainerStarted","Data":"eb8ee450f26267698a9da3011d325de6e6897597f5cbc5a21cd5c86068567953"} Jul 27 16:28:20.065915 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:20.065805 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-qc2ql" podStartSLOduration=1.877617538 podStartE2EDuration="4.065782467s" totalImagesPullingTime="2.188164929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:28:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:28:20.065407527 +0000 UTC m=+235.275257399" watchObservedRunningTime="2026-07-27 16:28:20.065782467 +0000 UTC m=+235.275632321" Jul 27 16:28:20.372949 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:20.372856 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/66de2422-6d67-4573-84f6-213a2c7f9e0b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-mfkn4\" (UID: \"66de2422-6d67-4573-84f6-213a2c7f9e0b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mfkn4" Jul 27 16:28:20.373106 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:20.373009 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 16:28:20.373106 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:20.373096 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66de2422-6d67-4573-84f6-213a2c7f9e0b-samples-operator-tls podName:66de2422-6d67-4573-84f6-213a2c7f9e0b nodeName:}" failed. No retries permitted until 2026-07-27 16:28:24.373074941 +0000 UTC m=+239.582924795 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/66de2422-6d67-4573-84f6-213a2c7f9e0b-samples-operator-tls") pod "cluster-samples-operator-6748489656-mfkn4" (UID: "66de2422-6d67-4573-84f6-213a2c7f9e0b") : secret "samples-operator-tls" not found Jul 27 16:28:20.951679 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:20.951604 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2ff8c"] Jul 27 16:28:20.954211 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:20.954185 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:20.956192 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:20.956168 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 27 16:28:20.956503 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:20.956487 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x8wvw\"" Jul 27 16:28:20.956650 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:20.956625 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 27 16:28:20.968426 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:20.968401 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2ff8c"] Jul 27 16:28:20.977683 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:20.977659 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2ff8c\" (UID: \"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9\") " pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:20.977882 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:20.977707 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-data-volume\") pod \"insights-runtime-extractor-2ff8c\" (UID: \"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9\") " pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:20.977882 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:20.977739 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxl9h\" (UniqueName: \"kubernetes.io/projected/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-kube-api-access-pxl9h\") pod \"insights-runtime-extractor-2ff8c\" (UID: \"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9\") " pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:20.977882 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:20.977814 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ff8c\" (UID: \"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9\") " pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:20.978030 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:20.977910 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-crio-socket\") pod \"insights-runtime-extractor-2ff8c\" (UID: \"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9\") " pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:21.053573 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:21.053544 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2cqxv_f7ba4530-6cc8-463f-9ac7-e9572867a152/console-operator/0.log" Jul 27 16:28:21.054058 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:21.053586 2578 generic.go:356] "Generic (PLEG): container finished" podID="f7ba4530-6cc8-463f-9ac7-e9572867a152" containerID="5cf64f5f877a951f20badea85df1f606d152359039ebd13fdf60996bacecf8a4" exitCode=255 Jul 27 16:28:21.054058 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:21.053618 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-2cqxv" event={"ID":"f7ba4530-6cc8-463f-9ac7-e9572867a152","Type":"ContainerDied","Data":"5cf64f5f877a951f20badea85df1f606d152359039ebd13fdf60996bacecf8a4"} Jul 27 16:28:21.054058 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:21.053959 2578 scope.go:117] "RemoveContainer" containerID="5cf64f5f877a951f20badea85df1f606d152359039ebd13fdf60996bacecf8a4" Jul 27 16:28:21.055334 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:21.055308 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hnq7z" event={"ID":"c46477cd-3c0c-4b54-a4ab-936b49966349","Type":"ContainerStarted","Data":"94c8a93ca47d213160fe5eaa807d4e133bae12421caad9298fb64ff68f31dc1f"} Jul 27 16:28:21.079086 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:21.079064 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-crio-socket\") pod \"insights-runtime-extractor-2ff8c\" (UID: \"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9\") " pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:21.079214 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:21.079166 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-crio-socket\") pod \"insights-runtime-extractor-2ff8c\" (UID: \"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9\") " pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:21.079340 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:21.079312 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2ff8c\" (UID: \"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9\") " pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:21.079507 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:21.079416 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 16:28:21.079507 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:21.079426 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-data-volume\") pod \"insights-runtime-extractor-2ff8c\" (UID: \"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9\") " pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:21.079507 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:21.079479 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxl9h\" (UniqueName: \"kubernetes.io/projected/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-kube-api-access-pxl9h\") pod \"insights-runtime-extractor-2ff8c\" (UID: \"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9\") " pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:21.080400 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:21.079883 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ff8c\" (UID: \"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9\") " pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:21.080400 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:21.079973 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-kube-rbac-proxy-cm podName:b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9 nodeName:}" failed. No retries permitted until 2026-07-27 16:28:21.579935427 +0000 UTC m=+236.789785295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2ff8c" (UID: "b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9") : configmap "kube-rbac-proxy" not found Jul 27 16:28:21.080400 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:21.080035 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 16:28:21.080400 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:21.080280 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-insights-runtime-extractor-tls podName:b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9 nodeName:}" failed. No retries permitted until 2026-07-27 16:28:21.580259525 +0000 UTC m=+236.790109380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2ff8c" (UID: "b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9") : secret "insights-runtime-extractor-tls" not found Jul 27 16:28:21.084090 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:21.081617 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-data-volume\") pod \"insights-runtime-extractor-2ff8c\" (UID: \"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9\") " pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:21.086220 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:21.086181 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hnq7z" podStartSLOduration=2.5599023499999998 podStartE2EDuration="5.086168007s" totalImagesPullingTime="2.526265657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:28:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:28:21.084701766 +0000 UTC m=+236.294551638" watchObservedRunningTime="2026-07-27 16:28:21.086168007 +0000 UTC m=+236.296017879" Jul 27 16:28:21.089093 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:21.089069 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxl9h\" (UniqueName: \"kubernetes.io/projected/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-kube-api-access-pxl9h\") pod \"insights-runtime-extractor-2ff8c\" (UID: \"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9\") " pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:21.440536 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:21.440499 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-rtgzw"] Jul 27 16:28:21.443668 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:21.443649 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-rtgzw" Jul 27 16:28:21.445690 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:21.445662 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 27 16:28:21.445858 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:21.445695 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 27 16:28:21.445858 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:21.445751 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-bvs7s\"" Jul 27 16:28:21.451503 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:21.451477 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-rtgzw"] Jul 27 16:28:21.483224 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:21.483187 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfbmw\" (UniqueName: \"kubernetes.io/projected/53afaeae-3d4c-4833-a29a-5f29a4244412-kube-api-access-kfbmw\") pod \"migrator-6865c9967-rtgzw\" (UID: \"53afaeae-3d4c-4833-a29a-5f29a4244412\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-rtgzw" Jul 27 16:28:21.584326 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:21.584295 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2ff8c\" (UID: \"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9\") " pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:21.584478 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:21.584342 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfbmw\" (UniqueName: \"kubernetes.io/projected/53afaeae-3d4c-4833-a29a-5f29a4244412-kube-api-access-kfbmw\") pod \"migrator-6865c9967-rtgzw\" (UID: \"53afaeae-3d4c-4833-a29a-5f29a4244412\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-rtgzw" Jul 27 16:28:21.584478 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:21.584364 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ff8c\" (UID: \"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9\") " pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:21.584478 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:21.584432 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 16:28:21.584478 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:21.584467 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 16:28:21.584659 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:21.584508 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-kube-rbac-proxy-cm podName:b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9 nodeName:}" failed. No retries permitted until 2026-07-27 16:28:22.584489217 +0000 UTC m=+237.794339087 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2ff8c" (UID: "b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9") : configmap "kube-rbac-proxy" not found Jul 27 16:28:21.584659 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:21.584528 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-insights-runtime-extractor-tls podName:b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9 nodeName:}" failed. No retries permitted until 2026-07-27 16:28:22.584519213 +0000 UTC m=+237.794369066 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2ff8c" (UID: "b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9") : secret "insights-runtime-extractor-tls" not found Jul 27 16:28:21.592388 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:21.592364 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfbmw\" (UniqueName: \"kubernetes.io/projected/53afaeae-3d4c-4833-a29a-5f29a4244412-kube-api-access-kfbmw\") pod \"migrator-6865c9967-rtgzw\" (UID: \"53afaeae-3d4c-4833-a29a-5f29a4244412\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-rtgzw" Jul 27 16:28:21.753732 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:21.753634 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-rtgzw" Jul 27 16:28:21.884654 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:21.884624 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-rtgzw"] Jul 27 16:28:21.887921 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:28:21.887896 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53afaeae_3d4c_4833_a29a_5f29a4244412.slice/crio-77fae492c1284af26b18d547a8076d1057523812f36d39bf3a0a8b00bf1e4092 WatchSource:0}: Error finding container 77fae492c1284af26b18d547a8076d1057523812f36d39bf3a0a8b00bf1e4092: Status 404 returned error can't find the container with id 77fae492c1284af26b18d547a8076d1057523812f36d39bf3a0a8b00bf1e4092 Jul 27 16:28:22.059544 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:22.059516 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2cqxv_f7ba4530-6cc8-463f-9ac7-e9572867a152/console-operator/1.log" Jul 27 16:28:22.059965 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:22.059930 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2cqxv_f7ba4530-6cc8-463f-9ac7-e9572867a152/console-operator/0.log" Jul 27 16:28:22.060005 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:22.059965 2578 generic.go:356] "Generic (PLEG): container finished" podID="f7ba4530-6cc8-463f-9ac7-e9572867a152" containerID="2db9855bc205f222ba6163f4ece293c9de3982e6c745870a5d10dad82815f9c8" exitCode=255 Jul 27 16:28:22.060058 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:22.060040 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-2cqxv" event={"ID":"f7ba4530-6cc8-463f-9ac7-e9572867a152","Type":"ContainerDied","Data":"2db9855bc205f222ba6163f4ece293c9de3982e6c745870a5d10dad82815f9c8"} Jul 27 16:28:22.060106 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:22.060092 2578 scope.go:117] "RemoveContainer" containerID="5cf64f5f877a951f20badea85df1f606d152359039ebd13fdf60996bacecf8a4" Jul 27 16:28:22.060335 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:22.060308 2578 scope.go:117] "RemoveContainer" containerID="2db9855bc205f222ba6163f4ece293c9de3982e6c745870a5d10dad82815f9c8" Jul 27 16:28:22.060560 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:22.060512 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-2cqxv_openshift-console-operator(f7ba4530-6cc8-463f-9ac7-e9572867a152)\"" pod="openshift-console-operator/console-operator-584dcb6b54-2cqxv" podUID="f7ba4530-6cc8-463f-9ac7-e9572867a152" Jul 27 16:28:22.061252 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:22.061228 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-rtgzw" event={"ID":"53afaeae-3d4c-4833-a29a-5f29a4244412","Type":"ContainerStarted","Data":"77fae492c1284af26b18d547a8076d1057523812f36d39bf3a0a8b00bf1e4092"} Jul 27 16:28:22.593928 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:22.593880 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ff8c\" (UID: \"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9\") " pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:22.594138 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:22.594027 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2ff8c\" (UID: \"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9\") " pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:22.594138 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:22.594033 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 16:28:22.594138 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:22.594105 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-insights-runtime-extractor-tls podName:b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9 nodeName:}" failed. No retries permitted until 2026-07-27 16:28:24.59408346 +0000 UTC m=+239.803933309 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2ff8c" (UID: "b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9") : secret "insights-runtime-extractor-tls" not found Jul 27 16:28:22.594138 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:22.594128 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 16:28:22.594310 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:22.594184 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-kube-rbac-proxy-cm podName:b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9 nodeName:}" failed. No retries permitted until 2026-07-27 16:28:24.594168521 +0000 UTC m=+239.804018376 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2ff8c" (UID: "b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9") : configmap "kube-rbac-proxy" not found Jul 27 16:28:22.728936 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:22.728911 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jvxww_2db67f70-a81c-43c3-bb3c-e42540477f31/dns-node-resolver/0.log" Jul 27 16:28:23.065672 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:23.065645 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2cqxv_f7ba4530-6cc8-463f-9ac7-e9572867a152/console-operator/1.log" Jul 27 16:28:23.066054 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:23.065992 2578 scope.go:117] "RemoveContainer" containerID="2db9855bc205f222ba6163f4ece293c9de3982e6c745870a5d10dad82815f9c8" Jul 27 16:28:23.066163 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:23.066144 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-2cqxv_openshift-console-operator(f7ba4530-6cc8-463f-9ac7-e9572867a152)\"" pod="openshift-console-operator/console-operator-584dcb6b54-2cqxv" podUID="f7ba4530-6cc8-463f-9ac7-e9572867a152" Jul 27 16:28:23.728543 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:23.728516 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2v5jv_ee20c72e-c217-455a-9560-b5ab054cf0f3/node-ca/0.log" Jul 27 16:28:24.406922 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:24.406886 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/66de2422-6d67-4573-84f6-213a2c7f9e0b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-mfkn4\" (UID: \"66de2422-6d67-4573-84f6-213a2c7f9e0b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mfkn4" Jul 27 16:28:24.407383 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:24.407061 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 16:28:24.407383 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:24.407146 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66de2422-6d67-4573-84f6-213a2c7f9e0b-samples-operator-tls podName:66de2422-6d67-4573-84f6-213a2c7f9e0b nodeName:}" failed. No retries permitted until 2026-07-27 16:28:32.407125601 +0000 UTC m=+247.616975470 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/66de2422-6d67-4573-84f6-213a2c7f9e0b-samples-operator-tls") pod "cluster-samples-operator-6748489656-mfkn4" (UID: "66de2422-6d67-4573-84f6-213a2c7f9e0b") : secret "samples-operator-tls" not found Jul 27 16:28:24.528671 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:24.528644 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5nzhx_e03109a1-5d54-4c1f-b015-7fd714bc4856/serve-healthcheck-canary/0.log" Jul 27 16:28:24.608496 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:24.608459 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2ff8c\" (UID: \"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9\") " pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:24.608650 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:24.608513 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ff8c\" (UID: \"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9\") " pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:24.608650 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:24.608579 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 16:28:24.608650 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:24.608632 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 16:28:24.608745 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:24.608656 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-kube-rbac-proxy-cm podName:b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9 nodeName:}" failed. No retries permitted until 2026-07-27 16:28:28.608637974 +0000 UTC m=+243.818487851 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2ff8c" (UID: "b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9") : configmap "kube-rbac-proxy" not found Jul 27 16:28:24.608745 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:24.608674 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-insights-runtime-extractor-tls podName:b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9 nodeName:}" failed. No retries permitted until 2026-07-27 16:28:28.60866332 +0000 UTC m=+243.818513171 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2ff8c" (UID: "b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9") : secret "insights-runtime-extractor-tls" not found Jul 27 16:28:25.106587 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:25.106548 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-mmr2p"] Jul 27 16:28:25.110779 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:25.110761 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-mmr2p" Jul 27 16:28:25.112754 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:25.112726 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 27 16:28:25.112898 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:25.112808 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 27 16:28:25.112898 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:25.112858 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 27 16:28:25.113333 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:25.113316 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-kw4cz\"" Jul 27 16:28:25.113425 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:25.113394 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 27 16:28:25.118101 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:25.118082 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-mmr2p"] Jul 27 16:28:25.213734 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:25.213699 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njlt2\" (UniqueName: \"kubernetes.io/projected/9c098a5f-8f2e-4710-91cb-de1a207103e8-kube-api-access-njlt2\") pod \"service-ca-658d7b7c78-mmr2p\" (UID: \"9c098a5f-8f2e-4710-91cb-de1a207103e8\") " pod="openshift-service-ca/service-ca-658d7b7c78-mmr2p" Jul 27 16:28:25.213964 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:25.213812 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9c098a5f-8f2e-4710-91cb-de1a207103e8-signing-cabundle\") pod \"service-ca-658d7b7c78-mmr2p\" (UID: \"9c098a5f-8f2e-4710-91cb-de1a207103e8\") " pod="openshift-service-ca/service-ca-658d7b7c78-mmr2p" Jul 27 16:28:25.213964 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:25.213881 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9c098a5f-8f2e-4710-91cb-de1a207103e8-signing-key\") pod \"service-ca-658d7b7c78-mmr2p\" (UID: \"9c098a5f-8f2e-4710-91cb-de1a207103e8\") " pod="openshift-service-ca/service-ca-658d7b7c78-mmr2p" Jul 27 16:28:25.314973 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:25.314939 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njlt2\" (UniqueName: \"kubernetes.io/projected/9c098a5f-8f2e-4710-91cb-de1a207103e8-kube-api-access-njlt2\") pod \"service-ca-658d7b7c78-mmr2p\" (UID: \"9c098a5f-8f2e-4710-91cb-de1a207103e8\") " pod="openshift-service-ca/service-ca-658d7b7c78-mmr2p" Jul 27 16:28:25.315177 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:25.315037 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9c098a5f-8f2e-4710-91cb-de1a207103e8-signing-cabundle\") pod \"service-ca-658d7b7c78-mmr2p\" (UID: \"9c098a5f-8f2e-4710-91cb-de1a207103e8\") " pod="openshift-service-ca/service-ca-658d7b7c78-mmr2p" Jul 27 16:28:25.315177 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:25.315077 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9c098a5f-8f2e-4710-91cb-de1a207103e8-signing-key\") pod \"service-ca-658d7b7c78-mmr2p\" (UID: \"9c098a5f-8f2e-4710-91cb-de1a207103e8\") " pod="openshift-service-ca/service-ca-658d7b7c78-mmr2p" Jul 27 16:28:25.317094 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:25.317074 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 27 16:28:25.317177 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:25.317149 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 27 16:28:25.322539 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:25.322520 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 27 16:28:25.326464 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:25.326438 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9c098a5f-8f2e-4710-91cb-de1a207103e8-signing-cabundle\") pod \"service-ca-658d7b7c78-mmr2p\" (UID: \"9c098a5f-8f2e-4710-91cb-de1a207103e8\") " pod="openshift-service-ca/service-ca-658d7b7c78-mmr2p" Jul 27 16:28:25.328041 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:25.328023 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9c098a5f-8f2e-4710-91cb-de1a207103e8-signing-key\") pod \"service-ca-658d7b7c78-mmr2p\" (UID: \"9c098a5f-8f2e-4710-91cb-de1a207103e8\") " pod="openshift-service-ca/service-ca-658d7b7c78-mmr2p" Jul 27 16:28:25.333825 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:25.333808 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 27 16:28:25.344621 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:25.344590 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njlt2\" (UniqueName: \"kubernetes.io/projected/9c098a5f-8f2e-4710-91cb-de1a207103e8-kube-api-access-njlt2\") pod \"service-ca-658d7b7c78-mmr2p\" (UID: \"9c098a5f-8f2e-4710-91cb-de1a207103e8\") " pod="openshift-service-ca/service-ca-658d7b7c78-mmr2p" Jul 27 16:28:25.422738 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:25.422663 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-kw4cz\"" Jul 27 16:28:25.431391 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:25.431358 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-mmr2p" Jul 27 16:28:25.557561 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:25.557531 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-mmr2p"] Jul 27 16:28:25.560793 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:28:25.560772 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c098a5f_8f2e_4710_91cb_de1a207103e8.slice/crio-2bb90e1951ea5d98bc2c52609a1af234f0c4309c2c93ae8b4e0b33d91a5343ec WatchSource:0}: Error finding container 2bb90e1951ea5d98bc2c52609a1af234f0c4309c2c93ae8b4e0b33d91a5343ec: Status 404 returned error can't find the container with id 2bb90e1951ea5d98bc2c52609a1af234f0c4309c2c93ae8b4e0b33d91a5343ec Jul 27 16:28:26.076057 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:26.076023 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-mmr2p" event={"ID":"9c098a5f-8f2e-4710-91cb-de1a207103e8","Type":"ContainerStarted","Data":"2f4b46aa80872e0f7dac44ee49596b12c2d4a2923ddf6c0e1be6df8788b67707"} Jul 27 16:28:26.076263 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:26.076073 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-mmr2p" event={"ID":"9c098a5f-8f2e-4710-91cb-de1a207103e8","Type":"ContainerStarted","Data":"2bb90e1951ea5d98bc2c52609a1af234f0c4309c2c93ae8b4e0b33d91a5343ec"} Jul 27 16:28:26.094729 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:26.094672 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-mmr2p" podStartSLOduration=1.094657116 podStartE2EDuration="1.094657116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:28:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:28:26.094046002 +0000 UTC m=+241.303895873" watchObservedRunningTime="2026-07-27 16:28:26.094657116 +0000 UTC m=+241.304507043" Jul 27 16:28:26.987128 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:26.987076 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-2cqxv" Jul 27 16:28:26.987537 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:26.987156 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-2cqxv" Jul 27 16:28:26.987575 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:26.987553 2578 scope.go:117] "RemoveContainer" containerID="2db9855bc205f222ba6163f4ece293c9de3982e6c745870a5d10dad82815f9c8" Jul 27 16:28:26.987728 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:26.987709 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-2cqxv_openshift-console-operator(f7ba4530-6cc8-463f-9ac7-e9572867a152)\"" pod="openshift-console-operator/console-operator-584dcb6b54-2cqxv" podUID="f7ba4530-6cc8-463f-9ac7-e9572867a152" Jul 27 16:28:27.082375 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:27.082338 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-rtgzw" event={"ID":"53afaeae-3d4c-4833-a29a-5f29a4244412","Type":"ContainerStarted","Data":"b9ae4257b043bbc8318c8bd7c13453a1c119202dcc67003b0dd61819d0a53714"} Jul 27 16:28:27.082566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:27.082425 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-rtgzw" event={"ID":"53afaeae-3d4c-4833-a29a-5f29a4244412","Type":"ContainerStarted","Data":"81fc95c13e262784b0259dcff91ca1e5cae1cac15ab649aaef7f59c6705d5693"} Jul 27 16:28:27.103094 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:27.103046 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-rtgzw" podStartSLOduration=1.534988313 podStartE2EDuration="6.103030799s" totalImagesPullingTime="4.568042486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:28:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:28:27.102882716 +0000 UTC m=+242.312732589" watchObservedRunningTime="2026-07-27 16:28:27.103030799 +0000 UTC m=+242.312880671" Jul 27 16:28:28.645074 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:28.645031 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2ff8c\" (UID: \"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9\") " pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:28.645471 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:28.645089 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ff8c\" (UID: \"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9\") " pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:28.645471 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:28.645159 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 16:28:28.645471 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:28.645215 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 16:28:28.645471 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:28.645231 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-kube-rbac-proxy-cm podName:b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9 nodeName:}" failed. No retries permitted until 2026-07-27 16:28:36.645214378 +0000 UTC m=+251.855064232 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2ff8c" (UID: "b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9") : configmap "kube-rbac-proxy" not found Jul 27 16:28:28.645471 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:28.645264 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-insights-runtime-extractor-tls podName:b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9 nodeName:}" failed. No retries permitted until 2026-07-27 16:28:36.645249996 +0000 UTC m=+251.855099846 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2ff8c" (UID: "b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9") : secret "insights-runtime-extractor-tls" not found Jul 27 16:28:32.477534 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:32.477500 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/66de2422-6d67-4573-84f6-213a2c7f9e0b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-mfkn4\" (UID: \"66de2422-6d67-4573-84f6-213a2c7f9e0b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mfkn4" Jul 27 16:28:32.479786 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:32.479765 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/66de2422-6d67-4573-84f6-213a2c7f9e0b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-mfkn4\" (UID: \"66de2422-6d67-4573-84f6-213a2c7f9e0b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mfkn4" Jul 27 16:28:32.552766 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:32.552736 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xbfhq\"" Jul 27 16:28:32.561409 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:32.561385 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mfkn4" Jul 27 16:28:32.688034 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:32.688004 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mfkn4"] Jul 27 16:28:33.105957 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:33.105913 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mfkn4" event={"ID":"66de2422-6d67-4573-84f6-213a2c7f9e0b","Type":"ContainerStarted","Data":"dce3b9dd986060130382939f159ee60b433a1fc10a12ed8a21e99f8920eae6bc"} Jul 27 16:28:35.114556 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:35.114516 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mfkn4" event={"ID":"66de2422-6d67-4573-84f6-213a2c7f9e0b","Type":"ContainerStarted","Data":"23724017f8bc7453d104b4c9d194ef3aae3d501bb12dc9688b634485ecad4223"} Jul 27 16:28:35.114945 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:35.114585 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mfkn4" event={"ID":"66de2422-6d67-4573-84f6-213a2c7f9e0b","Type":"ContainerStarted","Data":"553c9b36675117e1373ddddae0a81da4de54d7dc74ae94b52cb26ec1e929bf18"} Jul 27 16:28:35.131234 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:35.131184 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mfkn4" podStartSLOduration=17.0983346 podStartE2EDuration="19.131169427s" totalImagesPullingTime="2.032834827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:28:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:28:35.1303414 +0000 UTC m=+250.340191271" watchObservedRunningTime="2026-07-27 16:28:35.131169427 +0000 UTC m=+250.341019299" Jul 27 16:28:36.210249 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:36.210209 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs\") pod \"network-metrics-daemon-ttj4w\" (UID: \"7d73c7ed-f214-4fae-b194-9bae83a86b47\") " pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:28:36.212594 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:36.212565 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d73c7ed-f214-4fae-b194-9bae83a86b47-metrics-certs\") pod \"network-metrics-daemon-ttj4w\" (UID: \"7d73c7ed-f214-4fae-b194-9bae83a86b47\") " pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:28:36.475668 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:36.475586 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rrtwx\"" Jul 27 16:28:36.484282 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:36.484257 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ttj4w" Jul 27 16:28:36.609830 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:36.609807 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ttj4w"] Jul 27 16:28:36.612439 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:28:36.612409 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d73c7ed_f214_4fae_b194_9bae83a86b47.slice/crio-f35fc3a2495dd846cbafa4ba1a4e79dc233e42c27821d8169103cf67b88bbb9e WatchSource:0}: Error finding container f35fc3a2495dd846cbafa4ba1a4e79dc233e42c27821d8169103cf67b88bbb9e: Status 404 returned error can't find the container with id f35fc3a2495dd846cbafa4ba1a4e79dc233e42c27821d8169103cf67b88bbb9e Jul 27 16:28:36.714648 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:36.714609 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2ff8c\" (UID: \"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9\") " pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:36.714828 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:36.714660 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ff8c\" (UID: \"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9\") " pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:36.714828 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:36.714757 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 16:28:36.714828 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:36.714809 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-insights-runtime-extractor-tls podName:b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9 nodeName:}" failed. No retries permitted until 2026-07-27 16:28:52.714796121 +0000 UTC m=+267.924645971 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2ff8c" (UID: "b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9") : secret "insights-runtime-extractor-tls" not found Jul 27 16:28:36.715176 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:36.715158 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2ff8c\" (UID: \"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9\") " pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:37.121031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:37.120996 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ttj4w" event={"ID":"7d73c7ed-f214-4fae-b194-9bae83a86b47","Type":"ContainerStarted","Data":"f35fc3a2495dd846cbafa4ba1a4e79dc233e42c27821d8169103cf67b88bbb9e"} Jul 27 16:28:38.126113 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:38.126078 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ttj4w" event={"ID":"7d73c7ed-f214-4fae-b194-9bae83a86b47","Type":"ContainerStarted","Data":"b8c9518fd4c884d32fa068353ce0a8de5fc92bfee0b3015f19f34cde5e39d1e4"} Jul 27 16:28:38.126479 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:38.126132 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ttj4w" event={"ID":"7d73c7ed-f214-4fae-b194-9bae83a86b47","Type":"ContainerStarted","Data":"d166d6a59a0dcf3f228885cb1e239df73d013a4b6a30d9a36f50d486d0c5977c"} Jul 27 16:28:38.145282 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:38.145234 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ttj4w" podStartSLOduration=251.113407533 podStartE2EDuration="4m12.145218035s" totalImagesPullingTime="1.031810502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:28:38.144007175 +0000 UTC m=+253.353857047" watchObservedRunningTime="2026-07-27 16:28:38.145218035 +0000 UTC m=+253.355067901" Jul 27 16:28:38.372960 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:38.372931 2578 scope.go:117] "RemoveContainer" containerID="2db9855bc205f222ba6163f4ece293c9de3982e6c745870a5d10dad82815f9c8" Jul 27 16:28:39.131643 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:39.131616 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2cqxv_f7ba4530-6cc8-463f-9ac7-e9572867a152/console-operator/1.log" Jul 27 16:28:39.132066 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:39.131738 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-2cqxv" event={"ID":"f7ba4530-6cc8-463f-9ac7-e9572867a152","Type":"ContainerStarted","Data":"d7fe85b9579e8583bfd2b47036ba6bc84a69d7010f7948f81e44f2f6484581ac"} Jul 27 16:28:39.132150 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:39.132110 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-2cqxv" Jul 27 16:28:39.153943 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:39.153886 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-2cqxv" podStartSLOduration=19.959010078 podStartE2EDuration="23.153866334s" totalImagesPullingTime="3.194856256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:28:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:28:39.15259699 +0000 UTC m=+254.362446862" watchObservedRunningTime="2026-07-27 16:28:39.153866334 +0000 UTC m=+254.363716202" Jul 27 16:28:39.228151 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:39.228124 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-2cqxv" Jul 27 16:28:48.627116 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:48.627085 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9ff648bc7-9pq7k"] Jul 27 16:28:48.627560 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:28:48.627325 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" podUID="87a7e98f-c108-4469-ac83-bcb91660a1e6" Jul 27 16:28:48.746337 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:48.746295 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68b65b9694-9glf6"] Jul 27 16:28:48.773453 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:48.773421 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68b65b9694-9glf6"] Jul 27 16:28:48.773604 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:48.773529 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:28:48.912940 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:48.912827 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ac49ea94-cb43-44ca-a783-1ceee9a4698e-ca-trust-extracted\") pod \"image-registry-68b65b9694-9glf6\" (UID: \"ac49ea94-cb43-44ca-a783-1ceee9a4698e\") " pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:28:48.912940 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:48.912889 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ac49ea94-cb43-44ca-a783-1ceee9a4698e-installation-pull-secrets\") pod \"image-registry-68b65b9694-9glf6\" (UID: \"ac49ea94-cb43-44ca-a783-1ceee9a4698e\") " pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:28:48.912940 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:48.912935 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac49ea94-cb43-44ca-a783-1ceee9a4698e-trusted-ca\") pod \"image-registry-68b65b9694-9glf6\" (UID: \"ac49ea94-cb43-44ca-a783-1ceee9a4698e\") " pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:28:48.913181 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:48.912957 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac49ea94-cb43-44ca-a783-1ceee9a4698e-bound-sa-token\") pod \"image-registry-68b65b9694-9glf6\" (UID: \"ac49ea94-cb43-44ca-a783-1ceee9a4698e\") " pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:28:48.913181 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:48.913002 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ac49ea94-cb43-44ca-a783-1ceee9a4698e-registry-tls\") pod \"image-registry-68b65b9694-9glf6\" (UID: \"ac49ea94-cb43-44ca-a783-1ceee9a4698e\") " pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:28:48.913181 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:48.913029 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ac49ea94-cb43-44ca-a783-1ceee9a4698e-image-registry-private-configuration\") pod \"image-registry-68b65b9694-9glf6\" (UID: \"ac49ea94-cb43-44ca-a783-1ceee9a4698e\") " pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:28:48.913181 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:48.913062 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hkxs\" (UniqueName: \"kubernetes.io/projected/ac49ea94-cb43-44ca-a783-1ceee9a4698e-kube-api-access-8hkxs\") pod \"image-registry-68b65b9694-9glf6\" (UID: \"ac49ea94-cb43-44ca-a783-1ceee9a4698e\") " pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:28:48.913181 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:48.913088 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ac49ea94-cb43-44ca-a783-1ceee9a4698e-registry-certificates\") pod \"image-registry-68b65b9694-9glf6\" (UID: \"ac49ea94-cb43-44ca-a783-1ceee9a4698e\") " pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:28:49.013812 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.013770 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ac49ea94-cb43-44ca-a783-1ceee9a4698e-registry-tls\") pod \"image-registry-68b65b9694-9glf6\" (UID: \"ac49ea94-cb43-44ca-a783-1ceee9a4698e\") " pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:28:49.014023 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.013821 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ac49ea94-cb43-44ca-a783-1ceee9a4698e-image-registry-private-configuration\") pod \"image-registry-68b65b9694-9glf6\" (UID: \"ac49ea94-cb43-44ca-a783-1ceee9a4698e\") " pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:28:49.014023 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.013881 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hkxs\" (UniqueName: \"kubernetes.io/projected/ac49ea94-cb43-44ca-a783-1ceee9a4698e-kube-api-access-8hkxs\") pod \"image-registry-68b65b9694-9glf6\" (UID: \"ac49ea94-cb43-44ca-a783-1ceee9a4698e\") " pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:28:49.014023 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.013906 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ac49ea94-cb43-44ca-a783-1ceee9a4698e-registry-certificates\") pod \"image-registry-68b65b9694-9glf6\" (UID: \"ac49ea94-cb43-44ca-a783-1ceee9a4698e\") " pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:28:49.014189 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.014038 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ac49ea94-cb43-44ca-a783-1ceee9a4698e-ca-trust-extracted\") pod \"image-registry-68b65b9694-9glf6\" (UID: \"ac49ea94-cb43-44ca-a783-1ceee9a4698e\") " pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:28:49.014189 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.014078 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ac49ea94-cb43-44ca-a783-1ceee9a4698e-installation-pull-secrets\") pod \"image-registry-68b65b9694-9glf6\" (UID: \"ac49ea94-cb43-44ca-a783-1ceee9a4698e\") " pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:28:49.014315 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.014233 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac49ea94-cb43-44ca-a783-1ceee9a4698e-trusted-ca\") pod \"image-registry-68b65b9694-9glf6\" (UID: \"ac49ea94-cb43-44ca-a783-1ceee9a4698e\") " pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:28:49.014315 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.014280 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac49ea94-cb43-44ca-a783-1ceee9a4698e-bound-sa-token\") pod \"image-registry-68b65b9694-9glf6\" (UID: \"ac49ea94-cb43-44ca-a783-1ceee9a4698e\") " pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:28:49.014489 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.014458 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ac49ea94-cb43-44ca-a783-1ceee9a4698e-ca-trust-extracted\") pod \"image-registry-68b65b9694-9glf6\" (UID: \"ac49ea94-cb43-44ca-a783-1ceee9a4698e\") " pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:28:49.015001 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.014974 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ac49ea94-cb43-44ca-a783-1ceee9a4698e-registry-certificates\") pod \"image-registry-68b65b9694-9glf6\" (UID: \"ac49ea94-cb43-44ca-a783-1ceee9a4698e\") " pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:28:49.015333 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.015305 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac49ea94-cb43-44ca-a783-1ceee9a4698e-trusted-ca\") pod \"image-registry-68b65b9694-9glf6\" (UID: \"ac49ea94-cb43-44ca-a783-1ceee9a4698e\") " pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:28:49.016466 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.016442 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ac49ea94-cb43-44ca-a783-1ceee9a4698e-image-registry-private-configuration\") pod \"image-registry-68b65b9694-9glf6\" (UID: \"ac49ea94-cb43-44ca-a783-1ceee9a4698e\") " pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:28:49.016545 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.016508 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ac49ea94-cb43-44ca-a783-1ceee9a4698e-registry-tls\") pod \"image-registry-68b65b9694-9glf6\" (UID: \"ac49ea94-cb43-44ca-a783-1ceee9a4698e\") " pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:28:49.016623 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.016602 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ac49ea94-cb43-44ca-a783-1ceee9a4698e-installation-pull-secrets\") pod \"image-registry-68b65b9694-9glf6\" (UID: \"ac49ea94-cb43-44ca-a783-1ceee9a4698e\") " pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:28:49.027656 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.027633 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac49ea94-cb43-44ca-a783-1ceee9a4698e-bound-sa-token\") pod \"image-registry-68b65b9694-9glf6\" (UID: \"ac49ea94-cb43-44ca-a783-1ceee9a4698e\") " pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:28:49.027962 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.027943 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hkxs\" (UniqueName: \"kubernetes.io/projected/ac49ea94-cb43-44ca-a783-1ceee9a4698e-kube-api-access-8hkxs\") pod \"image-registry-68b65b9694-9glf6\" (UID: \"ac49ea94-cb43-44ca-a783-1ceee9a4698e\") " pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:28:49.084738 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.084708 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kc6vj\"" Jul 27 16:28:49.093406 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.093378 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:28:49.175644 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.173537 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:28:49.210488 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.210435 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:28:49.283705 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.283679 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68b65b9694-9glf6"] Jul 27 16:28:49.284974 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:28:49.284948 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac49ea94_cb43_44ca_a783_1ceee9a4698e.slice/crio-55bd4e59c483f0bb22bf585c411411b72b15ca23a59b93dd25aa9a30a3fd92e7 WatchSource:0}: Error finding container 55bd4e59c483f0bb22bf585c411411b72b15ca23a59b93dd25aa9a30a3fd92e7: Status 404 returned error can't find the container with id 55bd4e59c483f0bb22bf585c411411b72b15ca23a59b93dd25aa9a30a3fd92e7 Jul 27 16:28:49.317514 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.317486 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87a7e98f-c108-4469-ac83-bcb91660a1e6-installation-pull-secrets\") pod \"87a7e98f-c108-4469-ac83-bcb91660a1e6\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " Jul 27 16:28:49.317630 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.317535 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-bound-sa-token\") pod \"87a7e98f-c108-4469-ac83-bcb91660a1e6\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " Jul 27 16:28:49.317630 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.317594 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87a7e98f-c108-4469-ac83-bcb91660a1e6-image-registry-private-configuration\") pod \"87a7e98f-c108-4469-ac83-bcb91660a1e6\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " Jul 27 16:28:49.317800 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.317628 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-certificates\") pod \"87a7e98f-c108-4469-ac83-bcb91660a1e6\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " Jul 27 16:28:49.317800 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.317663 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87a7e98f-c108-4469-ac83-bcb91660a1e6-ca-trust-extracted\") pod \"87a7e98f-c108-4469-ac83-bcb91660a1e6\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " Jul 27 16:28:49.317800 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.317707 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87a7e98f-c108-4469-ac83-bcb91660a1e6-trusted-ca\") pod \"87a7e98f-c108-4469-ac83-bcb91660a1e6\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " Jul 27 16:28:49.317800 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.317762 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dvjr\" (UniqueName: \"kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-kube-api-access-9dvjr\") pod \"87a7e98f-c108-4469-ac83-bcb91660a1e6\" (UID: \"87a7e98f-c108-4469-ac83-bcb91660a1e6\") " Jul 27 16:28:49.318223 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.318186 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87a7e98f-c108-4469-ac83-bcb91660a1e6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "87a7e98f-c108-4469-ac83-bcb91660a1e6" (UID: "87a7e98f-c108-4469-ac83-bcb91660a1e6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 16:28:49.318319 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.318290 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87a7e98f-c108-4469-ac83-bcb91660a1e6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "87a7e98f-c108-4469-ac83-bcb91660a1e6" (UID: "87a7e98f-c108-4469-ac83-bcb91660a1e6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 16:28:49.318360 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.318337 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "87a7e98f-c108-4469-ac83-bcb91660a1e6" (UID: "87a7e98f-c108-4469-ac83-bcb91660a1e6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 16:28:49.320060 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.320032 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87a7e98f-c108-4469-ac83-bcb91660a1e6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "87a7e98f-c108-4469-ac83-bcb91660a1e6" (UID: "87a7e98f-c108-4469-ac83-bcb91660a1e6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 16:28:49.320168 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.320149 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87a7e98f-c108-4469-ac83-bcb91660a1e6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "87a7e98f-c108-4469-ac83-bcb91660a1e6" (UID: "87a7e98f-c108-4469-ac83-bcb91660a1e6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 16:28:49.320418 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.320391 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "87a7e98f-c108-4469-ac83-bcb91660a1e6" (UID: "87a7e98f-c108-4469-ac83-bcb91660a1e6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:28:49.320482 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.320447 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-kube-api-access-9dvjr" (OuterVolumeSpecName: "kube-api-access-9dvjr") pod "87a7e98f-c108-4469-ac83-bcb91660a1e6" (UID: "87a7e98f-c108-4469-ac83-bcb91660a1e6"). InnerVolumeSpecName "kube-api-access-9dvjr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:28:49.418545 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.418516 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87a7e98f-c108-4469-ac83-bcb91660a1e6-image-registry-private-configuration\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:28:49.418545 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.418538 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-certificates\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:28:49.418545 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.418549 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87a7e98f-c108-4469-ac83-bcb91660a1e6-ca-trust-extracted\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:28:49.418732 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.418560 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87a7e98f-c108-4469-ac83-bcb91660a1e6-trusted-ca\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:28:49.418732 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.418569 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dvjr\" (UniqueName: \"kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-kube-api-access-9dvjr\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:28:49.418732 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.418577 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87a7e98f-c108-4469-ac83-bcb91660a1e6-installation-pull-secrets\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:28:49.418732 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:49.418585 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-bound-sa-token\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:28:50.178332 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:50.178297 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68b65b9694-9glf6" event={"ID":"ac49ea94-cb43-44ca-a783-1ceee9a4698e","Type":"ContainerStarted","Data":"2b3997b4721e30024b85affb67aab2b88c5afd54be14491b896a09242f908ecf"} Jul 27 16:28:50.178332 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:50.178314 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9ff648bc7-9pq7k" Jul 27 16:28:50.178877 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:50.178345 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68b65b9694-9glf6" event={"ID":"ac49ea94-cb43-44ca-a783-1ceee9a4698e","Type":"ContainerStarted","Data":"55bd4e59c483f0bb22bf585c411411b72b15ca23a59b93dd25aa9a30a3fd92e7"} Jul 27 16:28:50.178877 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:50.178498 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:28:50.225306 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:50.225258 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68b65b9694-9glf6" podStartSLOduration=2.225244555 podStartE2EDuration="2.225244555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:28:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:28:50.225006018 +0000 UTC m=+265.434855911" watchObservedRunningTime="2026-07-27 16:28:50.225244555 +0000 UTC m=+265.435094427" Jul 27 16:28:50.270396 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:50.270366 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9ff648bc7-9pq7k"] Jul 27 16:28:50.275932 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:50.275870 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-9ff648bc7-9pq7k"] Jul 27 16:28:50.426393 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:50.426362 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87a7e98f-c108-4469-ac83-bcb91660a1e6-registry-tls\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:28:50.965692 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:50.965658 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84f7b69d5f-sr69p"] Jul 27 16:28:50.998805 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:50.998780 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84f7b69d5f-sr69p"] Jul 27 16:28:50.998966 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:50.998894 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f7b69d5f-sr69p" Jul 27 16:28:51.001800 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.001779 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 27 16:28:51.001965 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.001947 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 27 16:28:51.002027 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.002013 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 27 16:28:51.002097 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.002078 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 27 16:28:51.002137 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.002123 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 27 16:28:51.003545 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.003526 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 27 16:28:51.003662 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.003646 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 27 16:28:51.003709 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.003690 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tn6dk\"" Jul 27 16:28:51.131837 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.131805 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ce9fb4b-6111-42fc-b820-e01d7a60d130-console-serving-cert\") pod \"console-84f7b69d5f-sr69p\" (UID: \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\") " pod="openshift-console/console-84f7b69d5f-sr69p" Jul 27 16:28:51.131837 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.131869 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kwzm\" (UniqueName: \"kubernetes.io/projected/9ce9fb4b-6111-42fc-b820-e01d7a60d130-kube-api-access-7kwzm\") pod \"console-84f7b69d5f-sr69p\" (UID: \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\") " pod="openshift-console/console-84f7b69d5f-sr69p" Jul 27 16:28:51.132092 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.131945 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ce9fb4b-6111-42fc-b820-e01d7a60d130-service-ca\") pod \"console-84f7b69d5f-sr69p\" (UID: \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\") " pod="openshift-console/console-84f7b69d5f-sr69p" Jul 27 16:28:51.132092 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.131989 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ce9fb4b-6111-42fc-b820-e01d7a60d130-oauth-serving-cert\") pod \"console-84f7b69d5f-sr69p\" (UID: \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\") " pod="openshift-console/console-84f7b69d5f-sr69p" Jul 27 16:28:51.132092 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.132079 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ce9fb4b-6111-42fc-b820-e01d7a60d130-console-oauth-config\") pod \"console-84f7b69d5f-sr69p\" (UID: \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\") " pod="openshift-console/console-84f7b69d5f-sr69p" Jul 27 16:28:51.132195 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.132096 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ce9fb4b-6111-42fc-b820-e01d7a60d130-console-config\") pod \"console-84f7b69d5f-sr69p\" (UID: \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\") " pod="openshift-console/console-84f7b69d5f-sr69p" Jul 27 16:28:51.232674 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.232585 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ce9fb4b-6111-42fc-b820-e01d7a60d130-oauth-serving-cert\") pod \"console-84f7b69d5f-sr69p\" (UID: \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\") " pod="openshift-console/console-84f7b69d5f-sr69p" Jul 27 16:28:51.232674 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.232658 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ce9fb4b-6111-42fc-b820-e01d7a60d130-console-oauth-config\") pod \"console-84f7b69d5f-sr69p\" (UID: \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\") " pod="openshift-console/console-84f7b69d5f-sr69p" Jul 27 16:28:51.233114 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.232675 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ce9fb4b-6111-42fc-b820-e01d7a60d130-console-config\") pod \"console-84f7b69d5f-sr69p\" (UID: \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\") " pod="openshift-console/console-84f7b69d5f-sr69p" Jul 27 16:28:51.233114 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.232713 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ce9fb4b-6111-42fc-b820-e01d7a60d130-console-serving-cert\") pod \"console-84f7b69d5f-sr69p\" (UID: \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\") " pod="openshift-console/console-84f7b69d5f-sr69p" Jul 27 16:28:51.233114 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.232730 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kwzm\" (UniqueName: \"kubernetes.io/projected/9ce9fb4b-6111-42fc-b820-e01d7a60d130-kube-api-access-7kwzm\") pod \"console-84f7b69d5f-sr69p\" (UID: \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\") " pod="openshift-console/console-84f7b69d5f-sr69p" Jul 27 16:28:51.233114 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.232755 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ce9fb4b-6111-42fc-b820-e01d7a60d130-service-ca\") pod \"console-84f7b69d5f-sr69p\" (UID: \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\") " pod="openshift-console/console-84f7b69d5f-sr69p" Jul 27 16:28:51.233378 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.233360 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ce9fb4b-6111-42fc-b820-e01d7a60d130-oauth-serving-cert\") pod \"console-84f7b69d5f-sr69p\" (UID: \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\") " pod="openshift-console/console-84f7b69d5f-sr69p" Jul 27 16:28:51.233455 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.233439 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ce9fb4b-6111-42fc-b820-e01d7a60d130-console-config\") pod \"console-84f7b69d5f-sr69p\" (UID: \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\") " pod="openshift-console/console-84f7b69d5f-sr69p" Jul 27 16:28:51.233507 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.233439 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ce9fb4b-6111-42fc-b820-e01d7a60d130-service-ca\") pod \"console-84f7b69d5f-sr69p\" (UID: \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\") " pod="openshift-console/console-84f7b69d5f-sr69p" Jul 27 16:28:51.235221 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.235201 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ce9fb4b-6111-42fc-b820-e01d7a60d130-console-serving-cert\") pod \"console-84f7b69d5f-sr69p\" (UID: \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\") " pod="openshift-console/console-84f7b69d5f-sr69p" Jul 27 16:28:51.235328 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.235245 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ce9fb4b-6111-42fc-b820-e01d7a60d130-console-oauth-config\") pod \"console-84f7b69d5f-sr69p\" (UID: \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\") " pod="openshift-console/console-84f7b69d5f-sr69p" Jul 27 16:28:51.242367 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.242340 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kwzm\" (UniqueName: \"kubernetes.io/projected/9ce9fb4b-6111-42fc-b820-e01d7a60d130-kube-api-access-7kwzm\") pod \"console-84f7b69d5f-sr69p\" (UID: \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\") " pod="openshift-console/console-84f7b69d5f-sr69p" Jul 27 16:28:51.308140 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.308101 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f7b69d5f-sr69p" Jul 27 16:28:51.376954 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.376923 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87a7e98f-c108-4469-ac83-bcb91660a1e6" path="/var/lib/kubelet/pods/87a7e98f-c108-4469-ac83-bcb91660a1e6/volumes" Jul 27 16:28:51.442601 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:51.442571 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84f7b69d5f-sr69p"] Jul 27 16:28:51.445490 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:28:51.445465 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ce9fb4b_6111_42fc_b820_e01d7a60d130.slice/crio-66e9c26682dedeaa7fcac1afed0c37fb96ba2881bfa92ef8c8dbba77e1d6bf24 WatchSource:0}: Error finding container 66e9c26682dedeaa7fcac1afed0c37fb96ba2881bfa92ef8c8dbba77e1d6bf24: Status 404 returned error can't find the container with id 66e9c26682dedeaa7fcac1afed0c37fb96ba2881bfa92ef8c8dbba77e1d6bf24 Jul 27 16:28:52.187775 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:52.187707 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f7b69d5f-sr69p" event={"ID":"9ce9fb4b-6111-42fc-b820-e01d7a60d130","Type":"ContainerStarted","Data":"66e9c26682dedeaa7fcac1afed0c37fb96ba2881bfa92ef8c8dbba77e1d6bf24"} Jul 27 16:28:52.746576 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:52.746541 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ff8c\" (UID: \"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9\") " pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:52.749497 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:52.749457 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ff8c\" (UID: \"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9\") " pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:52.765281 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:52.765257 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x8wvw\"" Jul 27 16:28:52.774238 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:52.774212 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2ff8c" Jul 27 16:28:52.923211 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:52.923182 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2ff8c"] Jul 27 16:28:52.926492 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:28:52.926451 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb44e0e18_fa08_47e4_92fd_7d1e7a3c76b9.slice/crio-ec374e4de7571c873e11d66f92d43b245cd1c76529673df18aca09ab4c158681 WatchSource:0}: Error finding container ec374e4de7571c873e11d66f92d43b245cd1c76529673df18aca09ab4c158681: Status 404 returned error can't find the container with id ec374e4de7571c873e11d66f92d43b245cd1c76529673df18aca09ab4c158681 Jul 27 16:28:53.193052 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:53.193016 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2ff8c" event={"ID":"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9","Type":"ContainerStarted","Data":"ec374e4de7571c873e11d66f92d43b245cd1c76529673df18aca09ab4c158681"} Jul 27 16:28:55.202115 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:55.202075 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f7b69d5f-sr69p" event={"ID":"9ce9fb4b-6111-42fc-b820-e01d7a60d130","Type":"ContainerStarted","Data":"dca8a77e7fd5432967ea165ded74fb1a819715a6441379d1d4af5ee0749e7541"} Jul 27 16:28:55.222440 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:28:55.222391 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84f7b69d5f-sr69p" podStartSLOduration=2.243914923 podStartE2EDuration="5.222375672s" totalImagesPullingTime="2.978460749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:28:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:28:55.220774129 +0000 UTC m=+270.430624002" watchObservedRunningTime="2026-07-27 16:28:55.222375672 +0000 UTC m=+270.432225544" Jul 27 16:29:01.227050 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:01.227015 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2ff8c" event={"ID":"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9","Type":"ContainerStarted","Data":"533f5aafde350018b9d6fec893b2de67643e663142aa76beb03ac2542743e57a"} Jul 27 16:29:01.308411 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:01.308373 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84f7b69d5f-sr69p" Jul 27 16:29:01.308589 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:01.308455 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84f7b69d5f-sr69p" Jul 27 16:29:01.310005 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:01.309972 2578 patch_prober.go:28] interesting pod/console-84f7b69d5f-sr69p container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jul 27 16:29:01.310139 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:01.310027 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-84f7b69d5f-sr69p" podUID="9ce9fb4b-6111-42fc-b820-e01d7a60d130" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jul 27 16:29:02.323061 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:02.323030 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66dcd899f7-mpb7g"] Jul 27 16:29:02.337263 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:02.337222 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66dcd899f7-mpb7g"] Jul 27 16:29:02.337430 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:02.337340 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:02.345568 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:02.345349 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 27 16:29:02.436817 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:02.436769 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9248accd-2f38-473d-a0f4-2f8e802e3679-console-config\") pod \"console-66dcd899f7-mpb7g\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:02.436995 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:02.436819 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9248accd-2f38-473d-a0f4-2f8e802e3679-console-serving-cert\") pod \"console-66dcd899f7-mpb7g\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:02.436995 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:02.436923 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9248accd-2f38-473d-a0f4-2f8e802e3679-console-oauth-config\") pod \"console-66dcd899f7-mpb7g\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:02.437107 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:02.436995 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb7zm\" (UniqueName: \"kubernetes.io/projected/9248accd-2f38-473d-a0f4-2f8e802e3679-kube-api-access-kb7zm\") pod \"console-66dcd899f7-mpb7g\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:02.437107 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:02.437026 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9248accd-2f38-473d-a0f4-2f8e802e3679-trusted-ca-bundle\") pod \"console-66dcd899f7-mpb7g\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:02.437205 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:02.437112 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9248accd-2f38-473d-a0f4-2f8e802e3679-service-ca\") pod \"console-66dcd899f7-mpb7g\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:02.437205 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:02.437155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9248accd-2f38-473d-a0f4-2f8e802e3679-oauth-serving-cert\") pod \"console-66dcd899f7-mpb7g\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:02.538340 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:02.538304 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9248accd-2f38-473d-a0f4-2f8e802e3679-console-config\") pod \"console-66dcd899f7-mpb7g\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:02.538340 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:02.538346 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9248accd-2f38-473d-a0f4-2f8e802e3679-console-serving-cert\") pod \"console-66dcd899f7-mpb7g\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:02.538588 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:02.538380 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9248accd-2f38-473d-a0f4-2f8e802e3679-console-oauth-config\") pod \"console-66dcd899f7-mpb7g\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:02.538588 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:02.538421 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb7zm\" (UniqueName: \"kubernetes.io/projected/9248accd-2f38-473d-a0f4-2f8e802e3679-kube-api-access-kb7zm\") pod \"console-66dcd899f7-mpb7g\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:02.538588 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:02.538456 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9248accd-2f38-473d-a0f4-2f8e802e3679-trusted-ca-bundle\") pod \"console-66dcd899f7-mpb7g\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:02.538726 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:02.538585 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9248accd-2f38-473d-a0f4-2f8e802e3679-service-ca\") pod \"console-66dcd899f7-mpb7g\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:02.538726 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:02.538628 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9248accd-2f38-473d-a0f4-2f8e802e3679-oauth-serving-cert\") pod \"console-66dcd899f7-mpb7g\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:02.539131 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:02.539106 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9248accd-2f38-473d-a0f4-2f8e802e3679-console-config\") pod \"console-66dcd899f7-mpb7g\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:02.539393 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:02.539343 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9248accd-2f38-473d-a0f4-2f8e802e3679-service-ca\") pod \"console-66dcd899f7-mpb7g\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:02.539494 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:02.539466 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9248accd-2f38-473d-a0f4-2f8e802e3679-trusted-ca-bundle\") pod \"console-66dcd899f7-mpb7g\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:02.539767 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:02.539746 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9248accd-2f38-473d-a0f4-2f8e802e3679-oauth-serving-cert\") pod \"console-66dcd899f7-mpb7g\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:02.541361 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:02.541341 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9248accd-2f38-473d-a0f4-2f8e802e3679-console-oauth-config\") pod \"console-66dcd899f7-mpb7g\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:02.541561 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:02.541536 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9248accd-2f38-473d-a0f4-2f8e802e3679-console-serving-cert\") pod \"console-66dcd899f7-mpb7g\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:02.547386 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:02.547367 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb7zm\" (UniqueName: \"kubernetes.io/projected/9248accd-2f38-473d-a0f4-2f8e802e3679-kube-api-access-kb7zm\") pod \"console-66dcd899f7-mpb7g\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:02.647962 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:02.647884 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:03.721218 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:03.721188 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66dcd899f7-mpb7g"] Jul 27 16:29:03.723651 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:29:03.723621 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9248accd_2f38_473d_a0f4_2f8e802e3679.slice/crio-a8d9a7b219aab824600cfd0c2207cb965ee00ab83b68971a3d2713da84b2cce9 WatchSource:0}: Error finding container a8d9a7b219aab824600cfd0c2207cb965ee00ab83b68971a3d2713da84b2cce9: Status 404 returned error can't find the container with id a8d9a7b219aab824600cfd0c2207cb965ee00ab83b68971a3d2713da84b2cce9 Jul 27 16:29:04.242463 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.242415 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2ff8c" event={"ID":"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9","Type":"ContainerStarted","Data":"8fc78ead7f43b870a609c1e43818e7f85649c4cd2ce4482d2313898935511257"} Jul 27 16:29:04.244383 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.244351 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66dcd899f7-mpb7g" event={"ID":"9248accd-2f38-473d-a0f4-2f8e802e3679","Type":"ContainerStarted","Data":"84be4021f180ceeada59c3602d25c1c0d1c94249a9eca23701c42e9dc6cac6d3"} Jul 27 16:29:04.244516 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.244403 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66dcd899f7-mpb7g" event={"ID":"9248accd-2f38-473d-a0f4-2f8e802e3679","Type":"ContainerStarted","Data":"a8d9a7b219aab824600cfd0c2207cb965ee00ab83b68971a3d2713da84b2cce9"} Jul 27 16:29:04.271018 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.270965 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66dcd899f7-mpb7g" podStartSLOduration=2.270948228 podStartE2EDuration="2.270948228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:29:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:29:04.269577833 +0000 UTC m=+279.479427706" watchObservedRunningTime="2026-07-27 16:29:04.270948228 +0000 UTC m=+279.480798165" Jul 27 16:29:04.565401 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.565074 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-q2rzs"] Jul 27 16:29:04.569513 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.568734 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:04.571970 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.571453 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 27 16:29:04.571970 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.571573 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 27 16:29:04.571970 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.571763 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 27 16:29:04.571970 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.571818 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g5zfk\"" Jul 27 16:29:04.572313 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.572010 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 27 16:29:04.572313 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.572165 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 27 16:29:04.572424 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.572321 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 27 16:29:04.759213 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.759101 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ceeb9e64-0822-4be7-bf8e-2477efec381a-node-exporter-accelerators-collector-config\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:04.759921 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.759782 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ceeb9e64-0822-4be7-bf8e-2477efec381a-node-exporter-tls\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:04.760453 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.759837 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ceeb9e64-0822-4be7-bf8e-2477efec381a-sys\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:04.760453 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.760134 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ceeb9e64-0822-4be7-bf8e-2477efec381a-root\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:04.760453 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.760170 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ceeb9e64-0822-4be7-bf8e-2477efec381a-node-exporter-wtmp\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:04.760453 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.760214 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ceeb9e64-0822-4be7-bf8e-2477efec381a-metrics-client-ca\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:04.760453 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.760240 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ceeb9e64-0822-4be7-bf8e-2477efec381a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:04.760453 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.760293 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7d7s\" (UniqueName: \"kubernetes.io/projected/ceeb9e64-0822-4be7-bf8e-2477efec381a-kube-api-access-q7d7s\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:04.760453 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.760335 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ceeb9e64-0822-4be7-bf8e-2477efec381a-node-exporter-textfile\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:04.862919 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.861645 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ceeb9e64-0822-4be7-bf8e-2477efec381a-node-exporter-textfile\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:04.862919 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.861702 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ceeb9e64-0822-4be7-bf8e-2477efec381a-node-exporter-accelerators-collector-config\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:04.862919 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.861761 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ceeb9e64-0822-4be7-bf8e-2477efec381a-node-exporter-tls\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:04.862919 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.861795 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ceeb9e64-0822-4be7-bf8e-2477efec381a-sys\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:04.862919 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.861822 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ceeb9e64-0822-4be7-bf8e-2477efec381a-root\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:04.862919 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.861858 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ceeb9e64-0822-4be7-bf8e-2477efec381a-node-exporter-wtmp\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:04.862919 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.861893 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ceeb9e64-0822-4be7-bf8e-2477efec381a-metrics-client-ca\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:04.862919 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.861918 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ceeb9e64-0822-4be7-bf8e-2477efec381a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:04.862919 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.861961 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7d7s\" (UniqueName: \"kubernetes.io/projected/ceeb9e64-0822-4be7-bf8e-2477efec381a-kube-api-access-q7d7s\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:04.862919 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.862161 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ceeb9e64-0822-4be7-bf8e-2477efec381a-sys\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:04.862919 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.862483 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ceeb9e64-0822-4be7-bf8e-2477efec381a-node-exporter-textfile\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:04.863568 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:29:04.863059 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 27 16:29:04.863568 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:29:04.863134 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceeb9e64-0822-4be7-bf8e-2477efec381a-node-exporter-tls podName:ceeb9e64-0822-4be7-bf8e-2477efec381a nodeName:}" failed. No retries permitted until 2026-07-27 16:29:05.363112014 +0000 UTC m=+280.572961867 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ceeb9e64-0822-4be7-bf8e-2477efec381a-node-exporter-tls") pod "node-exporter-q2rzs" (UID: "ceeb9e64-0822-4be7-bf8e-2477efec381a") : secret "node-exporter-tls" not found Jul 27 16:29:04.863568 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.863473 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ceeb9e64-0822-4be7-bf8e-2477efec381a-node-exporter-wtmp\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:04.863568 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.863532 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ceeb9e64-0822-4be7-bf8e-2477efec381a-root\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:04.864680 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.864065 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ceeb9e64-0822-4be7-bf8e-2477efec381a-metrics-client-ca\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:04.864680 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.864366 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ceeb9e64-0822-4be7-bf8e-2477efec381a-node-exporter-accelerators-collector-config\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:04.867523 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.867328 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ceeb9e64-0822-4be7-bf8e-2477efec381a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:04.881136 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:04.881070 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7d7s\" (UniqueName: \"kubernetes.io/projected/ceeb9e64-0822-4be7-bf8e-2477efec381a-kube-api-access-q7d7s\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:05.365142 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.365094 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ceeb9e64-0822-4be7-bf8e-2477efec381a-node-exporter-tls\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:05.368314 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.368266 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ceeb9e64-0822-4be7-bf8e-2477efec381a-node-exporter-tls\") pod \"node-exporter-q2rzs\" (UID: \"ceeb9e64-0822-4be7-bf8e-2477efec381a\") " pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:05.485311 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.485276 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q2rzs" Jul 27 16:29:05.498609 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:29:05.498578 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceeb9e64_0822_4be7_bf8e_2477efec381a.slice/crio-36c5487645da9af8b400d5e5a978b10e708e28c5c067e7b521fd9e92cea9d603 WatchSource:0}: Error finding container 36c5487645da9af8b400d5e5a978b10e708e28c5c067e7b521fd9e92cea9d603: Status 404 returned error can't find the container with id 36c5487645da9af8b400d5e5a978b10e708e28c5c067e7b521fd9e92cea9d603 Jul 27 16:29:05.594649 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.594540 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 16:29:05.600027 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.599998 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.602897 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.602636 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 27 16:29:05.602897 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.602653 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 27 16:29:05.602897 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.602694 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 27 16:29:05.602897 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.602718 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 27 16:29:05.602897 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.602643 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 27 16:29:05.602897 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.602640 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 27 16:29:05.602897 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.602780 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 27 16:29:05.603309 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.603152 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-j7552\"" Jul 27 16:29:05.603309 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.603154 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 27 16:29:05.603398 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.603337 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 27 16:29:05.612782 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.612759 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 16:29:05.769496 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.769408 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6c71508f-c3bd-4848-ae0b-f7c64e151845-web-config\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.769496 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.769448 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6c71508f-c3bd-4848-ae0b-f7c64e151845-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.769496 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.769490 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6c71508f-c3bd-4848-ae0b-f7c64e151845-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.770026 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.769538 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh7ch\" (UniqueName: \"kubernetes.io/projected/6c71508f-c3bd-4848-ae0b-f7c64e151845-kube-api-access-xh7ch\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.770026 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.769606 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c71508f-c3bd-4848-ae0b-f7c64e151845-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.770026 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.769652 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6c71508f-c3bd-4848-ae0b-f7c64e151845-config-out\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.770026 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.769669 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6c71508f-c3bd-4848-ae0b-f7c64e151845-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.770026 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.769696 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c71508f-c3bd-4848-ae0b-f7c64e151845-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.770026 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.769775 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6c71508f-c3bd-4848-ae0b-f7c64e151845-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.770026 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.769806 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c71508f-c3bd-4848-ae0b-f7c64e151845-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.770026 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.769858 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6c71508f-c3bd-4848-ae0b-f7c64e151845-config-volume\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.770026 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.769884 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c71508f-c3bd-4848-ae0b-f7c64e151845-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.770026 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.769928 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6c71508f-c3bd-4848-ae0b-f7c64e151845-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.870664 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.870625 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6c71508f-c3bd-4848-ae0b-f7c64e151845-web-config\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.870831 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.870673 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6c71508f-c3bd-4848-ae0b-f7c64e151845-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.870831 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.870712 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6c71508f-c3bd-4848-ae0b-f7c64e151845-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.870831 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.870737 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh7ch\" (UniqueName: \"kubernetes.io/projected/6c71508f-c3bd-4848-ae0b-f7c64e151845-kube-api-access-xh7ch\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.870831 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.870765 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c71508f-c3bd-4848-ae0b-f7c64e151845-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.870831 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.870800 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6c71508f-c3bd-4848-ae0b-f7c64e151845-config-out\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.871101 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.870838 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6c71508f-c3bd-4848-ae0b-f7c64e151845-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.871101 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.870878 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c71508f-c3bd-4848-ae0b-f7c64e151845-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.871101 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.870935 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6c71508f-c3bd-4848-ae0b-f7c64e151845-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.871101 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.870970 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c71508f-c3bd-4848-ae0b-f7c64e151845-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.871101 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.871017 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6c71508f-c3bd-4848-ae0b-f7c64e151845-config-volume\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.871101 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.871038 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c71508f-c3bd-4848-ae0b-f7c64e151845-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.871101 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.871067 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6c71508f-c3bd-4848-ae0b-f7c64e151845-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.873964 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.873932 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6c71508f-c3bd-4848-ae0b-f7c64e151845-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.874354 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.874204 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c71508f-c3bd-4848-ae0b-f7c64e151845-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.874692 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.874480 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c71508f-c3bd-4848-ae0b-f7c64e151845-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.874692 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.874683 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6c71508f-c3bd-4848-ae0b-f7c64e151845-config-volume\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.875016 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.874913 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6c71508f-c3bd-4848-ae0b-f7c64e151845-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.875116 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.875032 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6c71508f-c3bd-4848-ae0b-f7c64e151845-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.875422 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.875369 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6c71508f-c3bd-4848-ae0b-f7c64e151845-web-config\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.875574 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.875541 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6c71508f-c3bd-4848-ae0b-f7c64e151845-config-out\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.875950 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.875929 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c71508f-c3bd-4848-ae0b-f7c64e151845-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.876049 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.875984 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c71508f-c3bd-4848-ae0b-f7c64e151845-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.876049 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.876002 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6c71508f-c3bd-4848-ae0b-f7c64e151845-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.876154 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.876107 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6c71508f-c3bd-4848-ae0b-f7c64e151845-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.879566 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.879541 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh7ch\" (UniqueName: \"kubernetes.io/projected/6c71508f-c3bd-4848-ae0b-f7c64e151845-kube-api-access-xh7ch\") pod \"alertmanager-main-0\" (UID: \"6c71508f-c3bd-4848-ae0b-f7c64e151845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:05.910317 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:05.910288 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 16:29:06.254168 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:06.254136 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q2rzs" event={"ID":"ceeb9e64-0822-4be7-bf8e-2477efec381a","Type":"ContainerStarted","Data":"36c5487645da9af8b400d5e5a978b10e708e28c5c067e7b521fd9e92cea9d603"} Jul 27 16:29:06.857947 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:29:06.857905 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-n424n" podUID="4c5b7b1c-57c2-4d71-b2f9-0d25b9988896" Jul 27 16:29:07.257363 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.257292 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n424n" Jul 27 16:29:07.407163 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.407136 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 16:29:07.407947 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:29:07.407909 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c71508f_c3bd_4848_ae0b_f7c64e151845.slice/crio-d63fb060cc259a9c5d8dc244daecd4d9e9cff27650cfda998ad89d1314c25586 WatchSource:0}: Error finding container d63fb060cc259a9c5d8dc244daecd4d9e9cff27650cfda998ad89d1314c25586: Status 404 returned error can't find the container with id d63fb060cc259a9c5d8dc244daecd4d9e9cff27650cfda998ad89d1314c25586 Jul 27 16:29:07.517745 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.517665 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5d5894ff6-rsjxw"] Jul 27 16:29:07.521470 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.521454 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:07.523579 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.523541 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 27 16:29:07.523916 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.523893 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 27 16:29:07.523916 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.523907 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-90did9gvkmifr\"" Jul 27 16:29:07.524093 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.523892 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2hhbv\"" Jul 27 16:29:07.524093 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.524025 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 27 16:29:07.524093 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.524032 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 27 16:29:07.524250 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.524237 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 27 16:29:07.534741 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.534720 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5d5894ff6-rsjxw"] Jul 27 16:29:07.686953 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.686913 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8753aa7d-e535-44ab-9aa4-6cf62478407a-metrics-client-ca\") pod \"thanos-querier-5d5894ff6-rsjxw\" (UID: \"8753aa7d-e535-44ab-9aa4-6cf62478407a\") " pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:07.686953 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.686956 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8753aa7d-e535-44ab-9aa4-6cf62478407a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d5894ff6-rsjxw\" (UID: \"8753aa7d-e535-44ab-9aa4-6cf62478407a\") " pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:07.687206 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.687047 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8753aa7d-e535-44ab-9aa4-6cf62478407a-secret-thanos-querier-tls\") pod \"thanos-querier-5d5894ff6-rsjxw\" (UID: \"8753aa7d-e535-44ab-9aa4-6cf62478407a\") " pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:07.687206 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.687073 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4rs8\" (UniqueName: \"kubernetes.io/projected/8753aa7d-e535-44ab-9aa4-6cf62478407a-kube-api-access-j4rs8\") pod \"thanos-querier-5d5894ff6-rsjxw\" (UID: \"8753aa7d-e535-44ab-9aa4-6cf62478407a\") " pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:07.687206 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.687120 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8753aa7d-e535-44ab-9aa4-6cf62478407a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d5894ff6-rsjxw\" (UID: \"8753aa7d-e535-44ab-9aa4-6cf62478407a\") " pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:07.687206 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.687160 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8753aa7d-e535-44ab-9aa4-6cf62478407a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d5894ff6-rsjxw\" (UID: \"8753aa7d-e535-44ab-9aa4-6cf62478407a\") " pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:07.687206 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.687205 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8753aa7d-e535-44ab-9aa4-6cf62478407a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d5894ff6-rsjxw\" (UID: \"8753aa7d-e535-44ab-9aa4-6cf62478407a\") " pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:07.687385 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.687247 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8753aa7d-e535-44ab-9aa4-6cf62478407a-secret-grpc-tls\") pod \"thanos-querier-5d5894ff6-rsjxw\" (UID: \"8753aa7d-e535-44ab-9aa4-6cf62478407a\") " pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:07.788306 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.788281 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8753aa7d-e535-44ab-9aa4-6cf62478407a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d5894ff6-rsjxw\" (UID: \"8753aa7d-e535-44ab-9aa4-6cf62478407a\") " pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:07.788483 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.788319 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8753aa7d-e535-44ab-9aa4-6cf62478407a-secret-grpc-tls\") pod \"thanos-querier-5d5894ff6-rsjxw\" (UID: \"8753aa7d-e535-44ab-9aa4-6cf62478407a\") " pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:07.788483 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.788349 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8753aa7d-e535-44ab-9aa4-6cf62478407a-metrics-client-ca\") pod \"thanos-querier-5d5894ff6-rsjxw\" (UID: \"8753aa7d-e535-44ab-9aa4-6cf62478407a\") " pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:07.788483 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.788381 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8753aa7d-e535-44ab-9aa4-6cf62478407a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d5894ff6-rsjxw\" (UID: \"8753aa7d-e535-44ab-9aa4-6cf62478407a\") " pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:07.788483 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.788437 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8753aa7d-e535-44ab-9aa4-6cf62478407a-secret-thanos-querier-tls\") pod \"thanos-querier-5d5894ff6-rsjxw\" (UID: \"8753aa7d-e535-44ab-9aa4-6cf62478407a\") " pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:07.788483 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.788460 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4rs8\" (UniqueName: \"kubernetes.io/projected/8753aa7d-e535-44ab-9aa4-6cf62478407a-kube-api-access-j4rs8\") pod \"thanos-querier-5d5894ff6-rsjxw\" (UID: \"8753aa7d-e535-44ab-9aa4-6cf62478407a\") " pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:07.788734 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.788518 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8753aa7d-e535-44ab-9aa4-6cf62478407a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d5894ff6-rsjxw\" (UID: \"8753aa7d-e535-44ab-9aa4-6cf62478407a\") " pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:07.788734 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.788544 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8753aa7d-e535-44ab-9aa4-6cf62478407a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d5894ff6-rsjxw\" (UID: \"8753aa7d-e535-44ab-9aa4-6cf62478407a\") " pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:07.789385 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.789355 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8753aa7d-e535-44ab-9aa4-6cf62478407a-metrics-client-ca\") pod \"thanos-querier-5d5894ff6-rsjxw\" (UID: \"8753aa7d-e535-44ab-9aa4-6cf62478407a\") " pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:07.791268 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.791238 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8753aa7d-e535-44ab-9aa4-6cf62478407a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d5894ff6-rsjxw\" (UID: \"8753aa7d-e535-44ab-9aa4-6cf62478407a\") " pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:07.791371 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.791241 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8753aa7d-e535-44ab-9aa4-6cf62478407a-secret-thanos-querier-tls\") pod \"thanos-querier-5d5894ff6-rsjxw\" (UID: \"8753aa7d-e535-44ab-9aa4-6cf62478407a\") " pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:07.791443 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.791374 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8753aa7d-e535-44ab-9aa4-6cf62478407a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d5894ff6-rsjxw\" (UID: \"8753aa7d-e535-44ab-9aa4-6cf62478407a\") " pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:07.791443 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.791404 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8753aa7d-e535-44ab-9aa4-6cf62478407a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d5894ff6-rsjxw\" (UID: \"8753aa7d-e535-44ab-9aa4-6cf62478407a\") " pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:07.791578 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.791556 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8753aa7d-e535-44ab-9aa4-6cf62478407a-secret-grpc-tls\") pod \"thanos-querier-5d5894ff6-rsjxw\" (UID: \"8753aa7d-e535-44ab-9aa4-6cf62478407a\") " pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:07.791712 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.791696 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8753aa7d-e535-44ab-9aa4-6cf62478407a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d5894ff6-rsjxw\" (UID: \"8753aa7d-e535-44ab-9aa4-6cf62478407a\") " pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:07.796191 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.796175 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4rs8\" (UniqueName: \"kubernetes.io/projected/8753aa7d-e535-44ab-9aa4-6cf62478407a-kube-api-access-j4rs8\") pod \"thanos-querier-5d5894ff6-rsjxw\" (UID: \"8753aa7d-e535-44ab-9aa4-6cf62478407a\") " pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:07.833124 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.833093 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:07.966072 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:07.965992 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5d5894ff6-rsjxw"] Jul 27 16:29:07.970256 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:29:07.970225 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8753aa7d_e535_44ab_9aa4_6cf62478407a.slice/crio-aa2cd2e48687c0a99fec5f45801c6c15ba411851da534c43ddc28aa3c4be699c WatchSource:0}: Error finding container aa2cd2e48687c0a99fec5f45801c6c15ba411851da534c43ddc28aa3c4be699c: Status 404 returned error can't find the container with id aa2cd2e48687c0a99fec5f45801c6c15ba411851da534c43ddc28aa3c4be699c Jul 27 16:29:08.266284 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:08.266185 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2ff8c" event={"ID":"b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9","Type":"ContainerStarted","Data":"1313c81b0c4ad00a4841c939b9f82bf5140ff94eaade7643e6a3a7cd538e8704"} Jul 27 16:29:08.267628 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:08.267590 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c71508f-c3bd-4848-ae0b-f7c64e151845","Type":"ContainerStarted","Data":"d63fb060cc259a9c5d8dc244daecd4d9e9cff27650cfda998ad89d1314c25586"} Jul 27 16:29:08.268807 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:08.268779 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" event={"ID":"8753aa7d-e535-44ab-9aa4-6cf62478407a","Type":"ContainerStarted","Data":"aa2cd2e48687c0a99fec5f45801c6c15ba411851da534c43ddc28aa3c4be699c"} Jul 27 16:29:08.284748 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:08.284671 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2ff8c" podStartSLOduration=34.005245329 podStartE2EDuration="48.284650827s" totalImagesPullingTime="14.279405498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:28:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:29:08.28327025 +0000 UTC m=+283.493120123" watchObservedRunningTime="2026-07-27 16:29:08.284650827 +0000 UTC m=+283.494500702" Jul 27 16:29:09.097690 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:09.097655 2578 patch_prober.go:28] interesting pod/image-registry-68b65b9694-9glf6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 27 16:29:09.098054 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:09.097710 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-68b65b9694-9glf6" podUID="ac49ea94-cb43-44ca-a783-1ceee9a4698e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 27 16:29:09.275041 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:09.275006 2578 generic.go:356] "Generic (PLEG): container finished" podID="6c71508f-c3bd-4848-ae0b-f7c64e151845" containerID="676f565baa40c924fe764eb8eed1bcf03192b1af60a7bc20259d5154854b664c" exitCode=0 Jul 27 16:29:09.275200 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:09.275091 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c71508f-c3bd-4848-ae0b-f7c64e151845","Type":"ContainerDied","Data":"676f565baa40c924fe764eb8eed1bcf03192b1af60a7bc20259d5154854b664c"} Jul 27 16:29:09.276928 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:09.276904 2578 generic.go:356] "Generic (PLEG): container finished" podID="ceeb9e64-0822-4be7-bf8e-2477efec381a" containerID="0b51431f051a160e59f9cfc0c7a467bd2fccc1e94b672f5c2585e7c82c58a40b" exitCode=0 Jul 27 16:29:09.276994 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:09.276978 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q2rzs" event={"ID":"ceeb9e64-0822-4be7-bf8e-2477efec381a","Type":"ContainerDied","Data":"0b51431f051a160e59f9cfc0c7a467bd2fccc1e94b672f5c2585e7c82c58a40b"} Jul 27 16:29:10.283505 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.283468 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q2rzs" event={"ID":"ceeb9e64-0822-4be7-bf8e-2477efec381a","Type":"ContainerStarted","Data":"39dc0379caf02b956613307f61b706829e28ef6d644afdbba630a5cb6511d55a"} Jul 27 16:29:10.283948 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.283527 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q2rzs" event={"ID":"ceeb9e64-0822-4be7-bf8e-2477efec381a","Type":"ContainerStarted","Data":"0aa8855a9a41d2ea0f2b027093c3e2aca8adf2463d941d01fbf27b2cbabdb7dd"} Jul 27 16:29:10.307568 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.307472 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-q2rzs" podStartSLOduration=3.019589767 podStartE2EDuration="6.307453347s" totalImagesPullingTime="3.219827498s" totalInitContainerRuntime="68.036082ms" isStatefulPod=true podCreationTimestamp="2026-07-27 16:29:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:29:10.306578774 +0000 UTC m=+285.516428651" watchObservedRunningTime="2026-07-27 16:29:10.307453347 +0000 UTC m=+285.517303220" Jul 27 16:29:10.713654 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.713613 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls\") pod \"dns-default-n424n\" (UID: \"4c5b7b1c-57c2-4d71-b2f9-0d25b9988896\") " pod="openshift-dns/dns-default-n424n" Jul 27 16:29:10.716593 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.716536 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c5b7b1c-57c2-4d71-b2f9-0d25b9988896-metrics-tls\") pod \"dns-default-n424n\" (UID: \"4c5b7b1c-57c2-4d71-b2f9-0d25b9988896\") " pod="openshift-dns/dns-default-n424n" Jul 27 16:29:10.742043 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.742011 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84f7b69d5f-sr69p"] Jul 27 16:29:10.776523 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.776485 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 16:29:10.781245 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.781220 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.787660 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.787497 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 27 16:29:10.787660 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.787522 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 27 16:29:10.787869 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.787767 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 27 16:29:10.787869 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.787792 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 27 16:29:10.787983 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.787834 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 27 16:29:10.787983 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.787954 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 27 16:29:10.788078 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.788063 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-cgglf\"" Jul 27 16:29:10.788128 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.787856 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 27 16:29:10.788229 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.788212 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 27 16:29:10.788287 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.788224 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 27 16:29:10.788600 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.788576 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 27 16:29:10.788681 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.788606 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 27 16:29:10.788777 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.788608 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 27 16:29:10.789064 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.789026 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 27 16:29:10.789064 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.789040 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a0qtpcb1b0qvu\"" Jul 27 16:29:10.789227 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.789166 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 27 16:29:10.790519 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.790502 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 27 16:29:10.795117 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.795094 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7965bdb85-pqmlm"] Jul 27 16:29:10.798597 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.798576 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:29:10.809070 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.809043 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 16:29:10.812322 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.812290 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7965bdb85-pqmlm"] Jul 27 16:29:10.814417 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.814370 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92088feb-314e-46bb-a47a-3dd94bfcd7a0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.814417 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.814414 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fb6002a-16b5-47e4-9b97-1282888d1a79-console-config\") pod \"console-7965bdb85-pqmlm\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:29:10.814598 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.814436 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fb6002a-16b5-47e4-9b97-1282888d1a79-service-ca\") pod \"console-7965bdb85-pqmlm\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:29:10.814598 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.814465 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92088feb-314e-46bb-a47a-3dd94bfcd7a0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.814598 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.814506 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92088feb-314e-46bb-a47a-3dd94bfcd7a0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.814598 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.814534 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92088feb-314e-46bb-a47a-3dd94bfcd7a0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.814598 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.814574 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92088feb-314e-46bb-a47a-3dd94bfcd7a0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.814836 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.814603 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92088feb-314e-46bb-a47a-3dd94bfcd7a0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.814836 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.814648 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92088feb-314e-46bb-a47a-3dd94bfcd7a0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.814836 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.814710 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92088feb-314e-46bb-a47a-3dd94bfcd7a0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.814836 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.814737 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fb6002a-16b5-47e4-9b97-1282888d1a79-console-serving-cert\") pod \"console-7965bdb85-pqmlm\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:29:10.814836 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.814762 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fb6002a-16b5-47e4-9b97-1282888d1a79-oauth-serving-cert\") pod \"console-7965bdb85-pqmlm\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:29:10.814836 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.814791 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92088feb-314e-46bb-a47a-3dd94bfcd7a0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.814836 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.814817 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hng64\" (UniqueName: \"kubernetes.io/projected/92088feb-314e-46bb-a47a-3dd94bfcd7a0-kube-api-access-hng64\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.815197 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.814862 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72gmb\" (UniqueName: \"kubernetes.io/projected/1fb6002a-16b5-47e4-9b97-1282888d1a79-kube-api-access-72gmb\") pod \"console-7965bdb85-pqmlm\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:29:10.815197 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.814887 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92088feb-314e-46bb-a47a-3dd94bfcd7a0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.815197 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.814912 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92088feb-314e-46bb-a47a-3dd94bfcd7a0-config-out\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.815197 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.814933 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92088feb-314e-46bb-a47a-3dd94bfcd7a0-web-config\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.815197 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.814958 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92088feb-314e-46bb-a47a-3dd94bfcd7a0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.815197 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.815031 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/92088feb-314e-46bb-a47a-3dd94bfcd7a0-config\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.815197 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.815078 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92088feb-314e-46bb-a47a-3dd94bfcd7a0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.815197 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.815102 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92088feb-314e-46bb-a47a-3dd94bfcd7a0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.815197 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.815127 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fb6002a-16b5-47e4-9b97-1282888d1a79-console-oauth-config\") pod \"console-7965bdb85-pqmlm\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:29:10.815197 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.815156 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92088feb-314e-46bb-a47a-3dd94bfcd7a0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.815197 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.815181 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92088feb-314e-46bb-a47a-3dd94bfcd7a0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.815746 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.815204 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fb6002a-16b5-47e4-9b97-1282888d1a79-trusted-ca-bundle\") pod \"console-7965bdb85-pqmlm\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:29:10.815746 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.815243 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92088feb-314e-46bb-a47a-3dd94bfcd7a0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.862741 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.862704 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pc959\"" Jul 27 16:29:10.868607 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.868564 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n424n" Jul 27 16:29:10.916114 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.916073 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92088feb-314e-46bb-a47a-3dd94bfcd7a0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.916268 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.916125 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fb6002a-16b5-47e4-9b97-1282888d1a79-console-config\") pod \"console-7965bdb85-pqmlm\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:29:10.916268 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.916152 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fb6002a-16b5-47e4-9b97-1282888d1a79-service-ca\") pod \"console-7965bdb85-pqmlm\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:29:10.916268 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.916186 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92088feb-314e-46bb-a47a-3dd94bfcd7a0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.916268 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.916227 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92088feb-314e-46bb-a47a-3dd94bfcd7a0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.916268 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.916256 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92088feb-314e-46bb-a47a-3dd94bfcd7a0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.916520 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.916301 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92088feb-314e-46bb-a47a-3dd94bfcd7a0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.916520 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.916331 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92088feb-314e-46bb-a47a-3dd94bfcd7a0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.916520 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.916355 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92088feb-314e-46bb-a47a-3dd94bfcd7a0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.916520 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.916380 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92088feb-314e-46bb-a47a-3dd94bfcd7a0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.916520 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.916402 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fb6002a-16b5-47e4-9b97-1282888d1a79-console-serving-cert\") pod \"console-7965bdb85-pqmlm\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:29:10.916520 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.916427 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fb6002a-16b5-47e4-9b97-1282888d1a79-oauth-serving-cert\") pod \"console-7965bdb85-pqmlm\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:29:10.916520 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.916452 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92088feb-314e-46bb-a47a-3dd94bfcd7a0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.916520 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.916476 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hng64\" (UniqueName: \"kubernetes.io/projected/92088feb-314e-46bb-a47a-3dd94bfcd7a0-kube-api-access-hng64\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.916520 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.916504 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72gmb\" (UniqueName: \"kubernetes.io/projected/1fb6002a-16b5-47e4-9b97-1282888d1a79-kube-api-access-72gmb\") pod \"console-7965bdb85-pqmlm\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:29:10.916836 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.916530 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92088feb-314e-46bb-a47a-3dd94bfcd7a0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.916836 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.916555 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92088feb-314e-46bb-a47a-3dd94bfcd7a0-config-out\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.916836 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.916577 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92088feb-314e-46bb-a47a-3dd94bfcd7a0-web-config\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.916836 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.916600 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92088feb-314e-46bb-a47a-3dd94bfcd7a0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.916836 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.916637 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/92088feb-314e-46bb-a47a-3dd94bfcd7a0-config\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.916836 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.916687 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92088feb-314e-46bb-a47a-3dd94bfcd7a0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.916836 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.916712 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92088feb-314e-46bb-a47a-3dd94bfcd7a0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.916836 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.916735 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fb6002a-16b5-47e4-9b97-1282888d1a79-console-oauth-config\") pod \"console-7965bdb85-pqmlm\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:29:10.916836 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.916764 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92088feb-314e-46bb-a47a-3dd94bfcd7a0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.916836 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.916788 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92088feb-314e-46bb-a47a-3dd94bfcd7a0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.916836 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.916812 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fb6002a-16b5-47e4-9b97-1282888d1a79-trusted-ca-bundle\") pod \"console-7965bdb85-pqmlm\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:29:10.917205 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.916863 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92088feb-314e-46bb-a47a-3dd94bfcd7a0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.918097 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.917958 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92088feb-314e-46bb-a47a-3dd94bfcd7a0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.919502 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.918432 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fb6002a-16b5-47e4-9b97-1282888d1a79-service-ca\") pod \"console-7965bdb85-pqmlm\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:29:10.922730 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.921056 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92088feb-314e-46bb-a47a-3dd94bfcd7a0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.922730 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.921399 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92088feb-314e-46bb-a47a-3dd94bfcd7a0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.922730 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.921669 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fb6002a-16b5-47e4-9b97-1282888d1a79-console-config\") pod \"console-7965bdb85-pqmlm\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:29:10.922730 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.921716 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92088feb-314e-46bb-a47a-3dd94bfcd7a0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.922730 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.921998 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92088feb-314e-46bb-a47a-3dd94bfcd7a0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.922730 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.922364 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92088feb-314e-46bb-a47a-3dd94bfcd7a0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.922730 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.922475 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fb6002a-16b5-47e4-9b97-1282888d1a79-trusted-ca-bundle\") pod \"console-7965bdb85-pqmlm\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:29:10.925105 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.923728 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92088feb-314e-46bb-a47a-3dd94bfcd7a0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.925335 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.925309 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fb6002a-16b5-47e4-9b97-1282888d1a79-oauth-serving-cert\") pod \"console-7965bdb85-pqmlm\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:29:10.925745 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.925721 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92088feb-314e-46bb-a47a-3dd94bfcd7a0-web-config\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.925828 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.925772 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92088feb-314e-46bb-a47a-3dd94bfcd7a0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.927323 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.927299 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92088feb-314e-46bb-a47a-3dd94bfcd7a0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.927994 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.927960 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92088feb-314e-46bb-a47a-3dd94bfcd7a0-config-out\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.928306 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.928263 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92088feb-314e-46bb-a47a-3dd94bfcd7a0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.928497 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.928419 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92088feb-314e-46bb-a47a-3dd94bfcd7a0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.929352 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.928872 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fb6002a-16b5-47e4-9b97-1282888d1a79-console-serving-cert\") pod \"console-7965bdb85-pqmlm\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:29:10.931903 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.930561 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92088feb-314e-46bb-a47a-3dd94bfcd7a0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.931903 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.930661 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fb6002a-16b5-47e4-9b97-1282888d1a79-console-oauth-config\") pod \"console-7965bdb85-pqmlm\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:29:10.931903 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.931099 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92088feb-314e-46bb-a47a-3dd94bfcd7a0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.931903 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.931475 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92088feb-314e-46bb-a47a-3dd94bfcd7a0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.931903 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.931477 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92088feb-314e-46bb-a47a-3dd94bfcd7a0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.931903 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.931650 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/92088feb-314e-46bb-a47a-3dd94bfcd7a0-config\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.931903 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.931857 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92088feb-314e-46bb-a47a-3dd94bfcd7a0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.937126 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.936669 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hng64\" (UniqueName: \"kubernetes.io/projected/92088feb-314e-46bb-a47a-3dd94bfcd7a0-kube-api-access-hng64\") pod \"prometheus-k8s-0\" (UID: \"92088feb-314e-46bb-a47a-3dd94bfcd7a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:10.937602 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:10.937556 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72gmb\" (UniqueName: \"kubernetes.io/projected/1fb6002a-16b5-47e4-9b97-1282888d1a79-kube-api-access-72gmb\") pod \"console-7965bdb85-pqmlm\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:29:11.026383 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:11.026350 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n424n"] Jul 27 16:29:11.094400 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:11.094372 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:11.110878 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:11.110658 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:29:11.192422 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:11.192333 2578 patch_prober.go:28] interesting pod/image-registry-68b65b9694-9glf6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 27 16:29:11.192768 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:11.192383 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-68b65b9694-9glf6" podUID="ac49ea94-cb43-44ca-a783-1ceee9a4698e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 27 16:29:11.287292 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:11.287270 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 16:29:11.290280 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:29:11.290031 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92088feb_314e_46bb_a47a_3dd94bfcd7a0.slice/crio-90a0a2d4b92084817257957f38b6b8eab795f841059e0fa4caa1ebaeebe760c9 WatchSource:0}: Error finding container 90a0a2d4b92084817257957f38b6b8eab795f841059e0fa4caa1ebaeebe760c9: Status 404 returned error can't find the container with id 90a0a2d4b92084817257957f38b6b8eab795f841059e0fa4caa1ebaeebe760c9 Jul 27 16:29:11.292407 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:11.292123 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7965bdb85-pqmlm"] Jul 27 16:29:11.293316 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:11.293220 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n424n" event={"ID":"4c5b7b1c-57c2-4d71-b2f9-0d25b9988896","Type":"ContainerStarted","Data":"1c9a834c90d19e0a230cd8c71f14541b9bcd743594ce4b3ea31fa4ed01be7c8c"} Jul 27 16:29:11.297073 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:29:11.297021 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fb6002a_16b5_47e4_9b97_1282888d1a79.slice/crio-cba70353bdbccc69cb93fdefdc20b2c63ce91b0c5978f3795e6600905712d9d8 WatchSource:0}: Error finding container cba70353bdbccc69cb93fdefdc20b2c63ce91b0c5978f3795e6600905712d9d8: Status 404 returned error can't find the container with id cba70353bdbccc69cb93fdefdc20b2c63ce91b0c5978f3795e6600905712d9d8 Jul 27 16:29:11.298705 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:11.298675 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c71508f-c3bd-4848-ae0b-f7c64e151845","Type":"ContainerStarted","Data":"3bab5c646d9bc512cd882f92598121ad6c711be27f1d621e9de17fabaa571304"} Jul 27 16:29:11.298824 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:11.298781 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c71508f-c3bd-4848-ae0b-f7c64e151845","Type":"ContainerStarted","Data":"b9a6b52e6b457facee8e6ba9eb1677b359437a0f5f941bdbb316843335642b18"} Jul 27 16:29:11.298957 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:11.298864 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c71508f-c3bd-4848-ae0b-f7c64e151845","Type":"ContainerStarted","Data":"3ca79641c8f00fcd7e63785ee6ff960b20b20e35db71a689552e14b070492c46"} Jul 27 16:29:11.298957 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:11.298927 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c71508f-c3bd-4848-ae0b-f7c64e151845","Type":"ContainerStarted","Data":"775dcdc0e33afc3802fc5521a1005c7430e653e3a1ade2084cfa6294f8eaae90"} Jul 27 16:29:12.304459 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:12.304423 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7965bdb85-pqmlm" event={"ID":"1fb6002a-16b5-47e4-9b97-1282888d1a79","Type":"ContainerStarted","Data":"98d8050afc208424d55f604926b3e1d41070c76300a5f3a4359334538a5f65f1"} Jul 27 16:29:12.304890 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:12.304482 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7965bdb85-pqmlm" event={"ID":"1fb6002a-16b5-47e4-9b97-1282888d1a79","Type":"ContainerStarted","Data":"cba70353bdbccc69cb93fdefdc20b2c63ce91b0c5978f3795e6600905712d9d8"} Jul 27 16:29:12.309321 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:12.309286 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c71508f-c3bd-4848-ae0b-f7c64e151845","Type":"ContainerStarted","Data":"fbb6cdd6df8b4b71405a65b122e08c4f9be963cab511b228eda7ebfe70fb2b81"} Jul 27 16:29:12.311553 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:12.311526 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" event={"ID":"8753aa7d-e535-44ab-9aa4-6cf62478407a","Type":"ContainerStarted","Data":"3b6e970927c28b1948ec02d672a2669e3c3c4a9b6676c69082244e57457f9466"} Jul 27 16:29:12.314023 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:12.313997 2578 generic.go:356] "Generic (PLEG): container finished" podID="92088feb-314e-46bb-a47a-3dd94bfcd7a0" containerID="5c41779cce6daac7ac34494eef1bad161823c812cecece39085bd5bc914e4b31" exitCode=0 Jul 27 16:29:12.314134 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:12.314048 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92088feb-314e-46bb-a47a-3dd94bfcd7a0","Type":"ContainerDied","Data":"5c41779cce6daac7ac34494eef1bad161823c812cecece39085bd5bc914e4b31"} Jul 27 16:29:12.314134 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:12.314109 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92088feb-314e-46bb-a47a-3dd94bfcd7a0","Type":"ContainerStarted","Data":"90a0a2d4b92084817257957f38b6b8eab795f841059e0fa4caa1ebaeebe760c9"} Jul 27 16:29:12.325044 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:12.323286 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7965bdb85-pqmlm" podStartSLOduration=2.323265958 podStartE2EDuration="2.323265958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:29:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:29:12.321784112 +0000 UTC m=+287.531633988" watchObservedRunningTime="2026-07-27 16:29:12.323265958 +0000 UTC m=+287.533115848" Jul 27 16:29:12.648914 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:12.648877 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:12.649080 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:12.648943 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:12.650713 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:12.650688 2578 patch_prober.go:28] interesting pod/console-66dcd899f7-mpb7g container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= Jul 27 16:29:12.650825 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:12.650745 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-66dcd899f7-mpb7g" podUID="9248accd-2f38-473d-a0f4-2f8e802e3679" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" Jul 27 16:29:13.321957 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:13.321922 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" event={"ID":"8753aa7d-e535-44ab-9aa4-6cf62478407a","Type":"ContainerStarted","Data":"61c6eba2e3c06ee4cc559885b9bae151d39e034d791917f751036e79ceda28ae"} Jul 27 16:29:13.322326 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:13.322023 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" event={"ID":"8753aa7d-e535-44ab-9aa4-6cf62478407a","Type":"ContainerStarted","Data":"77cbcb4fa90072dab2b44e0e2daf94ce4aa60e36791e7dc822e926fab1f38ea0"} Jul 27 16:29:13.322326 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:13.322053 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" event={"ID":"8753aa7d-e535-44ab-9aa4-6cf62478407a","Type":"ContainerStarted","Data":"c3e9ae7ec9678012f12d420604dfd326efa8569af5b3b26870815a2c9b5ff12e"} Jul 27 16:29:13.322326 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:13.322078 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" event={"ID":"8753aa7d-e535-44ab-9aa4-6cf62478407a","Type":"ContainerStarted","Data":"22343bc9de4936ed271935e4582f45fd67e18c94b4f1fb97401f780bd044a7a4"} Jul 27 16:29:13.322326 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:13.322100 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" event={"ID":"8753aa7d-e535-44ab-9aa4-6cf62478407a","Type":"ContainerStarted","Data":"bdee8b884d4aef3949093baa53b95148a456414e26e76f00206702e744491962"} Jul 27 16:29:13.322326 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:13.322144 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:13.323780 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:13.323752 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n424n" event={"ID":"4c5b7b1c-57c2-4d71-b2f9-0d25b9988896","Type":"ContainerStarted","Data":"e9c96c954ed3dee0f2ee051053d07981009537faa48e85a7c9759327ea1ca2e0"} Jul 27 16:29:13.323910 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:13.323794 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n424n" event={"ID":"4c5b7b1c-57c2-4d71-b2f9-0d25b9988896","Type":"ContainerStarted","Data":"85dcbc927bcded7a8d023257d8b6cf5975b536a1e7b1b518531bd2fc43080670"} Jul 27 16:29:13.323910 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:13.323820 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-n424n" Jul 27 16:29:13.327222 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:13.327199 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c71508f-c3bd-4848-ae0b-f7c64e151845","Type":"ContainerStarted","Data":"3f40c996363dcbaa905060e7ccf4c23c5149fd28df1c3fe1bea1ab09b1c6c9f0"} Jul 27 16:29:13.353144 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:13.353089 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" podStartSLOduration=1.5234821109999999 podStartE2EDuration="6.353074588s" totalImagesPullingTime="4.829592477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:29:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:29:13.351557425 +0000 UTC m=+288.561407338" watchObservedRunningTime="2026-07-27 16:29:13.353074588 +0000 UTC m=+288.562924460" Jul 27 16:29:13.377361 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:13.377303 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-n424n" podStartSLOduration=251.40215953 podStartE2EDuration="4m13.377281153s" totalImagesPullingTime="1.975121623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:29:13.375081892 +0000 UTC m=+288.584931828" watchObservedRunningTime="2026-07-27 16:29:13.377281153 +0000 UTC m=+288.587131026" Jul 27 16:29:13.407369 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:13.407308 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.751862362 podStartE2EDuration="8.40728621s" totalImagesPullingTime="4.637633874s" totalInitContainerRuntime="17.789974ms" isStatefulPod=false podCreationTimestamp="2026-07-27 16:29:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:29:13.405910267 +0000 UTC m=+288.615760139" watchObservedRunningTime="2026-07-27 16:29:13.40728621 +0000 UTC m=+288.617136087" Jul 27 16:29:16.346989 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:16.346825 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92088feb-314e-46bb-a47a-3dd94bfcd7a0","Type":"ContainerStarted","Data":"93ae463e6875140f1e7a2181d60209da0ae466b527b821e4769a904d89e9efb5"} Jul 27 16:29:16.346989 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:16.346909 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92088feb-314e-46bb-a47a-3dd94bfcd7a0","Type":"ContainerStarted","Data":"bf4351cbb0f009f1d208f4d9a5b76b72758923057131d9ce53cf22095efaac86"} Jul 27 16:29:16.346989 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:16.346935 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92088feb-314e-46bb-a47a-3dd94bfcd7a0","Type":"ContainerStarted","Data":"d9d706e585cd4db6eebbca510fc18bf9a9fb72c64a3289497b90f636b4f505e6"} Jul 27 16:29:16.346989 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:16.346957 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92088feb-314e-46bb-a47a-3dd94bfcd7a0","Type":"ContainerStarted","Data":"c1e8f8c1883ece8aed65338b274fbabd1d6c9f08c3733c108ef9ec17ab7764b0"} Jul 27 16:29:17.358701 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:17.358667 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92088feb-314e-46bb-a47a-3dd94bfcd7a0","Type":"ContainerStarted","Data":"7622bba3210bead52f1085e503f8e5c971a919be2993b9619ce9d857f2606e3d"} Jul 27 16:29:17.359194 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:17.358744 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92088feb-314e-46bb-a47a-3dd94bfcd7a0","Type":"ContainerStarted","Data":"0062539fdde417a123180063f405bf5a95bbc5c3505a909d1c3b0a398da99035"} Jul 27 16:29:17.387282 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:17.387234 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.665642388 podStartE2EDuration="7.387218494s" totalImagesPullingTime="3.69290844s" totalInitContainerRuntime="28.667666ms" isStatefulPod=false podCreationTimestamp="2026-07-27 16:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:29:17.386159689 +0000 UTC m=+292.596009573" watchObservedRunningTime="2026-07-27 16:29:17.387218494 +0000 UTC m=+292.597068366" Jul 27 16:29:19.101350 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:19.101316 2578 patch_prober.go:28] interesting pod/image-registry-68b65b9694-9glf6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 27 16:29:19.101700 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:19.101371 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-68b65b9694-9glf6" podUID="ac49ea94-cb43-44ca-a783-1ceee9a4698e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 27 16:29:19.338396 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:19.338368 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5d5894ff6-rsjxw" Jul 27 16:29:21.094765 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:21.094726 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:29:21.111615 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:21.111582 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:29:21.111699 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:21.111645 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:29:21.113082 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:21.113057 2578 patch_prober.go:28] interesting pod/console-7965bdb85-pqmlm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= Jul 27 16:29:21.113199 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:21.113112 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7965bdb85-pqmlm" podUID="1fb6002a-16b5-47e4-9b97-1282888d1a79" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" Jul 27 16:29:21.186780 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:21.186749 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68b65b9694-9glf6" Jul 27 16:29:22.652519 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:22.652491 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:22.656560 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:22.656538 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:23.334912 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:23.334884 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-n424n" Jul 27 16:29:25.178528 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:25.178501 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2cqxv_f7ba4530-6cc8-463f-9ac7-e9572867a152/console-operator/1.log" Jul 27 16:29:25.180752 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:25.180729 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2cqxv_f7ba4530-6cc8-463f-9ac7-e9572867a152/console-operator/1.log" Jul 27 16:29:25.189860 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:25.189819 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 27 16:29:31.115341 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:31.115300 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:29:31.350280 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:31.119085 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:29:31.350280 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:31.186252 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66dcd899f7-mpb7g"] Jul 27 16:29:35.763662 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:35.763602 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84f7b69d5f-sr69p" podUID="9ce9fb4b-6111-42fc-b820-e01d7a60d130" containerName="console" containerID="cri-o://dca8a77e7fd5432967ea165ded74fb1a819715a6441379d1d4af5ee0749e7541" gracePeriod=15 Jul 27 16:29:35.924476 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:29:35.924439 2578 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ce9fb4b_6111_42fc_b820_e01d7a60d130.slice/crio-conmon-dca8a77e7fd5432967ea165ded74fb1a819715a6441379d1d4af5ee0749e7541.scope\": RecentStats: unable to find data in memory cache]" Jul 27 16:29:36.443635 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:36.443601 2578 generic.go:356] "Generic (PLEG): container finished" podID="9ce9fb4b-6111-42fc-b820-e01d7a60d130" containerID="dca8a77e7fd5432967ea165ded74fb1a819715a6441379d1d4af5ee0749e7541" exitCode=0 Jul 27 16:29:36.443821 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:36.443683 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f7b69d5f-sr69p" event={"ID":"9ce9fb4b-6111-42fc-b820-e01d7a60d130","Type":"ContainerDied","Data":"dca8a77e7fd5432967ea165ded74fb1a819715a6441379d1d4af5ee0749e7541"} Jul 27 16:29:36.543720 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:36.543688 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f7b69d5f-sr69p" Jul 27 16:29:36.582560 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:36.582529 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ce9fb4b-6111-42fc-b820-e01d7a60d130-oauth-serving-cert\") pod \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\" (UID: \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\") " Jul 27 16:29:36.582755 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:36.582604 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ce9fb4b-6111-42fc-b820-e01d7a60d130-service-ca\") pod \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\" (UID: \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\") " Jul 27 16:29:36.582755 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:36.582733 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ce9fb4b-6111-42fc-b820-e01d7a60d130-console-oauth-config\") pod \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\" (UID: \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\") " Jul 27 16:29:36.582939 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:36.582771 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ce9fb4b-6111-42fc-b820-e01d7a60d130-console-serving-cert\") pod \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\" (UID: \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\") " Jul 27 16:29:36.582939 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:36.582811 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kwzm\" (UniqueName: \"kubernetes.io/projected/9ce9fb4b-6111-42fc-b820-e01d7a60d130-kube-api-access-7kwzm\") pod \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\" (UID: \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\") " Jul 27 16:29:36.582939 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:36.582884 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ce9fb4b-6111-42fc-b820-e01d7a60d130-console-config\") pod \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\" (UID: \"9ce9fb4b-6111-42fc-b820-e01d7a60d130\") " Jul 27 16:29:36.583108 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:36.583018 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ce9fb4b-6111-42fc-b820-e01d7a60d130-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9ce9fb4b-6111-42fc-b820-e01d7a60d130" (UID: "9ce9fb4b-6111-42fc-b820-e01d7a60d130"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 16:29:36.583165 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:36.583153 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ce9fb4b-6111-42fc-b820-e01d7a60d130-oauth-serving-cert\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:29:36.583300 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:36.583266 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ce9fb4b-6111-42fc-b820-e01d7a60d130-console-config" (OuterVolumeSpecName: "console-config") pod "9ce9fb4b-6111-42fc-b820-e01d7a60d130" (UID: "9ce9fb4b-6111-42fc-b820-e01d7a60d130"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 16:29:36.583422 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:36.583315 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ce9fb4b-6111-42fc-b820-e01d7a60d130-service-ca" (OuterVolumeSpecName: "service-ca") pod "9ce9fb4b-6111-42fc-b820-e01d7a60d130" (UID: "9ce9fb4b-6111-42fc-b820-e01d7a60d130"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 16:29:36.585036 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:36.585016 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ce9fb4b-6111-42fc-b820-e01d7a60d130-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9ce9fb4b-6111-42fc-b820-e01d7a60d130" (UID: "9ce9fb4b-6111-42fc-b820-e01d7a60d130"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 16:29:36.585132 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:36.585073 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ce9fb4b-6111-42fc-b820-e01d7a60d130-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9ce9fb4b-6111-42fc-b820-e01d7a60d130" (UID: "9ce9fb4b-6111-42fc-b820-e01d7a60d130"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 16:29:36.585172 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:36.585132 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ce9fb4b-6111-42fc-b820-e01d7a60d130-kube-api-access-7kwzm" (OuterVolumeSpecName: "kube-api-access-7kwzm") pod "9ce9fb4b-6111-42fc-b820-e01d7a60d130" (UID: "9ce9fb4b-6111-42fc-b820-e01d7a60d130"). InnerVolumeSpecName "kube-api-access-7kwzm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:29:36.684246 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:36.684148 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kwzm\" (UniqueName: \"kubernetes.io/projected/9ce9fb4b-6111-42fc-b820-e01d7a60d130-kube-api-access-7kwzm\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:29:36.684246 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:36.684181 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ce9fb4b-6111-42fc-b820-e01d7a60d130-console-config\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:29:36.684246 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:36.684192 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ce9fb4b-6111-42fc-b820-e01d7a60d130-service-ca\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:29:36.684246 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:36.684200 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ce9fb4b-6111-42fc-b820-e01d7a60d130-console-oauth-config\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:29:36.684246 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:36.684209 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ce9fb4b-6111-42fc-b820-e01d7a60d130-console-serving-cert\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:29:37.449165 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:37.449138 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f7b69d5f-sr69p" Jul 27 16:29:37.449629 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:37.449168 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f7b69d5f-sr69p" event={"ID":"9ce9fb4b-6111-42fc-b820-e01d7a60d130","Type":"ContainerDied","Data":"66e9c26682dedeaa7fcac1afed0c37fb96ba2881bfa92ef8c8dbba77e1d6bf24"} Jul 27 16:29:37.449629 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:37.449228 2578 scope.go:117] "RemoveContainer" containerID="dca8a77e7fd5432967ea165ded74fb1a819715a6441379d1d4af5ee0749e7541" Jul 27 16:29:37.463269 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:37.463244 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84f7b69d5f-sr69p"] Jul 27 16:29:37.465600 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:37.465574 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84f7b69d5f-sr69p"] Jul 27 16:29:39.377639 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:39.377607 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ce9fb4b-6111-42fc-b820-e01d7a60d130" path="/var/lib/kubelet/pods/9ce9fb4b-6111-42fc-b820-e01d7a60d130/volumes" Jul 27 16:29:45.484174 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:45.484139 2578 generic.go:356] "Generic (PLEG): container finished" podID="32b6b148-9234-4492-a6dc-b6723f680477" containerID="eb8ee450f26267698a9da3011d325de6e6897597f5cbc5a21cd5c86068567953" exitCode=0 Jul 27 16:29:45.484592 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:45.484217 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-qc2ql" event={"ID":"32b6b148-9234-4492-a6dc-b6723f680477","Type":"ContainerDied","Data":"eb8ee450f26267698a9da3011d325de6e6897597f5cbc5a21cd5c86068567953"} Jul 27 16:29:45.484592 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:45.484542 2578 scope.go:117] "RemoveContainer" containerID="eb8ee450f26267698a9da3011d325de6e6897597f5cbc5a21cd5c86068567953" Jul 27 16:29:45.920739 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:45.920676 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5nzhx_e03109a1-5d54-4c1f-b015-7fd714bc4856/serve-healthcheck-canary/0.log" Jul 27 16:29:46.479479 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:46.479434 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-mfkn4_66de2422-6d67-4573-84f6-213a2c7f9e0b/cluster-samples-operator/0.log" Jul 27 16:29:46.490259 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:46.490225 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-qc2ql" event={"ID":"32b6b148-9234-4492-a6dc-b6723f680477","Type":"ContainerStarted","Data":"a59c74c92a4084b136a0fef1066a15b5b4b3cab031d1179f0e61d502f427e64a"} Jul 27 16:29:46.678552 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:46.678520 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-mfkn4_66de2422-6d67-4573-84f6-213a2c7f9e0b/cluster-samples-operator-watch/0.log" Jul 27 16:29:52.521299 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:52.521260 2578 generic.go:356] "Generic (PLEG): container finished" podID="c46477cd-3c0c-4b54-a4ab-936b49966349" containerID="94c8a93ca47d213160fe5eaa807d4e133bae12421caad9298fb64ff68f31dc1f" exitCode=0 Jul 27 16:29:52.521684 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:52.521323 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hnq7z" event={"ID":"c46477cd-3c0c-4b54-a4ab-936b49966349","Type":"ContainerDied","Data":"94c8a93ca47d213160fe5eaa807d4e133bae12421caad9298fb64ff68f31dc1f"} Jul 27 16:29:52.521723 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:52.521712 2578 scope.go:117] "RemoveContainer" containerID="94c8a93ca47d213160fe5eaa807d4e133bae12421caad9298fb64ff68f31dc1f" Jul 27 16:29:53.527448 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:53.527412 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hnq7z" event={"ID":"c46477cd-3c0c-4b54-a4ab-936b49966349","Type":"ContainerStarted","Data":"e478847b2b25d81dc806cb557b6f12cadc13c1b3638b9730d219f429731f279b"} Jul 27 16:29:56.205953 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.205918 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66dcd899f7-mpb7g" podUID="9248accd-2f38-473d-a0f4-2f8e802e3679" containerName="console" containerID="cri-o://84be4021f180ceeada59c3602d25c1c0d1c94249a9eca23701c42e9dc6cac6d3" gracePeriod=15 Jul 27 16:29:56.456582 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.456512 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:56.542638 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.542605 2578 generic.go:356] "Generic (PLEG): container finished" podID="9248accd-2f38-473d-a0f4-2f8e802e3679" containerID="84be4021f180ceeada59c3602d25c1c0d1c94249a9eca23701c42e9dc6cac6d3" exitCode=0 Jul 27 16:29:56.542827 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.542651 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66dcd899f7-mpb7g" Jul 27 16:29:56.542827 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.542684 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66dcd899f7-mpb7g" event={"ID":"9248accd-2f38-473d-a0f4-2f8e802e3679","Type":"ContainerDied","Data":"84be4021f180ceeada59c3602d25c1c0d1c94249a9eca23701c42e9dc6cac6d3"} Jul 27 16:29:56.542827 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.542739 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66dcd899f7-mpb7g" event={"ID":"9248accd-2f38-473d-a0f4-2f8e802e3679","Type":"ContainerDied","Data":"a8d9a7b219aab824600cfd0c2207cb965ee00ab83b68971a3d2713da84b2cce9"} Jul 27 16:29:56.542827 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.542759 2578 scope.go:117] "RemoveContainer" containerID="84be4021f180ceeada59c3602d25c1c0d1c94249a9eca23701c42e9dc6cac6d3" Jul 27 16:29:56.552380 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.552360 2578 scope.go:117] "RemoveContainer" containerID="84be4021f180ceeada59c3602d25c1c0d1c94249a9eca23701c42e9dc6cac6d3" Jul 27 16:29:56.552710 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:29:56.552685 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84be4021f180ceeada59c3602d25c1c0d1c94249a9eca23701c42e9dc6cac6d3\": container with ID starting with 84be4021f180ceeada59c3602d25c1c0d1c94249a9eca23701c42e9dc6cac6d3 not found: ID does not exist" containerID="84be4021f180ceeada59c3602d25c1c0d1c94249a9eca23701c42e9dc6cac6d3" Jul 27 16:29:56.552775 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.552721 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84be4021f180ceeada59c3602d25c1c0d1c94249a9eca23701c42e9dc6cac6d3"} err="failed to get container status \"84be4021f180ceeada59c3602d25c1c0d1c94249a9eca23701c42e9dc6cac6d3\": rpc error: code = NotFound desc = could not find container \"84be4021f180ceeada59c3602d25c1c0d1c94249a9eca23701c42e9dc6cac6d3\": container with ID starting with 84be4021f180ceeada59c3602d25c1c0d1c94249a9eca23701c42e9dc6cac6d3 not found: ID does not exist" Jul 27 16:29:56.570072 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.570044 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9248accd-2f38-473d-a0f4-2f8e802e3679-trusted-ca-bundle\") pod \"9248accd-2f38-473d-a0f4-2f8e802e3679\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " Jul 27 16:29:56.570072 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.570080 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9248accd-2f38-473d-a0f4-2f8e802e3679-oauth-serving-cert\") pod \"9248accd-2f38-473d-a0f4-2f8e802e3679\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " Jul 27 16:29:56.570275 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.570112 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kb7zm\" (UniqueName: \"kubernetes.io/projected/9248accd-2f38-473d-a0f4-2f8e802e3679-kube-api-access-kb7zm\") pod \"9248accd-2f38-473d-a0f4-2f8e802e3679\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " Jul 27 16:29:56.570275 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.570252 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9248accd-2f38-473d-a0f4-2f8e802e3679-console-oauth-config\") pod \"9248accd-2f38-473d-a0f4-2f8e802e3679\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " Jul 27 16:29:56.570370 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.570308 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9248accd-2f38-473d-a0f4-2f8e802e3679-service-ca\") pod \"9248accd-2f38-473d-a0f4-2f8e802e3679\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " Jul 27 16:29:56.570370 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.570343 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9248accd-2f38-473d-a0f4-2f8e802e3679-console-config\") pod \"9248accd-2f38-473d-a0f4-2f8e802e3679\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " Jul 27 16:29:56.570468 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.570397 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9248accd-2f38-473d-a0f4-2f8e802e3679-console-serving-cert\") pod \"9248accd-2f38-473d-a0f4-2f8e802e3679\" (UID: \"9248accd-2f38-473d-a0f4-2f8e802e3679\") " Jul 27 16:29:56.570526 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.570502 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9248accd-2f38-473d-a0f4-2f8e802e3679-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9248accd-2f38-473d-a0f4-2f8e802e3679" (UID: "9248accd-2f38-473d-a0f4-2f8e802e3679"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 16:29:56.570587 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.570519 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9248accd-2f38-473d-a0f4-2f8e802e3679-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9248accd-2f38-473d-a0f4-2f8e802e3679" (UID: "9248accd-2f38-473d-a0f4-2f8e802e3679"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 16:29:56.570867 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.570794 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9248accd-2f38-473d-a0f4-2f8e802e3679-trusted-ca-bundle\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:29:56.570867 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.570814 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9248accd-2f38-473d-a0f4-2f8e802e3679-oauth-serving-cert\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:29:56.570867 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.570836 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9248accd-2f38-473d-a0f4-2f8e802e3679-console-config" (OuterVolumeSpecName: "console-config") pod "9248accd-2f38-473d-a0f4-2f8e802e3679" (UID: "9248accd-2f38-473d-a0f4-2f8e802e3679"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 16:29:56.571079 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.570907 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9248accd-2f38-473d-a0f4-2f8e802e3679-service-ca" (OuterVolumeSpecName: "service-ca") pod "9248accd-2f38-473d-a0f4-2f8e802e3679" (UID: "9248accd-2f38-473d-a0f4-2f8e802e3679"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 16:29:56.572607 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.572583 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9248accd-2f38-473d-a0f4-2f8e802e3679-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9248accd-2f38-473d-a0f4-2f8e802e3679" (UID: "9248accd-2f38-473d-a0f4-2f8e802e3679"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 16:29:56.572741 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.572720 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9248accd-2f38-473d-a0f4-2f8e802e3679-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9248accd-2f38-473d-a0f4-2f8e802e3679" (UID: "9248accd-2f38-473d-a0f4-2f8e802e3679"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 16:29:56.572794 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.572734 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9248accd-2f38-473d-a0f4-2f8e802e3679-kube-api-access-kb7zm" (OuterVolumeSpecName: "kube-api-access-kb7zm") pod "9248accd-2f38-473d-a0f4-2f8e802e3679" (UID: "9248accd-2f38-473d-a0f4-2f8e802e3679"). InnerVolumeSpecName "kube-api-access-kb7zm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:29:56.671319 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.671280 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kb7zm\" (UniqueName: \"kubernetes.io/projected/9248accd-2f38-473d-a0f4-2f8e802e3679-kube-api-access-kb7zm\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:29:56.671319 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.671315 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9248accd-2f38-473d-a0f4-2f8e802e3679-console-oauth-config\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:29:56.671319 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.671326 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9248accd-2f38-473d-a0f4-2f8e802e3679-service-ca\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:29:56.671633 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.671334 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9248accd-2f38-473d-a0f4-2f8e802e3679-console-config\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:29:56.671633 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.671342 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9248accd-2f38-473d-a0f4-2f8e802e3679-console-serving-cert\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:29:56.867261 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.867228 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66dcd899f7-mpb7g"] Jul 27 16:29:56.871496 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:56.871467 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66dcd899f7-mpb7g"] Jul 27 16:29:57.377657 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:29:57.377620 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9248accd-2f38-473d-a0f4-2f8e802e3679" path="/var/lib/kubelet/pods/9248accd-2f38-473d-a0f4-2f8e802e3679/volumes" Jul 27 16:30:11.094778 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:11.094724 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:30:11.115500 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:11.115466 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:30:11.620592 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:11.620565 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 16:30:35.744970 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.744929 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-596747d8cb-8w87m"] Jul 27 16:30:35.745468 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.745418 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ce9fb4b-6111-42fc-b820-e01d7a60d130" containerName="console" Jul 27 16:30:35.745468 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.745437 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ce9fb4b-6111-42fc-b820-e01d7a60d130" containerName="console" Jul 27 16:30:35.745468 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.745448 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9248accd-2f38-473d-a0f4-2f8e802e3679" containerName="console" Jul 27 16:30:35.745468 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.745457 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9248accd-2f38-473d-a0f4-2f8e802e3679" containerName="console" Jul 27 16:30:35.745666 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.745554 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ce9fb4b-6111-42fc-b820-e01d7a60d130" containerName="console" Jul 27 16:30:35.745666 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.745568 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9248accd-2f38-473d-a0f4-2f8e802e3679" containerName="console" Jul 27 16:30:35.754062 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.754034 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-596747d8cb-8w87m" Jul 27 16:30:35.762631 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.762603 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-596747d8cb-8w87m"] Jul 27 16:30:35.827786 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.827746 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7jwv\" (UniqueName: \"kubernetes.io/projected/75237cfc-ef5d-41fc-8973-002bd8954f2a-kube-api-access-p7jwv\") pod \"console-596747d8cb-8w87m\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " pod="openshift-console/console-596747d8cb-8w87m" Jul 27 16:30:35.827786 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.827794 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75237cfc-ef5d-41fc-8973-002bd8954f2a-console-oauth-config\") pod \"console-596747d8cb-8w87m\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " pod="openshift-console/console-596747d8cb-8w87m" Jul 27 16:30:35.828014 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.827863 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75237cfc-ef5d-41fc-8973-002bd8954f2a-console-config\") pod \"console-596747d8cb-8w87m\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " pod="openshift-console/console-596747d8cb-8w87m" Jul 27 16:30:35.828014 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.827912 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75237cfc-ef5d-41fc-8973-002bd8954f2a-service-ca\") pod \"console-596747d8cb-8w87m\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " pod="openshift-console/console-596747d8cb-8w87m" Jul 27 16:30:35.828014 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.827933 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75237cfc-ef5d-41fc-8973-002bd8954f2a-console-serving-cert\") pod \"console-596747d8cb-8w87m\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " pod="openshift-console/console-596747d8cb-8w87m" Jul 27 16:30:35.828014 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.827962 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75237cfc-ef5d-41fc-8973-002bd8954f2a-trusted-ca-bundle\") pod \"console-596747d8cb-8w87m\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " pod="openshift-console/console-596747d8cb-8w87m" Jul 27 16:30:35.828141 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.828059 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75237cfc-ef5d-41fc-8973-002bd8954f2a-oauth-serving-cert\") pod \"console-596747d8cb-8w87m\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " pod="openshift-console/console-596747d8cb-8w87m" Jul 27 16:30:35.929140 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.929104 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75237cfc-ef5d-41fc-8973-002bd8954f2a-console-oauth-config\") pod \"console-596747d8cb-8w87m\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " pod="openshift-console/console-596747d8cb-8w87m" Jul 27 16:30:35.929140 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.929145 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75237cfc-ef5d-41fc-8973-002bd8954f2a-console-config\") pod \"console-596747d8cb-8w87m\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " pod="openshift-console/console-596747d8cb-8w87m" Jul 27 16:30:35.929331 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.929180 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75237cfc-ef5d-41fc-8973-002bd8954f2a-service-ca\") pod \"console-596747d8cb-8w87m\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " pod="openshift-console/console-596747d8cb-8w87m" Jul 27 16:30:35.929331 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.929206 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75237cfc-ef5d-41fc-8973-002bd8954f2a-console-serving-cert\") pod \"console-596747d8cb-8w87m\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " pod="openshift-console/console-596747d8cb-8w87m" Jul 27 16:30:35.929331 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.929241 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75237cfc-ef5d-41fc-8973-002bd8954f2a-trusted-ca-bundle\") pod \"console-596747d8cb-8w87m\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " pod="openshift-console/console-596747d8cb-8w87m" Jul 27 16:30:35.929331 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.929311 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75237cfc-ef5d-41fc-8973-002bd8954f2a-oauth-serving-cert\") pod \"console-596747d8cb-8w87m\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " pod="openshift-console/console-596747d8cb-8w87m" Jul 27 16:30:35.929475 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.929360 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7jwv\" (UniqueName: \"kubernetes.io/projected/75237cfc-ef5d-41fc-8973-002bd8954f2a-kube-api-access-p7jwv\") pod \"console-596747d8cb-8w87m\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " pod="openshift-console/console-596747d8cb-8w87m" Jul 27 16:30:35.930041 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.930014 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75237cfc-ef5d-41fc-8973-002bd8954f2a-console-config\") pod \"console-596747d8cb-8w87m\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " pod="openshift-console/console-596747d8cb-8w87m" Jul 27 16:30:35.930142 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.930014 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75237cfc-ef5d-41fc-8973-002bd8954f2a-service-ca\") pod \"console-596747d8cb-8w87m\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " pod="openshift-console/console-596747d8cb-8w87m" Jul 27 16:30:35.930212 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.930180 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75237cfc-ef5d-41fc-8973-002bd8954f2a-oauth-serving-cert\") pod \"console-596747d8cb-8w87m\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " pod="openshift-console/console-596747d8cb-8w87m" Jul 27 16:30:35.930415 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.930396 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75237cfc-ef5d-41fc-8973-002bd8954f2a-trusted-ca-bundle\") pod \"console-596747d8cb-8w87m\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " pod="openshift-console/console-596747d8cb-8w87m" Jul 27 16:30:35.931741 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.931719 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75237cfc-ef5d-41fc-8973-002bd8954f2a-console-serving-cert\") pod \"console-596747d8cb-8w87m\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " pod="openshift-console/console-596747d8cb-8w87m" Jul 27 16:30:35.931815 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.931753 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75237cfc-ef5d-41fc-8973-002bd8954f2a-console-oauth-config\") pod \"console-596747d8cb-8w87m\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " pod="openshift-console/console-596747d8cb-8w87m" Jul 27 16:30:35.939988 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:35.939967 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7jwv\" (UniqueName: \"kubernetes.io/projected/75237cfc-ef5d-41fc-8973-002bd8954f2a-kube-api-access-p7jwv\") pod \"console-596747d8cb-8w87m\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " pod="openshift-console/console-596747d8cb-8w87m" Jul 27 16:30:36.063901 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:36.063864 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-596747d8cb-8w87m" Jul 27 16:30:36.209703 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:36.209659 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-596747d8cb-8w87m"] Jul 27 16:30:36.212528 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:30:36.212500 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75237cfc_ef5d_41fc_8973_002bd8954f2a.slice/crio-f33726ef94455c465dff53e08268bcf582738628e03e89da865430330253b688 WatchSource:0}: Error finding container f33726ef94455c465dff53e08268bcf582738628e03e89da865430330253b688: Status 404 returned error can't find the container with id f33726ef94455c465dff53e08268bcf582738628e03e89da865430330253b688 Jul 27 16:30:36.710988 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:36.710955 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-596747d8cb-8w87m" event={"ID":"75237cfc-ef5d-41fc-8973-002bd8954f2a","Type":"ContainerStarted","Data":"e98b8ebb86bbbb491cfa166d0098a44ffe09f9074adf7aac3d058e4d20912253"} Jul 27 16:30:36.711200 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:36.711009 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-596747d8cb-8w87m" event={"ID":"75237cfc-ef5d-41fc-8973-002bd8954f2a","Type":"ContainerStarted","Data":"f33726ef94455c465dff53e08268bcf582738628e03e89da865430330253b688"} Jul 27 16:30:36.734479 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:36.734421 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-596747d8cb-8w87m" podStartSLOduration=1.734401619 podStartE2EDuration="1.734401619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:30:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:30:36.734226626 +0000 UTC m=+371.944076500" watchObservedRunningTime="2026-07-27 16:30:36.734401619 +0000 UTC m=+371.944251491" Jul 27 16:30:39.451041 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:39.451009 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-596747d8cb-8w87m"] Jul 27 16:30:39.486403 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:39.486370 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-789b87658f-2gl9h"] Jul 27 16:30:39.488624 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:39.488602 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789b87658f-2gl9h" Jul 27 16:30:39.505460 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:39.505432 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-789b87658f-2gl9h"] Jul 27 16:30:39.562197 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:39.562159 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4mml\" (UniqueName: \"kubernetes.io/projected/af54b53f-74bb-419c-add3-5b38ad8adf48-kube-api-access-b4mml\") pod \"console-789b87658f-2gl9h\" (UID: \"af54b53f-74bb-419c-add3-5b38ad8adf48\") " pod="openshift-console/console-789b87658f-2gl9h" Jul 27 16:30:39.562372 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:39.562205 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af54b53f-74bb-419c-add3-5b38ad8adf48-oauth-serving-cert\") pod \"console-789b87658f-2gl9h\" (UID: \"af54b53f-74bb-419c-add3-5b38ad8adf48\") " pod="openshift-console/console-789b87658f-2gl9h" Jul 27 16:30:39.562372 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:39.562230 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af54b53f-74bb-419c-add3-5b38ad8adf48-console-oauth-config\") pod \"console-789b87658f-2gl9h\" (UID: \"af54b53f-74bb-419c-add3-5b38ad8adf48\") " pod="openshift-console/console-789b87658f-2gl9h" Jul 27 16:30:39.562372 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:39.562288 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af54b53f-74bb-419c-add3-5b38ad8adf48-console-serving-cert\") pod \"console-789b87658f-2gl9h\" (UID: \"af54b53f-74bb-419c-add3-5b38ad8adf48\") " pod="openshift-console/console-789b87658f-2gl9h" Jul 27 16:30:39.562372 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:39.562314 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af54b53f-74bb-419c-add3-5b38ad8adf48-console-config\") pod \"console-789b87658f-2gl9h\" (UID: \"af54b53f-74bb-419c-add3-5b38ad8adf48\") " pod="openshift-console/console-789b87658f-2gl9h" Jul 27 16:30:39.562372 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:39.562360 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af54b53f-74bb-419c-add3-5b38ad8adf48-trusted-ca-bundle\") pod \"console-789b87658f-2gl9h\" (UID: \"af54b53f-74bb-419c-add3-5b38ad8adf48\") " pod="openshift-console/console-789b87658f-2gl9h" Jul 27 16:30:39.562597 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:39.562382 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af54b53f-74bb-419c-add3-5b38ad8adf48-service-ca\") pod \"console-789b87658f-2gl9h\" (UID: \"af54b53f-74bb-419c-add3-5b38ad8adf48\") " pod="openshift-console/console-789b87658f-2gl9h" Jul 27 16:30:39.663403 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:39.663373 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af54b53f-74bb-419c-add3-5b38ad8adf48-trusted-ca-bundle\") pod \"console-789b87658f-2gl9h\" (UID: \"af54b53f-74bb-419c-add3-5b38ad8adf48\") " pod="openshift-console/console-789b87658f-2gl9h" Jul 27 16:30:39.663403 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:39.663412 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af54b53f-74bb-419c-add3-5b38ad8adf48-service-ca\") pod \"console-789b87658f-2gl9h\" (UID: \"af54b53f-74bb-419c-add3-5b38ad8adf48\") " pod="openshift-console/console-789b87658f-2gl9h" Jul 27 16:30:39.663631 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:39.663459 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4mml\" (UniqueName: \"kubernetes.io/projected/af54b53f-74bb-419c-add3-5b38ad8adf48-kube-api-access-b4mml\") pod \"console-789b87658f-2gl9h\" (UID: \"af54b53f-74bb-419c-add3-5b38ad8adf48\") " pod="openshift-console/console-789b87658f-2gl9h" Jul 27 16:30:39.663631 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:39.663481 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af54b53f-74bb-419c-add3-5b38ad8adf48-oauth-serving-cert\") pod \"console-789b87658f-2gl9h\" (UID: \"af54b53f-74bb-419c-add3-5b38ad8adf48\") " pod="openshift-console/console-789b87658f-2gl9h" Jul 27 16:30:39.663631 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:39.663511 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af54b53f-74bb-419c-add3-5b38ad8adf48-console-oauth-config\") pod \"console-789b87658f-2gl9h\" (UID: \"af54b53f-74bb-419c-add3-5b38ad8adf48\") " pod="openshift-console/console-789b87658f-2gl9h" Jul 27 16:30:39.665576 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:39.664289 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af54b53f-74bb-419c-add3-5b38ad8adf48-console-serving-cert\") pod \"console-789b87658f-2gl9h\" (UID: \"af54b53f-74bb-419c-add3-5b38ad8adf48\") " pod="openshift-console/console-789b87658f-2gl9h" Jul 27 16:30:39.665576 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:39.664353 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af54b53f-74bb-419c-add3-5b38ad8adf48-console-config\") pod \"console-789b87658f-2gl9h\" (UID: \"af54b53f-74bb-419c-add3-5b38ad8adf48\") " pod="openshift-console/console-789b87658f-2gl9h" Jul 27 16:30:39.665576 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:39.664623 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af54b53f-74bb-419c-add3-5b38ad8adf48-service-ca\") pod \"console-789b87658f-2gl9h\" (UID: \"af54b53f-74bb-419c-add3-5b38ad8adf48\") " pod="openshift-console/console-789b87658f-2gl9h" Jul 27 16:30:39.665576 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:39.664944 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af54b53f-74bb-419c-add3-5b38ad8adf48-trusted-ca-bundle\") pod \"console-789b87658f-2gl9h\" (UID: \"af54b53f-74bb-419c-add3-5b38ad8adf48\") " pod="openshift-console/console-789b87658f-2gl9h" Jul 27 16:30:39.665576 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:39.665131 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af54b53f-74bb-419c-add3-5b38ad8adf48-console-config\") pod \"console-789b87658f-2gl9h\" (UID: \"af54b53f-74bb-419c-add3-5b38ad8adf48\") " pod="openshift-console/console-789b87658f-2gl9h" Jul 27 16:30:39.665576 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:39.665264 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af54b53f-74bb-419c-add3-5b38ad8adf48-oauth-serving-cert\") pod \"console-789b87658f-2gl9h\" (UID: \"af54b53f-74bb-419c-add3-5b38ad8adf48\") " pod="openshift-console/console-789b87658f-2gl9h" Jul 27 16:30:39.667631 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:39.667602 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af54b53f-74bb-419c-add3-5b38ad8adf48-console-serving-cert\") pod \"console-789b87658f-2gl9h\" (UID: \"af54b53f-74bb-419c-add3-5b38ad8adf48\") " pod="openshift-console/console-789b87658f-2gl9h" Jul 27 16:30:39.671779 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:39.671754 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af54b53f-74bb-419c-add3-5b38ad8adf48-console-oauth-config\") pod \"console-789b87658f-2gl9h\" (UID: \"af54b53f-74bb-419c-add3-5b38ad8adf48\") " pod="openshift-console/console-789b87658f-2gl9h" Jul 27 16:30:39.673715 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:39.673692 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4mml\" (UniqueName: \"kubernetes.io/projected/af54b53f-74bb-419c-add3-5b38ad8adf48-kube-api-access-b4mml\") pod \"console-789b87658f-2gl9h\" (UID: \"af54b53f-74bb-419c-add3-5b38ad8adf48\") " pod="openshift-console/console-789b87658f-2gl9h" Jul 27 16:30:39.798820 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:39.798785 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789b87658f-2gl9h" Jul 27 16:30:39.939317 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:39.939293 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-789b87658f-2gl9h"] Jul 27 16:30:39.942011 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:30:39.941981 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf54b53f_74bb_419c_add3_5b38ad8adf48.slice/crio-5f06709218b8ee973ef1a7908d8d3dc2db7a8fa7403c4dbef36ed6c7455379c7 WatchSource:0}: Error finding container 5f06709218b8ee973ef1a7908d8d3dc2db7a8fa7403c4dbef36ed6c7455379c7: Status 404 returned error can't find the container with id 5f06709218b8ee973ef1a7908d8d3dc2db7a8fa7403c4dbef36ed6c7455379c7 Jul 27 16:30:40.729282 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:40.729249 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789b87658f-2gl9h" event={"ID":"af54b53f-74bb-419c-add3-5b38ad8adf48","Type":"ContainerStarted","Data":"9b99e36ab374533ffea8cbb0b666dade8952648abbf568533d4ae577938330f4"} Jul 27 16:30:40.729675 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:40.729297 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789b87658f-2gl9h" event={"ID":"af54b53f-74bb-419c-add3-5b38ad8adf48","Type":"ContainerStarted","Data":"5f06709218b8ee973ef1a7908d8d3dc2db7a8fa7403c4dbef36ed6c7455379c7"} Jul 27 16:30:40.751321 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:40.751269 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-789b87658f-2gl9h" podStartSLOduration=1.7512529639999999 podStartE2EDuration="1.751252964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:30:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:30:40.748750499 +0000 UTC m=+375.958600382" watchObservedRunningTime="2026-07-27 16:30:40.751252964 +0000 UTC m=+375.961102835" Jul 27 16:30:46.064662 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:46.064624 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-596747d8cb-8w87m" Jul 27 16:30:49.798961 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:49.798923 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-789b87658f-2gl9h" Jul 27 16:30:49.799355 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:49.798992 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-789b87658f-2gl9h" Jul 27 16:30:49.803898 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:49.803872 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-789b87658f-2gl9h" Jul 27 16:30:50.773499 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:50.773472 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-789b87658f-2gl9h" Jul 27 16:30:50.858632 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:30:50.858597 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7965bdb85-pqmlm"] Jul 27 16:31:04.470562 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.470523 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-596747d8cb-8w87m" podUID="75237cfc-ef5d-41fc-8973-002bd8954f2a" containerName="console" containerID="cri-o://e98b8ebb86bbbb491cfa166d0098a44ffe09f9074adf7aac3d058e4d20912253" gracePeriod=15 Jul 27 16:31:04.733341 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.733284 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-596747d8cb-8w87m" Jul 27 16:31:04.798677 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.798638 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75237cfc-ef5d-41fc-8973-002bd8954f2a-service-ca\") pod \"75237cfc-ef5d-41fc-8973-002bd8954f2a\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " Jul 27 16:31:04.798677 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.798677 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75237cfc-ef5d-41fc-8973-002bd8954f2a-oauth-serving-cert\") pod \"75237cfc-ef5d-41fc-8973-002bd8954f2a\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " Jul 27 16:31:04.798957 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.798717 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75237cfc-ef5d-41fc-8973-002bd8954f2a-console-oauth-config\") pod \"75237cfc-ef5d-41fc-8973-002bd8954f2a\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " Jul 27 16:31:04.798957 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.798758 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7jwv\" (UniqueName: \"kubernetes.io/projected/75237cfc-ef5d-41fc-8973-002bd8954f2a-kube-api-access-p7jwv\") pod \"75237cfc-ef5d-41fc-8973-002bd8954f2a\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " Jul 27 16:31:04.798957 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.798785 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75237cfc-ef5d-41fc-8973-002bd8954f2a-console-config\") pod \"75237cfc-ef5d-41fc-8973-002bd8954f2a\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " Jul 27 16:31:04.798957 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.798810 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75237cfc-ef5d-41fc-8973-002bd8954f2a-console-serving-cert\") pod \"75237cfc-ef5d-41fc-8973-002bd8954f2a\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " Jul 27 16:31:04.798957 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.798875 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75237cfc-ef5d-41fc-8973-002bd8954f2a-trusted-ca-bundle\") pod \"75237cfc-ef5d-41fc-8973-002bd8954f2a\" (UID: \"75237cfc-ef5d-41fc-8973-002bd8954f2a\") " Jul 27 16:31:04.799233 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.799116 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75237cfc-ef5d-41fc-8973-002bd8954f2a-service-ca" (OuterVolumeSpecName: "service-ca") pod "75237cfc-ef5d-41fc-8973-002bd8954f2a" (UID: "75237cfc-ef5d-41fc-8973-002bd8954f2a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 16:31:04.799233 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.799215 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75237cfc-ef5d-41fc-8973-002bd8954f2a-service-ca\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:31:04.799233 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.799217 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75237cfc-ef5d-41fc-8973-002bd8954f2a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "75237cfc-ef5d-41fc-8973-002bd8954f2a" (UID: "75237cfc-ef5d-41fc-8973-002bd8954f2a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 16:31:04.799381 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.799214 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75237cfc-ef5d-41fc-8973-002bd8954f2a-console-config" (OuterVolumeSpecName: "console-config") pod "75237cfc-ef5d-41fc-8973-002bd8954f2a" (UID: "75237cfc-ef5d-41fc-8973-002bd8954f2a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 16:31:04.799435 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.799413 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75237cfc-ef5d-41fc-8973-002bd8954f2a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "75237cfc-ef5d-41fc-8973-002bd8954f2a" (UID: "75237cfc-ef5d-41fc-8973-002bd8954f2a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 16:31:04.801255 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.801225 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75237cfc-ef5d-41fc-8973-002bd8954f2a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "75237cfc-ef5d-41fc-8973-002bd8954f2a" (UID: "75237cfc-ef5d-41fc-8973-002bd8954f2a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 16:31:04.801391 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.801337 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75237cfc-ef5d-41fc-8973-002bd8954f2a-kube-api-access-p7jwv" (OuterVolumeSpecName: "kube-api-access-p7jwv") pod "75237cfc-ef5d-41fc-8973-002bd8954f2a" (UID: "75237cfc-ef5d-41fc-8973-002bd8954f2a"). InnerVolumeSpecName "kube-api-access-p7jwv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:31:04.801452 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.801423 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75237cfc-ef5d-41fc-8973-002bd8954f2a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "75237cfc-ef5d-41fc-8973-002bd8954f2a" (UID: "75237cfc-ef5d-41fc-8973-002bd8954f2a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 16:31:04.827438 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.827408 2578 generic.go:356] "Generic (PLEG): container finished" podID="75237cfc-ef5d-41fc-8973-002bd8954f2a" containerID="e98b8ebb86bbbb491cfa166d0098a44ffe09f9074adf7aac3d058e4d20912253" exitCode=0 Jul 27 16:31:04.827634 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.827463 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-596747d8cb-8w87m" Jul 27 16:31:04.827634 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.827495 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-596747d8cb-8w87m" event={"ID":"75237cfc-ef5d-41fc-8973-002bd8954f2a","Type":"ContainerDied","Data":"e98b8ebb86bbbb491cfa166d0098a44ffe09f9074adf7aac3d058e4d20912253"} Jul 27 16:31:04.827634 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.827553 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-596747d8cb-8w87m" event={"ID":"75237cfc-ef5d-41fc-8973-002bd8954f2a","Type":"ContainerDied","Data":"f33726ef94455c465dff53e08268bcf582738628e03e89da865430330253b688"} Jul 27 16:31:04.827634 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.827576 2578 scope.go:117] "RemoveContainer" containerID="e98b8ebb86bbbb491cfa166d0098a44ffe09f9074adf7aac3d058e4d20912253" Jul 27 16:31:04.836455 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.836437 2578 scope.go:117] "RemoveContainer" containerID="e98b8ebb86bbbb491cfa166d0098a44ffe09f9074adf7aac3d058e4d20912253" Jul 27 16:31:04.836741 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:31:04.836721 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e98b8ebb86bbbb491cfa166d0098a44ffe09f9074adf7aac3d058e4d20912253\": container with ID starting with e98b8ebb86bbbb491cfa166d0098a44ffe09f9074adf7aac3d058e4d20912253 not found: ID does not exist" containerID="e98b8ebb86bbbb491cfa166d0098a44ffe09f9074adf7aac3d058e4d20912253" Jul 27 16:31:04.836895 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.836747 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e98b8ebb86bbbb491cfa166d0098a44ffe09f9074adf7aac3d058e4d20912253"} err="failed to get container status \"e98b8ebb86bbbb491cfa166d0098a44ffe09f9074adf7aac3d058e4d20912253\": rpc error: code = NotFound desc = could not find container \"e98b8ebb86bbbb491cfa166d0098a44ffe09f9074adf7aac3d058e4d20912253\": container with ID starting with e98b8ebb86bbbb491cfa166d0098a44ffe09f9074adf7aac3d058e4d20912253 not found: ID does not exist" Jul 27 16:31:04.865684 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.865652 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-596747d8cb-8w87m"] Jul 27 16:31:04.872159 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.872134 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-596747d8cb-8w87m"] Jul 27 16:31:04.900115 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.900089 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75237cfc-ef5d-41fc-8973-002bd8954f2a-console-oauth-config\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:31:04.900115 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.900116 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7jwv\" (UniqueName: \"kubernetes.io/projected/75237cfc-ef5d-41fc-8973-002bd8954f2a-kube-api-access-p7jwv\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:31:04.900263 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.900128 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75237cfc-ef5d-41fc-8973-002bd8954f2a-console-config\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:31:04.900263 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.900137 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75237cfc-ef5d-41fc-8973-002bd8954f2a-console-serving-cert\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:31:04.900263 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.900145 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75237cfc-ef5d-41fc-8973-002bd8954f2a-trusted-ca-bundle\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:31:04.900263 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:04.900155 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75237cfc-ef5d-41fc-8973-002bd8954f2a-oauth-serving-cert\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:31:05.377574 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:05.377543 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75237cfc-ef5d-41fc-8973-002bd8954f2a" path="/var/lib/kubelet/pods/75237cfc-ef5d-41fc-8973-002bd8954f2a/volumes" Jul 27 16:31:15.877850 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:15.877770 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7965bdb85-pqmlm" podUID="1fb6002a-16b5-47e4-9b97-1282888d1a79" containerName="console" containerID="cri-o://98d8050afc208424d55f604926b3e1d41070c76300a5f3a4359334538a5f65f1" gracePeriod=15 Jul 27 16:31:16.128620 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.128555 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:31:16.202623 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.202587 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fb6002a-16b5-47e4-9b97-1282888d1a79-trusted-ca-bundle\") pod \"1fb6002a-16b5-47e4-9b97-1282888d1a79\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " Jul 27 16:31:16.202795 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.202701 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fb6002a-16b5-47e4-9b97-1282888d1a79-oauth-serving-cert\") pod \"1fb6002a-16b5-47e4-9b97-1282888d1a79\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " Jul 27 16:31:16.202795 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.202737 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fb6002a-16b5-47e4-9b97-1282888d1a79-service-ca\") pod \"1fb6002a-16b5-47e4-9b97-1282888d1a79\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " Jul 27 16:31:16.202795 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.202779 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fb6002a-16b5-47e4-9b97-1282888d1a79-console-serving-cert\") pod \"1fb6002a-16b5-47e4-9b97-1282888d1a79\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " Jul 27 16:31:16.203033 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.202817 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fb6002a-16b5-47e4-9b97-1282888d1a79-console-config\") pod \"1fb6002a-16b5-47e4-9b97-1282888d1a79\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " Jul 27 16:31:16.203033 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.202860 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fb6002a-16b5-47e4-9b97-1282888d1a79-console-oauth-config\") pod \"1fb6002a-16b5-47e4-9b97-1282888d1a79\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " Jul 27 16:31:16.203033 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.202902 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72gmb\" (UniqueName: \"kubernetes.io/projected/1fb6002a-16b5-47e4-9b97-1282888d1a79-kube-api-access-72gmb\") pod \"1fb6002a-16b5-47e4-9b97-1282888d1a79\" (UID: \"1fb6002a-16b5-47e4-9b97-1282888d1a79\") " Jul 27 16:31:16.203192 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.203024 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fb6002a-16b5-47e4-9b97-1282888d1a79-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1fb6002a-16b5-47e4-9b97-1282888d1a79" (UID: "1fb6002a-16b5-47e4-9b97-1282888d1a79"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 16:31:16.203316 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.203196 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fb6002a-16b5-47e4-9b97-1282888d1a79-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1fb6002a-16b5-47e4-9b97-1282888d1a79" (UID: "1fb6002a-16b5-47e4-9b97-1282888d1a79"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 16:31:16.203316 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.203242 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fb6002a-16b5-47e4-9b97-1282888d1a79-trusted-ca-bundle\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:31:16.203421 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.203334 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fb6002a-16b5-47e4-9b97-1282888d1a79-console-config" (OuterVolumeSpecName: "console-config") pod "1fb6002a-16b5-47e4-9b97-1282888d1a79" (UID: "1fb6002a-16b5-47e4-9b97-1282888d1a79"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 16:31:16.203557 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.203529 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fb6002a-16b5-47e4-9b97-1282888d1a79-service-ca" (OuterVolumeSpecName: "service-ca") pod "1fb6002a-16b5-47e4-9b97-1282888d1a79" (UID: "1fb6002a-16b5-47e4-9b97-1282888d1a79"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 16:31:16.205138 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.205110 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fb6002a-16b5-47e4-9b97-1282888d1a79-kube-api-access-72gmb" (OuterVolumeSpecName: "kube-api-access-72gmb") pod "1fb6002a-16b5-47e4-9b97-1282888d1a79" (UID: "1fb6002a-16b5-47e4-9b97-1282888d1a79"). InnerVolumeSpecName "kube-api-access-72gmb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:31:16.205256 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.205214 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fb6002a-16b5-47e4-9b97-1282888d1a79-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1fb6002a-16b5-47e4-9b97-1282888d1a79" (UID: "1fb6002a-16b5-47e4-9b97-1282888d1a79"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 16:31:16.205468 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.205448 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fb6002a-16b5-47e4-9b97-1282888d1a79-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1fb6002a-16b5-47e4-9b97-1282888d1a79" (UID: "1fb6002a-16b5-47e4-9b97-1282888d1a79"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 16:31:16.304098 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.304065 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fb6002a-16b5-47e4-9b97-1282888d1a79-oauth-serving-cert\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:31:16.304098 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.304092 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fb6002a-16b5-47e4-9b97-1282888d1a79-service-ca\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:31:16.304098 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.304103 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fb6002a-16b5-47e4-9b97-1282888d1a79-console-serving-cert\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:31:16.304316 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.304112 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fb6002a-16b5-47e4-9b97-1282888d1a79-console-config\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:31:16.304316 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.304120 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fb6002a-16b5-47e4-9b97-1282888d1a79-console-oauth-config\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:31:16.304316 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.304128 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72gmb\" (UniqueName: \"kubernetes.io/projected/1fb6002a-16b5-47e4-9b97-1282888d1a79-kube-api-access-72gmb\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:31:16.881243 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.881205 2578 generic.go:356] "Generic (PLEG): container finished" podID="1fb6002a-16b5-47e4-9b97-1282888d1a79" containerID="98d8050afc208424d55f604926b3e1d41070c76300a5f3a4359334538a5f65f1" exitCode=0 Jul 27 16:31:16.881674 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.881252 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7965bdb85-pqmlm" Jul 27 16:31:16.881674 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.881294 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7965bdb85-pqmlm" event={"ID":"1fb6002a-16b5-47e4-9b97-1282888d1a79","Type":"ContainerDied","Data":"98d8050afc208424d55f604926b3e1d41070c76300a5f3a4359334538a5f65f1"} Jul 27 16:31:16.881674 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.881348 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7965bdb85-pqmlm" event={"ID":"1fb6002a-16b5-47e4-9b97-1282888d1a79","Type":"ContainerDied","Data":"cba70353bdbccc69cb93fdefdc20b2c63ce91b0c5978f3795e6600905712d9d8"} Jul 27 16:31:16.881674 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.881368 2578 scope.go:117] "RemoveContainer" containerID="98d8050afc208424d55f604926b3e1d41070c76300a5f3a4359334538a5f65f1" Jul 27 16:31:16.890224 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.890207 2578 scope.go:117] "RemoveContainer" containerID="98d8050afc208424d55f604926b3e1d41070c76300a5f3a4359334538a5f65f1" Jul 27 16:31:16.890495 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:31:16.890478 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98d8050afc208424d55f604926b3e1d41070c76300a5f3a4359334538a5f65f1\": container with ID starting with 98d8050afc208424d55f604926b3e1d41070c76300a5f3a4359334538a5f65f1 not found: ID does not exist" containerID="98d8050afc208424d55f604926b3e1d41070c76300a5f3a4359334538a5f65f1" Jul 27 16:31:16.890540 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.890506 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98d8050afc208424d55f604926b3e1d41070c76300a5f3a4359334538a5f65f1"} err="failed to get container status \"98d8050afc208424d55f604926b3e1d41070c76300a5f3a4359334538a5f65f1\": rpc error: code = NotFound desc = could not find container \"98d8050afc208424d55f604926b3e1d41070c76300a5f3a4359334538a5f65f1\": container with ID starting with 98d8050afc208424d55f604926b3e1d41070c76300a5f3a4359334538a5f65f1 not found: ID does not exist" Jul 27 16:31:16.902931 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.902904 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7965bdb85-pqmlm"] Jul 27 16:31:16.907990 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:16.907970 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7965bdb85-pqmlm"] Jul 27 16:31:17.377246 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:31:17.377213 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fb6002a-16b5-47e4-9b97-1282888d1a79" path="/var/lib/kubelet/pods/1fb6002a-16b5-47e4-9b97-1282888d1a79/volumes" Jul 27 16:33:43.684456 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:43.684366 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-5db9fcb679-l6hfl"] Jul 27 16:33:43.685054 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:43.684867 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75237cfc-ef5d-41fc-8973-002bd8954f2a" containerName="console" Jul 27 16:33:43.685054 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:43.684885 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="75237cfc-ef5d-41fc-8973-002bd8954f2a" containerName="console" Jul 27 16:33:43.685054 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:43.684918 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fb6002a-16b5-47e4-9b97-1282888d1a79" containerName="console" Jul 27 16:33:43.685054 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:43.684927 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fb6002a-16b5-47e4-9b97-1282888d1a79" containerName="console" Jul 27 16:33:43.685054 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:43.685003 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="75237cfc-ef5d-41fc-8973-002bd8954f2a" containerName="console" Jul 27 16:33:43.685054 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:43.685018 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fb6002a-16b5-47e4-9b97-1282888d1a79" containerName="console" Jul 27 16:33:43.688100 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:43.688079 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-5db9fcb679-l6hfl" Jul 27 16:33:43.690301 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:43.690278 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 27 16:33:43.690301 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:43.690291 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jul 27 16:33:43.690301 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:43.690280 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jul 27 16:33:43.690706 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:43.690680 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-ln87p\"" Jul 27 16:33:43.690706 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:43.690699 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 27 16:33:43.698207 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:43.698184 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-5db9fcb679-l6hfl"] Jul 27 16:33:43.803533 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:43.803489 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b80be86e-e812-426e-8b07-9c2f90fe5513-cert\") pod \"kubeflow-trainer-controller-manager-5db9fcb679-l6hfl\" (UID: \"b80be86e-e812-426e-8b07-9c2f90fe5513\") " pod="opendatahub/kubeflow-trainer-controller-manager-5db9fcb679-l6hfl" Jul 27 16:33:43.803868 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:43.803543 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnc42\" (UniqueName: \"kubernetes.io/projected/b80be86e-e812-426e-8b07-9c2f90fe5513-kube-api-access-jnc42\") pod \"kubeflow-trainer-controller-manager-5db9fcb679-l6hfl\" (UID: \"b80be86e-e812-426e-8b07-9c2f90fe5513\") " pod="opendatahub/kubeflow-trainer-controller-manager-5db9fcb679-l6hfl" Jul 27 16:33:43.803868 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:43.803621 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/b80be86e-e812-426e-8b07-9c2f90fe5513-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-5db9fcb679-l6hfl\" (UID: \"b80be86e-e812-426e-8b07-9c2f90fe5513\") " pod="opendatahub/kubeflow-trainer-controller-manager-5db9fcb679-l6hfl" Jul 27 16:33:43.904517 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:43.904481 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/b80be86e-e812-426e-8b07-9c2f90fe5513-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-5db9fcb679-l6hfl\" (UID: \"b80be86e-e812-426e-8b07-9c2f90fe5513\") " pod="opendatahub/kubeflow-trainer-controller-manager-5db9fcb679-l6hfl" Jul 27 16:33:43.904686 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:43.904544 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b80be86e-e812-426e-8b07-9c2f90fe5513-cert\") pod \"kubeflow-trainer-controller-manager-5db9fcb679-l6hfl\" (UID: \"b80be86e-e812-426e-8b07-9c2f90fe5513\") " pod="opendatahub/kubeflow-trainer-controller-manager-5db9fcb679-l6hfl" Jul 27 16:33:43.904686 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:43.904573 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnc42\" (UniqueName: \"kubernetes.io/projected/b80be86e-e812-426e-8b07-9c2f90fe5513-kube-api-access-jnc42\") pod \"kubeflow-trainer-controller-manager-5db9fcb679-l6hfl\" (UID: \"b80be86e-e812-426e-8b07-9c2f90fe5513\") " pod="opendatahub/kubeflow-trainer-controller-manager-5db9fcb679-l6hfl" Jul 27 16:33:43.905229 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:43.905206 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/b80be86e-e812-426e-8b07-9c2f90fe5513-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-5db9fcb679-l6hfl\" (UID: \"b80be86e-e812-426e-8b07-9c2f90fe5513\") " pod="opendatahub/kubeflow-trainer-controller-manager-5db9fcb679-l6hfl" Jul 27 16:33:43.906939 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:43.906911 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b80be86e-e812-426e-8b07-9c2f90fe5513-cert\") pod \"kubeflow-trainer-controller-manager-5db9fcb679-l6hfl\" (UID: \"b80be86e-e812-426e-8b07-9c2f90fe5513\") " pod="opendatahub/kubeflow-trainer-controller-manager-5db9fcb679-l6hfl" Jul 27 16:33:43.921991 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:43.921964 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnc42\" (UniqueName: \"kubernetes.io/projected/b80be86e-e812-426e-8b07-9c2f90fe5513-kube-api-access-jnc42\") pod \"kubeflow-trainer-controller-manager-5db9fcb679-l6hfl\" (UID: \"b80be86e-e812-426e-8b07-9c2f90fe5513\") " pod="opendatahub/kubeflow-trainer-controller-manager-5db9fcb679-l6hfl" Jul 27 16:33:44.005202 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:44.005109 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-5db9fcb679-l6hfl" Jul 27 16:33:44.134758 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:44.134729 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-5db9fcb679-l6hfl"] Jul 27 16:33:44.137018 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:33:44.136991 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb80be86e_e812_426e_8b07_9c2f90fe5513.slice/crio-4e6a745e4f46e358357067b29f6b5fde3caa6b6c66890a8ca09bdd737b3719a3 WatchSource:0}: Error finding container 4e6a745e4f46e358357067b29f6b5fde3caa6b6c66890a8ca09bdd737b3719a3: Status 404 returned error can't find the container with id 4e6a745e4f46e358357067b29f6b5fde3caa6b6c66890a8ca09bdd737b3719a3 Jul 27 16:33:44.139278 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:44.139260 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 16:33:44.462979 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:44.462946 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-5db9fcb679-l6hfl" event={"ID":"b80be86e-e812-426e-8b07-9c2f90fe5513","Type":"ContainerStarted","Data":"4e6a745e4f46e358357067b29f6b5fde3caa6b6c66890a8ca09bdd737b3719a3"} Jul 27 16:33:47.478154 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:47.478116 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-5db9fcb679-l6hfl" event={"ID":"b80be86e-e812-426e-8b07-9c2f90fe5513","Type":"ContainerStarted","Data":"745e4bf7aa45d344f1f06a6259a457498d21f7cf8eac9e44bcd4ed32baf2fb53"} Jul 27 16:33:47.478614 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:47.478183 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-5db9fcb679-l6hfl" Jul 27 16:33:47.497579 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:33:47.497530 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-5db9fcb679-l6hfl" podStartSLOduration=1.709517022 podStartE2EDuration="4.497514273s" totalImagesPullingTime="2.787997251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:33:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:33:47.496565441 +0000 UTC m=+562.706415318" watchObservedRunningTime="2026-07-27 16:33:47.497514273 +0000 UTC m=+562.707364144" Jul 27 16:34:03.487540 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:34:03.487513 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-5db9fcb679-l6hfl" Jul 27 16:34:25.208483 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:34:25.208455 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2cqxv_f7ba4530-6cc8-463f-9ac7-e9572867a152/console-operator/1.log" Jul 27 16:34:25.209194 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:34:25.208689 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2cqxv_f7ba4530-6cc8-463f-9ac7-e9572867a152/console-operator/1.log" Jul 27 16:35:09.671364 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:35:09.671310 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-n94vk/progression-enabled-node-0-0-zjzkp"] Jul 27 16:35:09.673549 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:35:09.673530 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-n94vk/progression-enabled-node-0-0-zjzkp" Jul 27 16:35:09.675525 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:35:09.675496 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-n94vk\"/\"openshift-service-ca.crt\"" Jul 27 16:35:09.675525 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:35:09.675519 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-n94vk\"/\"default-dockercfg-xv8jx\"" Jul 27 16:35:09.675715 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:35:09.675613 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-n94vk\"/\"kube-root-ca.crt\"" Jul 27 16:35:09.680267 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:35:09.679946 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz5s2\" (UniqueName: \"kubernetes.io/projected/69069aa8-5802-4551-94f6-4fda5813b90f-kube-api-access-gz5s2\") pod \"progression-enabled-node-0-0-zjzkp\" (UID: \"69069aa8-5802-4551-94f6-4fda5813b90f\") " pod="rhai-e2e-progression-n94vk/progression-enabled-node-0-0-zjzkp" Jul 27 16:35:09.687706 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:35:09.687674 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-n94vk/progression-enabled-node-0-0-zjzkp"] Jul 27 16:35:09.780734 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:35:09.780699 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz5s2\" (UniqueName: \"kubernetes.io/projected/69069aa8-5802-4551-94f6-4fda5813b90f-kube-api-access-gz5s2\") pod \"progression-enabled-node-0-0-zjzkp\" (UID: \"69069aa8-5802-4551-94f6-4fda5813b90f\") " pod="rhai-e2e-progression-n94vk/progression-enabled-node-0-0-zjzkp" Jul 27 16:35:09.789934 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:35:09.789906 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz5s2\" (UniqueName: \"kubernetes.io/projected/69069aa8-5802-4551-94f6-4fda5813b90f-kube-api-access-gz5s2\") pod \"progression-enabled-node-0-0-zjzkp\" (UID: \"69069aa8-5802-4551-94f6-4fda5813b90f\") " pod="rhai-e2e-progression-n94vk/progression-enabled-node-0-0-zjzkp" Jul 27 16:35:09.983464 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:35:09.983357 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-n94vk/progression-enabled-node-0-0-zjzkp" Jul 27 16:35:10.118340 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:35:10.118315 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-n94vk/progression-enabled-node-0-0-zjzkp"] Jul 27 16:35:10.120918 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:35:10.120892 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69069aa8_5802_4551_94f6_4fda5813b90f.slice/crio-20d4f9d19020f98848134824f23abd78661f08f2a8f1bde9b553027672edafda WatchSource:0}: Error finding container 20d4f9d19020f98848134824f23abd78661f08f2a8f1bde9b553027672edafda: Status 404 returned error can't find the container with id 20d4f9d19020f98848134824f23abd78661f08f2a8f1bde9b553027672edafda Jul 27 16:35:10.824354 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:35:10.824316 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-n94vk/progression-enabled-node-0-0-zjzkp" event={"ID":"69069aa8-5802-4551-94f6-4fda5813b90f","Type":"ContainerStarted","Data":"20d4f9d19020f98848134824f23abd78661f08f2a8f1bde9b553027672edafda"} Jul 27 16:37:08.373942 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:08.373900 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-n94vk/progression-enabled-node-0-0-zjzkp" event={"ID":"69069aa8-5802-4551-94f6-4fda5813b90f","Type":"ContainerStarted","Data":"5cb3ed4e4e05ef125ce3224d64810e1e8671e5b446572c40d7c38096444d05db"} Jul 27 16:37:08.374360 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:08.374058 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-n94vk/progression-enabled-node-0-0-zjzkp" Jul 27 16:37:08.399732 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:08.399680 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-n94vk/progression-enabled-node-0-0-zjzkp" podStartSLOduration=2.107356213 podStartE2EDuration="1m59.399666319s" totalImagesPullingTime="1m57.292310106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:35:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:37:08.398750965 +0000 UTC m=+763.608600865" watchObservedRunningTime="2026-07-27 16:37:08.399666319 +0000 UTC m=+763.609516192" Jul 27 16:37:09.378270 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:09.378233 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-n94vk/progression-enabled-node-0-0-zjzkp" Jul 27 16:37:30.741953 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:30.741825 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-n94vk/progression-enabled-node-0-0-zjzkp" podUID="69069aa8-5802-4551-94f6-4fda5813b90f" containerName="node" probeResult="failure" output="Get \"http://10.133.0.27:28080/metrics\": read tcp 10.133.0.2:36604->10.133.0.27:28080: read: connection reset by peer" Jul 27 16:37:31.374412 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:31.374361 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-n94vk/progression-enabled-node-0-0-zjzkp" podUID="69069aa8-5802-4551-94f6-4fda5813b90f" containerName="node" probeResult="failure" output="Get \"http://10.133.0.27:28080/metrics\": dial tcp 10.133.0.27:28080: connect: connection refused" Jul 27 16:37:31.377496 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:31.377475 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-n94vk/progression-enabled-node-0-0-zjzkp" Jul 27 16:37:31.377912 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:31.377888 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-n94vk/progression-enabled-node-0-0-zjzkp" podUID="69069aa8-5802-4551-94f6-4fda5813b90f" containerName="node" probeResult="failure" output="Get \"http://10.133.0.27:28080/metrics\": dial tcp 10.133.0.27:28080: connect: connection refused" Jul 27 16:37:31.467490 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:31.467461 2578 generic.go:356] "Generic (PLEG): container finished" podID="69069aa8-5802-4551-94f6-4fda5813b90f" containerID="5cb3ed4e4e05ef125ce3224d64810e1e8671e5b446572c40d7c38096444d05db" exitCode=0 Jul 27 16:37:31.467665 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:31.467540 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-n94vk/progression-enabled-node-0-0-zjzkp" event={"ID":"69069aa8-5802-4551-94f6-4fda5813b90f","Type":"ContainerDied","Data":"5cb3ed4e4e05ef125ce3224d64810e1e8671e5b446572c40d7c38096444d05db"} Jul 27 16:37:32.628072 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:32.628043 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-n94vk/progression-enabled-node-0-0-zjzkp" Jul 27 16:37:32.690862 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:32.690823 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gz5s2\" (UniqueName: \"kubernetes.io/projected/69069aa8-5802-4551-94f6-4fda5813b90f-kube-api-access-gz5s2\") pod \"69069aa8-5802-4551-94f6-4fda5813b90f\" (UID: \"69069aa8-5802-4551-94f6-4fda5813b90f\") " Jul 27 16:37:32.692963 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:32.692939 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69069aa8-5802-4551-94f6-4fda5813b90f-kube-api-access-gz5s2" (OuterVolumeSpecName: "kube-api-access-gz5s2") pod "69069aa8-5802-4551-94f6-4fda5813b90f" (UID: "69069aa8-5802-4551-94f6-4fda5813b90f"). InnerVolumeSpecName "kube-api-access-gz5s2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:37:32.792387 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:32.792357 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gz5s2\" (UniqueName: \"kubernetes.io/projected/69069aa8-5802-4551-94f6-4fda5813b90f-kube-api-access-gz5s2\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:37:33.477314 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:33.477281 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-n94vk/progression-enabled-node-0-0-zjzkp" Jul 27 16:37:33.477481 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:33.477277 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-n94vk/progression-enabled-node-0-0-zjzkp" event={"ID":"69069aa8-5802-4551-94f6-4fda5813b90f","Type":"ContainerDied","Data":"20d4f9d19020f98848134824f23abd78661f08f2a8f1bde9b553027672edafda"} Jul 27 16:37:33.477481 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:33.477406 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20d4f9d19020f98848134824f23abd78661f08f2a8f1bde9b553027672edafda" Jul 27 16:37:34.441867 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:34.441800 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-n94vk/progression-disabled-node-0-0-796xs"] Jul 27 16:37:34.442354 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:34.442329 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69069aa8-5802-4551-94f6-4fda5813b90f" containerName="node" Jul 27 16:37:34.442354 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:34.442348 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="69069aa8-5802-4551-94f6-4fda5813b90f" containerName="node" Jul 27 16:37:34.442470 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:34.442420 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="69069aa8-5802-4551-94f6-4fda5813b90f" containerName="node" Jul 27 16:37:34.458428 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:34.458394 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-n94vk/progression-disabled-node-0-0-796xs"] Jul 27 16:37:34.458609 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:34.458526 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-n94vk/progression-disabled-node-0-0-796xs" Jul 27 16:37:34.460592 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:34.460570 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-n94vk\"/\"kube-root-ca.crt\"" Jul 27 16:37:34.460723 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:34.460685 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-n94vk\"/\"openshift-service-ca.crt\"" Jul 27 16:37:34.460723 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:34.460688 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-n94vk\"/\"default-dockercfg-xv8jx\"" Jul 27 16:37:34.508700 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:34.508661 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz2v8\" (UniqueName: \"kubernetes.io/projected/cbceb5bd-470c-4131-b1fa-10f33ae4a469-kube-api-access-tz2v8\") pod \"progression-disabled-node-0-0-796xs\" (UID: \"cbceb5bd-470c-4131-b1fa-10f33ae4a469\") " pod="rhai-e2e-progression-n94vk/progression-disabled-node-0-0-796xs" Jul 27 16:37:34.609761 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:34.609719 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz2v8\" (UniqueName: \"kubernetes.io/projected/cbceb5bd-470c-4131-b1fa-10f33ae4a469-kube-api-access-tz2v8\") pod \"progression-disabled-node-0-0-796xs\" (UID: \"cbceb5bd-470c-4131-b1fa-10f33ae4a469\") " pod="rhai-e2e-progression-n94vk/progression-disabled-node-0-0-796xs" Jul 27 16:37:34.618272 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:34.618236 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz2v8\" (UniqueName: \"kubernetes.io/projected/cbceb5bd-470c-4131-b1fa-10f33ae4a469-kube-api-access-tz2v8\") pod \"progression-disabled-node-0-0-796xs\" (UID: \"cbceb5bd-470c-4131-b1fa-10f33ae4a469\") " pod="rhai-e2e-progression-n94vk/progression-disabled-node-0-0-796xs" Jul 27 16:37:34.769962 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:34.769868 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-n94vk/progression-disabled-node-0-0-796xs" Jul 27 16:37:34.917770 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:34.917738 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-n94vk/progression-disabled-node-0-0-796xs"] Jul 27 16:37:34.921744 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:37:34.921721 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbceb5bd_470c_4131_b1fa_10f33ae4a469.slice/crio-0dc377a71b61152ad18bfe5604710085809534c7b2ca0b3297d5420ae513a1b4 WatchSource:0}: Error finding container 0dc377a71b61152ad18bfe5604710085809534c7b2ca0b3297d5420ae513a1b4: Status 404 returned error can't find the container with id 0dc377a71b61152ad18bfe5604710085809534c7b2ca0b3297d5420ae513a1b4 Jul 27 16:37:35.488373 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:35.488325 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-n94vk/progression-disabled-node-0-0-796xs" event={"ID":"cbceb5bd-470c-4131-b1fa-10f33ae4a469","Type":"ContainerStarted","Data":"d2d40ed5523080c233a95e41f2fdd2d19887ce017a2ffd9fd045ddb08ccfaf66"} Jul 27 16:37:35.488791 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:35.488389 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-n94vk/progression-disabled-node-0-0-796xs" event={"ID":"cbceb5bd-470c-4131-b1fa-10f33ae4a469","Type":"ContainerStarted","Data":"0dc377a71b61152ad18bfe5604710085809534c7b2ca0b3297d5420ae513a1b4"} Jul 27 16:37:35.488791 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:35.488446 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-n94vk/progression-disabled-node-0-0-796xs" Jul 27 16:37:35.509046 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:35.508984 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-n94vk/progression-disabled-node-0-0-796xs" podStartSLOduration=1.508964653 podStartE2EDuration="1.508964653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:37:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:37:35.507018031 +0000 UTC m=+790.716867903" watchObservedRunningTime="2026-07-27 16:37:35.508964653 +0000 UTC m=+790.718814522" Jul 27 16:37:37.496177 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:37.496150 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-n94vk/progression-disabled-node-0-0-796xs" Jul 27 16:37:58.493748 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:58.493648 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-n94vk/progression-disabled-node-0-0-796xs" podUID="cbceb5bd-470c-4131-b1fa-10f33ae4a469" containerName="node" probeResult="failure" output="Get \"http://10.133.0.28:28080/metrics\": dial tcp 10.133.0.28:28080: connect: connection refused" Jul 27 16:37:58.591043 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:58.591008 2578 generic.go:356] "Generic (PLEG): container finished" podID="cbceb5bd-470c-4131-b1fa-10f33ae4a469" containerID="d2d40ed5523080c233a95e41f2fdd2d19887ce017a2ffd9fd045ddb08ccfaf66" exitCode=0 Jul 27 16:37:58.591216 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:58.591080 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-n94vk/progression-disabled-node-0-0-796xs" event={"ID":"cbceb5bd-470c-4131-b1fa-10f33ae4a469","Type":"ContainerDied","Data":"d2d40ed5523080c233a95e41f2fdd2d19887ce017a2ffd9fd045ddb08ccfaf66"} Jul 27 16:37:59.745705 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:59.745678 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-n94vk/progression-disabled-node-0-0-796xs" Jul 27 16:37:59.846739 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:59.846642 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tz2v8\" (UniqueName: \"kubernetes.io/projected/cbceb5bd-470c-4131-b1fa-10f33ae4a469-kube-api-access-tz2v8\") pod \"cbceb5bd-470c-4131-b1fa-10f33ae4a469\" (UID: \"cbceb5bd-470c-4131-b1fa-10f33ae4a469\") " Jul 27 16:37:59.848753 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:59.848725 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbceb5bd-470c-4131-b1fa-10f33ae4a469-kube-api-access-tz2v8" (OuterVolumeSpecName: "kube-api-access-tz2v8") pod "cbceb5bd-470c-4131-b1fa-10f33ae4a469" (UID: "cbceb5bd-470c-4131-b1fa-10f33ae4a469"). InnerVolumeSpecName "kube-api-access-tz2v8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:37:59.947953 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:37:59.947911 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tz2v8\" (UniqueName: \"kubernetes.io/projected/cbceb5bd-470c-4131-b1fa-10f33ae4a469-kube-api-access-tz2v8\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:38:00.600381 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:00.600354 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-n94vk/progression-disabled-node-0-0-796xs" Jul 27 16:38:00.600381 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:00.600367 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-n94vk/progression-disabled-node-0-0-796xs" event={"ID":"cbceb5bd-470c-4131-b1fa-10f33ae4a469","Type":"ContainerDied","Data":"0dc377a71b61152ad18bfe5604710085809534c7b2ca0b3297d5420ae513a1b4"} Jul 27 16:38:00.600585 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:00.600409 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0dc377a71b61152ad18bfe5604710085809534c7b2ca0b3297d5420ae513a1b4" Jul 27 16:38:09.387334 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:09.387306 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-n94vk/progression-invalid-node-0-0-qdpcn"] Jul 27 16:38:09.387790 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:09.387611 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbceb5bd-470c-4131-b1fa-10f33ae4a469" containerName="node" Jul 27 16:38:09.387790 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:09.387621 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbceb5bd-470c-4131-b1fa-10f33ae4a469" containerName="node" Jul 27 16:38:09.387790 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:09.387708 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbceb5bd-470c-4131-b1fa-10f33ae4a469" containerName="node" Jul 27 16:38:09.389718 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:09.389702 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-n94vk/progression-invalid-node-0-0-qdpcn" Jul 27 16:38:09.392083 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:09.392054 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-n94vk\"/\"kube-root-ca.crt\"" Jul 27 16:38:09.392083 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:09.392079 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-n94vk\"/\"openshift-service-ca.crt\"" Jul 27 16:38:09.392275 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:09.392156 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-n94vk\"/\"default-dockercfg-xv8jx\"" Jul 27 16:38:09.398887 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:09.398866 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-n94vk/progression-invalid-node-0-0-qdpcn"] Jul 27 16:38:09.429713 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:09.429683 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv8tw\" (UniqueName: \"kubernetes.io/projected/f3d28554-d248-4dd0-b322-0001841c6cdd-kube-api-access-qv8tw\") pod \"progression-invalid-node-0-0-qdpcn\" (UID: \"f3d28554-d248-4dd0-b322-0001841c6cdd\") " pod="rhai-e2e-progression-n94vk/progression-invalid-node-0-0-qdpcn" Jul 27 16:38:09.530576 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:09.530535 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv8tw\" (UniqueName: \"kubernetes.io/projected/f3d28554-d248-4dd0-b322-0001841c6cdd-kube-api-access-qv8tw\") pod \"progression-invalid-node-0-0-qdpcn\" (UID: \"f3d28554-d248-4dd0-b322-0001841c6cdd\") " pod="rhai-e2e-progression-n94vk/progression-invalid-node-0-0-qdpcn" Jul 27 16:38:09.539036 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:09.539009 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv8tw\" (UniqueName: \"kubernetes.io/projected/f3d28554-d248-4dd0-b322-0001841c6cdd-kube-api-access-qv8tw\") pod \"progression-invalid-node-0-0-qdpcn\" (UID: \"f3d28554-d248-4dd0-b322-0001841c6cdd\") " pod="rhai-e2e-progression-n94vk/progression-invalid-node-0-0-qdpcn" Jul 27 16:38:09.700197 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:09.700102 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-n94vk/progression-invalid-node-0-0-qdpcn" Jul 27 16:38:09.830957 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:09.830868 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-n94vk/progression-invalid-node-0-0-qdpcn"] Jul 27 16:38:09.833954 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:38:09.833925 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3d28554_d248_4dd0_b322_0001841c6cdd.slice/crio-601698b3da9cc26ce86954c68f9b74d06db60f54bd433851a935375de0fbb5ba WatchSource:0}: Error finding container 601698b3da9cc26ce86954c68f9b74d06db60f54bd433851a935375de0fbb5ba: Status 404 returned error can't find the container with id 601698b3da9cc26ce86954c68f9b74d06db60f54bd433851a935375de0fbb5ba Jul 27 16:38:10.659738 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:10.659704 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-n94vk/progression-invalid-node-0-0-qdpcn" event={"ID":"f3d28554-d248-4dd0-b322-0001841c6cdd","Type":"ContainerStarted","Data":"14c7a1857fbe1e154f7a822a758db7c1d3794ebdc9612ac77e0d796e3034367c"} Jul 27 16:38:10.660152 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:10.659759 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-n94vk/progression-invalid-node-0-0-qdpcn" event={"ID":"f3d28554-d248-4dd0-b322-0001841c6cdd","Type":"ContainerStarted","Data":"601698b3da9cc26ce86954c68f9b74d06db60f54bd433851a935375de0fbb5ba"} Jul 27 16:38:10.660152 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:10.659782 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-n94vk/progression-invalid-node-0-0-qdpcn" Jul 27 16:38:10.677954 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:10.677902 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-n94vk/progression-invalid-node-0-0-qdpcn" podStartSLOduration=1.67788465 podStartE2EDuration="1.67788465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:38:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:38:10.675888201 +0000 UTC m=+825.885738070" watchObservedRunningTime="2026-07-27 16:38:10.67788465 +0000 UTC m=+825.887734521" Jul 27 16:38:11.662676 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:11.662650 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-n94vk/progression-invalid-node-0-0-qdpcn" Jul 27 16:38:32.968452 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:32.968408 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-n94vk/progression-invalid-node-0-0-qdpcn" podUID="f3d28554-d248-4dd0-b322-0001841c6cdd" containerName="node" probeResult="failure" output="Get \"http://10.133.0.29:28080/metrics\": read tcp 10.133.0.2:52860->10.133.0.29:28080: read: connection reset by peer" Jul 27 16:38:33.660145 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:33.660108 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-n94vk/progression-invalid-node-0-0-qdpcn" podUID="f3d28554-d248-4dd0-b322-0001841c6cdd" containerName="node" probeResult="failure" output="Get \"http://10.133.0.29:28080/metrics\": dial tcp 10.133.0.29:28080: connect: connection refused" Jul 27 16:38:33.660318 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:33.660221 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-n94vk/progression-invalid-node-0-0-qdpcn" Jul 27 16:38:33.660722 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:33.660699 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-n94vk/progression-invalid-node-0-0-qdpcn" podUID="f3d28554-d248-4dd0-b322-0001841c6cdd" containerName="node" probeResult="failure" output="Get \"http://10.133.0.29:28080/metrics\": dial tcp 10.133.0.29:28080: connect: connection refused" Jul 27 16:38:33.763547 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:33.763514 2578 generic.go:356] "Generic (PLEG): container finished" podID="f3d28554-d248-4dd0-b322-0001841c6cdd" containerID="14c7a1857fbe1e154f7a822a758db7c1d3794ebdc9612ac77e0d796e3034367c" exitCode=0 Jul 27 16:38:33.763704 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:33.763582 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-n94vk/progression-invalid-node-0-0-qdpcn" event={"ID":"f3d28554-d248-4dd0-b322-0001841c6cdd","Type":"ContainerDied","Data":"14c7a1857fbe1e154f7a822a758db7c1d3794ebdc9612ac77e0d796e3034367c"} Jul 27 16:38:34.897295 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:34.897273 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-n94vk/progression-invalid-node-0-0-qdpcn" Jul 27 16:38:34.964499 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:34.964470 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qv8tw\" (UniqueName: \"kubernetes.io/projected/f3d28554-d248-4dd0-b322-0001841c6cdd-kube-api-access-qv8tw\") pod \"f3d28554-d248-4dd0-b322-0001841c6cdd\" (UID: \"f3d28554-d248-4dd0-b322-0001841c6cdd\") " Jul 27 16:38:34.966501 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:34.966475 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3d28554-d248-4dd0-b322-0001841c6cdd-kube-api-access-qv8tw" (OuterVolumeSpecName: "kube-api-access-qv8tw") pod "f3d28554-d248-4dd0-b322-0001841c6cdd" (UID: "f3d28554-d248-4dd0-b322-0001841c6cdd"). InnerVolumeSpecName "kube-api-access-qv8tw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:38:35.065641 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:35.065603 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qv8tw\" (UniqueName: \"kubernetes.io/projected/f3d28554-d248-4dd0-b322-0001841c6cdd-kube-api-access-qv8tw\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:38:35.773320 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:35.773248 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-n94vk/progression-invalid-node-0-0-qdpcn" Jul 27 16:38:35.773463 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:35.773248 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-n94vk/progression-invalid-node-0-0-qdpcn" event={"ID":"f3d28554-d248-4dd0-b322-0001841c6cdd","Type":"ContainerDied","Data":"601698b3da9cc26ce86954c68f9b74d06db60f54bd433851a935375de0fbb5ba"} Jul 27 16:38:35.773463 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:38:35.773372 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="601698b3da9cc26ce86954c68f9b74d06db60f54bd433851a935375de0fbb5ba" Jul 27 16:39:25.242824 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:39:25.242751 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2cqxv_f7ba4530-6cc8-463f-9ac7-e9572867a152/console-operator/1.log" Jul 27 16:39:25.244043 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:39:25.244020 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2cqxv_f7ba4530-6cc8-463f-9ac7-e9572867a152/console-operator/1.log" Jul 27 16:40:25.054500 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:25.054438 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-n94vk/progression-no-metrics-node-0-0-n9t9c"] Jul 27 16:40:25.056495 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:25.055247 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3d28554-d248-4dd0-b322-0001841c6cdd" containerName="node" Jul 27 16:40:25.056495 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:25.055266 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3d28554-d248-4dd0-b322-0001841c6cdd" containerName="node" Jul 27 16:40:25.056495 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:25.055492 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3d28554-d248-4dd0-b322-0001841c6cdd" containerName="node" Jul 27 16:40:25.058139 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:25.058117 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-n94vk/progression-no-metrics-node-0-0-n9t9c" Jul 27 16:40:25.060562 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:25.060536 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-n94vk\"/\"default-dockercfg-xv8jx\"" Jul 27 16:40:25.060705 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:25.060577 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-n94vk\"/\"openshift-service-ca.crt\"" Jul 27 16:40:25.060705 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:25.060580 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-n94vk\"/\"kube-root-ca.crt\"" Jul 27 16:40:25.065273 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:25.065251 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-n94vk/progression-no-metrics-node-0-0-n9t9c"] Jul 27 16:40:25.126878 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:25.126828 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq5lb\" (UniqueName: \"kubernetes.io/projected/33eb503c-1f68-4ccd-8998-419f2376f634-kube-api-access-vq5lb\") pod \"progression-no-metrics-node-0-0-n9t9c\" (UID: \"33eb503c-1f68-4ccd-8998-419f2376f634\") " pod="rhai-e2e-progression-n94vk/progression-no-metrics-node-0-0-n9t9c" Jul 27 16:40:25.228068 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:25.228022 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq5lb\" (UniqueName: \"kubernetes.io/projected/33eb503c-1f68-4ccd-8998-419f2376f634-kube-api-access-vq5lb\") pod \"progression-no-metrics-node-0-0-n9t9c\" (UID: \"33eb503c-1f68-4ccd-8998-419f2376f634\") " pod="rhai-e2e-progression-n94vk/progression-no-metrics-node-0-0-n9t9c" Jul 27 16:40:25.235835 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:25.235810 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-n94vk\"/\"kube-root-ca.crt\"" Jul 27 16:40:25.246183 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:25.246154 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-n94vk\"/\"openshift-service-ca.crt\"" Jul 27 16:40:25.256942 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:25.256917 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq5lb\" (UniqueName: \"kubernetes.io/projected/33eb503c-1f68-4ccd-8998-419f2376f634-kube-api-access-vq5lb\") pod \"progression-no-metrics-node-0-0-n9t9c\" (UID: \"33eb503c-1f68-4ccd-8998-419f2376f634\") " pod="rhai-e2e-progression-n94vk/progression-no-metrics-node-0-0-n9t9c" Jul 27 16:40:25.371911 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:25.371825 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-n94vk\"/\"default-dockercfg-xv8jx\"" Jul 27 16:40:25.380195 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:25.380171 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-n94vk/progression-no-metrics-node-0-0-n9t9c" Jul 27 16:40:25.515091 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:25.515068 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-n94vk/progression-no-metrics-node-0-0-n9t9c"] Jul 27 16:40:25.517562 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:40:25.517539 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33eb503c_1f68_4ccd_8998_419f2376f634.slice/crio-ca3c2b12e8041da868ff791e54fc075900fd2fb4762df60902365cdddf789bc4 WatchSource:0}: Error finding container ca3c2b12e8041da868ff791e54fc075900fd2fb4762df60902365cdddf789bc4: Status 404 returned error can't find the container with id ca3c2b12e8041da868ff791e54fc075900fd2fb4762df60902365cdddf789bc4 Jul 27 16:40:26.272358 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:26.272326 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-n94vk/progression-no-metrics-node-0-0-n9t9c" event={"ID":"33eb503c-1f68-4ccd-8998-419f2376f634","Type":"ContainerStarted","Data":"1dda0b09253753fb05e00b0c428f2d8b4a9900f4451c18b2fe15b8080a31a42b"} Jul 27 16:40:26.272869 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:26.272383 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-n94vk/progression-no-metrics-node-0-0-n9t9c" event={"ID":"33eb503c-1f68-4ccd-8998-419f2376f634","Type":"ContainerStarted","Data":"ca3c2b12e8041da868ff791e54fc075900fd2fb4762df60902365cdddf789bc4"} Jul 27 16:40:26.289276 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:26.289233 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-n94vk/progression-no-metrics-node-0-0-n9t9c" podStartSLOduration=1.28921843 podStartE2EDuration="1.28921843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:40:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:40:26.288588272 +0000 UTC m=+961.498438145" watchObservedRunningTime="2026-07-27 16:40:26.28921843 +0000 UTC m=+961.499068302" Jul 27 16:40:31.297891 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:31.297834 2578 generic.go:356] "Generic (PLEG): container finished" podID="33eb503c-1f68-4ccd-8998-419f2376f634" containerID="1dda0b09253753fb05e00b0c428f2d8b4a9900f4451c18b2fe15b8080a31a42b" exitCode=0 Jul 27 16:40:31.298293 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:31.297918 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-n94vk/progression-no-metrics-node-0-0-n9t9c" event={"ID":"33eb503c-1f68-4ccd-8998-419f2376f634","Type":"ContainerDied","Data":"1dda0b09253753fb05e00b0c428f2d8b4a9900f4451c18b2fe15b8080a31a42b"} Jul 27 16:40:32.433461 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:32.433430 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-n94vk/progression-no-metrics-node-0-0-n9t9c" Jul 27 16:40:32.597026 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:32.596919 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vq5lb\" (UniqueName: \"kubernetes.io/projected/33eb503c-1f68-4ccd-8998-419f2376f634-kube-api-access-vq5lb\") pod \"33eb503c-1f68-4ccd-8998-419f2376f634\" (UID: \"33eb503c-1f68-4ccd-8998-419f2376f634\") " Jul 27 16:40:32.598998 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:32.598969 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33eb503c-1f68-4ccd-8998-419f2376f634-kube-api-access-vq5lb" (OuterVolumeSpecName: "kube-api-access-vq5lb") pod "33eb503c-1f68-4ccd-8998-419f2376f634" (UID: "33eb503c-1f68-4ccd-8998-419f2376f634"). InnerVolumeSpecName "kube-api-access-vq5lb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:40:32.698485 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:32.698439 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vq5lb\" (UniqueName: \"kubernetes.io/projected/33eb503c-1f68-4ccd-8998-419f2376f634-kube-api-access-vq5lb\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:40:33.308528 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:33.308494 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-n94vk/progression-no-metrics-node-0-0-n9t9c" event={"ID":"33eb503c-1f68-4ccd-8998-419f2376f634","Type":"ContainerDied","Data":"ca3c2b12e8041da868ff791e54fc075900fd2fb4762df60902365cdddf789bc4"} Jul 27 16:40:33.308528 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:33.308530 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-n94vk/progression-no-metrics-node-0-0-n9t9c" Jul 27 16:40:33.308743 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:33.308543 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca3c2b12e8041da868ff791e54fc075900fd2fb4762df60902365cdddf789bc4" Jul 27 16:40:37.564108 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:37.564074 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bpsjc/must-gather-jnvrd"] Jul 27 16:40:37.564606 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:37.564586 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33eb503c-1f68-4ccd-8998-419f2376f634" containerName="node" Jul 27 16:40:37.564688 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:37.564610 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="33eb503c-1f68-4ccd-8998-419f2376f634" containerName="node" Jul 27 16:40:37.564744 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:37.564714 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="33eb503c-1f68-4ccd-8998-419f2376f634" containerName="node" Jul 27 16:40:37.566797 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:37.566772 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bpsjc/must-gather-jnvrd" Jul 27 16:40:37.568976 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:37.568957 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bpsjc\"/\"kube-root-ca.crt\"" Jul 27 16:40:37.569430 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:37.569405 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bpsjc\"/\"openshift-service-ca.crt\"" Jul 27 16:40:37.569430 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:37.569409 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bpsjc\"/\"default-dockercfg-89jjr\"" Jul 27 16:40:37.575174 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:37.575151 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bpsjc/must-gather-jnvrd"] Jul 27 16:40:37.744224 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:37.744185 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cbf4115b-19e1-4cfa-a206-9541d72bd512-must-gather-output\") pod \"must-gather-jnvrd\" (UID: \"cbf4115b-19e1-4cfa-a206-9541d72bd512\") " pod="openshift-must-gather-bpsjc/must-gather-jnvrd" Jul 27 16:40:37.744224 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:37.744233 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs9nw\" (UniqueName: \"kubernetes.io/projected/cbf4115b-19e1-4cfa-a206-9541d72bd512-kube-api-access-hs9nw\") pod \"must-gather-jnvrd\" (UID: \"cbf4115b-19e1-4cfa-a206-9541d72bd512\") " pod="openshift-must-gather-bpsjc/must-gather-jnvrd" Jul 27 16:40:37.845695 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:37.845608 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs9nw\" (UniqueName: \"kubernetes.io/projected/cbf4115b-19e1-4cfa-a206-9541d72bd512-kube-api-access-hs9nw\") pod \"must-gather-jnvrd\" (UID: \"cbf4115b-19e1-4cfa-a206-9541d72bd512\") " pod="openshift-must-gather-bpsjc/must-gather-jnvrd" Jul 27 16:40:37.845890 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:37.845711 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cbf4115b-19e1-4cfa-a206-9541d72bd512-must-gather-output\") pod \"must-gather-jnvrd\" (UID: \"cbf4115b-19e1-4cfa-a206-9541d72bd512\") " pod="openshift-must-gather-bpsjc/must-gather-jnvrd" Jul 27 16:40:37.846048 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:37.846032 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cbf4115b-19e1-4cfa-a206-9541d72bd512-must-gather-output\") pod \"must-gather-jnvrd\" (UID: \"cbf4115b-19e1-4cfa-a206-9541d72bd512\") " pod="openshift-must-gather-bpsjc/must-gather-jnvrd" Jul 27 16:40:37.853216 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:37.853191 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs9nw\" (UniqueName: \"kubernetes.io/projected/cbf4115b-19e1-4cfa-a206-9541d72bd512-kube-api-access-hs9nw\") pod \"must-gather-jnvrd\" (UID: \"cbf4115b-19e1-4cfa-a206-9541d72bd512\") " pod="openshift-must-gather-bpsjc/must-gather-jnvrd" Jul 27 16:40:37.877260 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:37.877225 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bpsjc/must-gather-jnvrd" Jul 27 16:40:38.010516 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:38.010490 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bpsjc/must-gather-jnvrd"] Jul 27 16:40:38.012861 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:40:38.012811 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbf4115b_19e1_4cfa_a206_9541d72bd512.slice/crio-edee870a4d787e5c664ac3e94e8d950a98b4af3a7aeb916c79a767185fb85a7a WatchSource:0}: Error finding container edee870a4d787e5c664ac3e94e8d950a98b4af3a7aeb916c79a767185fb85a7a: Status 404 returned error can't find the container with id edee870a4d787e5c664ac3e94e8d950a98b4af3a7aeb916c79a767185fb85a7a Jul 27 16:40:38.014735 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:38.014721 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 16:40:38.332392 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:38.332357 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bpsjc/must-gather-jnvrd" event={"ID":"cbf4115b-19e1-4cfa-a206-9541d72bd512","Type":"ContainerStarted","Data":"edee870a4d787e5c664ac3e94e8d950a98b4af3a7aeb916c79a767185fb85a7a"} Jul 27 16:40:41.984580 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:41.984541 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-n94vk/progression-disabled-node-0-0-796xs"] Jul 27 16:40:41.988602 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:41.988570 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-n94vk/progression-disabled-node-0-0-796xs"] Jul 27 16:40:41.993515 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:41.993489 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-n94vk/progression-enabled-node-0-0-zjzkp"] Jul 27 16:40:41.996374 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:41.996351 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-n94vk/progression-enabled-node-0-0-zjzkp"] Jul 27 16:40:42.001591 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:42.001562 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-n94vk/progression-invalid-node-0-0-qdpcn"] Jul 27 16:40:42.004581 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:42.004561 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-n94vk/progression-invalid-node-0-0-qdpcn"] Jul 27 16:40:42.017919 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:42.017894 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-n94vk/progression-no-metrics-node-0-0-n9t9c"] Jul 27 16:40:42.022831 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:42.022808 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-n94vk/progression-no-metrics-node-0-0-n9t9c"] Jul 27 16:40:43.377438 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:43.377409 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33eb503c-1f68-4ccd-8998-419f2376f634" path="/var/lib/kubelet/pods/33eb503c-1f68-4ccd-8998-419f2376f634/volumes" Jul 27 16:40:43.377814 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:43.377718 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69069aa8-5802-4551-94f6-4fda5813b90f" path="/var/lib/kubelet/pods/69069aa8-5802-4551-94f6-4fda5813b90f/volumes" Jul 27 16:40:43.378026 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:43.378013 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbceb5bd-470c-4131-b1fa-10f33ae4a469" path="/var/lib/kubelet/pods/cbceb5bd-470c-4131-b1fa-10f33ae4a469/volumes" Jul 27 16:40:43.378287 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:43.378276 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3d28554-d248-4dd0-b322-0001841c6cdd" path="/var/lib/kubelet/pods/f3d28554-d248-4dd0-b322-0001841c6cdd/volumes" Jul 27 16:40:45.377799 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:45.377756 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bpsjc/must-gather-jnvrd" event={"ID":"cbf4115b-19e1-4cfa-a206-9541d72bd512","Type":"ContainerStarted","Data":"a9c00f383c88c88798c2cf40873d61c56d24f365191bcce558faf46f37fed08b"} Jul 27 16:40:45.378212 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:45.377815 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bpsjc/must-gather-jnvrd" event={"ID":"cbf4115b-19e1-4cfa-a206-9541d72bd512","Type":"ContainerStarted","Data":"9aa03aae7fe6e59afbaede078d41002ce7a1503eab4ef50500bd8eeb0f5e06b0"} Jul 27 16:40:45.392379 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:45.392318 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bpsjc/must-gather-jnvrd" podStartSLOduration=2.033963078 podStartE2EDuration="8.392296738s" totalImagesPullingTime="6.35833366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:40:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:40:45.390557835 +0000 UTC m=+980.600407705" watchObservedRunningTime="2026-07-27 16:40:45.392296738 +0000 UTC m=+980.602146611" Jul 27 16:40:54.482184 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:54.482152 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-5db9fcb679-l6hfl_b80be86e-e812-426e-8b07-9c2f90fe5513/manager/0.log" Jul 27 16:40:54.977885 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:54.977838 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-5db9fcb679-l6hfl_b80be86e-e812-426e-8b07-9c2f90fe5513/manager/0.log" Jul 27 16:40:55.486118 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:40:55.486082 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-5db9fcb679-l6hfl_b80be86e-e812-426e-8b07-9c2f90fe5513/manager/0.log" Jul 27 16:41:33.634151 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:33.634116 2578 generic.go:356] "Generic (PLEG): container finished" podID="cbf4115b-19e1-4cfa-a206-9541d72bd512" containerID="9aa03aae7fe6e59afbaede078d41002ce7a1503eab4ef50500bd8eeb0f5e06b0" exitCode=0 Jul 27 16:41:33.634587 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:33.634192 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bpsjc/must-gather-jnvrd" event={"ID":"cbf4115b-19e1-4cfa-a206-9541d72bd512","Type":"ContainerDied","Data":"9aa03aae7fe6e59afbaede078d41002ce7a1503eab4ef50500bd8eeb0f5e06b0"} Jul 27 16:41:33.634587 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:33.634536 2578 scope.go:117] "RemoveContainer" containerID="9aa03aae7fe6e59afbaede078d41002ce7a1503eab4ef50500bd8eeb0f5e06b0" Jul 27 16:41:33.796998 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:33.796974 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-bpsjc_must-gather-jnvrd_cbf4115b-19e1-4cfa-a206-9541d72bd512/gather/0.log" Jul 27 16:41:36.833560 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:36.833533 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qgww4_d581df3a-c6fa-49b7-a6a5-11b5d9f30f9d/global-pull-secret-syncer/0.log" Jul 27 16:41:36.931374 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:36.931345 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r89j2_45eeca03-5f0c-4e88-8e51-060a5e5e1e65/konnectivity-agent/0.log" Jul 27 16:41:37.009458 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:37.009432 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-40.ec2.internal_5707262778505577d5d82f3e1320d33c/haproxy/0.log" Jul 27 16:41:39.133085 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:39.133046 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-bpsjc/must-gather-jnvrd"] Jul 27 16:41:39.133505 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:39.133226 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-bpsjc/must-gather-jnvrd" podUID="cbf4115b-19e1-4cfa-a206-9541d72bd512" containerName="copy" containerID="cri-o://a9c00f383c88c88798c2cf40873d61c56d24f365191bcce558faf46f37fed08b" gracePeriod=2 Jul 27 16:41:39.142138 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:39.142111 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-bpsjc/must-gather-jnvrd"] Jul 27 16:41:39.147284 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:41:39.147251 2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"cbf4115b-19e1-4cfa-a206-9541d72bd512\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-bpsjc\"/\"must-gather-jnvrd\": pods \"must-gather-jnvrd\" not found" pod="openshift-must-gather-bpsjc/must-gather-jnvrd" Jul 27 16:41:39.376532 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:39.376506 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-bpsjc_must-gather-jnvrd_cbf4115b-19e1-4cfa-a206-9541d72bd512/copy/0.log" Jul 27 16:41:39.378591 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:39.378568 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bpsjc/must-gather-jnvrd" Jul 27 16:41:39.380174 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:41:39.380146 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-jnvrd\" is forbidden: User \"system:node:ip-10-0-143-40.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-bpsjc\": no relationship found between node 'ip-10-0-143-40.ec2.internal' and this object" podUID="cbf4115b-19e1-4cfa-a206-9541d72bd512" pod="openshift-must-gather-bpsjc/must-gather-jnvrd" Jul 27 16:41:39.411663 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:39.411596 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hs9nw\" (UniqueName: \"kubernetes.io/projected/cbf4115b-19e1-4cfa-a206-9541d72bd512-kube-api-access-hs9nw\") pod \"cbf4115b-19e1-4cfa-a206-9541d72bd512\" (UID: \"cbf4115b-19e1-4cfa-a206-9541d72bd512\") " Jul 27 16:41:39.411663 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:39.411635 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cbf4115b-19e1-4cfa-a206-9541d72bd512-must-gather-output\") pod \"cbf4115b-19e1-4cfa-a206-9541d72bd512\" (UID: \"cbf4115b-19e1-4cfa-a206-9541d72bd512\") " Jul 27 16:41:39.413806 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:39.413782 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbf4115b-19e1-4cfa-a206-9541d72bd512-kube-api-access-hs9nw" (OuterVolumeSpecName: "kube-api-access-hs9nw") pod "cbf4115b-19e1-4cfa-a206-9541d72bd512" (UID: "cbf4115b-19e1-4cfa-a206-9541d72bd512"). InnerVolumeSpecName "kube-api-access-hs9nw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:41:39.413913 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:39.413865 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbf4115b-19e1-4cfa-a206-9541d72bd512-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "cbf4115b-19e1-4cfa-a206-9541d72bd512" (UID: "cbf4115b-19e1-4cfa-a206-9541d72bd512"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 16:41:39.512340 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:39.512305 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hs9nw\" (UniqueName: \"kubernetes.io/projected/cbf4115b-19e1-4cfa-a206-9541d72bd512-kube-api-access-hs9nw\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:41:39.512340 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:39.512333 2578 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cbf4115b-19e1-4cfa-a206-9541d72bd512-must-gather-output\") on node \"ip-10-0-143-40.ec2.internal\" DevicePath \"\"" Jul 27 16:41:39.664522 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:39.664453 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-bpsjc_must-gather-jnvrd_cbf4115b-19e1-4cfa-a206-9541d72bd512/copy/0.log" Jul 27 16:41:39.664812 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:39.664791 2578 generic.go:356] "Generic (PLEG): container finished" podID="cbf4115b-19e1-4cfa-a206-9541d72bd512" containerID="a9c00f383c88c88798c2cf40873d61c56d24f365191bcce558faf46f37fed08b" exitCode=143 Jul 27 16:41:39.664942 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:39.664838 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bpsjc/must-gather-jnvrd" Jul 27 16:41:39.664942 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:39.664885 2578 scope.go:117] "RemoveContainer" containerID="a9c00f383c88c88798c2cf40873d61c56d24f365191bcce558faf46f37fed08b" Jul 27 16:41:39.673312 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:39.673297 2578 scope.go:117] "RemoveContainer" containerID="9aa03aae7fe6e59afbaede078d41002ce7a1503eab4ef50500bd8eeb0f5e06b0" Jul 27 16:41:39.684804 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:39.684787 2578 scope.go:117] "RemoveContainer" containerID="a9c00f383c88c88798c2cf40873d61c56d24f365191bcce558faf46f37fed08b" Jul 27 16:41:39.685072 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:41:39.685051 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9c00f383c88c88798c2cf40873d61c56d24f365191bcce558faf46f37fed08b\": container with ID starting with a9c00f383c88c88798c2cf40873d61c56d24f365191bcce558faf46f37fed08b not found: ID does not exist" containerID="a9c00f383c88c88798c2cf40873d61c56d24f365191bcce558faf46f37fed08b" Jul 27 16:41:39.685121 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:39.685082 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9c00f383c88c88798c2cf40873d61c56d24f365191bcce558faf46f37fed08b"} err="failed to get container status \"a9c00f383c88c88798c2cf40873d61c56d24f365191bcce558faf46f37fed08b\": rpc error: code = NotFound desc = could not find container \"a9c00f383c88c88798c2cf40873d61c56d24f365191bcce558faf46f37fed08b\": container with ID starting with a9c00f383c88c88798c2cf40873d61c56d24f365191bcce558faf46f37fed08b not found: ID does not exist" Jul 27 16:41:39.685121 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:39.685099 2578 scope.go:117] "RemoveContainer" containerID="9aa03aae7fe6e59afbaede078d41002ce7a1503eab4ef50500bd8eeb0f5e06b0" Jul 27 16:41:39.685308 ip-10-0-143-40 kubenswrapper[2578]: E0727 16:41:39.685292 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9aa03aae7fe6e59afbaede078d41002ce7a1503eab4ef50500bd8eeb0f5e06b0\": container with ID starting with 9aa03aae7fe6e59afbaede078d41002ce7a1503eab4ef50500bd8eeb0f5e06b0 not found: ID does not exist" containerID="9aa03aae7fe6e59afbaede078d41002ce7a1503eab4ef50500bd8eeb0f5e06b0" Jul 27 16:41:39.685347 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:39.685312 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9aa03aae7fe6e59afbaede078d41002ce7a1503eab4ef50500bd8eeb0f5e06b0"} err="failed to get container status \"9aa03aae7fe6e59afbaede078d41002ce7a1503eab4ef50500bd8eeb0f5e06b0\": rpc error: code = NotFound desc = could not find container \"9aa03aae7fe6e59afbaede078d41002ce7a1503eab4ef50500bd8eeb0f5e06b0\": container with ID starting with 9aa03aae7fe6e59afbaede078d41002ce7a1503eab4ef50500bd8eeb0f5e06b0 not found: ID does not exist" Jul 27 16:41:41.186175 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:41.186106 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c71508f-c3bd-4848-ae0b-f7c64e151845/alertmanager/0.log" Jul 27 16:41:41.221859 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:41.221816 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c71508f-c3bd-4848-ae0b-f7c64e151845/config-reloader/0.log" Jul 27 16:41:41.248821 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:41.248799 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c71508f-c3bd-4848-ae0b-f7c64e151845/kube-rbac-proxy-web/0.log" Jul 27 16:41:41.279947 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:41.279921 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c71508f-c3bd-4848-ae0b-f7c64e151845/kube-rbac-proxy/0.log" Jul 27 16:41:41.310266 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:41.310244 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c71508f-c3bd-4848-ae0b-f7c64e151845/kube-rbac-proxy-metric/0.log" Jul 27 16:41:41.339423 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:41.339394 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c71508f-c3bd-4848-ae0b-f7c64e151845/prom-label-proxy/0.log" Jul 27 16:41:41.368307 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:41.368275 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c71508f-c3bd-4848-ae0b-f7c64e151845/init-config-reloader/0.log" Jul 27 16:41:41.379026 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:41.378996 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbf4115b-19e1-4cfa-a206-9541d72bd512" path="/var/lib/kubelet/pods/cbf4115b-19e1-4cfa-a206-9541d72bd512/volumes" Jul 27 16:41:41.698348 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:41.698324 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q2rzs_ceeb9e64-0822-4be7-bf8e-2477efec381a/node-exporter/0.log" Jul 27 16:41:41.729952 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:41.729925 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q2rzs_ceeb9e64-0822-4be7-bf8e-2477efec381a/kube-rbac-proxy/0.log" Jul 27 16:41:41.764762 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:41.764734 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q2rzs_ceeb9e64-0822-4be7-bf8e-2477efec381a/init-textfile/0.log" Jul 27 16:41:42.017271 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:42.017239 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92088feb-314e-46bb-a47a-3dd94bfcd7a0/prometheus/0.log" Jul 27 16:41:42.053851 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:42.053815 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92088feb-314e-46bb-a47a-3dd94bfcd7a0/config-reloader/0.log" Jul 27 16:41:42.093278 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:42.093257 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92088feb-314e-46bb-a47a-3dd94bfcd7a0/thanos-sidecar/0.log" Jul 27 16:41:42.121989 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:42.121971 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92088feb-314e-46bb-a47a-3dd94bfcd7a0/kube-rbac-proxy-web/0.log" Jul 27 16:41:42.153303 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:42.153282 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92088feb-314e-46bb-a47a-3dd94bfcd7a0/kube-rbac-proxy/0.log" Jul 27 16:41:42.182506 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:42.182484 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92088feb-314e-46bb-a47a-3dd94bfcd7a0/kube-rbac-proxy-thanos/0.log" Jul 27 16:41:42.215763 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:42.215739 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92088feb-314e-46bb-a47a-3dd94bfcd7a0/init-config-reloader/0.log" Jul 27 16:41:42.440791 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:42.440759 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d5894ff6-rsjxw_8753aa7d-e535-44ab-9aa4-6cf62478407a/thanos-query/0.log" Jul 27 16:41:42.468791 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:42.468769 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d5894ff6-rsjxw_8753aa7d-e535-44ab-9aa4-6cf62478407a/kube-rbac-proxy-web/0.log" Jul 27 16:41:42.504205 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:42.504180 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d5894ff6-rsjxw_8753aa7d-e535-44ab-9aa4-6cf62478407a/kube-rbac-proxy/0.log" Jul 27 16:41:42.532530 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:42.532503 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d5894ff6-rsjxw_8753aa7d-e535-44ab-9aa4-6cf62478407a/prom-label-proxy/0.log" Jul 27 16:41:42.560579 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:42.560554 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d5894ff6-rsjxw_8753aa7d-e535-44ab-9aa4-6cf62478407a/kube-rbac-proxy-rules/0.log" Jul 27 16:41:42.593031 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:42.593005 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d5894ff6-rsjxw_8753aa7d-e535-44ab-9aa4-6cf62478407a/kube-rbac-proxy-metrics/0.log" Jul 27 16:41:43.870409 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:43.870379 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wgg7p/perf-node-gather-daemonset-p7smz"] Jul 27 16:41:43.870887 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:43.870869 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbf4115b-19e1-4cfa-a206-9541d72bd512" containerName="gather" Jul 27 16:41:43.870968 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:43.870889 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbf4115b-19e1-4cfa-a206-9541d72bd512" containerName="gather" Jul 27 16:41:43.870968 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:43.870935 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbf4115b-19e1-4cfa-a206-9541d72bd512" containerName="copy" Jul 27 16:41:43.870968 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:43.870944 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbf4115b-19e1-4cfa-a206-9541d72bd512" containerName="copy" Jul 27 16:41:43.871116 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:43.871023 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbf4115b-19e1-4cfa-a206-9541d72bd512" containerName="gather" Jul 27 16:41:43.871116 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:43.871035 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbf4115b-19e1-4cfa-a206-9541d72bd512" containerName="copy" Jul 27 16:41:43.875432 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:43.875411 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-p7smz" Jul 27 16:41:43.877360 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:43.877339 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wgg7p\"/\"kube-root-ca.crt\"" Jul 27 16:41:43.877360 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:43.877352 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wgg7p\"/\"openshift-service-ca.crt\"" Jul 27 16:41:43.877925 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:43.877910 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wgg7p\"/\"default-dockercfg-hjb57\"" Jul 27 16:41:43.884277 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:43.884256 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wgg7p/perf-node-gather-daemonset-p7smz"] Jul 27 16:41:43.951965 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:43.951938 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9m7m\" (UniqueName: \"kubernetes.io/projected/8e820b15-4642-488f-88e1-9796e71275fc-kube-api-access-f9m7m\") pod \"perf-node-gather-daemonset-p7smz\" (UID: \"8e820b15-4642-488f-88e1-9796e71275fc\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-p7smz" Jul 27 16:41:43.952120 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:43.952016 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e820b15-4642-488f-88e1-9796e71275fc-podres\") pod \"perf-node-gather-daemonset-p7smz\" (UID: \"8e820b15-4642-488f-88e1-9796e71275fc\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-p7smz" Jul 27 16:41:43.952120 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:43.952048 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e820b15-4642-488f-88e1-9796e71275fc-lib-modules\") pod \"perf-node-gather-daemonset-p7smz\" (UID: \"8e820b15-4642-488f-88e1-9796e71275fc\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-p7smz" Jul 27 16:41:43.952120 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:43.952080 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e820b15-4642-488f-88e1-9796e71275fc-proc\") pod \"perf-node-gather-daemonset-p7smz\" (UID: \"8e820b15-4642-488f-88e1-9796e71275fc\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-p7smz" Jul 27 16:41:43.952245 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:43.952121 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e820b15-4642-488f-88e1-9796e71275fc-sys\") pod \"perf-node-gather-daemonset-p7smz\" (UID: \"8e820b15-4642-488f-88e1-9796e71275fc\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-p7smz" Jul 27 16:41:44.052859 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:44.052789 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e820b15-4642-488f-88e1-9796e71275fc-lib-modules\") pod \"perf-node-gather-daemonset-p7smz\" (UID: \"8e820b15-4642-488f-88e1-9796e71275fc\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-p7smz" Jul 27 16:41:44.053055 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:44.052896 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e820b15-4642-488f-88e1-9796e71275fc-proc\") pod \"perf-node-gather-daemonset-p7smz\" (UID: \"8e820b15-4642-488f-88e1-9796e71275fc\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-p7smz" Jul 27 16:41:44.053055 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:44.052921 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e820b15-4642-488f-88e1-9796e71275fc-sys\") pod \"perf-node-gather-daemonset-p7smz\" (UID: \"8e820b15-4642-488f-88e1-9796e71275fc\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-p7smz" Jul 27 16:41:44.053055 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:44.052952 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9m7m\" (UniqueName: \"kubernetes.io/projected/8e820b15-4642-488f-88e1-9796e71275fc-kube-api-access-f9m7m\") pod \"perf-node-gather-daemonset-p7smz\" (UID: \"8e820b15-4642-488f-88e1-9796e71275fc\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-p7smz" Jul 27 16:41:44.053055 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:44.052989 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e820b15-4642-488f-88e1-9796e71275fc-lib-modules\") pod \"perf-node-gather-daemonset-p7smz\" (UID: \"8e820b15-4642-488f-88e1-9796e71275fc\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-p7smz" Jul 27 16:41:44.053055 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:44.053014 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e820b15-4642-488f-88e1-9796e71275fc-proc\") pod \"perf-node-gather-daemonset-p7smz\" (UID: \"8e820b15-4642-488f-88e1-9796e71275fc\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-p7smz" Jul 27 16:41:44.053055 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:44.053028 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e820b15-4642-488f-88e1-9796e71275fc-sys\") pod \"perf-node-gather-daemonset-p7smz\" (UID: \"8e820b15-4642-488f-88e1-9796e71275fc\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-p7smz" Jul 27 16:41:44.053055 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:44.053035 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e820b15-4642-488f-88e1-9796e71275fc-podres\") pod \"perf-node-gather-daemonset-p7smz\" (UID: \"8e820b15-4642-488f-88e1-9796e71275fc\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-p7smz" Jul 27 16:41:44.053303 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:44.053101 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e820b15-4642-488f-88e1-9796e71275fc-podres\") pod \"perf-node-gather-daemonset-p7smz\" (UID: \"8e820b15-4642-488f-88e1-9796e71275fc\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-p7smz" Jul 27 16:41:44.058138 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:44.058113 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2cqxv_f7ba4530-6cc8-463f-9ac7-e9572867a152/console-operator/1.log" Jul 27 16:41:44.061221 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:44.061190 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9m7m\" (UniqueName: \"kubernetes.io/projected/8e820b15-4642-488f-88e1-9796e71275fc-kube-api-access-f9m7m\") pod \"perf-node-gather-daemonset-p7smz\" (UID: \"8e820b15-4642-488f-88e1-9796e71275fc\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-p7smz" Jul 27 16:41:44.063377 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:44.063357 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2cqxv_f7ba4530-6cc8-463f-9ac7-e9572867a152/console-operator/2.log" Jul 27 16:41:44.186016 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:44.185942 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-p7smz" Jul 27 16:41:44.311920 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:44.311857 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wgg7p/perf-node-gather-daemonset-p7smz"] Jul 27 16:41:44.314546 ip-10-0-143-40 kubenswrapper[2578]: W0727 16:41:44.314515 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8e820b15_4642_488f_88e1_9796e71275fc.slice/crio-ec90142efdcfafb14d28bc01397a2070155d2854306b307006503543f8f57191 WatchSource:0}: Error finding container ec90142efdcfafb14d28bc01397a2070155d2854306b307006503543f8f57191: Status 404 returned error can't find the container with id ec90142efdcfafb14d28bc01397a2070155d2854306b307006503543f8f57191 Jul 27 16:41:44.490488 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:44.490460 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-789b87658f-2gl9h_af54b53f-74bb-419c-add3-5b38ad8adf48/console/0.log" Jul 27 16:41:44.691249 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:44.691166 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-p7smz" event={"ID":"8e820b15-4642-488f-88e1-9796e71275fc","Type":"ContainerStarted","Data":"7f978377692c886a4abcbda9bcb4185f94ff6bacddb3da9b09bca1dfc2f7b9fd"} Jul 27 16:41:44.691249 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:44.691211 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-p7smz" event={"ID":"8e820b15-4642-488f-88e1-9796e71275fc","Type":"ContainerStarted","Data":"ec90142efdcfafb14d28bc01397a2070155d2854306b307006503543f8f57191"} Jul 27 16:41:44.691249 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:44.691241 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-p7smz" Jul 27 16:41:44.713969 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:44.710177 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-p7smz" podStartSLOduration=1.710155197 podStartE2EDuration="1.710155197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:41:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:41:44.707731894 +0000 UTC m=+1039.917581766" watchObservedRunningTime="2026-07-27 16:41:44.710155197 +0000 UTC m=+1039.920005070" Jul 27 16:41:45.849754 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:45.849719 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n424n_4c5b7b1c-57c2-4d71-b2f9-0d25b9988896/dns/0.log" Jul 27 16:41:45.884279 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:45.884254 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n424n_4c5b7b1c-57c2-4d71-b2f9-0d25b9988896/kube-rbac-proxy/0.log" Jul 27 16:41:45.969177 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:45.969146 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jvxww_2db67f70-a81c-43c3-bb3c-e42540477f31/dns-node-resolver/0.log" Jul 27 16:41:46.430336 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:46.430307 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-68b65b9694-9glf6_ac49ea94-cb43-44ca-a783-1ceee9a4698e/registry/0.log" Jul 27 16:41:46.455979 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:46.455955 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2v5jv_ee20c72e-c217-455a-9560-b5ab054cf0f3/node-ca/0.log" Jul 27 16:41:47.601172 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:47.601142 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5nzhx_e03109a1-5d54-4c1f-b015-7fd714bc4856/serve-healthcheck-canary/0.log" Jul 27 16:41:48.023339 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:48.023264 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-qc2ql_32b6b148-9234-4492-a6dc-b6723f680477/insights-operator/1.log" Jul 27 16:41:48.023485 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:48.023348 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-qc2ql_32b6b148-9234-4492-a6dc-b6723f680477/insights-operator/0.log" Jul 27 16:41:48.047696 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:48.047673 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2ff8c_b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9/kube-rbac-proxy/0.log" Jul 27 16:41:48.072976 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:48.072956 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2ff8c_b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9/exporter/0.log" Jul 27 16:41:48.098289 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:48.098264 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2ff8c_b44e0e18-fa08-47e4-92fd-7d1e7a3c76b9/extractor/0.log" Jul 27 16:41:50.706503 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:50.706478 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-p7smz" Jul 27 16:41:53.501629 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:53.501600 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-rtgzw_53afaeae-3d4c-4833-a29a-5f29a4244412/migrator/0.log" Jul 27 16:41:53.530798 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:53.530768 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-rtgzw_53afaeae-3d4c-4833-a29a-5f29a4244412/graceful-termination/0.log" Jul 27 16:41:54.802813 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:54.802787 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5qcd_c079aa05-1e43-4257-b459-54127b27d843/kube-multus-additional-cni-plugins/0.log" Jul 27 16:41:54.833856 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:54.833819 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5qcd_c079aa05-1e43-4257-b459-54127b27d843/egress-router-binary-copy/0.log" Jul 27 16:41:54.861035 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:54.861005 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5qcd_c079aa05-1e43-4257-b459-54127b27d843/cni-plugins/0.log" Jul 27 16:41:54.887394 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:54.887367 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5qcd_c079aa05-1e43-4257-b459-54127b27d843/bond-cni-plugin/0.log" Jul 27 16:41:54.913556 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:54.913534 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5qcd_c079aa05-1e43-4257-b459-54127b27d843/routeoverride-cni/0.log" Jul 27 16:41:54.939522 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:54.939501 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5qcd_c079aa05-1e43-4257-b459-54127b27d843/whereabouts-cni-bincopy/0.log" Jul 27 16:41:54.967464 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:54.967440 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5qcd_c079aa05-1e43-4257-b459-54127b27d843/whereabouts-cni/0.log" Jul 27 16:41:55.408199 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:55.408128 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sf2f9_561fc239-ede6-415f-ae7a-2745af950649/kube-multus/0.log" Jul 27 16:41:55.513140 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:55.513108 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ttj4w_7d73c7ed-f214-4fae-b194-9bae83a86b47/network-metrics-daemon/0.log" Jul 27 16:41:55.536903 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:55.536878 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ttj4w_7d73c7ed-f214-4fae-b194-9bae83a86b47/kube-rbac-proxy/0.log" Jul 27 16:41:56.976200 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:56.976173 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzzjg_f7c2ba5c-55aa-4741-87cc-cbb3cd80d949/ovn-controller/0.log" Jul 27 16:41:57.004130 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:57.004108 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzzjg_f7c2ba5c-55aa-4741-87cc-cbb3cd80d949/ovn-acl-logging/0.log" Jul 27 16:41:57.036071 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:57.036048 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzzjg_f7c2ba5c-55aa-4741-87cc-cbb3cd80d949/kube-rbac-proxy-node/0.log" Jul 27 16:41:57.071514 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:57.071487 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzzjg_f7c2ba5c-55aa-4741-87cc-cbb3cd80d949/kube-rbac-proxy-ovn-metrics/0.log" Jul 27 16:41:57.096808 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:57.096786 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzzjg_f7c2ba5c-55aa-4741-87cc-cbb3cd80d949/northd/0.log" Jul 27 16:41:57.121959 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:57.121937 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzzjg_f7c2ba5c-55aa-4741-87cc-cbb3cd80d949/nbdb/0.log" Jul 27 16:41:57.150938 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:57.150910 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzzjg_f7c2ba5c-55aa-4741-87cc-cbb3cd80d949/sbdb/0.log" Jul 27 16:41:57.195498 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:57.195471 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzzjg_f7c2ba5c-55aa-4741-87cc-cbb3cd80d949/ovnkube-controller/0.log" Jul 27 16:41:58.159265 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:58.159242 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7d88cb55d8-lrhjd_3d8558c5-3631-46a8-aa4d-c2b2ed981e3c/check-endpoints/0.log" Jul 27 16:41:58.212649 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:58.212624 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-8pf9l_81ef96f6-f835-4c1c-bad7-6a54c5da90c7/network-check-target-container/0.log" Jul 27 16:41:59.176936 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:59.176907 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-vqvbd_22ae248d-bc07-48a7-8e01-4c9fa5f1bc99/iptables-alerter/0.log" Jul 27 16:41:59.837468 ip-10-0-143-40 kubenswrapper[2578]: I0727 16:41:59.837443 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-cpjj4_c53359a8-84df-4989-88b1-ae04880c1c4e/tuned/0.log"