Jul 29 15:46:15.633173 ip-10-0-140-163 systemd[1]: Starting Kubernetes Kubelet... Jul 29 15:46:16.103849 ip-10-0-140-163 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 15:46:16.103849 ip-10-0-140-163 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 29 15:46:16.103849 ip-10-0-140-163 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 15:46:16.104468 ip-10-0-140-163 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 29 15:46:16.104468 ip-10-0-140-163 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 15:46:16.104933 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.104853 2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 29 15:46:16.110534 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110514 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:46:16.110534 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110530 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:46:16.110534 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110535 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:46:16.110534 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110539 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:46:16.110763 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110544 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:46:16.110763 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110548 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:46:16.110763 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110552 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:46:16.110763 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110557 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:46:16.110763 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110561 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:46:16.110763 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110565 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:46:16.110763 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110571 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:46:16.110763 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110578 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:46:16.110763 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110582 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:46:16.110763 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110587 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:46:16.110763 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110592 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:46:16.110763 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110605 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:46:16.110763 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110611 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:46:16.110763 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110615 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:46:16.110763 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110619 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:46:16.110763 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110624 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:46:16.110763 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110629 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:46:16.110763 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110633 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:46:16.110763 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110637 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:46:16.111558 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110641 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:46:16.111558 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110646 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:46:16.111558 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110651 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:46:16.111558 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110655 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:46:16.111558 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110660 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:46:16.111558 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110664 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:46:16.111558 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110669 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:46:16.111558 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110673 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:46:16.111558 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110677 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:46:16.111558 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110681 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:46:16.111558 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110685 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:46:16.111558 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110689 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:46:16.111558 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110694 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:46:16.111558 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110699 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:46:16.111558 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110705 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:46:16.111558 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110709 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:46:16.111558 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110713 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:46:16.111558 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110719 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:46:16.111558 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110723 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:46:16.111558 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110727 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:46:16.112495 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110732 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:46:16.112495 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110737 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:46:16.112495 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110742 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:46:16.112495 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110746 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:46:16.112495 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110750 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:46:16.112495 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110755 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:46:16.112495 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110759 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:46:16.112495 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110763 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:46:16.112495 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110767 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:46:16.112495 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110771 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:46:16.112495 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110775 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:46:16.112495 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110780 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:46:16.112495 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110785 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:46:16.112495 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110789 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:46:16.112495 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110793 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:46:16.112495 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110797 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:46:16.112495 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110804 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:46:16.112495 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110812 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:46:16.112495 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110817 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:46:16.112495 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110821 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:46:16.113331 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110826 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:46:16.113331 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110844 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:46:16.113331 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110850 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:46:16.113331 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110856 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:46:16.113331 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110860 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:46:16.113331 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110865 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:46:16.113331 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110869 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:46:16.113331 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110874 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:46:16.113331 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110879 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:46:16.113331 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110883 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:46:16.113331 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110889 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:46:16.113331 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110893 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:46:16.113331 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110898 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:46:16.113331 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110902 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:46:16.113331 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110907 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:46:16.113331 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110912 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:46:16.113331 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110916 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:46:16.113331 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110920 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:46:16.113331 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110924 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:46:16.113331 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110929 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:46:16.114159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110933 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:46:16.114159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110937 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:46:16.114159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110941 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:46:16.114159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110946 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:46:16.114159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110950 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:46:16.114159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110954 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:46:16.114159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110959 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:46:16.114159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110964 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:46:16.114159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110970 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:46:16.114159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110975 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:46:16.114159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110979 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:46:16.114159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110983 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:46:16.114159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110988 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:46:16.114159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110992 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:46:16.114159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.110999 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:46:16.114159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.111005 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:46:16.114159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112174 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:46:16.114159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112183 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:46:16.114159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112188 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:46:16.114159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112192 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:46:16.115056 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112197 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:46:16.115056 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112201 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:46:16.115056 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112206 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:46:16.115056 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112211 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:46:16.115056 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112215 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:46:16.115056 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112218 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:46:16.115056 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112222 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:46:16.115056 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112227 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:46:16.115056 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112230 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:46:16.115056 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112234 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:46:16.115056 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112238 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:46:16.115056 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112242 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:46:16.115056 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112246 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:46:16.115056 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112251 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:46:16.115056 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112256 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:46:16.115056 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112260 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:46:16.115056 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112264 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:46:16.115056 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112269 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:46:16.115056 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112273 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:46:16.115613 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112277 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:46:16.115613 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112281 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:46:16.115613 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112286 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:46:16.115613 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112290 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:46:16.115613 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112294 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:46:16.115613 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112298 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:46:16.115613 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112302 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:46:16.115613 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112306 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:46:16.115613 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112310 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:46:16.115613 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112315 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:46:16.115613 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112319 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:46:16.115613 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112323 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:46:16.115613 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112327 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:46:16.115613 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112331 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:46:16.115613 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112336 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:46:16.115613 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112341 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:46:16.115613 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112346 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:46:16.115613 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112351 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:46:16.115613 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112355 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:46:16.115613 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112360 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:46:16.116111 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112364 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:46:16.116111 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112368 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:46:16.116111 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112372 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:46:16.116111 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112376 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:46:16.116111 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112380 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:46:16.116111 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112384 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:46:16.116111 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112388 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:46:16.116111 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112393 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:46:16.116111 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112397 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:46:16.116111 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112401 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:46:16.116111 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112406 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:46:16.116111 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112410 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:46:16.116111 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112414 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:46:16.116111 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112419 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:46:16.116111 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112426 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:46:16.116111 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112431 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:46:16.116111 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112435 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:46:16.116111 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112439 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:46:16.116111 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112443 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:46:16.116665 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112447 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:46:16.116665 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112451 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:46:16.116665 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112455 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:46:16.116665 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112460 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:46:16.116665 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112464 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:46:16.116665 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112469 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:46:16.116665 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112473 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:46:16.116665 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112477 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:46:16.116665 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112482 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:46:16.116665 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112486 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:46:16.116665 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112491 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:46:16.116665 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112499 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:46:16.116665 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112503 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:46:16.116665 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112507 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:46:16.116665 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112511 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:46:16.116665 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112515 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:46:16.116665 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112520 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:46:16.116665 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112524 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:46:16.116665 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112530 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:46:16.117299 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112536 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:46:16.117299 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112541 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:46:16.117299 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112546 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:46:16.117299 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112550 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:46:16.117299 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112555 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:46:16.117299 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112559 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:46:16.117299 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112563 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:46:16.117299 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112567 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:46:16.117299 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112574 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:46:16.117299 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112578 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:46:16.117299 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112582 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:46:16.117299 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112586 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:46:16.117299 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112590 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:46:16.117299 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112594 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:46:16.117299 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112598 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:46:16.117299 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112602 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:46:16.117299 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112606 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:46:16.117299 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.112610 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:46:16.117299 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113186 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:46:16.117299 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113195 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:46:16.117845 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113199 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:46:16.117845 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113203 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:46:16.117845 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113208 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:46:16.117845 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113211 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:46:16.117845 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113216 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:46:16.117845 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113220 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:46:16.117845 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113224 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:46:16.117845 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113229 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:46:16.117845 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113233 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:46:16.117845 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113238 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:46:16.117845 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113243 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:46:16.117845 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113248 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:46:16.117845 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113252 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:46:16.117845 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113257 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:46:16.117845 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113262 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:46:16.117845 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113266 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:46:16.117845 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113270 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:46:16.117845 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113274 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:46:16.117845 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113279 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:46:16.117845 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113283 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:46:16.118411 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113291 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:46:16.118411 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113295 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:46:16.118411 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113299 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:46:16.118411 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113303 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:46:16.118411 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113307 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:46:16.118411 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113311 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:46:16.118411 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113315 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:46:16.118411 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113319 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:46:16.118411 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113323 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:46:16.118411 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113329 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:46:16.118411 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113334 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:46:16.118411 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113338 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:46:16.118411 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113342 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:46:16.118411 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113346 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:46:16.118411 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113350 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:46:16.118411 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113354 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:46:16.118411 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113358 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:46:16.118411 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113367 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:46:16.118411 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113372 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:46:16.118955 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113376 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:46:16.118955 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113381 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:46:16.118955 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113385 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:46:16.118955 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113389 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:46:16.118955 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113393 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:46:16.118955 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113396 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:46:16.118955 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113400 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:46:16.118955 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113404 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:46:16.118955 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113408 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:46:16.118955 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113413 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:46:16.118955 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113417 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:46:16.118955 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113421 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:46:16.118955 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113425 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:46:16.118955 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113431 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:46:16.118955 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113435 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:46:16.118955 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113439 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:46:16.118955 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113443 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:46:16.118955 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113450 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:46:16.118955 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113455 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:46:16.119432 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113460 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:46:16.119432 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113464 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:46:16.119432 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113468 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:46:16.119432 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113473 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:46:16.119432 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113477 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:46:16.119432 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113483 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:46:16.119432 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113487 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:46:16.119432 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113491 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:46:16.119432 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113496 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:46:16.119432 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113500 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:46:16.119432 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113504 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:46:16.119432 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113510 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:46:16.119432 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113516 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:46:16.119432 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113520 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:46:16.119432 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113524 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:46:16.119432 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113528 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:46:16.119432 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113532 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:46:16.119432 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113537 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:46:16.119432 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113541 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:46:16.119949 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113545 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:46:16.119949 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113549 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:46:16.119949 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113553 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:46:16.119949 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113557 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:46:16.119949 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113561 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:46:16.119949 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113566 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:46:16.119949 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113570 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:46:16.119949 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113576 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:46:16.119949 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113580 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:46:16.119949 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113584 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:46:16.119949 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113588 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:46:16.119949 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113592 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:46:16.119949 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113596 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:46:16.119949 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113600 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:46:16.119949 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113604 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:46:16.119949 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113608 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:46:16.119949 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113613 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:46:16.119949 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113616 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:46:16.119949 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113620 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:46:16.119949 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.113624 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:46:16.120410 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113722 2554 flags.go:64] FLAG: --address="0.0.0.0" Jul 29 15:46:16.120410 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113732 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 29 15:46:16.120410 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113744 2554 flags.go:64] FLAG: --anonymous-auth="true" Jul 29 15:46:16.120410 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113750 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 29 15:46:16.120410 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113759 2554 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 29 15:46:16.120410 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113765 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 29 15:46:16.120410 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113771 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 29 15:46:16.120410 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113778 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 29 15:46:16.120410 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113783 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 29 15:46:16.120410 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113787 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 29 15:46:16.120410 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113792 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 29 15:46:16.120410 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113798 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 29 15:46:16.120410 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113803 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 29 15:46:16.120410 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113807 2554 flags.go:64] FLAG: --cgroup-root="" Jul 29 15:46:16.120410 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113812 2554 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 29 15:46:16.120410 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113817 2554 flags.go:64] FLAG: --client-ca-file="" Jul 29 15:46:16.120410 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113821 2554 flags.go:64] FLAG: --cloud-provider="external" Jul 29 15:46:16.120410 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113826 2554 flags.go:64] FLAG: --cluster-dns="[]" Jul 29 15:46:16.120410 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113848 2554 flags.go:64] FLAG: --cluster-domain="" Jul 29 15:46:16.120410 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113855 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 29 15:46:16.120410 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113860 2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 29 15:46:16.120410 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113865 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 29 15:46:16.120410 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113870 2554 flags.go:64] FLAG: --container-log-max-files="5" Jul 29 15:46:16.120410 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113876 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 29 15:46:16.121005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113881 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 29 15:46:16.121005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113886 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 29 15:46:16.121005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113891 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 29 15:46:16.121005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113896 2554 flags.go:64] FLAG: --contention-profiling="false" Jul 29 15:46:16.121005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113901 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 29 15:46:16.121005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113905 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 29 15:46:16.121005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113910 2554 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 29 15:46:16.121005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113915 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 29 15:46:16.121005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113921 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 29 15:46:16.121005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113926 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 29 15:46:16.121005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113930 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 29 15:46:16.121005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113935 2554 flags.go:64] FLAG: --enable-load-reader="false" Jul 29 15:46:16.121005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113941 2554 flags.go:64] FLAG: --enable-server="true" Jul 29 15:46:16.121005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113946 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 29 15:46:16.121005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113953 2554 flags.go:64] FLAG: --event-burst="100" Jul 29 15:46:16.121005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113959 2554 flags.go:64] FLAG: --event-qps="50" Jul 29 15:46:16.121005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113963 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 29 15:46:16.121005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113968 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 29 15:46:16.121005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113973 2554 flags.go:64] FLAG: --eviction-hard="" Jul 29 15:46:16.121005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113979 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 29 15:46:16.121005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113984 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 29 15:46:16.121005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113989 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 29 15:46:16.121005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113994 2554 flags.go:64] FLAG: --eviction-soft="" Jul 29 15:46:16.121005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.113998 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 29 15:46:16.121005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114003 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 29 15:46:16.121603 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114008 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 29 15:46:16.121603 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114012 2554 flags.go:64] FLAG: --experimental-mounter-path="" Jul 29 15:46:16.121603 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114019 2554 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 29 15:46:16.121603 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114023 2554 flags.go:64] FLAG: --fail-swap-on="true" Jul 29 15:46:16.121603 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114028 2554 flags.go:64] FLAG: --feature-gates="" Jul 29 15:46:16.121603 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114034 2554 flags.go:64] FLAG: --file-check-frequency="20s" Jul 29 15:46:16.121603 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114038 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 29 15:46:16.121603 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114043 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 29 15:46:16.121603 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114048 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 29 15:46:16.121603 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114052 2554 flags.go:64] FLAG: --healthz-port="10248" Jul 29 15:46:16.121603 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114058 2554 flags.go:64] FLAG: --help="false" Jul 29 15:46:16.121603 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114062 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-140-163.ec2.internal" Jul 29 15:46:16.121603 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114067 2554 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 29 15:46:16.121603 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114072 2554 flags.go:64] FLAG: --http-check-frequency="20s" Jul 29 15:46:16.121603 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114076 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 29 15:46:16.121603 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114081 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 29 15:46:16.121603 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114087 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 29 15:46:16.121603 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114091 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 29 15:46:16.121603 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114096 2554 flags.go:64] FLAG: --image-service-endpoint="" Jul 29 15:46:16.121603 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114102 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 29 15:46:16.121603 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114107 2554 flags.go:64] FLAG: --kube-api-burst="100" Jul 29 15:46:16.121603 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114112 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 29 15:46:16.121603 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114117 2554 flags.go:64] FLAG: --kube-api-qps="50" Jul 29 15:46:16.121603 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114122 2554 flags.go:64] FLAG: --kube-reserved="" Jul 29 15:46:16.122262 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114126 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 29 15:46:16.122262 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114131 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 29 15:46:16.122262 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114136 2554 flags.go:64] FLAG: --kubelet-cgroups="" Jul 29 15:46:16.122262 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114141 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 29 15:46:16.122262 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114145 2554 flags.go:64] FLAG: --lock-file="" Jul 29 15:46:16.122262 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114150 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 29 15:46:16.122262 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114155 2554 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 29 15:46:16.122262 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114159 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 29 15:46:16.122262 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114167 2554 flags.go:64] FLAG: --log-json-split-stream="false" Jul 29 15:46:16.122262 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114171 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 29 15:46:16.122262 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114177 2554 flags.go:64] FLAG: --log-text-split-stream="false" Jul 29 15:46:16.122262 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114181 2554 flags.go:64] FLAG: --logging-format="text" Jul 29 15:46:16.122262 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114185 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 29 15:46:16.122262 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114191 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 29 15:46:16.122262 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114196 2554 flags.go:64] FLAG: --manifest-url="" Jul 29 15:46:16.122262 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114200 2554 flags.go:64] FLAG: --manifest-url-header="" Jul 29 15:46:16.122262 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114207 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 29 15:46:16.122262 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114212 2554 flags.go:64] FLAG: --max-open-files="1000000" Jul 29 15:46:16.122262 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114217 2554 flags.go:64] FLAG: --max-pods="110" Jul 29 15:46:16.122262 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114222 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 29 15:46:16.122262 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114226 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 29 15:46:16.122262 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114231 2554 flags.go:64] FLAG: --memory-manager-policy="None" Jul 29 15:46:16.122262 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114236 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 29 15:46:16.122262 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114240 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 29 15:46:16.122262 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114245 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 29 15:46:16.122917 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114250 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 29 15:46:16.122917 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114260 2554 flags.go:64] FLAG: --node-status-max-images="50" Jul 29 15:46:16.122917 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114267 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 29 15:46:16.122917 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114272 2554 flags.go:64] FLAG: --oom-score-adj="-999" Jul 29 15:46:16.122917 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114276 2554 flags.go:64] FLAG: --pod-cidr="" Jul 29 15:46:16.122917 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114281 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 29 15:46:16.122917 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114297 2554 flags.go:64] FLAG: --pod-manifest-path="" Jul 29 15:46:16.122917 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114303 2554 flags.go:64] FLAG: --pod-max-pids="-1" Jul 29 15:46:16.122917 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114307 2554 flags.go:64] FLAG: --pods-per-core="0" Jul 29 15:46:16.122917 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114312 2554 flags.go:64] FLAG: --port="10250" Jul 29 15:46:16.122917 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114317 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 29 15:46:16.122917 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114339 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b1a80f811d8c48a5" Jul 29 15:46:16.122917 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114345 2554 flags.go:64] FLAG: --qos-reserved="" Jul 29 15:46:16.122917 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114351 2554 flags.go:64] FLAG: --read-only-port="10255" Jul 29 15:46:16.122917 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114356 2554 flags.go:64] FLAG: --register-node="true" Jul 29 15:46:16.122917 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114361 2554 flags.go:64] FLAG: --register-with-taints="" Jul 29 15:46:16.122917 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114367 2554 flags.go:64] FLAG: --registry-burst="10" Jul 29 15:46:16.122917 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114372 2554 flags.go:64] FLAG: --registry-qps="5" Jul 29 15:46:16.122917 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114377 2554 flags.go:64] FLAG: --reserved-cpus="" Jul 29 15:46:16.122917 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114381 2554 flags.go:64] FLAG: --reserved-memory="" Jul 29 15:46:16.122917 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114387 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 29 15:46:16.122917 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114392 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 29 15:46:16.122917 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114397 2554 flags.go:64] FLAG: --rotate-certificates="false" Jul 29 15:46:16.122917 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114402 2554 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 29 15:46:16.122917 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114407 2554 flags.go:64] FLAG: --runonce="false" Jul 29 15:46:16.123824 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114411 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 29 15:46:16.123824 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114416 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 29 15:46:16.123824 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114421 2554 flags.go:64] FLAG: --seccomp-default="false" Jul 29 15:46:16.123824 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114426 2554 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 29 15:46:16.123824 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114431 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 29 15:46:16.123824 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114436 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 29 15:46:16.123824 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114441 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 29 15:46:16.123824 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114445 2554 flags.go:64] FLAG: --storage-driver-password="root" Jul 29 15:46:16.123824 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114450 2554 flags.go:64] FLAG: --storage-driver-secure="false" Jul 29 15:46:16.123824 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114456 2554 flags.go:64] FLAG: --storage-driver-table="stats" Jul 29 15:46:16.123824 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114461 2554 flags.go:64] FLAG: --storage-driver-user="root" Jul 29 15:46:16.123824 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114466 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 29 15:46:16.123824 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114471 2554 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 29 15:46:16.123824 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114476 2554 flags.go:64] FLAG: --system-cgroups="" Jul 29 15:46:16.123824 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114481 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 29 15:46:16.123824 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114490 2554 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 29 15:46:16.123824 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114495 2554 flags.go:64] FLAG: --tls-cert-file="" Jul 29 15:46:16.123824 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114500 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 29 15:46:16.123824 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114506 2554 flags.go:64] FLAG: --tls-min-version="" Jul 29 15:46:16.123824 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114510 2554 flags.go:64] FLAG: --tls-private-key-file="" Jul 29 15:46:16.123824 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114515 2554 flags.go:64] FLAG: --topology-manager-policy="none" Jul 29 15:46:16.123824 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114519 2554 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 29 15:46:16.123824 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114524 2554 flags.go:64] FLAG: --topology-manager-scope="container" Jul 29 15:46:16.123824 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114529 2554 flags.go:64] FLAG: --v="2" Jul 29 15:46:16.123824 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114535 2554 flags.go:64] FLAG: --version="false" Jul 29 15:46:16.124588 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114541 2554 flags.go:64] FLAG: --vmodule="" Jul 29 15:46:16.124588 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114547 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 29 15:46:16.124588 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.114552 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 29 15:46:16.124588 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114726 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:46:16.124588 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114733 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:46:16.124588 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114737 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:46:16.124588 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114742 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:46:16.124588 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114746 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:46:16.124588 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114750 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:46:16.124588 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114755 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:46:16.124588 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114760 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:46:16.124588 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114764 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:46:16.124588 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114768 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:46:16.124588 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114772 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:46:16.124588 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114776 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:46:16.124588 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114781 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:46:16.124588 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114789 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:46:16.124588 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114796 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:46:16.124588 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114800 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:46:16.124588 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114805 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:46:16.124588 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114810 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:46:16.125109 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114814 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:46:16.125109 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114818 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:46:16.125109 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114823 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:46:16.125109 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114828 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:46:16.125109 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114847 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:46:16.125109 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114852 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:46:16.125109 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114856 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:46:16.125109 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114863 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:46:16.125109 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114868 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:46:16.125109 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114873 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:46:16.125109 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114878 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:46:16.125109 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114882 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:46:16.125109 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114886 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:46:16.125109 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114890 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:46:16.125109 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114894 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:46:16.125109 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114899 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:46:16.125109 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114903 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:46:16.125109 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114907 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:46:16.125109 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114912 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:46:16.125571 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114916 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:46:16.125571 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114920 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:46:16.125571 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114925 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:46:16.125571 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114929 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:46:16.125571 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114933 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:46:16.125571 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114937 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:46:16.125571 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114941 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:46:16.125571 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114945 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:46:16.125571 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114951 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:46:16.125571 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114955 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:46:16.125571 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114960 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:46:16.125571 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114964 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:46:16.125571 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114968 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:46:16.125571 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114972 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:46:16.125571 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114976 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:46:16.125571 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114981 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:46:16.125571 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114988 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:46:16.125571 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114994 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:46:16.125571 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.114998 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:46:16.126031 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115004 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:46:16.126031 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115008 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:46:16.126031 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115013 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:46:16.126031 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115017 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:46:16.126031 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115021 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:46:16.126031 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115026 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:46:16.126031 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115030 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:46:16.126031 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115035 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:46:16.126031 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115039 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:46:16.126031 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115043 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:46:16.126031 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115047 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:46:16.126031 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115051 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:46:16.126031 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115055 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:46:16.126031 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115059 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:46:16.126031 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115062 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:46:16.126031 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115067 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:46:16.126031 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115071 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:46:16.126031 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115074 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:46:16.126031 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115079 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:46:16.126031 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115083 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:46:16.126527 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115087 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:46:16.126527 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115094 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:46:16.126527 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115098 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:46:16.126527 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115102 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:46:16.126527 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115106 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:46:16.126527 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115127 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:46:16.126527 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115133 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:46:16.126527 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115139 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:46:16.126527 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115144 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:46:16.126527 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115148 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:46:16.126527 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115154 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:46:16.126527 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115158 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:46:16.126527 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115162 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:46:16.126527 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115166 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:46:16.126527 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115171 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:46:16.126527 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115176 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:46:16.126527 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115180 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:46:16.126527 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115186 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:46:16.126527 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115191 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:46:16.126527 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115195 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:46:16.127025 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115199 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:46:16.127025 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115203 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:46:16.127025 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.115208 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:46:16.127025 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.116325 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 15:46:16.127025 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.124588 2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 29 15:46:16.127025 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.124603 2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 29 15:46:16.127025 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.125140 2554 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 29 15:46:16.127025 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.125148 2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 29 15:46:16.127025 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125207 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:46:16.127025 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125212 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:46:16.127025 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125215 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:46:16.127025 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125219 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:46:16.127025 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125222 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:46:16.127025 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125225 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:46:16.127025 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125228 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:46:16.127389 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125231 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:46:16.127389 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125234 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:46:16.127389 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125236 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:46:16.127389 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125239 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:46:16.127389 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125242 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:46:16.127389 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125245 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:46:16.127389 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125247 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:46:16.127389 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125250 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:46:16.127389 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125252 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:46:16.127389 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125255 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:46:16.127389 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125257 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:46:16.127389 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125260 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:46:16.127389 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125263 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:46:16.127389 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125266 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:46:16.127389 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125270 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:46:16.127389 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125273 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:46:16.127389 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125275 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:46:16.127389 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125278 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:46:16.127389 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125280 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:46:16.127389 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125283 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:46:16.127875 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125286 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:46:16.127875 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125289 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:46:16.127875 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125292 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:46:16.127875 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125295 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:46:16.127875 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125298 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:46:16.127875 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125300 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:46:16.127875 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125303 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:46:16.127875 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125305 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:46:16.127875 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125308 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:46:16.127875 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125311 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:46:16.127875 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125313 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:46:16.127875 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125316 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:46:16.127875 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125318 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:46:16.127875 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125321 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:46:16.127875 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125323 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:46:16.127875 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125326 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:46:16.127875 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125329 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:46:16.127875 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125331 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:46:16.127875 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125334 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:46:16.127875 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125336 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:46:16.128340 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125339 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:46:16.128340 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125342 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:46:16.128340 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125345 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:46:16.128340 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125347 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:46:16.128340 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125350 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:46:16.128340 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125352 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:46:16.128340 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125355 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:46:16.128340 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125357 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:46:16.128340 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125360 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:46:16.128340 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125363 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:46:16.128340 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125365 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:46:16.128340 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125368 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:46:16.128340 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125371 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:46:16.128340 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125373 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:46:16.128340 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125377 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:46:16.128340 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125379 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:46:16.128340 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125382 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:46:16.128340 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125385 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:46:16.128340 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125388 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:46:16.128340 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125390 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:46:16.128823 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125393 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:46:16.128823 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125396 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:46:16.128823 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125399 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:46:16.128823 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125401 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:46:16.128823 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125403 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:46:16.128823 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125406 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:46:16.128823 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125408 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:46:16.128823 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125413 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:46:16.128823 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125416 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:46:16.128823 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125420 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:46:16.128823 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125423 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:46:16.128823 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125426 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:46:16.128823 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125430 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:46:16.128823 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125433 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:46:16.128823 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125435 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:46:16.128823 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125438 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:46:16.128823 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125440 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:46:16.128823 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125443 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:46:16.128823 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125446 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:46:16.129335 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125448 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:46:16.129335 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125451 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:46:16.129335 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125453 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:46:16.129335 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125456 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:46:16.129335 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125458 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:46:16.129335 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125461 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:46:16.129335 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125464 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:46:16.129335 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125467 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:46:16.129335 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125469 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:46:16.129335 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125472 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:46:16.129335 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125474 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:46:16.129335 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125477 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:46:16.129335 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125480 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:46:16.129335 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.125485 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 15:46:16.129335 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125589 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:46:16.129696 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125594 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:46:16.129696 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125597 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:46:16.129696 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125600 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:46:16.129696 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125603 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:46:16.129696 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125605 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:46:16.129696 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125608 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:46:16.129696 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125611 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:46:16.129696 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125614 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:46:16.129696 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125616 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:46:16.129696 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125618 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:46:16.129696 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125621 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:46:16.129696 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125624 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:46:16.129696 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125629 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:46:16.129696 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125633 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:46:16.129696 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125637 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:46:16.129696 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125640 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:46:16.129696 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125643 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:46:16.129696 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125646 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:46:16.129696 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125648 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:46:16.130159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125651 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:46:16.130159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125653 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:46:16.130159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125656 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:46:16.130159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125658 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:46:16.130159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125661 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:46:16.130159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125664 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:46:16.130159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125667 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:46:16.130159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125669 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:46:16.130159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125672 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:46:16.130159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125674 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:46:16.130159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125677 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:46:16.130159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125679 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:46:16.130159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125682 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:46:16.130159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125684 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:46:16.130159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125687 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:46:16.130159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125689 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:46:16.130159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125692 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:46:16.130159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125694 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:46:16.130159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125697 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:46:16.130159 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125699 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:46:16.130658 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125701 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:46:16.130658 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125704 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:46:16.130658 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125706 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:46:16.130658 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125709 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:46:16.130658 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125711 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:46:16.130658 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125714 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:46:16.130658 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125717 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:46:16.130658 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125720 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:46:16.130658 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125722 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:46:16.130658 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125724 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:46:16.130658 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125727 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:46:16.130658 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125729 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:46:16.130658 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125732 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:46:16.130658 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125734 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:46:16.130658 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125737 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:46:16.130658 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125739 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:46:16.130658 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125742 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:46:16.130658 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125745 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:46:16.130658 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125749 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:46:16.131134 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125752 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:46:16.131134 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125755 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:46:16.131134 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125757 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:46:16.131134 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125760 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:46:16.131134 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125763 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:46:16.131134 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125765 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:46:16.131134 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125768 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:46:16.131134 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125770 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:46:16.131134 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125773 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:46:16.131134 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125775 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:46:16.131134 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125778 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:46:16.131134 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125780 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:46:16.131134 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125782 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:46:16.131134 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125785 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:46:16.131134 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125788 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:46:16.131134 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125791 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:46:16.131134 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125793 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:46:16.131134 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125795 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:46:16.131134 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125798 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:46:16.131134 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125801 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:46:16.131645 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125804 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:46:16.131645 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125806 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:46:16.131645 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125809 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:46:16.131645 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125811 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:46:16.131645 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125814 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:46:16.131645 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125817 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:46:16.131645 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125819 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:46:16.131645 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125821 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:46:16.131645 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125824 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:46:16.131645 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125826 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:46:16.131645 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125829 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:46:16.131645 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125842 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:46:16.131645 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125844 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:46:16.131645 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125847 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:46:16.131645 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125849 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:46:16.131645 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125852 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:46:16.131645 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125855 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:46:16.131645 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125857 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:46:16.131645 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125859 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:46:16.131645 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:16.125862 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:46:16.132115 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.125867 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 15:46:16.132115 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.125967 2554 server.go:962] "Client rotation is on, will bootstrap in background" Jul 29 15:46:16.132115 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.130157 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 29 15:46:16.133901 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.133889 2554 server.go:1019] "Starting client certificate rotation" Jul 29 15:46:16.134014 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.133997 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 15:46:16.134042 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.134038 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 15:46:16.138956 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.138943 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 15:46:16.140211 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.140190 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 15:46:16.156745 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.156727 2554 log.go:25] "Validated CRI v1 runtime API" Jul 29 15:46:16.158816 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.158802 2554 log.go:25] "Validated CRI v1 image API" Jul 29 15:46:16.159652 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.159639 2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 29 15:46:16.166031 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.166011 2554 fs.go:135] Filesystem UUIDs: map[35e8df45-0cd8-42ab-95cd-54c253568a59:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 92cca043-009a-40f9-94f0-4704e280f48e:/dev/nvme0n1p3] Jul 29 15:46:16.166103 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.166030 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 29 15:46:16.170121 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.170019 2554 manager.go:216] Machine: {Timestamp:2026-07-29 15:46:16.169562674 +0000 UTC m=+0.410303195 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3198431 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec253d3c83fafc9f5706ef89f76418a6 SystemUUID:ec253d3c-83fa-fc9f-5706-ef89f76418a6 BootID:ee43bd7c-38fd-462c-b808-f6322dfb2c49 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:72:84:88:c2:d1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:72:84:88:c2:d1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:ef:1b:28:65:fc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 29 15:46:16.170121 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.170112 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 29 15:46:16.170250 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.170197 2554 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 29 15:46:16.173757 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.173740 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 15:46:16.174022 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.173994 2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 29 15:46:16.174167 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.174026 2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-163.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 29 15:46:16.174729 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.174719 2554 topology_manager.go:138] "Creating topology manager with none policy" Jul 29 15:46:16.174763 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.174732 2554 container_manager_linux.go:309] "Creating device plugin manager" Jul 29 15:46:16.174763 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.174740 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 15:46:16.175477 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.175467 2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 15:46:16.176349 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.176338 2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 29 15:46:16.178791 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.178779 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 29 15:46:16.178924 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.178913 2554 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 29 15:46:16.178964 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.178956 2554 kubelet.go:486] "Attempting to sync node with API server" Jul 29 15:46:16.179005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.178977 2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 29 15:46:16.179005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.178989 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 29 15:46:16.179005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.178998 2554 kubelet.go:398] "Adding apiserver pod source" Jul 29 15:46:16.179132 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.179016 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 29 15:46:16.179495 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.179480 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 15:46:16.179570 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.179513 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 15:46:16.182545 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.182522 2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 29 15:46:16.184427 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.184414 2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 29 15:46:16.184481 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.184443 2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 29 15:46:16.186444 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.186431 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 29 15:46:16.186479 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.186452 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 29 15:46:16.186479 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.186462 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 29 15:46:16.186479 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.186471 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 29 15:46:16.186563 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.186484 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 29 15:46:16.186563 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.186493 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 29 15:46:16.186563 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.186503 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 29 15:46:16.186563 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.186511 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 29 15:46:16.186563 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.186521 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 29 15:46:16.186563 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.186529 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 29 15:46:16.186563 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.186548 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 29 15:46:16.186563 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.186554 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 29 15:46:16.187507 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.187496 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 29 15:46:16.187544 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.187508 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 29 15:46:16.190682 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.190668 2554 server.go:1268] "Started kubelet" Jul 29 15:46:16.190756 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.190678 2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-163.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 29 15:46:16.190756 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:16.190708 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-163.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 29 15:46:16.190756 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:16.190709 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 29 15:46:16.190907 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.190760 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 29 15:46:16.190907 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.190748 2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 29 15:46:16.190907 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.190811 2554 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 29 15:46:16.191455 ip-10-0-140-163 systemd[1]: Started Kubernetes Kubelet. Jul 29 15:46:16.192683 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.192664 2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 29 15:46:16.192862 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.192824 2554 server.go:310] "Adding debug handlers to kubelet server" Jul 29 15:46:16.197275 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:16.197248 2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 29 15:46:16.197778 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:16.196896 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-163.ec2.internal.18c6cd3fcc25c833 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-163.ec2.internal,UID:ip-10-0-140-163.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-163.ec2.internal,},FirstTimestamp:2026-07-29 15:46:16.190642227 +0000 UTC m=+0.431382754,LastTimestamp:2026-07-29 15:46:16.190642227 +0000 UTC m=+0.431382754,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-163.ec2.internal,}" Jul 29 15:46:16.201141 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.201128 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 29 15:46:16.201196 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.201156 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 29 15:46:16.201692 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:16.201636 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-163.ec2.internal\" not found" Jul 29 15:46:16.202170 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.202143 2554 factory.go:55] Registering systemd factory Jul 29 15:46:16.202269 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.202180 2554 factory.go:223] Registration of the systemd container factory successfully Jul 29 15:46:16.202428 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.202416 2554 factory.go:153] Registering CRI-O factory Jul 29 15:46:16.202428 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.202429 2554 factory.go:223] Registration of the crio container factory successfully Jul 29 15:46:16.202511 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.202470 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 29 15:46:16.202511 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.202488 2554 factory.go:103] Registering Raw factory Jul 29 15:46:16.202511 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.202500 2554 manager.go:1196] Started watching for new ooms in manager Jul 29 15:46:16.203001 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.202986 2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 29 15:46:16.203069 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.202988 2554 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 29 15:46:16.203069 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.203013 2554 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 29 15:46:16.203069 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.203039 2554 manager.go:349] Starting recovery of all containers Jul 29 15:46:16.203199 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.203113 2554 reconstruct.go:97] "Volume reconstruction finished" Jul 29 15:46:16.203199 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.203124 2554 reconciler.go:29] "Reconciler: start to sync state" Jul 29 15:46:16.203288 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:16.203237 2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-163.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 29 15:46:16.203336 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:16.203305 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 29 15:46:16.215223 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.215206 2554 manager.go:354] Recovery completed Jul 29 15:46:16.219133 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.219120 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:46:16.220991 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.220971 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:46:16.221122 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.221006 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:46:16.221122 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.221017 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:46:16.221580 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.221563 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 29 15:46:16.221580 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.221581 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 29 15:46:16.221726 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.221599 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 29 15:46:16.221726 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.221632 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:46:16.223349 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.223319 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:46:16.223424 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.223354 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:46:16.223424 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.223368 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:46:16.223519 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.223430 2554 policy_none.go:49] "None policy: Start" Jul 29 15:46:16.223519 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.223446 2554 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 29 15:46:16.223519 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.223460 2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 29 15:46:16.224031 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:16.223972 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-163.ec2.internal.18c6cd3fcdf4e036 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-163.ec2.internal,UID:ip-10-0-140-163.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-163.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-163.ec2.internal,},FirstTimestamp:2026-07-29 15:46:16.220991542 +0000 UTC m=+0.461732070,LastTimestamp:2026-07-29 15:46:16.220991542 +0000 UTC m=+0.461732070,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-163.ec2.internal,}" Jul 29 15:46:16.224588 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.224576 2554 policy_none.go:47] "Start" Jul 29 15:46:16.233374 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:16.233298 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-163.ec2.internal.18c6cd3fcdf53134 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-163.ec2.internal,UID:ip-10-0-140-163.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-163.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-163.ec2.internal,},FirstTimestamp:2026-07-29 15:46:16.221012276 +0000 UTC m=+0.461752798,LastTimestamp:2026-07-29 15:46:16.221012276 +0000 UTC m=+0.461752798,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-163.ec2.internal,}" Jul 29 15:46:16.236182 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:16.236119 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-163.ec2.internal.18c6cd3fcdf5544c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-163.ec2.internal,UID:ip-10-0-140-163.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-163.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-163.ec2.internal,},FirstTimestamp:2026-07-29 15:46:16.22102126 +0000 UTC m=+0.461761783,LastTimestamp:2026-07-29 15:46:16.22102126 +0000 UTC m=+0.461761783,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-163.ec2.internal,}" Jul 29 15:46:16.239710 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.239693 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4bw78" Jul 29 15:46:16.240899 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:16.240801 2554 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-163.ec2.internal.18c6cd3fcdf4e036\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-163.ec2.internal.18c6cd3fcdf4e036 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-163.ec2.internal,UID:ip-10-0-140-163.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-163.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-163.ec2.internal,},FirstTimestamp:2026-07-29 15:46:16.220991542 +0000 UTC m=+0.461732070,LastTimestamp:2026-07-29 15:46:16.223338646 +0000 UTC m=+0.464079171,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-163.ec2.internal,}" Jul 29 15:46:16.247885 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:16.247810 2554 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-163.ec2.internal.18c6cd3fcdf53134\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-163.ec2.internal.18c6cd3fcdf53134 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-163.ec2.internal,UID:ip-10-0-140-163.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-163.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-163.ec2.internal,},FirstTimestamp:2026-07-29 15:46:16.221012276 +0000 UTC m=+0.461752798,LastTimestamp:2026-07-29 15:46:16.223361503 +0000 UTC m=+0.464102029,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-163.ec2.internal,}" Jul 29 15:46:16.248471 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.248455 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4bw78" Jul 29 15:46:16.252255 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:16.252183 2554 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-163.ec2.internal.18c6cd3fcdf5544c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-163.ec2.internal.18c6cd3fcdf5544c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-163.ec2.internal,UID:ip-10-0-140-163.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-163.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-163.ec2.internal,},FirstTimestamp:2026-07-29 15:46:16.22102126 +0000 UTC m=+0.461761783,LastTimestamp:2026-07-29 15:46:16.223373294 +0000 UTC m=+0.464113821,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-163.ec2.internal,}" Jul 29 15:46:16.253489 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.253478 2554 manager.go:337] "Starting Device Plugin manager" Jul 29 15:46:16.253552 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:16.253505 2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 29 15:46:16.253552 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.253514 2554 server.go:87] "Starting device plugin registration server" Jul 29 15:46:16.253780 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.253769 2554 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 29 15:46:16.253812 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.253788 2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 29 15:46:16.253914 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.253899 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 29 15:46:16.254253 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.253991 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 29 15:46:16.254253 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.254019 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 29 15:46:16.254540 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:16.254516 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 29 15:46:16.254610 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:16.254591 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-163.ec2.internal\" not found" Jul 29 15:46:16.273155 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.273136 2554 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2587 into the system container \"/system.slice\": " Jul 29 15:46:16.354424 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.354368 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:46:16.355613 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.355514 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:46:16.355613 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.355540 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:46:16.355613 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.355563 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:46:16.355613 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.355593 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-163.ec2.internal" Jul 29 15:46:16.364872 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.364856 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-163.ec2.internal" Jul 29 15:46:16.364969 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:16.364881 2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-163.ec2.internal\": node \"ip-10-0-140-163.ec2.internal\" not found" Jul 29 15:46:16.367388 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.367355 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 29 15:46:16.368540 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.368522 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 29 15:46:16.368611 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.368558 2554 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 29 15:46:16.368611 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.368582 2554 kubelet.go:2448] "Starting kubelet main sync loop" Jul 29 15:46:16.368611 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:16.368610 2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 29 15:46:16.370307 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.370271 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:46:16.411048 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:16.411024 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-163.ec2.internal\" not found" Jul 29 15:46:16.468908 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.468862 2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-163.ec2.internal"] Jul 29 15:46:16.468986 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.468954 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:46:16.473860 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.473827 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:46:16.473951 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.473877 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:46:16.473951 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.473891 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:46:16.475344 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.475329 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:46:16.475456 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.475441 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal" Jul 29 15:46:16.475506 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.475475 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:46:16.476095 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.476081 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:46:16.476166 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.476107 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:46:16.476166 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.476119 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:46:16.476240 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.476199 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:46:16.476240 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.476231 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:46:16.476296 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.476244 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:46:16.477521 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.477507 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-163.ec2.internal" Jul 29 15:46:16.477575 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.477534 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:46:16.478613 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.478599 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:46:16.478691 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.478620 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:46:16.478691 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.478634 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:46:16.503532 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:16.503512 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-163.ec2.internal\" not found" node="ip-10-0-140-163.ec2.internal" Jul 29 15:46:16.505481 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.505458 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d42b23c9b787526dd3bbeea8c76488c3-config\") pod \"kube-apiserver-proxy-ip-10-0-140-163.ec2.internal\" (UID: \"d42b23c9b787526dd3bbeea8c76488c3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-163.ec2.internal" Jul 29 15:46:16.505574 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.505489 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3a4d1ff8d89d88b800599793a6e9934c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal\" (UID: \"3a4d1ff8d89d88b800599793a6e9934c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal" Jul 29 15:46:16.505574 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.505505 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a4d1ff8d89d88b800599793a6e9934c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal\" (UID: \"3a4d1ff8d89d88b800599793a6e9934c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal" Jul 29 15:46:16.507859 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:16.507825 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-163.ec2.internal\" not found" node="ip-10-0-140-163.ec2.internal" Jul 29 15:46:16.511131 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:16.511116 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-163.ec2.internal\" not found" Jul 29 15:46:16.606477 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.606391 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3a4d1ff8d89d88b800599793a6e9934c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal\" (UID: \"3a4d1ff8d89d88b800599793a6e9934c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal" Jul 29 15:46:16.606477 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.606433 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a4d1ff8d89d88b800599793a6e9934c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal\" (UID: \"3a4d1ff8d89d88b800599793a6e9934c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal" Jul 29 15:46:16.606477 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.606452 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d42b23c9b787526dd3bbeea8c76488c3-config\") pod \"kube-apiserver-proxy-ip-10-0-140-163.ec2.internal\" (UID: \"d42b23c9b787526dd3bbeea8c76488c3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-163.ec2.internal" Jul 29 15:46:16.606690 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.606488 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d42b23c9b787526dd3bbeea8c76488c3-config\") pod \"kube-apiserver-proxy-ip-10-0-140-163.ec2.internal\" (UID: \"d42b23c9b787526dd3bbeea8c76488c3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-163.ec2.internal" Jul 29 15:46:16.606690 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.606499 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3a4d1ff8d89d88b800599793a6e9934c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal\" (UID: \"3a4d1ff8d89d88b800599793a6e9934c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal" Jul 29 15:46:16.606690 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.606513 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a4d1ff8d89d88b800599793a6e9934c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal\" (UID: \"3a4d1ff8d89d88b800599793a6e9934c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal" Jul 29 15:46:16.611514 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:16.611486 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-163.ec2.internal\" not found" Jul 29 15:46:16.712393 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:16.712350 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-163.ec2.internal\" not found" Jul 29 15:46:16.806861 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.806817 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal" Jul 29 15:46:16.811742 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:16.811723 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-163.ec2.internal" Jul 29 15:46:16.812809 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:16.812789 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-163.ec2.internal\" not found" Jul 29 15:46:16.913394 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:16.913307 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-163.ec2.internal\" not found" Jul 29 15:46:18.540591 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:18.540552 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-163.ec2.internal\" not found" Jul 29 15:46:18.562786 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:18.562760 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:46:18.640694 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:18.640670 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-163.ec2.internal\" not found" Jul 29 15:46:18.657841 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:18.657818 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 29 15:46:18.657980 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:18.657958 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 15:46:18.658046 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:18.657993 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 15:46:18.741656 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:18.741592 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-163.ec2.internal\" not found" Jul 29 15:46:18.756231 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:18.756211 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:46:18.780062 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:18.780035 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 15:41:17 +0000 UTC" deadline="2027-12-31 14:08:29.783173158 +0000 UTC" Jul 29 15:46:18.780199 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:18.780062 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12478h22m11.003115674s" Jul 29 15:46:18.842618 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:18.842588 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-163.ec2.internal\" not found" Jul 29 15:46:18.874754 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:18.874734 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:46:18.876533 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:18.876461 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:46:18.876533 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:18.876495 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:46:18.876533 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:18.876510 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:46:18.884401 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:18.884368 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a4d1ff8d89d88b800599793a6e9934c.slice/crio-ac1606fb3617e1e467b134da39bffcf16f643a1bd29ead29b654c8e9977597bb WatchSource:0}: Error finding container ac1606fb3617e1e467b134da39bffcf16f643a1bd29ead29b654c8e9977597bb: Status 404 returned error can't find the container with id ac1606fb3617e1e467b134da39bffcf16f643a1bd29ead29b654c8e9977597bb Jul 29 15:46:18.884847 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:18.884832 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd42b23c9b787526dd3bbeea8c76488c3.slice/crio-33ffcc35c7ee29b1f5159bac509a64ca1ffd9a7886fb9ff4c716cdef19918cef WatchSource:0}: Error finding container 33ffcc35c7ee29b1f5159bac509a64ca1ffd9a7886fb9ff4c716cdef19918cef: Status 404 returned error can't find the container with id 33ffcc35c7ee29b1f5159bac509a64ca1ffd9a7886fb9ff4c716cdef19918cef Jul 29 15:46:18.888948 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:18.888935 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 15:46:18.897849 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:18.897815 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal" event={"ID":"3a4d1ff8d89d88b800599793a6e9934c","Type":"ContainerStarted","Data":"ac1606fb3617e1e467b134da39bffcf16f643a1bd29ead29b654c8e9977597bb"} Jul 29 15:46:18.898758 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:18.898740 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-163.ec2.internal" event={"ID":"d42b23c9b787526dd3bbeea8c76488c3","Type":"ContainerStarted","Data":"33ffcc35c7ee29b1f5159bac509a64ca1ffd9a7886fb9ff4c716cdef19918cef"} Jul 29 15:46:18.943597 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:18.943558 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-163.ec2.internal\" not found" Jul 29 15:46:19.044132 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:19.044074 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-163.ec2.internal\" not found" Jul 29 15:46:19.144634 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:19.144610 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-163.ec2.internal\" not found" Jul 29 15:46:19.245409 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:19.245373 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-163.ec2.internal\" not found" Jul 29 15:46:19.267646 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.267624 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:46:19.328858 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.328779 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal" Jul 29 15:46:19.341610 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.341576 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 15:46:19.342669 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.342641 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-163.ec2.internal" Jul 29 15:46:19.351861 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.351841 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 15:46:19.706682 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.706606 2554 apiserver.go:52] "Watching apiserver" Jul 29 15:46:19.714716 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.714692 2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 29 15:46:19.715148 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.715126 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-x9fkz","openshift-dns/node-resolver-pw9xr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal","openshift-multus/multus-shxwt","openshift-network-diagnostics/network-check-target-fqgzw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76","openshift-image-registry/node-ca-wmtrp","openshift-multus/multus-additional-cni-plugins-6q78m","openshift-multus/network-metrics-daemon-jchg2","openshift-network-operator/iptables-alerter-2pzcs","openshift-ovn-kubernetes/ovnkube-node-4mfwv","kube-system/global-pull-secret-syncer-kdc28","kube-system/konnectivity-agent-w22f7","kube-system/kube-apiserver-proxy-ip-10-0-140-163.ec2.internal"] Jul 29 15:46:19.716850 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.716825 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wmtrp" Jul 29 15:46:19.718562 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.718528 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w22f7" Jul 29 15:46:19.719322 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.719293 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:19.719419 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:19.719381 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jchg2" podUID="92a38651-6bb4-4f5a-9d97-8ac79e1027f4" Jul 29 15:46:19.720079 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.720057 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mg8jt\"" Jul 29 15:46:19.721742 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.721721 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.723153 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.723132 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 29 15:46:19.723320 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.723299 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 29 15:46:19.723384 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.723299 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 29 15:46:19.723384 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.723326 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xv76j\"" Jul 29 15:46:19.723480 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.723382 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:46:19.723523 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:19.723493 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqgzw" podUID="73422f43-4d4a-4738-be77-ba5aff983673" Jul 29 15:46:19.723604 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.723585 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 29 15:46:19.723849 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.723835 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 29 15:46:19.724425 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.724137 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" Jul 29 15:46:19.726060 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.726035 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.727025 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.727007 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pw9xr" Jul 29 15:46:19.728577 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.728230 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 29 15:46:19.728577 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.728573 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2pzcs" Jul 29 15:46:19.729948 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.729626 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.731771 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.730915 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 29 15:46:19.731771 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.731091 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 29 15:46:19.731771 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.731105 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 29 15:46:19.731771 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.731290 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 29 15:46:19.731964 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.731944 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 29 15:46:19.732293 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.732195 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:19.732293 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:19.732256 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kdc28" podUID="d5e53580-c891-4bd3-8a76-ffcd74cb4ac5" Jul 29 15:46:19.732972 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.732458 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 29 15:46:19.732972 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.732675 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ds6wl\"" Jul 29 15:46:19.732972 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.732707 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 29 15:46:19.732972 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.732758 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7lpwk\"" Jul 29 15:46:19.732972 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.732801 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 29 15:46:19.732972 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.732675 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 29 15:46:19.732972 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.732872 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2sq9h\"" Jul 29 15:46:19.734412 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.734392 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6q78m" Jul 29 15:46:19.736006 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.735985 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nl6gt\"" Jul 29 15:46:19.736274 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.736256 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 29 15:46:19.736448 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.736427 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 29 15:46:19.736604 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.736532 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 29 15:46:19.741360 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.741341 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-run\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.741453 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.741372 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-host\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.741453 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.741398 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxdpx\" (UniqueName: \"kubernetes.io/projected/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-kube-api-access-jxdpx\") pod \"network-metrics-daemon-jchg2\" (UID: \"92a38651-6bb4-4f5a-9d97-8ac79e1027f4\") " pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:19.741453 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.741430 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-run-ovn\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.741606 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.741455 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-host-run-ovn-kubernetes\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.741606 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.741480 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.741606 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.741504 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3f46689-73a1-44b7-b437-339c9aaac015-cni-binary-copy\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.741606 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.741526 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-var-lib-kubelet\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.741606 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.741564 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1a7d3d7-8923-4451-b404-573d7c07b438-tmp\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.741606 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.741588 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-host-cni-bin\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.741874 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.741609 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-dbus\") pod \"global-pull-secret-syncer-kdc28\" (UID: \"d5e53580-c891-4bd3-8a76-ffcd74cb4ac5\") " pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:19.741874 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.741651 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b3f46689-73a1-44b7-b437-339c9aaac015-multus-daemon-config\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.741874 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.741674 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-etc-kubernetes\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.741874 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.741699 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1157fa0-074e-42dd-ab0c-2193bf3a8909-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pgn76\" (UID: \"d1157fa0-074e-42dd-ab0c-2193bf3a8909\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" Jul 29 15:46:19.741874 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.741721 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1157fa0-074e-42dd-ab0c-2193bf3a8909-socket-dir\") pod \"aws-ebs-csi-driver-node-pgn76\" (UID: \"d1157fa0-074e-42dd-ab0c-2193bf3a8909\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" Jul 29 15:46:19.741874 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.741744 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1157fa0-074e-42dd-ab0c-2193bf3a8909-sys-fs\") pod \"aws-ebs-csi-driver-node-pgn76\" (UID: \"d1157fa0-074e-42dd-ab0c-2193bf3a8909\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" Jul 29 15:46:19.741874 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.741766 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-system-cni-dir\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.741874 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.741791 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwqjc\" (UniqueName: \"kubernetes.io/projected/e1a7d3d7-8923-4451-b404-573d7c07b438-kube-api-access-gwqjc\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.741874 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.741822 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1157fa0-074e-42dd-ab0c-2193bf3a8909-etc-selinux\") pod \"aws-ebs-csi-driver-node-pgn76\" (UID: \"d1157fa0-074e-42dd-ab0c-2193bf3a8909\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" Jul 29 15:46:19.741874 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.741845 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-host-cni-netd\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.741874 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.741868 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/46a6b55c-7a78-40b3-8adf-69daad654fda-ovn-node-metrics-cert\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.742384 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.741893 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-multus-cni-dir\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.742384 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.741938 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-multus-socket-dir-parent\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.742384 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.741962 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-host-run-k8s-cni-cncf-io\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.742384 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.741984 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-host-run-netns\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.742384 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742010 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-etc-sysctl-d\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.742384 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742032 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-etc-systemd\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.742384 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742054 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-lib-modules\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.742384 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742077 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-cnibin\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.742384 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742099 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-hostroot\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.742384 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742121 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-multus-conf-dir\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.742384 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742158 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-etc-sysctl-conf\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.742384 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742186 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wzrf\" (UniqueName: \"kubernetes.io/projected/d9d34b9d-2d38-4123-a642-3e433d36b23e-kube-api-access-6wzrf\") pod \"node-resolver-pw9xr\" (UID: \"d9d34b9d-2d38-4123-a642-3e433d36b23e\") " pod="openshift-dns/node-resolver-pw9xr" Jul 29 15:46:19.742384 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742209 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-host-kubelet\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.742384 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742237 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f49f48c2-8c3b-4acb-91ea-88772241837e-host\") pod \"node-ca-wmtrp\" (UID: \"f49f48c2-8c3b-4acb-91ea-88772241837e\") " pod="openshift-image-registry/node-ca-wmtrp" Jul 29 15:46:19.742384 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742259 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-etc-modprobe-d\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.742384 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742299 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f64e1ce6-4c88-4b72-b669-e4cf22ffc766-iptables-alerter-script\") pod \"iptables-alerter-2pzcs\" (UID: \"f64e1ce6-4c88-4b72-b669-e4cf22ffc766\") " pod="openshift-network-operator/iptables-alerter-2pzcs" Jul 29 15:46:19.742384 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742322 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f49f48c2-8c3b-4acb-91ea-88772241837e-serviceca\") pod \"node-ca-wmtrp\" (UID: \"f49f48c2-8c3b-4acb-91ea-88772241837e\") " pod="openshift-image-registry/node-ca-wmtrp" Jul 29 15:46:19.743175 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742351 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-kubelet-config\") pod \"global-pull-secret-syncer-kdc28\" (UID: \"d5e53580-c891-4bd3-8a76-ffcd74cb4ac5\") " pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:19.743175 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742385 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-original-pull-secret\") pod \"global-pull-secret-syncer-kdc28\" (UID: \"d5e53580-c891-4bd3-8a76-ffcd74cb4ac5\") " pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:19.743175 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742408 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scf5t\" (UniqueName: \"kubernetes.io/projected/f49f48c2-8c3b-4acb-91ea-88772241837e-kube-api-access-scf5t\") pod \"node-ca-wmtrp\" (UID: \"f49f48c2-8c3b-4acb-91ea-88772241837e\") " pod="openshift-image-registry/node-ca-wmtrp" Jul 29 15:46:19.743175 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742432 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nmp5\" (UniqueName: \"kubernetes.io/projected/73422f43-4d4a-4738-be77-ba5aff983673-kube-api-access-8nmp5\") pod \"network-check-target-fqgzw\" (UID: \"73422f43-4d4a-4738-be77-ba5aff983673\") " pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:46:19.743175 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742455 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9d34b9d-2d38-4123-a642-3e433d36b23e-tmp-dir\") pod \"node-resolver-pw9xr\" (UID: \"d9d34b9d-2d38-4123-a642-3e433d36b23e\") " pod="openshift-dns/node-resolver-pw9xr" Jul 29 15:46:19.743175 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742478 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-run-systemd\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.743175 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742500 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-etc-openvswitch\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.743175 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742524 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/46a6b55c-7a78-40b3-8adf-69daad654fda-ovnkube-script-lib\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.743175 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742561 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-host-run-multus-certs\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.743175 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742589 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc2jp\" (UniqueName: \"kubernetes.io/projected/b3f46689-73a1-44b7-b437-339c9aaac015-kube-api-access-kc2jp\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.743175 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742611 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-sys\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.743175 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742633 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-metrics-certs\") pod \"network-metrics-daemon-jchg2\" (UID: \"92a38651-6bb4-4f5a-9d97-8ac79e1027f4\") " pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:19.743175 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742656 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5hdh\" (UniqueName: \"kubernetes.io/projected/f64e1ce6-4c88-4b72-b669-e4cf22ffc766-kube-api-access-v5hdh\") pod \"iptables-alerter-2pzcs\" (UID: \"f64e1ce6-4c88-4b72-b669-e4cf22ffc766\") " pod="openshift-network-operator/iptables-alerter-2pzcs" Jul 29 15:46:19.743175 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742680 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-run-openvswitch\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.743175 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742714 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-etc-sysconfig\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.743175 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742738 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1157fa0-074e-42dd-ab0c-2193bf3a8909-registration-dir\") pod \"aws-ebs-csi-driver-node-pgn76\" (UID: \"d1157fa0-074e-42dd-ab0c-2193bf3a8909\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" Jul 29 15:46:19.743911 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742765 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1157fa0-074e-42dd-ab0c-2193bf3a8909-device-dir\") pod \"aws-ebs-csi-driver-node-pgn76\" (UID: \"d1157fa0-074e-42dd-ab0c-2193bf3a8909\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" Jul 29 15:46:19.743911 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742789 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f64e1ce6-4c88-4b72-b669-e4cf22ffc766-host-slash\") pod \"iptables-alerter-2pzcs\" (UID: \"f64e1ce6-4c88-4b72-b669-e4cf22ffc766\") " pod="openshift-network-operator/iptables-alerter-2pzcs" Jul 29 15:46:19.743911 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742814 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-log-socket\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.743911 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742836 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/46a6b55c-7a78-40b3-8adf-69daad654fda-ovnkube-config\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.743911 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742858 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-os-release\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.743911 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742882 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-etc-kubernetes\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.743911 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742904 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e1a7d3d7-8923-4451-b404-573d7c07b438-etc-tuned\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.743911 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742930 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-systemd-units\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.743911 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742956 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-host-run-netns\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.743911 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.742995 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-node-log\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.743911 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.743031 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/49da76ad-4692-4991-a6b4-6df2e9632377-agent-certs\") pod \"konnectivity-agent-w22f7\" (UID: \"49da76ad-4692-4991-a6b4-6df2e9632377\") " pod="kube-system/konnectivity-agent-w22f7" Jul 29 15:46:19.743911 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.743426 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/49da76ad-4692-4991-a6b4-6df2e9632377-konnectivity-ca\") pod \"konnectivity-agent-w22f7\" (UID: \"49da76ad-4692-4991-a6b4-6df2e9632377\") " pod="kube-system/konnectivity-agent-w22f7" Jul 29 15:46:19.743911 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.743458 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b6bx\" (UniqueName: \"kubernetes.io/projected/d1157fa0-074e-42dd-ab0c-2193bf3a8909-kube-api-access-4b6bx\") pod \"aws-ebs-csi-driver-node-pgn76\" (UID: \"d1157fa0-074e-42dd-ab0c-2193bf3a8909\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" Jul 29 15:46:19.743911 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.743490 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-host-slash\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.743911 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.743559 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/46a6b55c-7a78-40b3-8adf-69daad654fda-env-overrides\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.743911 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.743602 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-host-var-lib-kubelet\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.744627 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.743633 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-var-lib-openvswitch\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.744627 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.743684 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-host-var-lib-cni-bin\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.744627 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.743714 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d9d34b9d-2d38-4123-a642-3e433d36b23e-hosts-file\") pod \"node-resolver-pw9xr\" (UID: \"d9d34b9d-2d38-4123-a642-3e433d36b23e\") " pod="openshift-dns/node-resolver-pw9xr" Jul 29 15:46:19.744627 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.743740 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfhpr\" (UniqueName: \"kubernetes.io/projected/46a6b55c-7a78-40b3-8adf-69daad654fda-kube-api-access-dfhpr\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.744627 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.743764 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-host-var-lib-cni-multus\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.748964 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.748395 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 29 15:46:19.748964 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.748630 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 29 15:46:19.748964 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.748655 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 29 15:46:19.748964 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.748842 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 29 15:46:19.749227 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.749057 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kcgsr\"" Jul 29 15:46:19.749781 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.749622 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xdtxz\"" Jul 29 15:46:19.749781 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.749148 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 29 15:46:19.749781 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.749165 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mqfhd\"" Jul 29 15:46:19.749781 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.749186 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 29 15:46:19.750025 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.749469 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 29 15:46:19.750025 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.749522 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 29 15:46:19.750025 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.749956 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 29 15:46:19.750025 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.749259 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 29 15:46:19.788824 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.788796 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 15:46:19.830956 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.830929 2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 29 15:46:19.844364 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844308 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-etc-kubernetes\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.844513 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844373 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1157fa0-074e-42dd-ab0c-2193bf3a8909-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pgn76\" (UID: \"d1157fa0-074e-42dd-ab0c-2193bf3a8909\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" Jul 29 15:46:19.844513 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844398 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1157fa0-074e-42dd-ab0c-2193bf3a8909-socket-dir\") pod \"aws-ebs-csi-driver-node-pgn76\" (UID: \"d1157fa0-074e-42dd-ab0c-2193bf3a8909\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" Jul 29 15:46:19.844513 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844416 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1157fa0-074e-42dd-ab0c-2193bf3a8909-sys-fs\") pod \"aws-ebs-csi-driver-node-pgn76\" (UID: \"d1157fa0-074e-42dd-ab0c-2193bf3a8909\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" Jul 29 15:46:19.844513 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844440 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/52405e2b-d7e9-42f3-a9ae-609e02a252a2-os-release\") pod \"multus-additional-cni-plugins-6q78m\" (UID: \"52405e2b-d7e9-42f3-a9ae-609e02a252a2\") " pod="openshift-multus/multus-additional-cni-plugins-6q78m" Jul 29 15:46:19.844513 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844465 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-system-cni-dir\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.844782 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844510 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1157fa0-074e-42dd-ab0c-2193bf3a8909-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pgn76\" (UID: \"d1157fa0-074e-42dd-ab0c-2193bf3a8909\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" Jul 29 15:46:19.844782 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844512 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-etc-kubernetes\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.844782 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844559 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1157fa0-074e-42dd-ab0c-2193bf3a8909-sys-fs\") pod \"aws-ebs-csi-driver-node-pgn76\" (UID: \"d1157fa0-074e-42dd-ab0c-2193bf3a8909\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" Jul 29 15:46:19.844782 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844516 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwqjc\" (UniqueName: \"kubernetes.io/projected/e1a7d3d7-8923-4451-b404-573d7c07b438-kube-api-access-gwqjc\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.844782 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844634 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-system-cni-dir\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.844782 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844654 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1157fa0-074e-42dd-ab0c-2193bf3a8909-socket-dir\") pod \"aws-ebs-csi-driver-node-pgn76\" (UID: \"d1157fa0-074e-42dd-ab0c-2193bf3a8909\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" Jul 29 15:46:19.844782 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844676 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1157fa0-074e-42dd-ab0c-2193bf3a8909-etc-selinux\") pod \"aws-ebs-csi-driver-node-pgn76\" (UID: \"d1157fa0-074e-42dd-ab0c-2193bf3a8909\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" Jul 29 15:46:19.844782 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844703 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-host-cni-netd\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.844782 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844730 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/46a6b55c-7a78-40b3-8adf-69daad654fda-ovn-node-metrics-cert\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.844782 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844756 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-multus-cni-dir\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.844782 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844767 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-host-cni-netd\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.844782 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844779 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-multus-socket-dir-parent\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.844782 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844781 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1157fa0-074e-42dd-ab0c-2193bf3a8909-etc-selinux\") pod \"aws-ebs-csi-driver-node-pgn76\" (UID: \"d1157fa0-074e-42dd-ab0c-2193bf3a8909\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" Jul 29 15:46:19.845380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844816 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-host-run-k8s-cni-cncf-io\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.845380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844832 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-multus-socket-dir-parent\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.845380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844855 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-host-run-netns\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.845380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844879 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-etc-sysctl-d\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.845380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844887 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-host-run-k8s-cni-cncf-io\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.845380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844902 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-etc-systemd\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.845380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844935 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-host-run-netns\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.845380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844939 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-lib-modules\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.845380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844967 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-multus-cni-dir\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.845380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844976 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-cnibin\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.845380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.844980 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-etc-sysctl-d\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.845380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845002 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-hostroot\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.845380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845025 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-multus-conf-dir\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.845380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845053 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-etc-systemd\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.845380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845050 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-lib-modules\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.845380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845070 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-etc-sysctl-conf\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.845380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845094 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-hostroot\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.845380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845095 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wzrf\" (UniqueName: \"kubernetes.io/projected/d9d34b9d-2d38-4123-a642-3e433d36b23e-kube-api-access-6wzrf\") pod \"node-resolver-pw9xr\" (UID: \"d9d34b9d-2d38-4123-a642-3e433d36b23e\") " pod="openshift-dns/node-resolver-pw9xr" Jul 29 15:46:19.846124 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845095 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-cnibin\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.846124 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845131 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-multus-conf-dir\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.846124 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845142 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 29 15:46:19.846124 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845198 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-host-kubelet\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.846124 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845215 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-etc-sysctl-conf\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.846124 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845235 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f49f48c2-8c3b-4acb-91ea-88772241837e-host\") pod \"node-ca-wmtrp\" (UID: \"f49f48c2-8c3b-4acb-91ea-88772241837e\") " pod="openshift-image-registry/node-ca-wmtrp" Jul 29 15:46:19.846124 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845257 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-host-kubelet\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.846124 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845284 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-etc-modprobe-d\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.846124 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845301 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f64e1ce6-4c88-4b72-b669-e4cf22ffc766-iptables-alerter-script\") pod \"iptables-alerter-2pzcs\" (UID: \"f64e1ce6-4c88-4b72-b669-e4cf22ffc766\") " pod="openshift-network-operator/iptables-alerter-2pzcs" Jul 29 15:46:19.846124 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845323 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f49f48c2-8c3b-4acb-91ea-88772241837e-serviceca\") pod \"node-ca-wmtrp\" (UID: \"f49f48c2-8c3b-4acb-91ea-88772241837e\") " pod="openshift-image-registry/node-ca-wmtrp" Jul 29 15:46:19.846124 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845327 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f49f48c2-8c3b-4acb-91ea-88772241837e-host\") pod \"node-ca-wmtrp\" (UID: \"f49f48c2-8c3b-4acb-91ea-88772241837e\") " pod="openshift-image-registry/node-ca-wmtrp" Jul 29 15:46:19.846124 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845357 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-kubelet-config\") pod \"global-pull-secret-syncer-kdc28\" (UID: \"d5e53580-c891-4bd3-8a76-ffcd74cb4ac5\") " pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:19.846124 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845393 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-etc-modprobe-d\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.846124 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845393 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-original-pull-secret\") pod \"global-pull-secret-syncer-kdc28\" (UID: \"d5e53580-c891-4bd3-8a76-ffcd74cb4ac5\") " pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:19.846124 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845437 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-kubelet-config\") pod \"global-pull-secret-syncer-kdc28\" (UID: \"d5e53580-c891-4bd3-8a76-ffcd74cb4ac5\") " pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:19.846124 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845466 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scf5t\" (UniqueName: \"kubernetes.io/projected/f49f48c2-8c3b-4acb-91ea-88772241837e-kube-api-access-scf5t\") pod \"node-ca-wmtrp\" (UID: \"f49f48c2-8c3b-4acb-91ea-88772241837e\") " pod="openshift-image-registry/node-ca-wmtrp" Jul 29 15:46:19.846124 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:19.845570 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:19.846124 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845573 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nmp5\" (UniqueName: \"kubernetes.io/projected/73422f43-4d4a-4738-be77-ba5aff983673-kube-api-access-8nmp5\") pod \"network-check-target-fqgzw\" (UID: \"73422f43-4d4a-4738-be77-ba5aff983673\") " pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:46:19.846124 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845819 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f49f48c2-8c3b-4acb-91ea-88772241837e-serviceca\") pod \"node-ca-wmtrp\" (UID: \"f49f48c2-8c3b-4acb-91ea-88772241837e\") " pod="openshift-image-registry/node-ca-wmtrp" Jul 29 15:46:19.846877 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:19.845835 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-original-pull-secret podName:d5e53580-c891-4bd3-8a76-ffcd74cb4ac5 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:20.345793645 +0000 UTC m=+3.059828133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-original-pull-secret") pod "global-pull-secret-syncer-kdc28" (UID: "d5e53580-c891-4bd3-8a76-ffcd74cb4ac5") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:19.846877 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845881 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9d34b9d-2d38-4123-a642-3e433d36b23e-tmp-dir\") pod \"node-resolver-pw9xr\" (UID: \"d9d34b9d-2d38-4123-a642-3e433d36b23e\") " pod="openshift-dns/node-resolver-pw9xr" Jul 29 15:46:19.846877 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845925 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f64e1ce6-4c88-4b72-b669-e4cf22ffc766-iptables-alerter-script\") pod \"iptables-alerter-2pzcs\" (UID: \"f64e1ce6-4c88-4b72-b669-e4cf22ffc766\") " pod="openshift-network-operator/iptables-alerter-2pzcs" Jul 29 15:46:19.846877 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845930 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-run-systemd\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.846877 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.845976 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-etc-openvswitch\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.846877 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846000 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-run-systemd\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.846877 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846001 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/46a6b55c-7a78-40b3-8adf-69daad654fda-ovnkube-script-lib\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.846877 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846054 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-host-run-multus-certs\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.846877 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846058 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-etc-openvswitch\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.846877 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846079 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc2jp\" (UniqueName: \"kubernetes.io/projected/b3f46689-73a1-44b7-b437-339c9aaac015-kube-api-access-kc2jp\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.846877 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846111 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9d34b9d-2d38-4123-a642-3e433d36b23e-tmp-dir\") pod \"node-resolver-pw9xr\" (UID: \"d9d34b9d-2d38-4123-a642-3e433d36b23e\") " pod="openshift-dns/node-resolver-pw9xr" Jul 29 15:46:19.846877 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846131 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-host-run-multus-certs\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.846877 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846163 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-sys\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.846877 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846188 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-metrics-certs\") pod \"network-metrics-daemon-jchg2\" (UID: \"92a38651-6bb4-4f5a-9d97-8ac79e1027f4\") " pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:19.846877 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846212 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5hdh\" (UniqueName: \"kubernetes.io/projected/f64e1ce6-4c88-4b72-b669-e4cf22ffc766-kube-api-access-v5hdh\") pod \"iptables-alerter-2pzcs\" (UID: \"f64e1ce6-4c88-4b72-b669-e4cf22ffc766\") " pod="openshift-network-operator/iptables-alerter-2pzcs" Jul 29 15:46:19.846877 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846236 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-run-openvswitch\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.846877 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846259 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-etc-sysconfig\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.847699 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846294 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1157fa0-074e-42dd-ab0c-2193bf3a8909-registration-dir\") pod \"aws-ebs-csi-driver-node-pgn76\" (UID: \"d1157fa0-074e-42dd-ab0c-2193bf3a8909\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" Jul 29 15:46:19.847699 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846305 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-sys\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.847699 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846317 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1157fa0-074e-42dd-ab0c-2193bf3a8909-device-dir\") pod \"aws-ebs-csi-driver-node-pgn76\" (UID: \"d1157fa0-074e-42dd-ab0c-2193bf3a8909\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" Jul 29 15:46:19.847699 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:19.846326 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:19.847699 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846341 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f64e1ce6-4c88-4b72-b669-e4cf22ffc766-host-slash\") pod \"iptables-alerter-2pzcs\" (UID: \"f64e1ce6-4c88-4b72-b669-e4cf22ffc766\") " pod="openshift-network-operator/iptables-alerter-2pzcs" Jul 29 15:46:19.847699 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846356 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-etc-sysconfig\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.847699 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846362 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-log-socket\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.847699 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:19.846377 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-metrics-certs podName:92a38651-6bb4-4f5a-9d97-8ac79e1027f4 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:20.346361177 +0000 UTC m=+3.060395638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-metrics-certs") pod "network-metrics-daemon-jchg2" (UID: "92a38651-6bb4-4f5a-9d97-8ac79e1027f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:19.847699 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846396 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-run-openvswitch\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.847699 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846397 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-log-socket\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.847699 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846416 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/46a6b55c-7a78-40b3-8adf-69daad654fda-ovnkube-config\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.847699 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846438 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1157fa0-074e-42dd-ab0c-2193bf3a8909-registration-dir\") pod \"aws-ebs-csi-driver-node-pgn76\" (UID: \"d1157fa0-074e-42dd-ab0c-2193bf3a8909\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" Jul 29 15:46:19.847699 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846445 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1157fa0-074e-42dd-ab0c-2193bf3a8909-device-dir\") pod \"aws-ebs-csi-driver-node-pgn76\" (UID: \"d1157fa0-074e-42dd-ab0c-2193bf3a8909\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" Jul 29 15:46:19.847699 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846442 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-os-release\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.847699 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846480 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-etc-kubernetes\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.847699 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846504 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e1a7d3d7-8923-4451-b404-573d7c07b438-etc-tuned\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.847699 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846508 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-os-release\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.848481 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846521 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/46a6b55c-7a78-40b3-8adf-69daad654fda-ovnkube-script-lib\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.848481 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846550 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-systemd-units\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.848481 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846481 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f64e1ce6-4c88-4b72-b669-e4cf22ffc766-host-slash\") pod \"iptables-alerter-2pzcs\" (UID: \"f64e1ce6-4c88-4b72-b669-e4cf22ffc766\") " pod="openshift-network-operator/iptables-alerter-2pzcs" Jul 29 15:46:19.848481 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846523 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-etc-kubernetes\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.848481 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846586 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-host-run-netns\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.848481 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846612 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-node-log\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.848481 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846618 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-systemd-units\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.848481 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846649 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-host-run-netns\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.848481 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846641 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/52405e2b-d7e9-42f3-a9ae-609e02a252a2-system-cni-dir\") pod \"multus-additional-cni-plugins-6q78m\" (UID: \"52405e2b-d7e9-42f3-a9ae-609e02a252a2\") " pod="openshift-multus/multus-additional-cni-plugins-6q78m" Jul 29 15:46:19.848481 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846666 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-node-log\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.848481 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846688 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/52405e2b-d7e9-42f3-a9ae-609e02a252a2-cni-binary-copy\") pod \"multus-additional-cni-plugins-6q78m\" (UID: \"52405e2b-d7e9-42f3-a9ae-609e02a252a2\") " pod="openshift-multus/multus-additional-cni-plugins-6q78m" Jul 29 15:46:19.848481 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846719 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/49da76ad-4692-4991-a6b4-6df2e9632377-agent-certs\") pod \"konnectivity-agent-w22f7\" (UID: \"49da76ad-4692-4991-a6b4-6df2e9632377\") " pod="kube-system/konnectivity-agent-w22f7" Jul 29 15:46:19.848481 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846743 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/49da76ad-4692-4991-a6b4-6df2e9632377-konnectivity-ca\") pod \"konnectivity-agent-w22f7\" (UID: \"49da76ad-4692-4991-a6b4-6df2e9632377\") " pod="kube-system/konnectivity-agent-w22f7" Jul 29 15:46:19.848481 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846769 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b6bx\" (UniqueName: \"kubernetes.io/projected/d1157fa0-074e-42dd-ab0c-2193bf3a8909-kube-api-access-4b6bx\") pod \"aws-ebs-csi-driver-node-pgn76\" (UID: \"d1157fa0-074e-42dd-ab0c-2193bf3a8909\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" Jul 29 15:46:19.848481 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846790 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-host-slash\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.848481 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846814 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/46a6b55c-7a78-40b3-8adf-69daad654fda-env-overrides\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.848481 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846840 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/52405e2b-d7e9-42f3-a9ae-609e02a252a2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6q78m\" (UID: \"52405e2b-d7e9-42f3-a9ae-609e02a252a2\") " pod="openshift-multus/multus-additional-cni-plugins-6q78m" Jul 29 15:46:19.849345 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846866 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2gk8\" (UniqueName: \"kubernetes.io/projected/52405e2b-d7e9-42f3-a9ae-609e02a252a2-kube-api-access-x2gk8\") pod \"multus-additional-cni-plugins-6q78m\" (UID: \"52405e2b-d7e9-42f3-a9ae-609e02a252a2\") " pod="openshift-multus/multus-additional-cni-plugins-6q78m" Jul 29 15:46:19.849345 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846893 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-host-var-lib-kubelet\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.849345 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846924 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-var-lib-openvswitch\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.849345 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846938 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/46a6b55c-7a78-40b3-8adf-69daad654fda-ovnkube-config\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.849345 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846949 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-host-var-lib-cni-bin\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.849345 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846986 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d9d34b9d-2d38-4123-a642-3e433d36b23e-hosts-file\") pod \"node-resolver-pw9xr\" (UID: \"d9d34b9d-2d38-4123-a642-3e433d36b23e\") " pod="openshift-dns/node-resolver-pw9xr" Jul 29 15:46:19.849345 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.846999 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-host-slash\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.849345 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847014 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfhpr\" (UniqueName: \"kubernetes.io/projected/46a6b55c-7a78-40b3-8adf-69daad654fda-kube-api-access-dfhpr\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.849345 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847034 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-host-var-lib-kubelet\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.849345 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847086 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-host-var-lib-cni-multus\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.849345 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847093 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-var-lib-openvswitch\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.849345 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847111 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-run\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.849345 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847133 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-host\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.849345 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847137 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-host-var-lib-cni-bin\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.849345 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847172 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxdpx\" (UniqueName: \"kubernetes.io/projected/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-kube-api-access-jxdpx\") pod \"network-metrics-daemon-jchg2\" (UID: \"92a38651-6bb4-4f5a-9d97-8ac79e1027f4\") " pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:19.849345 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847184 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d9d34b9d-2d38-4123-a642-3e433d36b23e-hosts-file\") pod \"node-resolver-pw9xr\" (UID: \"d9d34b9d-2d38-4123-a642-3e433d36b23e\") " pod="openshift-dns/node-resolver-pw9xr" Jul 29 15:46:19.849345 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847200 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-run-ovn\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.850139 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847225 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-host-run-ovn-kubernetes\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.850139 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847225 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b3f46689-73a1-44b7-b437-339c9aaac015-host-var-lib-cni-multus\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.850139 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847245 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/49da76ad-4692-4991-a6b4-6df2e9632377-konnectivity-ca\") pod \"konnectivity-agent-w22f7\" (UID: \"49da76ad-4692-4991-a6b4-6df2e9632377\") " pod="kube-system/konnectivity-agent-w22f7" Jul 29 15:46:19.850139 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847261 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-host\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.850139 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847306 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-run-ovn\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.850139 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847305 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.850139 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847325 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-run\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.850139 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847335 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/52405e2b-d7e9-42f3-a9ae-609e02a252a2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6q78m\" (UID: \"52405e2b-d7e9-42f3-a9ae-609e02a252a2\") " pod="openshift-multus/multus-additional-cni-plugins-6q78m" Jul 29 15:46:19.850139 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847375 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/46a6b55c-7a78-40b3-8adf-69daad654fda-env-overrides\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.850139 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847450 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3f46689-73a1-44b7-b437-339c9aaac015-cni-binary-copy\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.850139 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847480 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.850139 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847479 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/52405e2b-d7e9-42f3-a9ae-609e02a252a2-cnibin\") pod \"multus-additional-cni-plugins-6q78m\" (UID: \"52405e2b-d7e9-42f3-a9ae-609e02a252a2\") " pod="openshift-multus/multus-additional-cni-plugins-6q78m" Jul 29 15:46:19.850139 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847508 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-host-run-ovn-kubernetes\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.850139 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847575 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-var-lib-kubelet\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.850139 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847600 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1a7d3d7-8923-4451-b404-573d7c07b438-tmp\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.850139 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847665 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1a7d3d7-8923-4451-b404-573d7c07b438-var-lib-kubelet\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.850139 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847698 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-host-cni-bin\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.850990 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847722 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-dbus\") pod \"global-pull-secret-syncer-kdc28\" (UID: \"d5e53580-c891-4bd3-8a76-ffcd74cb4ac5\") " pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:19.850990 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847750 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/52405e2b-d7e9-42f3-a9ae-609e02a252a2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6q78m\" (UID: \"52405e2b-d7e9-42f3-a9ae-609e02a252a2\") " pod="openshift-multus/multus-additional-cni-plugins-6q78m" Jul 29 15:46:19.850990 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847758 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/46a6b55c-7a78-40b3-8adf-69daad654fda-host-cni-bin\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.850990 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847775 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b3f46689-73a1-44b7-b437-339c9aaac015-multus-daemon-config\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.850990 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.847815 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-dbus\") pod \"global-pull-secret-syncer-kdc28\" (UID: \"d5e53580-c891-4bd3-8a76-ffcd74cb4ac5\") " pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:19.850990 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.848226 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b3f46689-73a1-44b7-b437-339c9aaac015-multus-daemon-config\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.850990 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.848690 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3f46689-73a1-44b7-b437-339c9aaac015-cni-binary-copy\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.850990 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.849707 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e1a7d3d7-8923-4451-b404-573d7c07b438-etc-tuned\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.850990 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.850118 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1a7d3d7-8923-4451-b404-573d7c07b438-tmp\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.851393 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.851374 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/46a6b55c-7a78-40b3-8adf-69daad654fda-ovn-node-metrics-cert\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.851564 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.851531 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:46:19.852986 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.852962 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/49da76ad-4692-4991-a6b4-6df2e9632377-agent-certs\") pod \"konnectivity-agent-w22f7\" (UID: \"49da76ad-4692-4991-a6b4-6df2e9632377\") " pod="kube-system/konnectivity-agent-w22f7" Jul 29 15:46:19.862624 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:19.862606 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:46:19.862713 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:19.862630 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:46:19.862713 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:19.862645 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8nmp5 for pod openshift-network-diagnostics/network-check-target-fqgzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:19.862713 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:19.862708 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73422f43-4d4a-4738-be77-ba5aff983673-kube-api-access-8nmp5 podName:73422f43-4d4a-4738-be77-ba5aff983673 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:20.362688076 +0000 UTC m=+3.076722634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8nmp5" (UniqueName: "kubernetes.io/projected/73422f43-4d4a-4738-be77-ba5aff983673-kube-api-access-8nmp5") pod "network-check-target-fqgzw" (UID: "73422f43-4d4a-4738-be77-ba5aff983673") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:19.863837 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.863768 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwqjc\" (UniqueName: \"kubernetes.io/projected/e1a7d3d7-8923-4451-b404-573d7c07b438-kube-api-access-gwqjc\") pod \"tuned-x9fkz\" (UID: \"e1a7d3d7-8923-4451-b404-573d7c07b438\") " pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:19.867479 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.867455 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5hdh\" (UniqueName: \"kubernetes.io/projected/f64e1ce6-4c88-4b72-b669-e4cf22ffc766-kube-api-access-v5hdh\") pod \"iptables-alerter-2pzcs\" (UID: \"f64e1ce6-4c88-4b72-b669-e4cf22ffc766\") " pod="openshift-network-operator/iptables-alerter-2pzcs" Jul 29 15:46:19.868126 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.868106 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wzrf\" (UniqueName: \"kubernetes.io/projected/d9d34b9d-2d38-4123-a642-3e433d36b23e-kube-api-access-6wzrf\") pod \"node-resolver-pw9xr\" (UID: \"d9d34b9d-2d38-4123-a642-3e433d36b23e\") " pod="openshift-dns/node-resolver-pw9xr" Jul 29 15:46:19.868644 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.868623 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scf5t\" (UniqueName: \"kubernetes.io/projected/f49f48c2-8c3b-4acb-91ea-88772241837e-kube-api-access-scf5t\") pod \"node-ca-wmtrp\" (UID: \"f49f48c2-8c3b-4acb-91ea-88772241837e\") " pod="openshift-image-registry/node-ca-wmtrp" Jul 29 15:46:19.872483 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.872453 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc2jp\" (UniqueName: \"kubernetes.io/projected/b3f46689-73a1-44b7-b437-339c9aaac015-kube-api-access-kc2jp\") pod \"multus-shxwt\" (UID: \"b3f46689-73a1-44b7-b437-339c9aaac015\") " pod="openshift-multus/multus-shxwt" Jul 29 15:46:19.881850 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.881828 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxdpx\" (UniqueName: \"kubernetes.io/projected/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-kube-api-access-jxdpx\") pod \"network-metrics-daemon-jchg2\" (UID: \"92a38651-6bb4-4f5a-9d97-8ac79e1027f4\") " pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:19.882694 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.882663 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfhpr\" (UniqueName: \"kubernetes.io/projected/46a6b55c-7a78-40b3-8adf-69daad654fda-kube-api-access-dfhpr\") pod \"ovnkube-node-4mfwv\" (UID: \"46a6b55c-7a78-40b3-8adf-69daad654fda\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:19.883143 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.883122 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b6bx\" (UniqueName: \"kubernetes.io/projected/d1157fa0-074e-42dd-ab0c-2193bf3a8909-kube-api-access-4b6bx\") pod \"aws-ebs-csi-driver-node-pgn76\" (UID: \"d1157fa0-074e-42dd-ab0c-2193bf3a8909\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" Jul 29 15:46:19.886729 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.886708 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vszlz" Jul 29 15:46:19.901152 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.901134 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vszlz" Jul 29 15:46:19.948582 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.948524 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/52405e2b-d7e9-42f3-a9ae-609e02a252a2-system-cni-dir\") pod \"multus-additional-cni-plugins-6q78m\" (UID: \"52405e2b-d7e9-42f3-a9ae-609e02a252a2\") " pod="openshift-multus/multus-additional-cni-plugins-6q78m" Jul 29 15:46:19.948740 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.948588 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/52405e2b-d7e9-42f3-a9ae-609e02a252a2-cni-binary-copy\") pod \"multus-additional-cni-plugins-6q78m\" (UID: \"52405e2b-d7e9-42f3-a9ae-609e02a252a2\") " pod="openshift-multus/multus-additional-cni-plugins-6q78m" Jul 29 15:46:19.948740 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.948625 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/52405e2b-d7e9-42f3-a9ae-609e02a252a2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6q78m\" (UID: \"52405e2b-d7e9-42f3-a9ae-609e02a252a2\") " pod="openshift-multus/multus-additional-cni-plugins-6q78m" Jul 29 15:46:19.948740 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.948651 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2gk8\" (UniqueName: \"kubernetes.io/projected/52405e2b-d7e9-42f3-a9ae-609e02a252a2-kube-api-access-x2gk8\") pod \"multus-additional-cni-plugins-6q78m\" (UID: \"52405e2b-d7e9-42f3-a9ae-609e02a252a2\") " pod="openshift-multus/multus-additional-cni-plugins-6q78m" Jul 29 15:46:19.948740 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.948686 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/52405e2b-d7e9-42f3-a9ae-609e02a252a2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6q78m\" (UID: \"52405e2b-d7e9-42f3-a9ae-609e02a252a2\") " pod="openshift-multus/multus-additional-cni-plugins-6q78m" Jul 29 15:46:19.948740 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.948710 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/52405e2b-d7e9-42f3-a9ae-609e02a252a2-cnibin\") pod \"multus-additional-cni-plugins-6q78m\" (UID: \"52405e2b-d7e9-42f3-a9ae-609e02a252a2\") " pod="openshift-multus/multus-additional-cni-plugins-6q78m" Jul 29 15:46:19.948740 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.948730 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/52405e2b-d7e9-42f3-a9ae-609e02a252a2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6q78m\" (UID: \"52405e2b-d7e9-42f3-a9ae-609e02a252a2\") " pod="openshift-multus/multus-additional-cni-plugins-6q78m" Jul 29 15:46:19.949056 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.948748 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/52405e2b-d7e9-42f3-a9ae-609e02a252a2-os-release\") pod \"multus-additional-cni-plugins-6q78m\" (UID: \"52405e2b-d7e9-42f3-a9ae-609e02a252a2\") " pod="openshift-multus/multus-additional-cni-plugins-6q78m" Jul 29 15:46:19.949056 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.948891 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/52405e2b-d7e9-42f3-a9ae-609e02a252a2-os-release\") pod \"multus-additional-cni-plugins-6q78m\" (UID: \"52405e2b-d7e9-42f3-a9ae-609e02a252a2\") " pod="openshift-multus/multus-additional-cni-plugins-6q78m" Jul 29 15:46:19.949056 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.948924 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/52405e2b-d7e9-42f3-a9ae-609e02a252a2-system-cni-dir\") pod \"multus-additional-cni-plugins-6q78m\" (UID: \"52405e2b-d7e9-42f3-a9ae-609e02a252a2\") " pod="openshift-multus/multus-additional-cni-plugins-6q78m" Jul 29 15:46:19.949191 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.949143 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/52405e2b-d7e9-42f3-a9ae-609e02a252a2-cnibin\") pod \"multus-additional-cni-plugins-6q78m\" (UID: \"52405e2b-d7e9-42f3-a9ae-609e02a252a2\") " pod="openshift-multus/multus-additional-cni-plugins-6q78m" Jul 29 15:46:19.949312 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.949295 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/52405e2b-d7e9-42f3-a9ae-609e02a252a2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6q78m\" (UID: \"52405e2b-d7e9-42f3-a9ae-609e02a252a2\") " pod="openshift-multus/multus-additional-cni-plugins-6q78m" Jul 29 15:46:19.949587 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.949567 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/52405e2b-d7e9-42f3-a9ae-609e02a252a2-cni-binary-copy\") pod \"multus-additional-cni-plugins-6q78m\" (UID: \"52405e2b-d7e9-42f3-a9ae-609e02a252a2\") " pod="openshift-multus/multus-additional-cni-plugins-6q78m" Jul 29 15:46:19.949676 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.949627 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/52405e2b-d7e9-42f3-a9ae-609e02a252a2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6q78m\" (UID: \"52405e2b-d7e9-42f3-a9ae-609e02a252a2\") " pod="openshift-multus/multus-additional-cni-plugins-6q78m" Jul 29 15:46:19.949676 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.949640 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/52405e2b-d7e9-42f3-a9ae-609e02a252a2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6q78m\" (UID: \"52405e2b-d7e9-42f3-a9ae-609e02a252a2\") " pod="openshift-multus/multus-additional-cni-plugins-6q78m" Jul 29 15:46:19.962807 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:19.962746 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2gk8\" (UniqueName: \"kubernetes.io/projected/52405e2b-d7e9-42f3-a9ae-609e02a252a2-kube-api-access-x2gk8\") pod \"multus-additional-cni-plugins-6q78m\" (UID: \"52405e2b-d7e9-42f3-a9ae-609e02a252a2\") " pod="openshift-multus/multus-additional-cni-plugins-6q78m" Jul 29 15:46:20.035115 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:20.035087 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wmtrp" Jul 29 15:46:20.041579 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:20.041556 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w22f7" Jul 29 15:46:20.051479 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:20.051458 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-shxwt" Jul 29 15:46:20.057915 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:20.057896 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" Jul 29 15:46:20.064996 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:20.064973 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" Jul 29 15:46:20.072603 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:20.072583 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pw9xr" Jul 29 15:46:20.081232 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:20.081214 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2pzcs" Jul 29 15:46:20.089802 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:20.089786 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:20.095962 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:20.095941 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6q78m" Jul 29 15:46:20.352370 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:20.352285 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-original-pull-secret\") pod \"global-pull-secret-syncer-kdc28\" (UID: \"d5e53580-c891-4bd3-8a76-ffcd74cb4ac5\") " pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:20.352370 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:20.352333 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-metrics-certs\") pod \"network-metrics-daemon-jchg2\" (UID: \"92a38651-6bb4-4f5a-9d97-8ac79e1027f4\") " pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:20.352549 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:20.352450 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:20.352549 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:20.352513 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-original-pull-secret podName:d5e53580-c891-4bd3-8a76-ffcd74cb4ac5 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:21.352499556 +0000 UTC m=+4.066534003 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-original-pull-secret") pod "global-pull-secret-syncer-kdc28" (UID: "d5e53580-c891-4bd3-8a76-ffcd74cb4ac5") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:20.352549 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:20.352450 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:20.352654 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:20.352584 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-metrics-certs podName:92a38651-6bb4-4f5a-9d97-8ac79e1027f4 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:21.352573508 +0000 UTC m=+4.066607950 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-metrics-certs") pod "network-metrics-daemon-jchg2" (UID: "92a38651-6bb4-4f5a-9d97-8ac79e1027f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:20.453404 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:20.453361 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nmp5\" (UniqueName: \"kubernetes.io/projected/73422f43-4d4a-4738-be77-ba5aff983673-kube-api-access-8nmp5\") pod \"network-check-target-fqgzw\" (UID: \"73422f43-4d4a-4738-be77-ba5aff983673\") " pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:46:20.453603 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:20.453559 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:46:20.453603 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:20.453584 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:46:20.453603 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:20.453595 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8nmp5 for pod openshift-network-diagnostics/network-check-target-fqgzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:20.453728 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:20.453647 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73422f43-4d4a-4738-be77-ba5aff983673-kube-api-access-8nmp5 podName:73422f43-4d4a-4738-be77-ba5aff983673 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:21.453634023 +0000 UTC m=+4.167668466 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8nmp5" (UniqueName: "kubernetes.io/projected/73422f43-4d4a-4738-be77-ba5aff983673-kube-api-access-8nmp5") pod "network-check-target-fqgzw" (UID: "73422f43-4d4a-4738-be77-ba5aff983673") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:20.689285 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:20.689256 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52405e2b_d7e9_42f3_a9ae_609e02a252a2.slice/crio-45392aec91b38f779023ebf348f77512b068582c99f9f89c099dc7d687622b57 WatchSource:0}: Error finding container 45392aec91b38f779023ebf348f77512b068582c99f9f89c099dc7d687622b57: Status 404 returned error can't find the container with id 45392aec91b38f779023ebf348f77512b068582c99f9f89c099dc7d687622b57 Jul 29 15:46:20.691251 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:20.691222 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf49f48c2_8c3b_4acb_91ea_88772241837e.slice/crio-cf0d1ea4db7b253b3cda76a59fb2629d911f5f79697bae053adf1ee6194634f5 WatchSource:0}: Error finding container cf0d1ea4db7b253b3cda76a59fb2629d911f5f79697bae053adf1ee6194634f5: Status 404 returned error can't find the container with id cf0d1ea4db7b253b3cda76a59fb2629d911f5f79697bae053adf1ee6194634f5 Jul 29 15:46:20.693649 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:20.693616 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9d34b9d_2d38_4123_a642_3e433d36b23e.slice/crio-fbe519c0ff1104f99169a6938fa045a722ebc80f47207aa01db45fa0e5417499 WatchSource:0}: Error finding container fbe519c0ff1104f99169a6938fa045a722ebc80f47207aa01db45fa0e5417499: Status 404 returned error can't find the container with id fbe519c0ff1104f99169a6938fa045a722ebc80f47207aa01db45fa0e5417499 Jul 29 15:46:20.694805 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:20.694785 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3f46689_73a1_44b7_b437_339c9aaac015.slice/crio-b18d36b66879d80fac65c5eba466833d54e0a56e78fbec174a29b88e0a156eaf WatchSource:0}: Error finding container b18d36b66879d80fac65c5eba466833d54e0a56e78fbec174a29b88e0a156eaf: Status 404 returned error can't find the container with id b18d36b66879d80fac65c5eba466833d54e0a56e78fbec174a29b88e0a156eaf Jul 29 15:46:20.696087 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:20.696039 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46a6b55c_7a78_40b3_8adf_69daad654fda.slice/crio-48028de3784ba7bf8298390400511734eef5efa40e88d9329cb968e1b0356c27 WatchSource:0}: Error finding container 48028de3784ba7bf8298390400511734eef5efa40e88d9329cb968e1b0356c27: Status 404 returned error can't find the container with id 48028de3784ba7bf8298390400511734eef5efa40e88d9329cb968e1b0356c27 Jul 29 15:46:20.697253 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:20.697219 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1a7d3d7_8923_4451_b404_573d7c07b438.slice/crio-3deb136173cfc7bf59d64f3b59a600912b7c358bdd4ead981301c6ce416f95dc WatchSource:0}: Error finding container 3deb136173cfc7bf59d64f3b59a600912b7c358bdd4ead981301c6ce416f95dc: Status 404 returned error can't find the container with id 3deb136173cfc7bf59d64f3b59a600912b7c358bdd4ead981301c6ce416f95dc Jul 29 15:46:20.698687 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:20.698018 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49da76ad_4692_4991_a6b4_6df2e9632377.slice/crio-250b811442bea6ed2b2998dd7e0be49dfad1724e3e3fd525971f4667d9fbfe49 WatchSource:0}: Error finding container 250b811442bea6ed2b2998dd7e0be49dfad1724e3e3fd525971f4667d9fbfe49: Status 404 returned error can't find the container with id 250b811442bea6ed2b2998dd7e0be49dfad1724e3e3fd525971f4667d9fbfe49 Jul 29 15:46:20.698824 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:20.698734 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1157fa0_074e_42dd_ab0c_2193bf3a8909.slice/crio-f0a6425c55b8adf3146b8b0de6257500b804e81925b3cccd32ad116a3c669960 WatchSource:0}: Error finding container f0a6425c55b8adf3146b8b0de6257500b804e81925b3cccd32ad116a3c669960: Status 404 returned error can't find the container with id f0a6425c55b8adf3146b8b0de6257500b804e81925b3cccd32ad116a3c669960 Jul 29 15:46:20.700427 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:20.700313 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf64e1ce6_4c88_4b72_b669_e4cf22ffc766.slice/crio-be035dfb566c8a43b1871aa94ea77c6d3a5f7a805e8b55a1219c3f4cd02bc7d0 WatchSource:0}: Error finding container be035dfb566c8a43b1871aa94ea77c6d3a5f7a805e8b55a1219c3f4cd02bc7d0: Status 404 returned error can't find the container with id be035dfb566c8a43b1871aa94ea77c6d3a5f7a805e8b55a1219c3f4cd02bc7d0 Jul 29 15:46:20.902844 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:20.902533 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wmtrp" event={"ID":"f49f48c2-8c3b-4acb-91ea-88772241837e","Type":"ContainerStarted","Data":"cf0d1ea4db7b253b3cda76a59fb2629d911f5f79697bae053adf1ee6194634f5"} Jul 29 15:46:20.903703 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:20.903683 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q78m" event={"ID":"52405e2b-d7e9-42f3-a9ae-609e02a252a2","Type":"ContainerStarted","Data":"45392aec91b38f779023ebf348f77512b068582c99f9f89c099dc7d687622b57"} Jul 29 15:46:20.903915 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:20.903886 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 15:41:19 +0000 UTC" deadline="2028-02-28 11:46:52.121423316 +0000 UTC" Jul 29 15:46:20.903915 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:20.903912 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13892h0m31.217514344s" Jul 29 15:46:20.905402 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:20.905380 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-163.ec2.internal" event={"ID":"d42b23c9b787526dd3bbeea8c76488c3","Type":"ContainerStarted","Data":"5716bb1febe37784d45febba29c706df40f71059fda05d1af1eef0a8bbb6b528"} Jul 29 15:46:20.906443 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:20.906422 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w22f7" event={"ID":"49da76ad-4692-4991-a6b4-6df2e9632377","Type":"ContainerStarted","Data":"250b811442bea6ed2b2998dd7e0be49dfad1724e3e3fd525971f4667d9fbfe49"} Jul 29 15:46:20.907433 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:20.907414 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" event={"ID":"e1a7d3d7-8923-4451-b404-573d7c07b438","Type":"ContainerStarted","Data":"3deb136173cfc7bf59d64f3b59a600912b7c358bdd4ead981301c6ce416f95dc"} Jul 29 15:46:20.908377 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:20.908359 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" event={"ID":"46a6b55c-7a78-40b3-8adf-69daad654fda","Type":"ContainerStarted","Data":"48028de3784ba7bf8298390400511734eef5efa40e88d9329cb968e1b0356c27"} Jul 29 15:46:20.909431 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:20.909407 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2pzcs" event={"ID":"f64e1ce6-4c88-4b72-b669-e4cf22ffc766","Type":"ContainerStarted","Data":"be035dfb566c8a43b1871aa94ea77c6d3a5f7a805e8b55a1219c3f4cd02bc7d0"} Jul 29 15:46:20.910415 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:20.910392 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" event={"ID":"d1157fa0-074e-42dd-ab0c-2193bf3a8909","Type":"ContainerStarted","Data":"f0a6425c55b8adf3146b8b0de6257500b804e81925b3cccd32ad116a3c669960"} Jul 29 15:46:20.911415 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:20.911397 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-shxwt" event={"ID":"b3f46689-73a1-44b7-b437-339c9aaac015","Type":"ContainerStarted","Data":"b18d36b66879d80fac65c5eba466833d54e0a56e78fbec174a29b88e0a156eaf"} Jul 29 15:46:20.912341 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:20.912324 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pw9xr" event={"ID":"d9d34b9d-2d38-4123-a642-3e433d36b23e","Type":"ContainerStarted","Data":"fbe519c0ff1104f99169a6938fa045a722ebc80f47207aa01db45fa0e5417499"} Jul 29 15:46:21.114465 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:21.114434 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:46:21.361337 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:21.361242 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-original-pull-secret\") pod \"global-pull-secret-syncer-kdc28\" (UID: \"d5e53580-c891-4bd3-8a76-ffcd74cb4ac5\") " pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:21.361337 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:21.361311 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-metrics-certs\") pod \"network-metrics-daemon-jchg2\" (UID: \"92a38651-6bb4-4f5a-9d97-8ac79e1027f4\") " pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:21.361586 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:21.361471 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:21.361586 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:21.361535 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-metrics-certs podName:92a38651-6bb4-4f5a-9d97-8ac79e1027f4 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:23.361515021 +0000 UTC m=+6.075549493 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-metrics-certs") pod "network-metrics-daemon-jchg2" (UID: "92a38651-6bb4-4f5a-9d97-8ac79e1027f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:21.361969 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:21.361950 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:21.362098 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:21.362085 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-original-pull-secret podName:d5e53580-c891-4bd3-8a76-ffcd74cb4ac5 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:23.362067048 +0000 UTC m=+6.076101491 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-original-pull-secret") pod "global-pull-secret-syncer-kdc28" (UID: "d5e53580-c891-4bd3-8a76-ffcd74cb4ac5") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:21.462134 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:21.462095 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nmp5\" (UniqueName: \"kubernetes.io/projected/73422f43-4d4a-4738-be77-ba5aff983673-kube-api-access-8nmp5\") pod \"network-check-target-fqgzw\" (UID: \"73422f43-4d4a-4738-be77-ba5aff983673\") " pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:46:21.462390 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:21.462313 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:46:21.462390 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:21.462331 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:46:21.462390 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:21.462344 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8nmp5 for pod openshift-network-diagnostics/network-check-target-fqgzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:21.462579 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:21.462402 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73422f43-4d4a-4738-be77-ba5aff983673-kube-api-access-8nmp5 podName:73422f43-4d4a-4738-be77-ba5aff983673 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:23.462384838 +0000 UTC m=+6.176419282 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8nmp5" (UniqueName: "kubernetes.io/projected/73422f43-4d4a-4738-be77-ba5aff983673-kube-api-access-8nmp5") pod "network-check-target-fqgzw" (UID: "73422f43-4d4a-4738-be77-ba5aff983673") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:21.896918 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:21.896235 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:46:21.896918 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:21.896356 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqgzw" podUID="73422f43-4d4a-4738-be77-ba5aff983673" Jul 29 15:46:21.896918 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:21.896762 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:21.896918 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:21.896871 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jchg2" podUID="92a38651-6bb4-4f5a-9d97-8ac79e1027f4" Jul 29 15:46:21.897513 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:21.897360 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:21.897513 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:21.897456 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kdc28" podUID="d5e53580-c891-4bd3-8a76-ffcd74cb4ac5" Jul 29 15:46:21.904939 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:21.904878 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 15:41:19 +0000 UTC" deadline="2028-03-21 02:28:51.442366375 +0000 UTC" Jul 29 15:46:21.904939 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:21.904922 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14410h42m29.537447667s" Jul 29 15:46:21.926690 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:21.926443 2554 generic.go:356] "Generic (PLEG): container finished" podID="3a4d1ff8d89d88b800599793a6e9934c" containerID="28c2b339597fd57ce2b4c1cde0fd4de9bd1b450e43dcd8ad56e2a4bebbeda15a" exitCode=0 Jul 29 15:46:21.926690 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:21.926596 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal" event={"ID":"3a4d1ff8d89d88b800599793a6e9934c","Type":"ContainerDied","Data":"28c2b339597fd57ce2b4c1cde0fd4de9bd1b450e43dcd8ad56e2a4bebbeda15a"} Jul 29 15:46:21.946925 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:21.945726 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-163.ec2.internal" podStartSLOduration=2.945709754 podStartE2EDuration="2.945709754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:46:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:20.929609229 +0000 UTC m=+3.643643693" watchObservedRunningTime="2026-07-29 15:46:21.945709754 +0000 UTC m=+4.659744220" Jul 29 15:46:22.939395 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:22.939301 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal" event={"ID":"3a4d1ff8d89d88b800599793a6e9934c","Type":"ContainerStarted","Data":"c0caf7d0379a72654fc2724f8f601d33b9eae5dbe38d2a2ac6e5066ab2e746ed"} Jul 29 15:46:23.378147 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:23.377340 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-original-pull-secret\") pod \"global-pull-secret-syncer-kdc28\" (UID: \"d5e53580-c891-4bd3-8a76-ffcd74cb4ac5\") " pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:23.378147 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:23.377407 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-metrics-certs\") pod \"network-metrics-daemon-jchg2\" (UID: \"92a38651-6bb4-4f5a-9d97-8ac79e1027f4\") " pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:23.378147 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:23.377575 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:23.378147 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:23.377642 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-metrics-certs podName:92a38651-6bb4-4f5a-9d97-8ac79e1027f4 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:27.377623915 +0000 UTC m=+10.091658360 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-metrics-certs") pod "network-metrics-daemon-jchg2" (UID: "92a38651-6bb4-4f5a-9d97-8ac79e1027f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:23.378147 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:23.377724 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:23.378147 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:23.377761 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-original-pull-secret podName:d5e53580-c891-4bd3-8a76-ffcd74cb4ac5 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:27.377750738 +0000 UTC m=+10.091785185 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-original-pull-secret") pod "global-pull-secret-syncer-kdc28" (UID: "d5e53580-c891-4bd3-8a76-ffcd74cb4ac5") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:23.479020 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:23.478408 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nmp5\" (UniqueName: \"kubernetes.io/projected/73422f43-4d4a-4738-be77-ba5aff983673-kube-api-access-8nmp5\") pod \"network-check-target-fqgzw\" (UID: \"73422f43-4d4a-4738-be77-ba5aff983673\") " pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:46:23.479020 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:23.478608 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:46:23.479020 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:23.478630 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:46:23.479020 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:23.478643 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8nmp5 for pod openshift-network-diagnostics/network-check-target-fqgzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:23.479020 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:23.478703 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73422f43-4d4a-4738-be77-ba5aff983673-kube-api-access-8nmp5 podName:73422f43-4d4a-4738-be77-ba5aff983673 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:27.478684444 +0000 UTC m=+10.192718887 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8nmp5" (UniqueName: "kubernetes.io/projected/73422f43-4d4a-4738-be77-ba5aff983673-kube-api-access-8nmp5") pod "network-check-target-fqgzw" (UID: "73422f43-4d4a-4738-be77-ba5aff983673") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:23.898998 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:23.896389 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:23.898998 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:23.896437 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:23.898998 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:23.896531 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jchg2" podUID="92a38651-6bb4-4f5a-9d97-8ac79e1027f4" Jul 29 15:46:23.898998 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:23.896611 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:46:23.898998 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:23.896717 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqgzw" podUID="73422f43-4d4a-4738-be77-ba5aff983673" Jul 29 15:46:23.898998 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:23.896802 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kdc28" podUID="d5e53580-c891-4bd3-8a76-ffcd74cb4ac5" Jul 29 15:46:25.896201 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:25.896170 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:25.896654 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:25.896179 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:46:25.896654 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:25.896289 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kdc28" podUID="d5e53580-c891-4bd3-8a76-ffcd74cb4ac5" Jul 29 15:46:25.896654 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:25.896393 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqgzw" podUID="73422f43-4d4a-4738-be77-ba5aff983673" Jul 29 15:46:25.896654 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:25.896439 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:25.896654 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:25.896494 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jchg2" podUID="92a38651-6bb4-4f5a-9d97-8ac79e1027f4" Jul 29 15:46:27.408802 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:27.408762 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-original-pull-secret\") pod \"global-pull-secret-syncer-kdc28\" (UID: \"d5e53580-c891-4bd3-8a76-ffcd74cb4ac5\") " pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:27.409264 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:27.408829 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-metrics-certs\") pod \"network-metrics-daemon-jchg2\" (UID: \"92a38651-6bb4-4f5a-9d97-8ac79e1027f4\") " pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:27.409264 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:27.408956 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:27.409264 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:27.409027 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-metrics-certs podName:92a38651-6bb4-4f5a-9d97-8ac79e1027f4 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:35.409006447 +0000 UTC m=+18.123040900 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-metrics-certs") pod "network-metrics-daemon-jchg2" (UID: "92a38651-6bb4-4f5a-9d97-8ac79e1027f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:27.409430 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:27.409398 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:27.409474 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:27.409444 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-original-pull-secret podName:d5e53580-c891-4bd3-8a76-ffcd74cb4ac5 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:35.409430666 +0000 UTC m=+18.123465114 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-original-pull-secret") pod "global-pull-secret-syncer-kdc28" (UID: "d5e53580-c891-4bd3-8a76-ffcd74cb4ac5") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:27.509833 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:27.509769 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nmp5\" (UniqueName: \"kubernetes.io/projected/73422f43-4d4a-4738-be77-ba5aff983673-kube-api-access-8nmp5\") pod \"network-check-target-fqgzw\" (UID: \"73422f43-4d4a-4738-be77-ba5aff983673\") " pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:46:27.510000 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:27.509939 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:46:27.510000 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:27.509964 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:46:27.510000 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:27.509976 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8nmp5 for pod openshift-network-diagnostics/network-check-target-fqgzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:27.510155 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:27.510037 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73422f43-4d4a-4738-be77-ba5aff983673-kube-api-access-8nmp5 podName:73422f43-4d4a-4738-be77-ba5aff983673 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:35.510018549 +0000 UTC m=+18.224053015 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8nmp5" (UniqueName: "kubernetes.io/projected/73422f43-4d4a-4738-be77-ba5aff983673-kube-api-access-8nmp5") pod "network-check-target-fqgzw" (UID: "73422f43-4d4a-4738-be77-ba5aff983673") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:27.897301 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:27.896491 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:46:27.897301 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:27.896640 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqgzw" podUID="73422f43-4d4a-4738-be77-ba5aff983673" Jul 29 15:46:27.897301 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:27.897002 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:27.897301 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:27.897108 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jchg2" podUID="92a38651-6bb4-4f5a-9d97-8ac79e1027f4" Jul 29 15:46:27.897301 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:27.897152 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:27.897301 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:27.897218 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kdc28" podUID="d5e53580-c891-4bd3-8a76-ffcd74cb4ac5" Jul 29 15:46:29.896439 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:29.895833 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:29.896439 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:29.895835 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:46:29.896439 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:29.896011 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kdc28" podUID="d5e53580-c891-4bd3-8a76-ffcd74cb4ac5" Jul 29 15:46:29.896439 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:29.896047 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqgzw" podUID="73422f43-4d4a-4738-be77-ba5aff983673" Jul 29 15:46:29.896439 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:29.895855 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:29.896439 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:29.896151 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jchg2" podUID="92a38651-6bb4-4f5a-9d97-8ac79e1027f4" Jul 29 15:46:31.896211 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:31.896177 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:46:31.896680 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:31.896194 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:31.896680 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:31.896302 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqgzw" podUID="73422f43-4d4a-4738-be77-ba5aff983673" Jul 29 15:46:31.896680 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:31.896310 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:31.896680 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:31.896413 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jchg2" podUID="92a38651-6bb4-4f5a-9d97-8ac79e1027f4" Jul 29 15:46:31.896680 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:31.896518 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kdc28" podUID="d5e53580-c891-4bd3-8a76-ffcd74cb4ac5" Jul 29 15:46:33.895814 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:33.895761 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:33.896315 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:33.895761 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:33.896315 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:33.895892 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jchg2" podUID="92a38651-6bb4-4f5a-9d97-8ac79e1027f4" Jul 29 15:46:33.896315 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:33.895907 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:46:33.896315 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:33.896001 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kdc28" podUID="d5e53580-c891-4bd3-8a76-ffcd74cb4ac5" Jul 29 15:46:33.896315 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:33.896075 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqgzw" podUID="73422f43-4d4a-4738-be77-ba5aff983673" Jul 29 15:46:35.464928 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:35.464891 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-original-pull-secret\") pod \"global-pull-secret-syncer-kdc28\" (UID: \"d5e53580-c891-4bd3-8a76-ffcd74cb4ac5\") " pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:35.465358 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:35.464953 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-metrics-certs\") pod \"network-metrics-daemon-jchg2\" (UID: \"92a38651-6bb4-4f5a-9d97-8ac79e1027f4\") " pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:35.465358 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:35.465055 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:35.465358 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:35.465066 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:35.465358 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:35.465118 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-original-pull-secret podName:d5e53580-c891-4bd3-8a76-ffcd74cb4ac5 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:51.465099571 +0000 UTC m=+34.179134033 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-original-pull-secret") pod "global-pull-secret-syncer-kdc28" (UID: "d5e53580-c891-4bd3-8a76-ffcd74cb4ac5") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:35.465358 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:35.465137 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-metrics-certs podName:92a38651-6bb4-4f5a-9d97-8ac79e1027f4 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:51.465127566 +0000 UTC m=+34.179162008 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-metrics-certs") pod "network-metrics-daemon-jchg2" (UID: "92a38651-6bb4-4f5a-9d97-8ac79e1027f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:35.566272 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:35.566241 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nmp5\" (UniqueName: \"kubernetes.io/projected/73422f43-4d4a-4738-be77-ba5aff983673-kube-api-access-8nmp5\") pod \"network-check-target-fqgzw\" (UID: \"73422f43-4d4a-4738-be77-ba5aff983673\") " pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:46:35.566442 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:35.566422 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:46:35.566524 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:35.566448 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:46:35.566524 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:35.566459 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8nmp5 for pod openshift-network-diagnostics/network-check-target-fqgzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:35.566649 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:35.566525 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73422f43-4d4a-4738-be77-ba5aff983673-kube-api-access-8nmp5 podName:73422f43-4d4a-4738-be77-ba5aff983673 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:51.566507211 +0000 UTC m=+34.280541669 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8nmp5" (UniqueName: "kubernetes.io/projected/73422f43-4d4a-4738-be77-ba5aff983673-kube-api-access-8nmp5") pod "network-check-target-fqgzw" (UID: "73422f43-4d4a-4738-be77-ba5aff983673") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:35.899064 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:35.898983 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:35.899064 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:35.899019 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:46:35.899064 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:35.899020 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:35.899262 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:35.899115 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jchg2" podUID="92a38651-6bb4-4f5a-9d97-8ac79e1027f4" Jul 29 15:46:35.899262 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:35.899177 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqgzw" podUID="73422f43-4d4a-4738-be77-ba5aff983673" Jul 29 15:46:35.899262 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:35.899231 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kdc28" podUID="d5e53580-c891-4bd3-8a76-ffcd74cb4ac5" Jul 29 15:46:37.896735 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:37.896699 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:46:37.897241 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:37.896801 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqgzw" podUID="73422f43-4d4a-4738-be77-ba5aff983673" Jul 29 15:46:37.897241 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:37.896894 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:37.897241 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:37.897013 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jchg2" podUID="92a38651-6bb4-4f5a-9d97-8ac79e1027f4" Jul 29 15:46:37.897241 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:37.897055 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:37.897241 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:37.897126 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kdc28" podUID="d5e53580-c891-4bd3-8a76-ffcd74cb4ac5" Jul 29 15:46:39.895890 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:39.895597 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:39.896575 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:39.895601 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:39.896575 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:39.895972 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kdc28" podUID="d5e53580-c891-4bd3-8a76-ffcd74cb4ac5" Jul 29 15:46:39.896575 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:39.896071 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jchg2" podUID="92a38651-6bb4-4f5a-9d97-8ac79e1027f4" Jul 29 15:46:39.896575 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:39.895606 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:46:39.896575 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:39.896167 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqgzw" podUID="73422f43-4d4a-4738-be77-ba5aff983673" Jul 29 15:46:39.972832 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:39.972791 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w22f7" event={"ID":"49da76ad-4692-4991-a6b4-6df2e9632377","Type":"ContainerStarted","Data":"e81c47c6eaa60613baca269111e9d4a3dccb6e61ac738f48b7aaf012f13503ca"} Jul 29 15:46:39.974405 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:39.974353 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" event={"ID":"e1a7d3d7-8923-4451-b404-573d7c07b438","Type":"ContainerStarted","Data":"0abd93045a347231adb8a3059e6e13f3dcf3c10de3798ebf733b28f329e7f7e5"} Jul 29 15:46:39.977693 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:39.977669 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" event={"ID":"46a6b55c-7a78-40b3-8adf-69daad654fda","Type":"ContainerStarted","Data":"200c738413291db1c890877d6ba398267b353feac3f779dcaf21152900946f8d"} Jul 29 15:46:39.977829 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:39.977744 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" event={"ID":"46a6b55c-7a78-40b3-8adf-69daad654fda","Type":"ContainerStarted","Data":"d83ade6e801e25c7c2e7b71c46ff24f958ca9a9bf7964a27389afb62720793f6"} Jul 29 15:46:39.977829 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:39.977791 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" event={"ID":"46a6b55c-7a78-40b3-8adf-69daad654fda","Type":"ContainerStarted","Data":"2a8366249397be0df40e5989f17fe5d40bc98ef2cc6a79b0fc994cb942efba97"} Jul 29 15:46:39.977942 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:39.977830 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" event={"ID":"46a6b55c-7a78-40b3-8adf-69daad654fda","Type":"ContainerStarted","Data":"6216eb780103d89487c66c7b3578e143611bec462ad0aaee1aa76dc556d143ee"} Jul 29 15:46:39.977942 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:39.977860 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" event={"ID":"46a6b55c-7a78-40b3-8adf-69daad654fda","Type":"ContainerStarted","Data":"893083b6265c9dca9a2ccdb0515c8c5b659dcc537ce7f9283ba9c58ce5ac959e"} Jul 29 15:46:39.977942 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:39.977888 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" event={"ID":"46a6b55c-7a78-40b3-8adf-69daad654fda","Type":"ContainerStarted","Data":"e1a319d33e83637aee9885f62ce18fce40a423b50e59cbdd5586fd19043969b9"} Jul 29 15:46:39.979331 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:39.979307 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" event={"ID":"d1157fa0-074e-42dd-ab0c-2193bf3a8909","Type":"ContainerStarted","Data":"446ca8a6bc278c8774456e82029d64b814e993f833a2091f38e218a6b0967a33"} Jul 29 15:46:39.980868 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:39.980845 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-shxwt" event={"ID":"b3f46689-73a1-44b7-b437-339c9aaac015","Type":"ContainerStarted","Data":"08bcf50b2b1ec7b0d7e05361bb52f4896d9fa8a1dfb47b43033e6ba1d4ff6008"} Jul 29 15:46:39.982283 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:39.982260 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pw9xr" event={"ID":"d9d34b9d-2d38-4123-a642-3e433d36b23e","Type":"ContainerStarted","Data":"b179c8c2d9e9b6cef2e7e700ff6d0824688c3bda1e5dba808cd7f74834703f30"} Jul 29 15:46:39.983644 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:39.983625 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wmtrp" event={"ID":"f49f48c2-8c3b-4acb-91ea-88772241837e","Type":"ContainerStarted","Data":"f0ca4576a2aeaf9ebad7cd726ea0c578f5021a0373d83e9f4b02b3a0b8466b5c"} Jul 29 15:46:39.985221 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:39.985199 2554 generic.go:356] "Generic (PLEG): container finished" podID="52405e2b-d7e9-42f3-a9ae-609e02a252a2" containerID="a7567aa653847fa067e3e3d2f98ed232f8b93276cd86a07ad78fb0cb919763b2" exitCode=0 Jul 29 15:46:39.985327 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:39.985230 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q78m" event={"ID":"52405e2b-d7e9-42f3-a9ae-609e02a252a2","Type":"ContainerDied","Data":"a7567aa653847fa067e3e3d2f98ed232f8b93276cd86a07ad78fb0cb919763b2"} Jul 29 15:46:39.992533 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:39.992491 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-163.ec2.internal" podStartSLOduration=20.992476528 podStartE2EDuration="20.992476528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:46:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:22.958234235 +0000 UTC m=+5.672268707" watchObservedRunningTime="2026-07-29 15:46:39.992476528 +0000 UTC m=+22.706510991" Jul 29 15:46:39.993318 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:39.993289 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-w22f7" podStartSLOduration=5.080100746 podStartE2EDuration="22.993277951s" totalImagesPullingTime="17.913177205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:39.992450517 +0000 UTC m=+22.706484980" watchObservedRunningTime="2026-07-29 15:46:39.993277951 +0000 UTC m=+22.707312417" Jul 29 15:46:40.043272 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:40.043192 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-shxwt" podStartSLOduration=4.437624853 podStartE2EDuration="23.0431786s" totalImagesPullingTime="18.605553747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:40.04273914 +0000 UTC m=+22.756773607" watchObservedRunningTime="2026-07-29 15:46:40.0431786 +0000 UTC m=+22.757213063" Jul 29 15:46:40.064966 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:40.064913 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x9fkz" podStartSLOduration=3.6768753 podStartE2EDuration="22.064895936s" totalImagesPullingTime="18.388020636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:46:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:40.064809802 +0000 UTC m=+22.778844294" watchObservedRunningTime="2026-07-29 15:46:40.064895936 +0000 UTC m=+22.778930400" Jul 29 15:46:40.089654 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:40.089617 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pw9xr" podStartSLOduration=3.698336822 podStartE2EDuration="22.089605419s" totalImagesPullingTime="18.391268597s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:46:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:40.089350124 +0000 UTC m=+22.803384586" watchObservedRunningTime="2026-07-29 15:46:40.089605419 +0000 UTC m=+22.803639884" Jul 29 15:46:40.486382 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:40.486360 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 29 15:46:40.793026 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:40.792815 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T15:46:40.486378167Z","UUID":"7dadcb12-569e-472e-8412-571030619843","Handler":null,"Name":"","Endpoint":""} Jul 29 15:46:40.794887 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:40.794732 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 29 15:46:40.794887 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:40.794775 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 29 15:46:40.988843 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:40.988804 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2pzcs" event={"ID":"f64e1ce6-4c88-4b72-b669-e4cf22ffc766","Type":"ContainerStarted","Data":"ad7823d90ad7552afac0d7b2f501d92fdebc5ac709734756b91352ffc7d1821d"} Jul 29 15:46:40.990950 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:40.990922 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" event={"ID":"d1157fa0-074e-42dd-ab0c-2193bf3a8909","Type":"ContainerStarted","Data":"47b2826ebb624ba385da94119c3929c51a38706a09046d9b1c200115084cb855"} Jul 29 15:46:41.005091 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:41.005023 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wmtrp" podStartSLOduration=5.612964806 podStartE2EDuration="24.005003881s" totalImagesPullingTime="18.392039075s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:40.116929848 +0000 UTC m=+22.830964312" watchObservedRunningTime="2026-07-29 15:46:41.005003881 +0000 UTC m=+23.719038324" Jul 29 15:46:41.005320 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:41.005286 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2pzcs" podStartSLOduration=4.652118877 podStartE2EDuration="23.005277328s" totalImagesPullingTime="18.353158451s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:46:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:41.004784531 +0000 UTC m=+23.718818996" watchObservedRunningTime="2026-07-29 15:46:41.005277328 +0000 UTC m=+23.719311793" Jul 29 15:46:41.743645 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:41.743605 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-w22f7" Jul 29 15:46:41.744269 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:41.744249 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-w22f7" Jul 29 15:46:41.895778 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:41.895732 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:41.895778 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:41.895733 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:46:41.895966 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:41.895794 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:41.895966 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:41.895892 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqgzw" podUID="73422f43-4d4a-4738-be77-ba5aff983673" Jul 29 15:46:41.896076 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:41.895977 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kdc28" podUID="d5e53580-c891-4bd3-8a76-ffcd74cb4ac5" Jul 29 15:46:41.896076 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:41.896018 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jchg2" podUID="92a38651-6bb4-4f5a-9d97-8ac79e1027f4" Jul 29 15:46:41.995060 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:41.995000 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" event={"ID":"d1157fa0-074e-42dd-ab0c-2193bf3a8909","Type":"ContainerStarted","Data":"216a8201e430b68e8d73360c03ae6ff777c9fc0517d8a6d66633b050ff08aaf6"} Jul 29 15:46:41.995459 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:41.995239 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-w22f7" Jul 29 15:46:41.995705 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:41.995686 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-w22f7" Jul 29 15:46:42.015104 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:42.015054 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgn76" podStartSLOduration=3.276524887 podStartE2EDuration="24.015039413s" totalImagesPullingTime="20.738514526s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:46:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:42.01458146 +0000 UTC m=+24.728615924" watchObservedRunningTime="2026-07-29 15:46:42.015039413 +0000 UTC m=+24.729073876" Jul 29 15:46:43.000755 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:43.000565 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" event={"ID":"46a6b55c-7a78-40b3-8adf-69daad654fda","Type":"ContainerStarted","Data":"608dcf113366124795bebd72c0985d01ed6129598641495f736aafad25cd2bc2"} Jul 29 15:46:43.895941 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:43.895890 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:43.895941 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:43.895918 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:43.896126 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:43.895890 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:46:43.896126 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:43.896008 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kdc28" podUID="d5e53580-c891-4bd3-8a76-ffcd74cb4ac5" Jul 29 15:46:43.896126 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:43.896066 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jchg2" podUID="92a38651-6bb4-4f5a-9d97-8ac79e1027f4" Jul 29 15:46:43.896220 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:43.896149 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqgzw" podUID="73422f43-4d4a-4738-be77-ba5aff983673" Jul 29 15:46:45.006624 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:45.006445 2554 generic.go:356] "Generic (PLEG): container finished" podID="52405e2b-d7e9-42f3-a9ae-609e02a252a2" containerID="a15c4d1a43aaedfce8eed2e5ee3d6d97a56a6439ca8dcff6b00485b74b945dc7" exitCode=0 Jul 29 15:46:45.007456 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:45.006524 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q78m" event={"ID":"52405e2b-d7e9-42f3-a9ae-609e02a252a2","Type":"ContainerDied","Data":"a15c4d1a43aaedfce8eed2e5ee3d6d97a56a6439ca8dcff6b00485b74b945dc7"} Jul 29 15:46:45.010396 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:45.010366 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" event={"ID":"46a6b55c-7a78-40b3-8adf-69daad654fda","Type":"ContainerStarted","Data":"f74b5799ff55d23d673987e1d9ae092124a9874d6e3bd0005cda6102857e1b66"} Jul 29 15:46:45.010671 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:45.010652 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:45.025881 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:45.025850 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:45.072121 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:45.072069 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" podStartSLOduration=8.643528968 podStartE2EDuration="27.072054925s" totalImagesPullingTime="18.428525957s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:46:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:45.072023588 +0000 UTC m=+27.786058050" watchObservedRunningTime="2026-07-29 15:46:45.072054925 +0000 UTC m=+27.786089388" Jul 29 15:46:45.896483 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:45.896454 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:45.896777 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:45.896455 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:46:45.896777 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:45.896595 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jchg2" podUID="92a38651-6bb4-4f5a-9d97-8ac79e1027f4" Jul 29 15:46:45.896777 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:45.896648 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:45.896777 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:45.896734 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqgzw" podUID="73422f43-4d4a-4738-be77-ba5aff983673" Jul 29 15:46:45.896968 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:45.896804 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kdc28" podUID="d5e53580-c891-4bd3-8a76-ffcd74cb4ac5" Jul 29 15:46:46.013913 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:46.013883 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:46.014311 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:46.013977 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:46.028339 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:46.028315 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:46:46.353912 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:46.353882 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kdc28"] Jul 29 15:46:46.354067 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:46.353983 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:46.354121 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:46.354081 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kdc28" podUID="d5e53580-c891-4bd3-8a76-ffcd74cb4ac5" Jul 29 15:46:46.357993 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:46.357934 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jchg2"] Jul 29 15:46:46.358136 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:46.358046 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:46.358195 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:46.358157 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jchg2" podUID="92a38651-6bb4-4f5a-9d97-8ac79e1027f4" Jul 29 15:46:46.358599 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:46.358579 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fqgzw"] Jul 29 15:46:46.358709 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:46.358665 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:46:46.358781 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:46.358760 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqgzw" podUID="73422f43-4d4a-4738-be77-ba5aff983673" Jul 29 15:46:47.896513 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:47.896473 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:46:47.897071 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:47.896556 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:47.897071 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:47.896566 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqgzw" podUID="73422f43-4d4a-4738-be77-ba5aff983673" Jul 29 15:46:47.897071 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:47.896648 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kdc28" podUID="d5e53580-c891-4bd3-8a76-ffcd74cb4ac5" Jul 29 15:46:47.897071 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:47.896657 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:47.897071 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:47.896734 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jchg2" podUID="92a38651-6bb4-4f5a-9d97-8ac79e1027f4" Jul 29 15:46:48.019724 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:48.019694 2554 generic.go:356] "Generic (PLEG): container finished" podID="52405e2b-d7e9-42f3-a9ae-609e02a252a2" containerID="5107a2c7e767d9f891074694dab554dca0ba52d73254c88764648901bc1738db" exitCode=0 Jul 29 15:46:48.019871 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:48.019783 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q78m" event={"ID":"52405e2b-d7e9-42f3-a9ae-609e02a252a2","Type":"ContainerDied","Data":"5107a2c7e767d9f891074694dab554dca0ba52d73254c88764648901bc1738db"} Jul 29 15:46:49.895978 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:49.895941 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:49.896425 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:49.895941 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:49.896425 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:49.895941 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:46:49.896425 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:49.896079 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jchg2" podUID="92a38651-6bb4-4f5a-9d97-8ac79e1027f4" Jul 29 15:46:49.896425 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:49.896134 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kdc28" podUID="d5e53580-c891-4bd3-8a76-ffcd74cb4ac5" Jul 29 15:46:49.896425 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:49.896198 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqgzw" podUID="73422f43-4d4a-4738-be77-ba5aff983673" Jul 29 15:46:50.025901 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:50.025866 2554 generic.go:356] "Generic (PLEG): container finished" podID="52405e2b-d7e9-42f3-a9ae-609e02a252a2" containerID="13e016c1f1bb8d971fe3c098bbc23f7cf737114930539a889eecf02edd5b987d" exitCode=0 Jul 29 15:46:50.026189 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:50.025936 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q78m" event={"ID":"52405e2b-d7e9-42f3-a9ae-609e02a252a2","Type":"ContainerDied","Data":"13e016c1f1bb8d971fe3c098bbc23f7cf737114930539a889eecf02edd5b987d"} Jul 29 15:46:51.484378 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:51.484340 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-metrics-certs\") pod \"network-metrics-daemon-jchg2\" (UID: \"92a38651-6bb4-4f5a-9d97-8ac79e1027f4\") " pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:51.484912 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:51.484422 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-original-pull-secret\") pod \"global-pull-secret-syncer-kdc28\" (UID: \"d5e53580-c891-4bd3-8a76-ffcd74cb4ac5\") " pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:51.484912 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:51.484562 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:51.484912 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:51.484638 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-original-pull-secret podName:d5e53580-c891-4bd3-8a76-ffcd74cb4ac5 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:23.48462181 +0000 UTC m=+66.198656256 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-original-pull-secret") pod "global-pull-secret-syncer-kdc28" (UID: "d5e53580-c891-4bd3-8a76-ffcd74cb4ac5") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:46:51.484912 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:51.484568 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:51.484912 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:51.484700 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-metrics-certs podName:92a38651-6bb4-4f5a-9d97-8ac79e1027f4 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:23.484686255 +0000 UTC m=+66.198720708 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-metrics-certs") pod "network-metrics-daemon-jchg2" (UID: "92a38651-6bb4-4f5a-9d97-8ac79e1027f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:46:51.585438 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:51.585402 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nmp5\" (UniqueName: \"kubernetes.io/projected/73422f43-4d4a-4738-be77-ba5aff983673-kube-api-access-8nmp5\") pod \"network-check-target-fqgzw\" (UID: \"73422f43-4d4a-4738-be77-ba5aff983673\") " pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:46:51.585626 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:51.585559 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:46:51.585626 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:51.585576 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:46:51.585626 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:51.585587 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8nmp5 for pod openshift-network-diagnostics/network-check-target-fqgzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:51.585787 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:51.585642 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73422f43-4d4a-4738-be77-ba5aff983673-kube-api-access-8nmp5 podName:73422f43-4d4a-4738-be77-ba5aff983673 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:23.585624798 +0000 UTC m=+66.299659241 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8nmp5" (UniqueName: "kubernetes.io/projected/73422f43-4d4a-4738-be77-ba5aff983673-kube-api-access-8nmp5") pod "network-check-target-fqgzw" (UID: "73422f43-4d4a-4738-be77-ba5aff983673") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:46:51.896497 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:51.896417 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:46:51.896677 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:51.896525 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqgzw" podUID="73422f43-4d4a-4738-be77-ba5aff983673" Jul 29 15:46:51.896785 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:51.896757 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:51.896900 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:51.896883 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jchg2" podUID="92a38651-6bb4-4f5a-9d97-8ac79e1027f4" Jul 29 15:46:51.896948 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:51.896931 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:51.897036 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:51.897013 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kdc28" podUID="d5e53580-c891-4bd3-8a76-ffcd74cb4ac5" Jul 29 15:46:52.117468 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.117439 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-163.ec2.internal" event="NodeReady" Jul 29 15:46:52.117661 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.117613 2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 29 15:46:52.177324 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.177130 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-794786757-89ml8"] Jul 29 15:46:52.179358 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.179338 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:52.183123 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.183105 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 29 15:46:52.183412 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.183388 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-p9xsx\"" Jul 29 15:46:52.183412 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.183405 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 29 15:46:52.192243 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.189579 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 29 15:46:52.195188 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.195165 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 29 15:46:52.212150 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.212123 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cdv86"] Jul 29 15:46:52.214060 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.214039 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2m6gl"] Jul 29 15:46:52.214195 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.214171 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cdv86" Jul 29 15:46:52.215691 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.215671 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2m6gl" Jul 29 15:46:52.218830 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.218807 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 29 15:46:52.219451 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.219432 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 29 15:46:52.219605 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.219589 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l689t\"" Jul 29 15:46:52.219653 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.219634 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-794786757-89ml8"] Jul 29 15:46:52.219871 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.219858 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 29 15:46:52.221582 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.221561 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 29 15:46:52.221665 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.221616 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-796d6\"" Jul 29 15:46:52.238737 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.238715 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 29 15:46:52.257523 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.257496 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2m6gl"] Jul 29 15:46:52.263753 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.263725 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cdv86"] Jul 29 15:46:52.291960 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.291924 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/184a4db0-e00b-4e60-84bc-96dffd559d6e-metrics-tls\") pod \"dns-default-cdv86\" (UID: \"184a4db0-e00b-4e60-84bc-96dffd559d6e\") " pod="openshift-dns/dns-default-cdv86" Jul 29 15:46:52.292117 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.291978 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/78144aa9-485b-4141-af15-bec828994442-image-registry-private-configuration\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:52.292117 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.292019 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/184a4db0-e00b-4e60-84bc-96dffd559d6e-config-volume\") pod \"dns-default-cdv86\" (UID: \"184a4db0-e00b-4e60-84bc-96dffd559d6e\") " pod="openshift-dns/dns-default-cdv86" Jul 29 15:46:52.292117 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.292044 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/78144aa9-485b-4141-af15-bec828994442-registry-certificates\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:52.292117 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.292093 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjcx7\" (UniqueName: \"kubernetes.io/projected/184a4db0-e00b-4e60-84bc-96dffd559d6e-kube-api-access-wjcx7\") pod \"dns-default-cdv86\" (UID: \"184a4db0-e00b-4e60-84bc-96dffd559d6e\") " pod="openshift-dns/dns-default-cdv86" Jul 29 15:46:52.292380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.292133 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-registry-tls\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:52.292380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.292161 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkps4\" (UniqueName: \"kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-kube-api-access-jkps4\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:52.292380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.292187 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51ff4873-720e-4b87-ab6e-9b54928d8fdc-cert\") pod \"ingress-canary-2m6gl\" (UID: \"51ff4873-720e-4b87-ab6e-9b54928d8fdc\") " pod="openshift-ingress-canary/ingress-canary-2m6gl" Jul 29 15:46:52.292380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.292212 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/78144aa9-485b-4141-af15-bec828994442-ca-trust-extracted\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:52.292380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.292236 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/78144aa9-485b-4141-af15-bec828994442-installation-pull-secrets\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:52.292380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.292268 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/184a4db0-e00b-4e60-84bc-96dffd559d6e-tmp-dir\") pod \"dns-default-cdv86\" (UID: \"184a4db0-e00b-4e60-84bc-96dffd559d6e\") " pod="openshift-dns/dns-default-cdv86" Jul 29 15:46:52.292380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.292294 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/78144aa9-485b-4141-af15-bec828994442-trusted-ca\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:52.292380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.292340 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-bound-sa-token\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:52.292662 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.292388 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zwxb\" (UniqueName: \"kubernetes.io/projected/51ff4873-720e-4b87-ab6e-9b54928d8fdc-kube-api-access-7zwxb\") pod \"ingress-canary-2m6gl\" (UID: \"51ff4873-720e-4b87-ab6e-9b54928d8fdc\") " pod="openshift-ingress-canary/ingress-canary-2m6gl" Jul 29 15:46:52.393228 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.393186 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51ff4873-720e-4b87-ab6e-9b54928d8fdc-cert\") pod \"ingress-canary-2m6gl\" (UID: \"51ff4873-720e-4b87-ab6e-9b54928d8fdc\") " pod="openshift-ingress-canary/ingress-canary-2m6gl" Jul 29 15:46:52.393414 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.393248 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/78144aa9-485b-4141-af15-bec828994442-ca-trust-extracted\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:52.393414 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.393275 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/78144aa9-485b-4141-af15-bec828994442-installation-pull-secrets\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:52.393414 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.393307 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/184a4db0-e00b-4e60-84bc-96dffd559d6e-tmp-dir\") pod \"dns-default-cdv86\" (UID: \"184a4db0-e00b-4e60-84bc-96dffd559d6e\") " pod="openshift-dns/dns-default-cdv86" Jul 29 15:46:52.393414 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.393333 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/78144aa9-485b-4141-af15-bec828994442-trusted-ca\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:52.393414 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.393371 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-bound-sa-token\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:52.393414 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.393409 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zwxb\" (UniqueName: \"kubernetes.io/projected/51ff4873-720e-4b87-ab6e-9b54928d8fdc-kube-api-access-7zwxb\") pod \"ingress-canary-2m6gl\" (UID: \"51ff4873-720e-4b87-ab6e-9b54928d8fdc\") " pod="openshift-ingress-canary/ingress-canary-2m6gl" Jul 29 15:46:52.393749 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.393447 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/184a4db0-e00b-4e60-84bc-96dffd559d6e-metrics-tls\") pod \"dns-default-cdv86\" (UID: \"184a4db0-e00b-4e60-84bc-96dffd559d6e\") " pod="openshift-dns/dns-default-cdv86" Jul 29 15:46:52.393749 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.393488 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/78144aa9-485b-4141-af15-bec828994442-image-registry-private-configuration\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:52.393749 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.393528 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/184a4db0-e00b-4e60-84bc-96dffd559d6e-config-volume\") pod \"dns-default-cdv86\" (UID: \"184a4db0-e00b-4e60-84bc-96dffd559d6e\") " pod="openshift-dns/dns-default-cdv86" Jul 29 15:46:52.393749 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.393573 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/78144aa9-485b-4141-af15-bec828994442-registry-certificates\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:52.393749 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.393614 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjcx7\" (UniqueName: \"kubernetes.io/projected/184a4db0-e00b-4e60-84bc-96dffd559d6e-kube-api-access-wjcx7\") pod \"dns-default-cdv86\" (UID: \"184a4db0-e00b-4e60-84bc-96dffd559d6e\") " pod="openshift-dns/dns-default-cdv86" Jul 29 15:46:52.393749 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.393640 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-registry-tls\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:52.393749 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.393666 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkps4\" (UniqueName: \"kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-kube-api-access-jkps4\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:52.393749 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.393715 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/184a4db0-e00b-4e60-84bc-96dffd559d6e-tmp-dir\") pod \"dns-default-cdv86\" (UID: \"184a4db0-e00b-4e60-84bc-96dffd559d6e\") " pod="openshift-dns/dns-default-cdv86" Jul 29 15:46:52.394117 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:52.394039 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 15:46:52.394117 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:52.394055 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-794786757-89ml8: secret "image-registry-tls" not found Jul 29 15:46:52.394117 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:52.394108 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-registry-tls podName:78144aa9-485b-4141-af15-bec828994442 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:52.89409161 +0000 UTC m=+35.608126069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-registry-tls") pod "image-registry-794786757-89ml8" (UID: "78144aa9-485b-4141-af15-bec828994442") : secret "image-registry-tls" not found Jul 29 15:46:52.394273 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:52.394124 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:46:52.394273 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:52.394175 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/184a4db0-e00b-4e60-84bc-96dffd559d6e-metrics-tls podName:184a4db0-e00b-4e60-84bc-96dffd559d6e nodeName:}" failed. No retries permitted until 2026-07-29 15:46:52.894158808 +0000 UTC m=+35.608193258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/184a4db0-e00b-4e60-84bc-96dffd559d6e-metrics-tls") pod "dns-default-cdv86" (UID: "184a4db0-e00b-4e60-84bc-96dffd559d6e") : secret "dns-default-metrics-tls" not found Jul 29 15:46:52.394391 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.394303 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/184a4db0-e00b-4e60-84bc-96dffd559d6e-config-volume\") pod \"dns-default-cdv86\" (UID: \"184a4db0-e00b-4e60-84bc-96dffd559d6e\") " pod="openshift-dns/dns-default-cdv86" Jul 29 15:46:52.394448 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.394430 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/78144aa9-485b-4141-af15-bec828994442-trusted-ca\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:52.394503 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.394483 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/78144aa9-485b-4141-af15-bec828994442-registry-certificates\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:52.394795 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.394718 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/78144aa9-485b-4141-af15-bec828994442-ca-trust-extracted\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:52.397924 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.397904 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/78144aa9-485b-4141-af15-bec828994442-installation-pull-secrets\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:52.398023 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.397936 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/78144aa9-485b-4141-af15-bec828994442-image-registry-private-configuration\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:52.398023 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.397964 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51ff4873-720e-4b87-ab6e-9b54928d8fdc-cert\") pod \"ingress-canary-2m6gl\" (UID: \"51ff4873-720e-4b87-ab6e-9b54928d8fdc\") " pod="openshift-ingress-canary/ingress-canary-2m6gl" Jul 29 15:46:52.414822 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.414759 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-bound-sa-token\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:52.414961 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.414850 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zwxb\" (UniqueName: \"kubernetes.io/projected/51ff4873-720e-4b87-ab6e-9b54928d8fdc-kube-api-access-7zwxb\") pod \"ingress-canary-2m6gl\" (UID: \"51ff4873-720e-4b87-ab6e-9b54928d8fdc\") " pod="openshift-ingress-canary/ingress-canary-2m6gl" Jul 29 15:46:52.415031 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.415010 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkps4\" (UniqueName: \"kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-kube-api-access-jkps4\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:52.416177 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.416158 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjcx7\" (UniqueName: \"kubernetes.io/projected/184a4db0-e00b-4e60-84bc-96dffd559d6e-kube-api-access-wjcx7\") pod \"dns-default-cdv86\" (UID: \"184a4db0-e00b-4e60-84bc-96dffd559d6e\") " pod="openshift-dns/dns-default-cdv86" Jul 29 15:46:52.498030 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.497920 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w22f7_49da76ad-4692-4991-a6b4-6df2e9632377/konnectivity-agent/0.log" limit=1024 Jul 29 15:46:52.531987 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.531949 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2m6gl" Jul 29 15:46:52.613026 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.612922 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w22f7_49da76ad-4692-4991-a6b4-6df2e9632377/konnectivity-agent/0.log" limit=1024 Jul 29 15:46:52.898406 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.898320 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/184a4db0-e00b-4e60-84bc-96dffd559d6e-metrics-tls\") pod \"dns-default-cdv86\" (UID: \"184a4db0-e00b-4e60-84bc-96dffd559d6e\") " pod="openshift-dns/dns-default-cdv86" Jul 29 15:46:52.898579 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:52.898412 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-registry-tls\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:52.898579 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:52.898486 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:46:52.898700 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:52.898582 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 15:46:52.898700 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:52.898595 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/184a4db0-e00b-4e60-84bc-96dffd559d6e-metrics-tls podName:184a4db0-e00b-4e60-84bc-96dffd559d6e nodeName:}" failed. No retries permitted until 2026-07-29 15:46:53.898573936 +0000 UTC m=+36.612608384 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/184a4db0-e00b-4e60-84bc-96dffd559d6e-metrics-tls") pod "dns-default-cdv86" (UID: "184a4db0-e00b-4e60-84bc-96dffd559d6e") : secret "dns-default-metrics-tls" not found Jul 29 15:46:52.898700 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:52.898603 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-794786757-89ml8: secret "image-registry-tls" not found Jul 29 15:46:52.898700 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:52.898667 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-registry-tls podName:78144aa9-485b-4141-af15-bec828994442 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:53.898651005 +0000 UTC m=+36.612685462 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-registry-tls") pod "image-registry-794786757-89ml8" (UID: "78144aa9-485b-4141-af15-bec828994442") : secret "image-registry-tls" not found Jul 29 15:46:53.896079 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:53.896041 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:46:53.896628 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:53.896041 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:46:53.896628 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:53.896048 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:46:53.901136 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:53.899494 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9brzs\"" Jul 29 15:46:53.901651 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:53.901410 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 15:46:53.901651 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:53.901491 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mdhwr\"" Jul 29 15:46:53.901651 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:53.901505 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 15:46:53.901651 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:53.901577 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 15:46:53.902263 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:53.902242 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 15:46:53.908603 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:53.908583 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/184a4db0-e00b-4e60-84bc-96dffd559d6e-metrics-tls\") pod \"dns-default-cdv86\" (UID: \"184a4db0-e00b-4e60-84bc-96dffd559d6e\") " pod="openshift-dns/dns-default-cdv86" Jul 29 15:46:53.908760 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:53.908745 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:46:53.908828 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:53.908822 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/184a4db0-e00b-4e60-84bc-96dffd559d6e-metrics-tls podName:184a4db0-e00b-4e60-84bc-96dffd559d6e nodeName:}" failed. No retries permitted until 2026-07-29 15:46:55.908802073 +0000 UTC m=+38.622836516 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/184a4db0-e00b-4e60-84bc-96dffd559d6e-metrics-tls") pod "dns-default-cdv86" (UID: "184a4db0-e00b-4e60-84bc-96dffd559d6e") : secret "dns-default-metrics-tls" not found Jul 29 15:46:53.908886 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:53.908846 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-registry-tls\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:53.909204 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:53.908999 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 15:46:53.909204 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:53.909013 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-794786757-89ml8: secret "image-registry-tls" not found Jul 29 15:46:53.909204 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:53.909070 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-registry-tls podName:78144aa9-485b-4141-af15-bec828994442 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:55.909055759 +0000 UTC m=+38.623090204 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-registry-tls") pod "image-registry-794786757-89ml8" (UID: "78144aa9-485b-4141-af15-bec828994442") : secret "image-registry-tls" not found Jul 29 15:46:54.029771 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:54.029745 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2m6gl"] Jul 29 15:46:54.033922 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:46:54.033895 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ff4873_720e_4b87_ab6e_9b54928d8fdc.slice/crio-52cd0e42cbc7f04e04caaef85d7cec6b7e8856caa0121c84d36b9eb9249d7b60 WatchSource:0}: Error finding container 52cd0e42cbc7f04e04caaef85d7cec6b7e8856caa0121c84d36b9eb9249d7b60: Status 404 returned error can't find the container with id 52cd0e42cbc7f04e04caaef85d7cec6b7e8856caa0121c84d36b9eb9249d7b60 Jul 29 15:46:54.041214 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:54.041187 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q78m" event={"ID":"52405e2b-d7e9-42f3-a9ae-609e02a252a2","Type":"ContainerStarted","Data":"2e969f72f3a2c7c9917cd1a20d6e3e6604b75785e88cd91c000cf03363e4f0c2"} Jul 29 15:46:54.042513 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:54.042480 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2m6gl" event={"ID":"51ff4873-720e-4b87-ab6e-9b54928d8fdc","Type":"ContainerStarted","Data":"52cd0e42cbc7f04e04caaef85d7cec6b7e8856caa0121c84d36b9eb9249d7b60"} Jul 29 15:46:55.048020 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:55.047986 2554 generic.go:356] "Generic (PLEG): container finished" podID="52405e2b-d7e9-42f3-a9ae-609e02a252a2" containerID="2e969f72f3a2c7c9917cd1a20d6e3e6604b75785e88cd91c000cf03363e4f0c2" exitCode=0 Jul 29 15:46:55.048454 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:55.048036 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q78m" event={"ID":"52405e2b-d7e9-42f3-a9ae-609e02a252a2","Type":"ContainerDied","Data":"2e969f72f3a2c7c9917cd1a20d6e3e6604b75785e88cd91c000cf03363e4f0c2"} Jul 29 15:46:55.923125 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:55.923094 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/184a4db0-e00b-4e60-84bc-96dffd559d6e-metrics-tls\") pod \"dns-default-cdv86\" (UID: \"184a4db0-e00b-4e60-84bc-96dffd559d6e\") " pod="openshift-dns/dns-default-cdv86" Jul 29 15:46:55.923252 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:55.923228 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:46:55.923304 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:55.923257 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-registry-tls\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:55.923360 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:55.923306 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/184a4db0-e00b-4e60-84bc-96dffd559d6e-metrics-tls podName:184a4db0-e00b-4e60-84bc-96dffd559d6e nodeName:}" failed. No retries permitted until 2026-07-29 15:46:59.923286153 +0000 UTC m=+42.637320614 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/184a4db0-e00b-4e60-84bc-96dffd559d6e-metrics-tls") pod "dns-default-cdv86" (UID: "184a4db0-e00b-4e60-84bc-96dffd559d6e") : secret "dns-default-metrics-tls" not found Jul 29 15:46:55.923414 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:55.923369 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 15:46:55.923414 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:55.923384 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-794786757-89ml8: secret "image-registry-tls" not found Jul 29 15:46:55.923492 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:55.923441 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-registry-tls podName:78144aa9-485b-4141-af15-bec828994442 nodeName:}" failed. No retries permitted until 2026-07-29 15:46:59.923425827 +0000 UTC m=+42.637460287 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-registry-tls") pod "image-registry-794786757-89ml8" (UID: "78144aa9-485b-4141-af15-bec828994442") : secret "image-registry-tls" not found Jul 29 15:46:56.053721 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:56.053688 2554 generic.go:356] "Generic (PLEG): container finished" podID="52405e2b-d7e9-42f3-a9ae-609e02a252a2" containerID="137f79af62b7bf0e21133aa57b1a92f8b6d7c9925de3a0706fbc300c73264a98" exitCode=0 Jul 29 15:46:56.054183 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:56.053753 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q78m" event={"ID":"52405e2b-d7e9-42f3-a9ae-609e02a252a2","Type":"ContainerDied","Data":"137f79af62b7bf0e21133aa57b1a92f8b6d7c9925de3a0706fbc300c73264a98"} Jul 29 15:46:57.059003 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:57.058974 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q78m" event={"ID":"52405e2b-d7e9-42f3-a9ae-609e02a252a2","Type":"ContainerStarted","Data":"db493950165f7158153245e9ab24aa4b8a4971055a72a059e013e50b5866bef2"} Jul 29 15:46:57.086694 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:57.086647 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6q78m" podStartSLOduration=9.353290712 podStartE2EDuration="39.086631337s" totalImagesPullingTime="29.733340625s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:46:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:57.085033583 +0000 UTC m=+39.799068047" watchObservedRunningTime="2026-07-29 15:46:57.086631337 +0000 UTC m=+39.800665800" Jul 29 15:46:57.212899 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:57.212851 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w22f7_49da76ad-4692-4991-a6b4-6df2e9632377/konnectivity-agent/0.log" limit=1024 Jul 29 15:46:57.312291 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:57.312208 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w22f7_49da76ad-4692-4991-a6b4-6df2e9632377/konnectivity-agent/0.log" limit=1024 Jul 29 15:46:57.379008 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:57.378976 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w22f7_49da76ad-4692-4991-a6b4-6df2e9632377/konnectivity-agent/0.log" limit=1024 Jul 29 15:46:58.063005 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:58.062965 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2m6gl" event={"ID":"51ff4873-720e-4b87-ab6e-9b54928d8fdc","Type":"ContainerStarted","Data":"ff5c1b53d20497b0402bd8db91c9e9490f308125f03d03a810c991a16387cdeb"} Jul 29 15:46:58.080472 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:58.080425 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2m6gl" podStartSLOduration=3.10204112 podStartE2EDuration="6.080412052s" totalImagesPullingTime="2.978370932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:46:58.079772594 +0000 UTC m=+40.793807057" watchObservedRunningTime="2026-07-29 15:46:58.080412052 +0000 UTC m=+40.794446515" Jul 29 15:46:59.954246 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:59.954195 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-registry-tls\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:46:59.954711 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:46:59.954272 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/184a4db0-e00b-4e60-84bc-96dffd559d6e-metrics-tls\") pod \"dns-default-cdv86\" (UID: \"184a4db0-e00b-4e60-84bc-96dffd559d6e\") " pod="openshift-dns/dns-default-cdv86" Jul 29 15:46:59.954711 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:59.954374 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:46:59.954711 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:59.954380 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 15:46:59.954711 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:59.954401 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-794786757-89ml8: secret "image-registry-tls" not found Jul 29 15:46:59.954711 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:59.954424 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/184a4db0-e00b-4e60-84bc-96dffd559d6e-metrics-tls podName:184a4db0-e00b-4e60-84bc-96dffd559d6e nodeName:}" failed. No retries permitted until 2026-07-29 15:47:07.954411504 +0000 UTC m=+50.668445946 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/184a4db0-e00b-4e60-84bc-96dffd559d6e-metrics-tls") pod "dns-default-cdv86" (UID: "184a4db0-e00b-4e60-84bc-96dffd559d6e") : secret "dns-default-metrics-tls" not found Jul 29 15:46:59.954711 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:46:59.954455 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-registry-tls podName:78144aa9-485b-4141-af15-bec828994442 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:07.954439761 +0000 UTC m=+50.668474204 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-registry-tls") pod "image-registry-794786757-89ml8" (UID: "78144aa9-485b-4141-af15-bec828994442") : secret "image-registry-tls" not found Jul 29 15:47:00.962003 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:00.961968 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w22f7_49da76ad-4692-4991-a6b4-6df2e9632377/konnectivity-agent/0.log" limit=1024 Jul 29 15:47:01.038900 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:01.038863 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w22f7_49da76ad-4692-4991-a6b4-6df2e9632377/konnectivity-agent/0.log" limit=1024 Jul 29 15:47:01.334910 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:01.334827 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w22f7_49da76ad-4692-4991-a6b4-6df2e9632377/konnectivity-agent/0.log" limit=1024 Jul 29 15:47:01.960964 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:01.960930 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w22f7_49da76ad-4692-4991-a6b4-6df2e9632377/konnectivity-agent/0.log" limit=1024 Jul 29 15:47:02.029913 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:02.029881 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w22f7_49da76ad-4692-4991-a6b4-6df2e9632377/konnectivity-agent/0.log" limit=1024 Jul 29 15:47:03.500498 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:03.500465 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w22f7_49da76ad-4692-4991-a6b4-6df2e9632377/konnectivity-agent/0.log" limit=1024 Jul 29 15:47:03.600348 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:03.600317 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w22f7_49da76ad-4692-4991-a6b4-6df2e9632377/konnectivity-agent/0.log" limit=1024 Jul 29 15:47:03.999579 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:03.999529 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w22f7_49da76ad-4692-4991-a6b4-6df2e9632377/konnectivity-agent/0.log" limit=1024 Jul 29 15:47:08.014080 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:08.014035 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/184a4db0-e00b-4e60-84bc-96dffd559d6e-metrics-tls\") pod \"dns-default-cdv86\" (UID: \"184a4db0-e00b-4e60-84bc-96dffd559d6e\") " pod="openshift-dns/dns-default-cdv86" Jul 29 15:47:08.014508 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:08.014105 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-registry-tls\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:47:08.014508 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:08.014195 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:47:08.014508 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:08.014271 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/184a4db0-e00b-4e60-84bc-96dffd559d6e-metrics-tls podName:184a4db0-e00b-4e60-84bc-96dffd559d6e nodeName:}" failed. No retries permitted until 2026-07-29 15:47:24.014253836 +0000 UTC m=+66.728288279 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/184a4db0-e00b-4e60-84bc-96dffd559d6e-metrics-tls") pod "dns-default-cdv86" (UID: "184a4db0-e00b-4e60-84bc-96dffd559d6e") : secret "dns-default-metrics-tls" not found Jul 29 15:47:08.014508 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:08.014203 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 15:47:08.014508 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:08.014297 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-794786757-89ml8: secret "image-registry-tls" not found Jul 29 15:47:08.014508 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:08.014338 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-registry-tls podName:78144aa9-485b-4141-af15-bec828994442 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:24.014327451 +0000 UTC m=+66.728361893 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-registry-tls") pod "image-registry-794786757-89ml8" (UID: "78144aa9-485b-4141-af15-bec828994442") : secret "image-registry-tls" not found Jul 29 15:47:09.405271 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.405233 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4kzf8"] Jul 29 15:47:09.418335 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.418302 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4kzf8" Jul 29 15:47:09.418659 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.418632 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4kzf8"] Jul 29 15:47:09.421174 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.421147 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 29 15:47:09.421304 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.421284 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 29 15:47:09.421370 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.421363 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 29 15:47:09.422677 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.422653 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 29 15:47:09.422773 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.422675 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-9czp7\"" Jul 29 15:47:09.508165 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.508126 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-ccdn7"] Jul 29 15:47:09.526594 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.526561 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6f9fb4469f-8dzw8"] Jul 29 15:47:09.526808 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.526654 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-ccdn7" Jul 29 15:47:09.526980 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.526949 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e64886a0-bd69-40f8-8ac3-b6184100d5d2-config\") pod \"service-ca-operator-5d6c75f84f-4kzf8\" (UID: \"e64886a0-bd69-40f8-8ac3-b6184100d5d2\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4kzf8" Jul 29 15:47:09.527099 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.527009 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcwfj\" (UniqueName: \"kubernetes.io/projected/e64886a0-bd69-40f8-8ac3-b6184100d5d2-kube-api-access-pcwfj\") pod \"service-ca-operator-5d6c75f84f-4kzf8\" (UID: \"e64886a0-bd69-40f8-8ac3-b6184100d5d2\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4kzf8" Jul 29 15:47:09.527099 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.527068 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e64886a0-bd69-40f8-8ac3-b6184100d5d2-serving-cert\") pod \"service-ca-operator-5d6c75f84f-4kzf8\" (UID: \"e64886a0-bd69-40f8-8ac3-b6184100d5d2\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4kzf8" Jul 29 15:47:09.529061 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.529040 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-rf5mt\"" Jul 29 15:47:09.540525 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.540505 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-ccdn7"] Jul 29 15:47:09.540629 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.540553 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f9fb4469f-8dzw8"] Jul 29 15:47:09.540629 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.540615 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:09.543273 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.543253 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 29 15:47:09.543273 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.543264 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 29 15:47:09.543609 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.543594 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 29 15:47:09.543684 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.543649 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 29 15:47:09.543684 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.543596 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 29 15:47:09.543786 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.543681 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 29 15:47:09.543786 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.543729 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tfpf7\"" Jul 29 15:47:09.609032 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.608999 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76"] Jul 29 15:47:09.627687 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.627652 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e64886a0-bd69-40f8-8ac3-b6184100d5d2-config\") pod \"service-ca-operator-5d6c75f84f-4kzf8\" (UID: \"e64886a0-bd69-40f8-8ac3-b6184100d5d2\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4kzf8" Jul 29 15:47:09.627687 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.627689 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9qnl\" (UniqueName: \"kubernetes.io/projected/a5d66c78-cfc3-436a-b338-6934d8d86b22-kube-api-access-h9qnl\") pod \"network-check-source-7d88cb55d8-ccdn7\" (UID: \"a5d66c78-cfc3-436a-b338-6934d8d86b22\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-ccdn7" Jul 29 15:47:09.627883 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.627720 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcwfj\" (UniqueName: \"kubernetes.io/projected/e64886a0-bd69-40f8-8ac3-b6184100d5d2-kube-api-access-pcwfj\") pod \"service-ca-operator-5d6c75f84f-4kzf8\" (UID: \"e64886a0-bd69-40f8-8ac3-b6184100d5d2\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4kzf8" Jul 29 15:47:09.627883 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.627750 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e64886a0-bd69-40f8-8ac3-b6184100d5d2-serving-cert\") pod \"service-ca-operator-5d6c75f84f-4kzf8\" (UID: \"e64886a0-bd69-40f8-8ac3-b6184100d5d2\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4kzf8" Jul 29 15:47:09.632024 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.631981 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e64886a0-bd69-40f8-8ac3-b6184100d5d2-serving-cert\") pod \"service-ca-operator-5d6c75f84f-4kzf8\" (UID: \"e64886a0-bd69-40f8-8ac3-b6184100d5d2\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4kzf8" Jul 29 15:47:09.634605 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.634572 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-mr76j"] Jul 29 15:47:09.634750 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.634718 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76" Jul 29 15:47:09.638371 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.638162 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 29 15:47:09.638371 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.638170 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 29 15:47:09.638371 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.638242 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 29 15:47:09.638371 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.638281 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 29 15:47:09.638371 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.638315 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rm8vd\"" Jul 29 15:47:09.638902 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.638884 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e64886a0-bd69-40f8-8ac3-b6184100d5d2-config\") pod \"service-ca-operator-5d6c75f84f-4kzf8\" (UID: \"e64886a0-bd69-40f8-8ac3-b6184100d5d2\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4kzf8" Jul 29 15:47:09.642149 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.642129 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcwfj\" (UniqueName: \"kubernetes.io/projected/e64886a0-bd69-40f8-8ac3-b6184100d5d2-kube-api-access-pcwfj\") pod \"service-ca-operator-5d6c75f84f-4kzf8\" (UID: \"e64886a0-bd69-40f8-8ac3-b6184100d5d2\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4kzf8" Jul 29 15:47:09.656895 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.656847 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-b74zp"] Jul 29 15:47:09.656987 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.656955 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-mr76j" Jul 29 15:47:09.659641 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.659623 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 29 15:47:09.659641 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.659632 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-r4l9n\"" Jul 29 15:47:09.659804 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.659662 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 29 15:47:09.676970 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.676947 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-cpw78"] Jul 29 15:47:09.677126 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.677083 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-b74zp" Jul 29 15:47:09.680276 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.680234 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 29 15:47:09.680759 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.680729 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-prjhj\"" Jul 29 15:47:09.680870 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.680848 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 29 15:47:09.681194 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.681175 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 29 15:47:09.693229 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.693168 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 29 15:47:09.695193 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.695169 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76"] Jul 29 15:47:09.695304 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.695202 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-mr76j"] Jul 29 15:47:09.695304 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.695223 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-b74zp"] Jul 29 15:47:09.695304 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.695242 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-cpw78"] Jul 29 15:47:09.695304 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.695285 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-cpw78" Jul 29 15:47:09.698038 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.698021 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 29 15:47:09.698374 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.698357 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 29 15:47:09.698645 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.698629 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-q9s2c\"" Jul 29 15:47:09.698909 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.698895 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 29 15:47:09.699120 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.699100 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 29 15:47:09.704059 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.704040 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 29 15:47:09.711096 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.711074 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gtbm5"] Jul 29 15:47:09.725286 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.725262 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-ndcms"] Jul 29 15:47:09.725436 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.725385 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gtbm5" Jul 29 15:47:09.727607 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.727587 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4kzf8" Jul 29 15:47:09.728209 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.728186 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9qnl\" (UniqueName: \"kubernetes.io/projected/a5d66c78-cfc3-436a-b338-6934d8d86b22-kube-api-access-h9qnl\") pod \"network-check-source-7d88cb55d8-ccdn7\" (UID: \"a5d66c78-cfc3-436a-b338-6934d8d86b22\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-ccdn7" Jul 29 15:47:09.728358 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.728338 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5lfx\" (UniqueName: \"kubernetes.io/projected/73aeab81-faab-4712-968c-ab8ee7b67e10-kube-api-access-s5lfx\") pod \"router-default-6f9fb4469f-8dzw8\" (UID: \"73aeab81-faab-4712-968c-ab8ee7b67e10\") " pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:09.728489 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.728472 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/73aeab81-faab-4712-968c-ab8ee7b67e10-default-certificate\") pod \"router-default-6f9fb4469f-8dzw8\" (UID: \"73aeab81-faab-4712-968c-ab8ee7b67e10\") " pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:09.728620 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.728604 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73aeab81-faab-4712-968c-ab8ee7b67e10-metrics-certs\") pod \"router-default-6f9fb4469f-8dzw8\" (UID: \"73aeab81-faab-4712-968c-ab8ee7b67e10\") " pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:09.728762 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.728737 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/73aeab81-faab-4712-968c-ab8ee7b67e10-stats-auth\") pod \"router-default-6f9fb4469f-8dzw8\" (UID: \"73aeab81-faab-4712-968c-ab8ee7b67e10\") " pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:09.728866 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.728791 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 29 15:47:09.728866 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.728806 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73aeab81-faab-4712-968c-ab8ee7b67e10-service-ca-bundle\") pod \"router-default-6f9fb4469f-8dzw8\" (UID: \"73aeab81-faab-4712-968c-ab8ee7b67e10\") " pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:09.729016 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.728996 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 29 15:47:09.729101 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.729056 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 29 15:47:09.729289 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.729274 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-b2mb7\"" Jul 29 15:47:09.737184 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.737164 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gtbm5"] Jul 29 15:47:09.737291 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.737195 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-ndcms"] Jul 29 15:47:09.737354 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.737286 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-ndcms" Jul 29 15:47:09.740055 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.740033 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 29 15:47:09.740055 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.740060 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 29 15:47:09.740222 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.740120 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-42nzv\"" Jul 29 15:47:09.740222 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.740064 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 29 15:47:09.740322 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.740272 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9qnl\" (UniqueName: \"kubernetes.io/projected/a5d66c78-cfc3-436a-b338-6934d8d86b22-kube-api-access-h9qnl\") pod \"network-check-source-7d88cb55d8-ccdn7\" (UID: \"a5d66c78-cfc3-436a-b338-6934d8d86b22\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-ccdn7" Jul 29 15:47:09.740387 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.740372 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 29 15:47:09.745697 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.745671 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 29 15:47:09.830218 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.830182 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1d31deb-30f5-4af3-abeb-1d20733a12d1-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76\" (UID: \"d1d31deb-30f5-4af3-abeb-1d20733a12d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76" Jul 29 15:47:09.830349 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.830230 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b5c5993-07f9-4c76-b552-108228b1dfa8-tmp\") pod \"insights-operator-5885fdb759-cpw78\" (UID: \"5b5c5993-07f9-4c76-b552-108228b1dfa8\") " pod="openshift-insights/insights-operator-5885fdb759-cpw78" Jul 29 15:47:09.830349 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.830260 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfgbs\" (UniqueName: \"kubernetes.io/projected/5b5c5993-07f9-4c76-b552-108228b1dfa8-kube-api-access-dfgbs\") pod \"insights-operator-5885fdb759-cpw78\" (UID: \"5b5c5993-07f9-4c76-b552-108228b1dfa8\") " pod="openshift-insights/insights-operator-5885fdb759-cpw78" Jul 29 15:47:09.830349 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.830291 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d1d31deb-30f5-4af3-abeb-1d20733a12d1-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76\" (UID: \"d1d31deb-30f5-4af3-abeb-1d20733a12d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76" Jul 29 15:47:09.830349 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.830320 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b5c5993-07f9-4c76-b552-108228b1dfa8-serving-cert\") pod \"insights-operator-5885fdb759-cpw78\" (UID: \"5b5c5993-07f9-4c76-b552-108228b1dfa8\") " pod="openshift-insights/insights-operator-5885fdb759-cpw78" Jul 29 15:47:09.830349 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.830344 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bkbp\" (UniqueName: \"kubernetes.io/projected/acf996c0-566b-4eda-ba21-2542c991a168-kube-api-access-2bkbp\") pod \"volume-data-source-validator-549c6d54cf-mr76j\" (UID: \"acf996c0-566b-4eda-ba21-2542c991a168\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-mr76j" Jul 29 15:47:09.830565 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.830457 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b5c5993-07f9-4c76-b552-108228b1dfa8-service-ca-bundle\") pod \"insights-operator-5885fdb759-cpw78\" (UID: \"5b5c5993-07f9-4c76-b552-108228b1dfa8\") " pod="openshift-insights/insights-operator-5885fdb759-cpw78" Jul 29 15:47:09.830608 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.830570 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g777s\" (UniqueName: \"kubernetes.io/projected/d1d31deb-30f5-4af3-abeb-1d20733a12d1-kube-api-access-g777s\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76\" (UID: \"d1d31deb-30f5-4af3-abeb-1d20733a12d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76" Jul 29 15:47:09.830645 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.830628 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5lfx\" (UniqueName: \"kubernetes.io/projected/73aeab81-faab-4712-968c-ab8ee7b67e10-kube-api-access-s5lfx\") pod \"router-default-6f9fb4469f-8dzw8\" (UID: \"73aeab81-faab-4712-968c-ab8ee7b67e10\") " pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:09.830691 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.830670 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b5c5993-07f9-4c76-b552-108228b1dfa8-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-cpw78\" (UID: \"5b5c5993-07f9-4c76-b552-108228b1dfa8\") " pod="openshift-insights/insights-operator-5885fdb759-cpw78" Jul 29 15:47:09.830728 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.830714 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgszc\" (UniqueName: \"kubernetes.io/projected/9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4-kube-api-access-cgszc\") pod \"cluster-samples-operator-6748489656-gtbm5\" (UID: \"9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gtbm5" Jul 29 15:47:09.830766 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.830746 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/73aeab81-faab-4712-968c-ab8ee7b67e10-default-certificate\") pod \"router-default-6f9fb4469f-8dzw8\" (UID: \"73aeab81-faab-4712-968c-ab8ee7b67e10\") " pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:09.830766 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.830763 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5b5c5993-07f9-4c76-b552-108228b1dfa8-snapshots\") pod \"insights-operator-5885fdb759-cpw78\" (UID: \"5b5c5993-07f9-4c76-b552-108228b1dfa8\") " pod="openshift-insights/insights-operator-5885fdb759-cpw78" Jul 29 15:47:09.830862 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.830785 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73aeab81-faab-4712-968c-ab8ee7b67e10-metrics-certs\") pod \"router-default-6f9fb4469f-8dzw8\" (UID: \"73aeab81-faab-4712-968c-ab8ee7b67e10\") " pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:09.830862 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.830822 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2dfbf7d0-c804-4516-b8e7-926c7e521e6c-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-b74zp\" (UID: \"2dfbf7d0-c804-4516-b8e7-926c7e521e6c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-b74zp" Jul 29 15:47:09.830955 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.830889 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2dfbf7d0-c804-4516-b8e7-926c7e521e6c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-b74zp\" (UID: \"2dfbf7d0-c804-4516-b8e7-926c7e521e6c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-b74zp" Jul 29 15:47:09.831002 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.830949 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/73aeab81-faab-4712-968c-ab8ee7b67e10-stats-auth\") pod \"router-default-6f9fb4469f-8dzw8\" (UID: \"73aeab81-faab-4712-968c-ab8ee7b67e10\") " pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:09.831002 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.830976 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-gtbm5\" (UID: \"9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gtbm5" Jul 29 15:47:09.831094 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.831010 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73aeab81-faab-4712-968c-ab8ee7b67e10-service-ca-bundle\") pod \"router-default-6f9fb4469f-8dzw8\" (UID: \"73aeab81-faab-4712-968c-ab8ee7b67e10\") " pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:09.831094 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.831036 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8swxb\" (UniqueName: \"kubernetes.io/projected/2dfbf7d0-c804-4516-b8e7-926c7e521e6c-kube-api-access-8swxb\") pod \"cluster-monitoring-operator-548b489cb8-b74zp\" (UID: \"2dfbf7d0-c804-4516-b8e7-926c7e521e6c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-b74zp" Jul 29 15:47:09.831256 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:09.831239 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73aeab81-faab-4712-968c-ab8ee7b67e10-service-ca-bundle podName:73aeab81-faab-4712-968c-ab8ee7b67e10 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:10.33121771 +0000 UTC m=+53.045252156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/73aeab81-faab-4712-968c-ab8ee7b67e10-service-ca-bundle") pod "router-default-6f9fb4469f-8dzw8" (UID: "73aeab81-faab-4712-968c-ab8ee7b67e10") : configmap references non-existent config key: service-ca.crt Jul 29 15:47:09.831529 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:09.831513 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 15:47:09.831603 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:09.831592 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73aeab81-faab-4712-968c-ab8ee7b67e10-metrics-certs podName:73aeab81-faab-4712-968c-ab8ee7b67e10 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:10.331575677 +0000 UTC m=+53.045610126 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73aeab81-faab-4712-968c-ab8ee7b67e10-metrics-certs") pod "router-default-6f9fb4469f-8dzw8" (UID: "73aeab81-faab-4712-968c-ab8ee7b67e10") : secret "router-metrics-certs-default" not found Jul 29 15:47:09.834172 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.834149 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/73aeab81-faab-4712-968c-ab8ee7b67e10-default-certificate\") pod \"router-default-6f9fb4469f-8dzw8\" (UID: \"73aeab81-faab-4712-968c-ab8ee7b67e10\") " pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:09.834266 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.834173 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/73aeab81-faab-4712-968c-ab8ee7b67e10-stats-auth\") pod \"router-default-6f9fb4469f-8dzw8\" (UID: \"73aeab81-faab-4712-968c-ab8ee7b67e10\") " pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:09.835839 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.835822 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-ccdn7" Jul 29 15:47:09.847104 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.847081 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5lfx\" (UniqueName: \"kubernetes.io/projected/73aeab81-faab-4712-968c-ab8ee7b67e10-kube-api-access-s5lfx\") pod \"router-default-6f9fb4469f-8dzw8\" (UID: \"73aeab81-faab-4712-968c-ab8ee7b67e10\") " pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:09.863722 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.863698 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4kzf8"] Jul 29 15:47:09.867246 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:47:09.867217 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode64886a0_bd69_40f8_8ac3_b6184100d5d2.slice/crio-b8349cd51ad9bb708adee0124ddb8d8b4725220ae5a09269ad1442b28fc44a28 WatchSource:0}: Error finding container b8349cd51ad9bb708adee0124ddb8d8b4725220ae5a09269ad1442b28fc44a28: Status 404 returned error can't find the container with id b8349cd51ad9bb708adee0124ddb8d8b4725220ae5a09269ad1442b28fc44a28 Jul 29 15:47:09.932238 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.932204 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b5c5993-07f9-4c76-b552-108228b1dfa8-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-cpw78\" (UID: \"5b5c5993-07f9-4c76-b552-108228b1dfa8\") " pod="openshift-insights/insights-operator-5885fdb759-cpw78" Jul 29 15:47:09.932361 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.932256 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgszc\" (UniqueName: \"kubernetes.io/projected/9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4-kube-api-access-cgszc\") pod \"cluster-samples-operator-6748489656-gtbm5\" (UID: \"9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gtbm5" Jul 29 15:47:09.932361 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.932298 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5b5c5993-07f9-4c76-b552-108228b1dfa8-snapshots\") pod \"insights-operator-5885fdb759-cpw78\" (UID: \"5b5c5993-07f9-4c76-b552-108228b1dfa8\") " pod="openshift-insights/insights-operator-5885fdb759-cpw78" Jul 29 15:47:09.932361 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.932331 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9qlb\" (UniqueName: \"kubernetes.io/projected/5257faa4-46cf-45e5-b609-a414b4fd90af-kube-api-access-b9qlb\") pod \"console-operator-584dcb6b54-ndcms\" (UID: \"5257faa4-46cf-45e5-b609-a414b4fd90af\") " pod="openshift-console-operator/console-operator-584dcb6b54-ndcms" Jul 29 15:47:09.932491 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.932387 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2dfbf7d0-c804-4516-b8e7-926c7e521e6c-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-b74zp\" (UID: \"2dfbf7d0-c804-4516-b8e7-926c7e521e6c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-b74zp" Jul 29 15:47:09.932491 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.932416 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2dfbf7d0-c804-4516-b8e7-926c7e521e6c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-b74zp\" (UID: \"2dfbf7d0-c804-4516-b8e7-926c7e521e6c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-b74zp" Jul 29 15:47:09.932491 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.932456 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-gtbm5\" (UID: \"9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gtbm5" Jul 29 15:47:09.932658 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.932518 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8swxb\" (UniqueName: \"kubernetes.io/projected/2dfbf7d0-c804-4516-b8e7-926c7e521e6c-kube-api-access-8swxb\") pod \"cluster-monitoring-operator-548b489cb8-b74zp\" (UID: \"2dfbf7d0-c804-4516-b8e7-926c7e521e6c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-b74zp" Jul 29 15:47:09.932658 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.932567 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5257faa4-46cf-45e5-b609-a414b4fd90af-serving-cert\") pod \"console-operator-584dcb6b54-ndcms\" (UID: \"5257faa4-46cf-45e5-b609-a414b4fd90af\") " pod="openshift-console-operator/console-operator-584dcb6b54-ndcms" Jul 29 15:47:09.932658 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.932614 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1d31deb-30f5-4af3-abeb-1d20733a12d1-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76\" (UID: \"d1d31deb-30f5-4af3-abeb-1d20733a12d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76" Jul 29 15:47:09.932658 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.932646 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b5c5993-07f9-4c76-b552-108228b1dfa8-tmp\") pod \"insights-operator-5885fdb759-cpw78\" (UID: \"5b5c5993-07f9-4c76-b552-108228b1dfa8\") " pod="openshift-insights/insights-operator-5885fdb759-cpw78" Jul 29 15:47:09.932852 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.932670 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfgbs\" (UniqueName: \"kubernetes.io/projected/5b5c5993-07f9-4c76-b552-108228b1dfa8-kube-api-access-dfgbs\") pod \"insights-operator-5885fdb759-cpw78\" (UID: \"5b5c5993-07f9-4c76-b552-108228b1dfa8\") " pod="openshift-insights/insights-operator-5885fdb759-cpw78" Jul 29 15:47:09.932852 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.932707 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d1d31deb-30f5-4af3-abeb-1d20733a12d1-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76\" (UID: \"d1d31deb-30f5-4af3-abeb-1d20733a12d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76" Jul 29 15:47:09.932852 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.932740 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b5c5993-07f9-4c76-b552-108228b1dfa8-serving-cert\") pod \"insights-operator-5885fdb759-cpw78\" (UID: \"5b5c5993-07f9-4c76-b552-108228b1dfa8\") " pod="openshift-insights/insights-operator-5885fdb759-cpw78" Jul 29 15:47:09.932852 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.932768 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bkbp\" (UniqueName: \"kubernetes.io/projected/acf996c0-566b-4eda-ba21-2542c991a168-kube-api-access-2bkbp\") pod \"volume-data-source-validator-549c6d54cf-mr76j\" (UID: \"acf996c0-566b-4eda-ba21-2542c991a168\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-mr76j" Jul 29 15:47:09.932852 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.932822 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5257faa4-46cf-45e5-b609-a414b4fd90af-trusted-ca\") pod \"console-operator-584dcb6b54-ndcms\" (UID: \"5257faa4-46cf-45e5-b609-a414b4fd90af\") " pod="openshift-console-operator/console-operator-584dcb6b54-ndcms" Jul 29 15:47:09.933113 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.932885 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b5c5993-07f9-4c76-b552-108228b1dfa8-service-ca-bundle\") pod \"insights-operator-5885fdb759-cpw78\" (UID: \"5b5c5993-07f9-4c76-b552-108228b1dfa8\") " pod="openshift-insights/insights-operator-5885fdb759-cpw78" Jul 29 15:47:09.933113 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.932945 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5257faa4-46cf-45e5-b609-a414b4fd90af-config\") pod \"console-operator-584dcb6b54-ndcms\" (UID: \"5257faa4-46cf-45e5-b609-a414b4fd90af\") " pod="openshift-console-operator/console-operator-584dcb6b54-ndcms" Jul 29 15:47:09.933113 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.932987 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g777s\" (UniqueName: \"kubernetes.io/projected/d1d31deb-30f5-4af3-abeb-1d20733a12d1-kube-api-access-g777s\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76\" (UID: \"d1d31deb-30f5-4af3-abeb-1d20733a12d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76" Jul 29 15:47:09.933113 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.933058 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5b5c5993-07f9-4c76-b552-108228b1dfa8-snapshots\") pod \"insights-operator-5885fdb759-cpw78\" (UID: \"5b5c5993-07f9-4c76-b552-108228b1dfa8\") " pod="openshift-insights/insights-operator-5885fdb759-cpw78" Jul 29 15:47:09.933310 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.933214 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2dfbf7d0-c804-4516-b8e7-926c7e521e6c-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-b74zp\" (UID: \"2dfbf7d0-c804-4516-b8e7-926c7e521e6c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-b74zp" Jul 29 15:47:09.933310 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:09.933286 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 15:47:09.933415 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:09.933313 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 15:47:09.933415 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:09.933341 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dfbf7d0-c804-4516-b8e7-926c7e521e6c-cluster-monitoring-operator-tls podName:2dfbf7d0-c804-4516-b8e7-926c7e521e6c nodeName:}" failed. No retries permitted until 2026-07-29 15:47:10.433325064 +0000 UTC m=+53.147359507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2dfbf7d0-c804-4516-b8e7-926c7e521e6c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-b74zp" (UID: "2dfbf7d0-c804-4516-b8e7-926c7e521e6c") : secret "cluster-monitoring-operator-tls" not found Jul 29 15:47:09.933415 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:09.933363 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4-samples-operator-tls podName:9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:10.433347842 +0000 UTC m=+53.147382289 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4-samples-operator-tls") pod "cluster-samples-operator-6748489656-gtbm5" (UID: "9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4") : secret "samples-operator-tls" not found Jul 29 15:47:09.933983 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.933766 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b5c5993-07f9-4c76-b552-108228b1dfa8-tmp\") pod \"insights-operator-5885fdb759-cpw78\" (UID: \"5b5c5993-07f9-4c76-b552-108228b1dfa8\") " pod="openshift-insights/insights-operator-5885fdb759-cpw78" Jul 29 15:47:09.933983 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.933775 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b5c5993-07f9-4c76-b552-108228b1dfa8-service-ca-bundle\") pod \"insights-operator-5885fdb759-cpw78\" (UID: \"5b5c5993-07f9-4c76-b552-108228b1dfa8\") " pod="openshift-insights/insights-operator-5885fdb759-cpw78" Jul 29 15:47:09.933983 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.933851 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b5c5993-07f9-4c76-b552-108228b1dfa8-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-cpw78\" (UID: \"5b5c5993-07f9-4c76-b552-108228b1dfa8\") " pod="openshift-insights/insights-operator-5885fdb759-cpw78" Jul 29 15:47:09.934192 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.934054 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d1d31deb-30f5-4af3-abeb-1d20733a12d1-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76\" (UID: \"d1d31deb-30f5-4af3-abeb-1d20733a12d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76" Jul 29 15:47:09.935734 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.935713 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b5c5993-07f9-4c76-b552-108228b1dfa8-serving-cert\") pod \"insights-operator-5885fdb759-cpw78\" (UID: \"5b5c5993-07f9-4c76-b552-108228b1dfa8\") " pod="openshift-insights/insights-operator-5885fdb759-cpw78" Jul 29 15:47:09.935824 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.935808 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1d31deb-30f5-4af3-abeb-1d20733a12d1-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76\" (UID: \"d1d31deb-30f5-4af3-abeb-1d20733a12d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76" Jul 29 15:47:09.942020 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.941990 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgszc\" (UniqueName: \"kubernetes.io/projected/9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4-kube-api-access-cgszc\") pod \"cluster-samples-operator-6748489656-gtbm5\" (UID: \"9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gtbm5" Jul 29 15:47:09.942153 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.942072 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g777s\" (UniqueName: \"kubernetes.io/projected/d1d31deb-30f5-4af3-abeb-1d20733a12d1-kube-api-access-g777s\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76\" (UID: \"d1d31deb-30f5-4af3-abeb-1d20733a12d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76" Jul 29 15:47:09.942345 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.942320 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfgbs\" (UniqueName: \"kubernetes.io/projected/5b5c5993-07f9-4c76-b552-108228b1dfa8-kube-api-access-dfgbs\") pod \"insights-operator-5885fdb759-cpw78\" (UID: \"5b5c5993-07f9-4c76-b552-108228b1dfa8\") " pod="openshift-insights/insights-operator-5885fdb759-cpw78" Jul 29 15:47:09.942433 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.942317 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8swxb\" (UniqueName: \"kubernetes.io/projected/2dfbf7d0-c804-4516-b8e7-926c7e521e6c-kube-api-access-8swxb\") pod \"cluster-monitoring-operator-548b489cb8-b74zp\" (UID: \"2dfbf7d0-c804-4516-b8e7-926c7e521e6c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-b74zp" Jul 29 15:47:09.943029 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.943004 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bkbp\" (UniqueName: \"kubernetes.io/projected/acf996c0-566b-4eda-ba21-2542c991a168-kube-api-access-2bkbp\") pod \"volume-data-source-validator-549c6d54cf-mr76j\" (UID: \"acf996c0-566b-4eda-ba21-2542c991a168\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-mr76j" Jul 29 15:47:09.950816 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.950793 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76" Jul 29 15:47:09.965993 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.965969 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-mr76j" Jul 29 15:47:09.979355 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:09.979232 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-ccdn7"] Jul 29 15:47:09.981756 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:47:09.981730 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5d66c78_cfc3_436a_b338_6934d8d86b22.slice/crio-4bbd13797e786fe112c4787e0ae755dafa89b0b42e3fc74560516b870e54dc4c WatchSource:0}: Error finding container 4bbd13797e786fe112c4787e0ae755dafa89b0b42e3fc74560516b870e54dc4c: Status 404 returned error can't find the container with id 4bbd13797e786fe112c4787e0ae755dafa89b0b42e3fc74560516b870e54dc4c Jul 29 15:47:10.004520 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:10.004487 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-cpw78" Jul 29 15:47:10.035141 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:10.033641 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5257faa4-46cf-45e5-b609-a414b4fd90af-trusted-ca\") pod \"console-operator-584dcb6b54-ndcms\" (UID: \"5257faa4-46cf-45e5-b609-a414b4fd90af\") " pod="openshift-console-operator/console-operator-584dcb6b54-ndcms" Jul 29 15:47:10.035141 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:10.033764 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5257faa4-46cf-45e5-b609-a414b4fd90af-config\") pod \"console-operator-584dcb6b54-ndcms\" (UID: \"5257faa4-46cf-45e5-b609-a414b4fd90af\") " pod="openshift-console-operator/console-operator-584dcb6b54-ndcms" Jul 29 15:47:10.035141 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:10.033846 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9qlb\" (UniqueName: \"kubernetes.io/projected/5257faa4-46cf-45e5-b609-a414b4fd90af-kube-api-access-b9qlb\") pod \"console-operator-584dcb6b54-ndcms\" (UID: \"5257faa4-46cf-45e5-b609-a414b4fd90af\") " pod="openshift-console-operator/console-operator-584dcb6b54-ndcms" Jul 29 15:47:10.035141 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:10.033930 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5257faa4-46cf-45e5-b609-a414b4fd90af-serving-cert\") pod \"console-operator-584dcb6b54-ndcms\" (UID: \"5257faa4-46cf-45e5-b609-a414b4fd90af\") " pod="openshift-console-operator/console-operator-584dcb6b54-ndcms" Jul 29 15:47:10.035141 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:10.034920 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5257faa4-46cf-45e5-b609-a414b4fd90af-config\") pod \"console-operator-584dcb6b54-ndcms\" (UID: \"5257faa4-46cf-45e5-b609-a414b4fd90af\") " pod="openshift-console-operator/console-operator-584dcb6b54-ndcms" Jul 29 15:47:10.035886 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:10.035695 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5257faa4-46cf-45e5-b609-a414b4fd90af-trusted-ca\") pod \"console-operator-584dcb6b54-ndcms\" (UID: \"5257faa4-46cf-45e5-b609-a414b4fd90af\") " pod="openshift-console-operator/console-operator-584dcb6b54-ndcms" Jul 29 15:47:10.038065 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:10.037842 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5257faa4-46cf-45e5-b609-a414b4fd90af-serving-cert\") pod \"console-operator-584dcb6b54-ndcms\" (UID: \"5257faa4-46cf-45e5-b609-a414b4fd90af\") " pod="openshift-console-operator/console-operator-584dcb6b54-ndcms" Jul 29 15:47:10.045173 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:10.045140 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9qlb\" (UniqueName: \"kubernetes.io/projected/5257faa4-46cf-45e5-b609-a414b4fd90af-kube-api-access-b9qlb\") pod \"console-operator-584dcb6b54-ndcms\" (UID: \"5257faa4-46cf-45e5-b609-a414b4fd90af\") " pod="openshift-console-operator/console-operator-584dcb6b54-ndcms" Jul 29 15:47:10.059482 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:10.059178 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-ndcms" Jul 29 15:47:10.098267 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:10.098159 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-ccdn7" event={"ID":"a5d66c78-cfc3-436a-b338-6934d8d86b22","Type":"ContainerStarted","Data":"4bbd13797e786fe112c4787e0ae755dafa89b0b42e3fc74560516b870e54dc4c"} Jul 29 15:47:10.112700 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:10.112524 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4kzf8" event={"ID":"e64886a0-bd69-40f8-8ac3-b6184100d5d2","Type":"ContainerStarted","Data":"b8349cd51ad9bb708adee0124ddb8d8b4725220ae5a09269ad1442b28fc44a28"} Jul 29 15:47:10.134482 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:10.134270 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76"] Jul 29 15:47:10.137192 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:47:10.137117 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1d31deb_30f5_4af3_abeb_1d20733a12d1.slice/crio-1346b3992baf8f28d2c11b39d53234dd0cd60e2ceea890edf1a83340d7e06b74 WatchSource:0}: Error finding container 1346b3992baf8f28d2c11b39d53234dd0cd60e2ceea890edf1a83340d7e06b74: Status 404 returned error can't find the container with id 1346b3992baf8f28d2c11b39d53234dd0cd60e2ceea890edf1a83340d7e06b74 Jul 29 15:47:10.154588 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:10.154499 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-mr76j"] Jul 29 15:47:10.158027 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:47:10.157941 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf996c0_566b_4eda_ba21_2542c991a168.slice/crio-2b2aa7f1af5042763dfb7bddf9feb073a7430ff670bbf425b9c06ec911573cca WatchSource:0}: Error finding container 2b2aa7f1af5042763dfb7bddf9feb073a7430ff670bbf425b9c06ec911573cca: Status 404 returned error can't find the container with id 2b2aa7f1af5042763dfb7bddf9feb073a7430ff670bbf425b9c06ec911573cca Jul 29 15:47:10.191144 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:47:10.191101 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b5c5993_07f9_4c76_b552_108228b1dfa8.slice/crio-92d4c53f78458034cd6b9d8748060fa5381a6c94f5743f3c17b4f83fdfcf5048 WatchSource:0}: Error finding container 92d4c53f78458034cd6b9d8748060fa5381a6c94f5743f3c17b4f83fdfcf5048: Status 404 returned error can't find the container with id 92d4c53f78458034cd6b9d8748060fa5381a6c94f5743f3c17b4f83fdfcf5048 Jul 29 15:47:10.192721 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:10.192688 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-cpw78"] Jul 29 15:47:10.224608 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:10.224572 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-ndcms"] Jul 29 15:47:10.228651 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:47:10.228620 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5257faa4_46cf_45e5_b609_a414b4fd90af.slice/crio-c60d1dd2ab5b01181010211b178b9cf56976ea77d64c55cb450482e0f4aefca8 WatchSource:0}: Error finding container c60d1dd2ab5b01181010211b178b9cf56976ea77d64c55cb450482e0f4aefca8: Status 404 returned error can't find the container with id c60d1dd2ab5b01181010211b178b9cf56976ea77d64c55cb450482e0f4aefca8 Jul 29 15:47:10.336349 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:10.336315 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73aeab81-faab-4712-968c-ab8ee7b67e10-metrics-certs\") pod \"router-default-6f9fb4469f-8dzw8\" (UID: \"73aeab81-faab-4712-968c-ab8ee7b67e10\") " pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:10.336525 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:10.336370 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73aeab81-faab-4712-968c-ab8ee7b67e10-service-ca-bundle\") pod \"router-default-6f9fb4469f-8dzw8\" (UID: \"73aeab81-faab-4712-968c-ab8ee7b67e10\") " pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:10.336525 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:10.336465 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 15:47:10.336525 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:10.336488 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73aeab81-faab-4712-968c-ab8ee7b67e10-service-ca-bundle podName:73aeab81-faab-4712-968c-ab8ee7b67e10 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:11.336475169 +0000 UTC m=+54.050509611 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/73aeab81-faab-4712-968c-ab8ee7b67e10-service-ca-bundle") pod "router-default-6f9fb4469f-8dzw8" (UID: "73aeab81-faab-4712-968c-ab8ee7b67e10") : configmap references non-existent config key: service-ca.crt Jul 29 15:47:10.336525 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:10.336519 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73aeab81-faab-4712-968c-ab8ee7b67e10-metrics-certs podName:73aeab81-faab-4712-968c-ab8ee7b67e10 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:11.336506678 +0000 UTC m=+54.050541125 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73aeab81-faab-4712-968c-ab8ee7b67e10-metrics-certs") pod "router-default-6f9fb4469f-8dzw8" (UID: "73aeab81-faab-4712-968c-ab8ee7b67e10") : secret "router-metrics-certs-default" not found Jul 29 15:47:10.436894 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:10.436841 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2dfbf7d0-c804-4516-b8e7-926c7e521e6c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-b74zp\" (UID: \"2dfbf7d0-c804-4516-b8e7-926c7e521e6c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-b74zp" Jul 29 15:47:10.436894 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:10.436891 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-gtbm5\" (UID: \"9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gtbm5" Jul 29 15:47:10.437362 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:10.437001 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 15:47:10.437362 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:10.437003 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 15:47:10.437362 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:10.437065 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4-samples-operator-tls podName:9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:11.437046443 +0000 UTC m=+54.151080890 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4-samples-operator-tls") pod "cluster-samples-operator-6748489656-gtbm5" (UID: "9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4") : secret "samples-operator-tls" not found Jul 29 15:47:10.437362 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:10.437082 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dfbf7d0-c804-4516-b8e7-926c7e521e6c-cluster-monitoring-operator-tls podName:2dfbf7d0-c804-4516-b8e7-926c7e521e6c nodeName:}" failed. No retries permitted until 2026-07-29 15:47:11.437073723 +0000 UTC m=+54.151108167 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2dfbf7d0-c804-4516-b8e7-926c7e521e6c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-b74zp" (UID: "2dfbf7d0-c804-4516-b8e7-926c7e521e6c") : secret "cluster-monitoring-operator-tls" not found Jul 29 15:47:11.118337 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:11.118290 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76" event={"ID":"d1d31deb-30f5-4af3-abeb-1d20733a12d1","Type":"ContainerStarted","Data":"1346b3992baf8f28d2c11b39d53234dd0cd60e2ceea890edf1a83340d7e06b74"} Jul 29 15:47:11.119938 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:11.119909 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-cpw78" event={"ID":"5b5c5993-07f9-4c76-b552-108228b1dfa8","Type":"ContainerStarted","Data":"92d4c53f78458034cd6b9d8748060fa5381a6c94f5743f3c17b4f83fdfcf5048"} Jul 29 15:47:11.124104 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:11.124070 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-mr76j" event={"ID":"acf996c0-566b-4eda-ba21-2542c991a168","Type":"ContainerStarted","Data":"2b2aa7f1af5042763dfb7bddf9feb073a7430ff670bbf425b9c06ec911573cca"} Jul 29 15:47:11.125921 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:11.125860 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-ndcms" event={"ID":"5257faa4-46cf-45e5-b609-a414b4fd90af","Type":"ContainerStarted","Data":"c60d1dd2ab5b01181010211b178b9cf56976ea77d64c55cb450482e0f4aefca8"} Jul 29 15:47:11.346203 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:11.346158 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73aeab81-faab-4712-968c-ab8ee7b67e10-metrics-certs\") pod \"router-default-6f9fb4469f-8dzw8\" (UID: \"73aeab81-faab-4712-968c-ab8ee7b67e10\") " pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:11.346394 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:11.346245 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73aeab81-faab-4712-968c-ab8ee7b67e10-service-ca-bundle\") pod \"router-default-6f9fb4469f-8dzw8\" (UID: \"73aeab81-faab-4712-968c-ab8ee7b67e10\") " pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:11.346453 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:11.346391 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73aeab81-faab-4712-968c-ab8ee7b67e10-service-ca-bundle podName:73aeab81-faab-4712-968c-ab8ee7b67e10 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:13.346372378 +0000 UTC m=+56.060406825 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/73aeab81-faab-4712-968c-ab8ee7b67e10-service-ca-bundle") pod "router-default-6f9fb4469f-8dzw8" (UID: "73aeab81-faab-4712-968c-ab8ee7b67e10") : configmap references non-existent config key: service-ca.crt Jul 29 15:47:11.346842 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:11.346820 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 15:47:11.346941 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:11.346885 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73aeab81-faab-4712-968c-ab8ee7b67e10-metrics-certs podName:73aeab81-faab-4712-968c-ab8ee7b67e10 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:13.346867789 +0000 UTC m=+56.060902235 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73aeab81-faab-4712-968c-ab8ee7b67e10-metrics-certs") pod "router-default-6f9fb4469f-8dzw8" (UID: "73aeab81-faab-4712-968c-ab8ee7b67e10") : secret "router-metrics-certs-default" not found Jul 29 15:47:11.447940 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:11.447854 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2dfbf7d0-c804-4516-b8e7-926c7e521e6c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-b74zp\" (UID: \"2dfbf7d0-c804-4516-b8e7-926c7e521e6c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-b74zp" Jul 29 15:47:11.447940 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:11.447911 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-gtbm5\" (UID: \"9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gtbm5" Jul 29 15:47:11.448426 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:11.448023 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 15:47:11.448426 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:11.448048 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 15:47:11.448426 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:11.448098 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dfbf7d0-c804-4516-b8e7-926c7e521e6c-cluster-monitoring-operator-tls podName:2dfbf7d0-c804-4516-b8e7-926c7e521e6c nodeName:}" failed. No retries permitted until 2026-07-29 15:47:13.448077547 +0000 UTC m=+56.162112032 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2dfbf7d0-c804-4516-b8e7-926c7e521e6c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-b74zp" (UID: "2dfbf7d0-c804-4516-b8e7-926c7e521e6c") : secret "cluster-monitoring-operator-tls" not found Jul 29 15:47:11.448426 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:11.448120 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4-samples-operator-tls podName:9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:13.448110369 +0000 UTC m=+56.162144818 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4-samples-operator-tls") pod "cluster-samples-operator-6748489656-gtbm5" (UID: "9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4") : secret "samples-operator-tls" not found Jul 29 15:47:13.365524 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:13.365487 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73aeab81-faab-4712-968c-ab8ee7b67e10-metrics-certs\") pod \"router-default-6f9fb4469f-8dzw8\" (UID: \"73aeab81-faab-4712-968c-ab8ee7b67e10\") " pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:13.365984 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:13.365574 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73aeab81-faab-4712-968c-ab8ee7b67e10-service-ca-bundle\") pod \"router-default-6f9fb4469f-8dzw8\" (UID: \"73aeab81-faab-4712-968c-ab8ee7b67e10\") " pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:13.365984 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:13.365638 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 15:47:13.365984 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:13.365720 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73aeab81-faab-4712-968c-ab8ee7b67e10-metrics-certs podName:73aeab81-faab-4712-968c-ab8ee7b67e10 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:17.365703552 +0000 UTC m=+60.079737995 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73aeab81-faab-4712-968c-ab8ee7b67e10-metrics-certs") pod "router-default-6f9fb4469f-8dzw8" (UID: "73aeab81-faab-4712-968c-ab8ee7b67e10") : secret "router-metrics-certs-default" not found Jul 29 15:47:13.365984 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:13.365735 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73aeab81-faab-4712-968c-ab8ee7b67e10-service-ca-bundle podName:73aeab81-faab-4712-968c-ab8ee7b67e10 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:17.365728526 +0000 UTC m=+60.079762968 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/73aeab81-faab-4712-968c-ab8ee7b67e10-service-ca-bundle") pod "router-default-6f9fb4469f-8dzw8" (UID: "73aeab81-faab-4712-968c-ab8ee7b67e10") : configmap references non-existent config key: service-ca.crt Jul 29 15:47:13.466306 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:13.466219 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2dfbf7d0-c804-4516-b8e7-926c7e521e6c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-b74zp\" (UID: \"2dfbf7d0-c804-4516-b8e7-926c7e521e6c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-b74zp" Jul 29 15:47:13.466306 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:13.466280 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-gtbm5\" (UID: \"9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gtbm5" Jul 29 15:47:13.466531 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:13.466339 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 15:47:13.466531 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:13.466424 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 15:47:13.466531 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:13.466426 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dfbf7d0-c804-4516-b8e7-926c7e521e6c-cluster-monitoring-operator-tls podName:2dfbf7d0-c804-4516-b8e7-926c7e521e6c nodeName:}" failed. No retries permitted until 2026-07-29 15:47:17.466402306 +0000 UTC m=+60.180436752 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2dfbf7d0-c804-4516-b8e7-926c7e521e6c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-b74zp" (UID: "2dfbf7d0-c804-4516-b8e7-926c7e521e6c") : secret "cluster-monitoring-operator-tls" not found Jul 29 15:47:13.466531 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:13.466489 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4-samples-operator-tls podName:9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:17.466473607 +0000 UTC m=+60.180508054 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4-samples-operator-tls") pod "cluster-samples-operator-6748489656-gtbm5" (UID: "9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4") : secret "samples-operator-tls" not found Jul 29 15:47:16.132235 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.132201 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-b4cnv"] Jul 29 15:47:16.134686 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.134663 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:16.137638 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.137469 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 29 15:47:16.137638 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.137605 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d2ddt\"" Jul 29 15:47:16.138654 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.138635 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 29 15:47:16.144259 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.144222 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-ccdn7" event={"ID":"a5d66c78-cfc3-436a-b338-6934d8d86b22","Type":"ContainerStarted","Data":"a162d4fbff208a56f562b3d6f62f15c2806d56b98dd08f7fb9c8f80147dab0fc"} Jul 29 15:47:16.146738 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.146362 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-cpw78" event={"ID":"5b5c5993-07f9-4c76-b552-108228b1dfa8","Type":"ContainerStarted","Data":"578c8a6a01dddc1248fc7903a52630f91760143e8a411e7c500dc635637b74b1"} Jul 29 15:47:16.148254 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.148232 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-mr76j" event={"ID":"acf996c0-566b-4eda-ba21-2542c991a168","Type":"ContainerStarted","Data":"e5187f6e54aebe88c6aa604500e3bbbdbdf7508f12d214f87dada04386b1e11b"} Jul 29 15:47:16.150317 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.150294 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndcms_5257faa4-46cf-45e5-b609-a414b4fd90af/console-operator/0.log" Jul 29 15:47:16.150422 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.150339 2554 generic.go:356] "Generic (PLEG): container finished" podID="5257faa4-46cf-45e5-b609-a414b4fd90af" containerID="3dc4ebd92de4bb835e794d26177880a5a5fb751d82a15df6e2224f35852c71bd" exitCode=255 Jul 29 15:47:16.150422 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.150415 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-ndcms" event={"ID":"5257faa4-46cf-45e5-b609-a414b4fd90af","Type":"ContainerDied","Data":"3dc4ebd92de4bb835e794d26177880a5a5fb751d82a15df6e2224f35852c71bd"} Jul 29 15:47:16.150634 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.150615 2554 scope.go:117] "RemoveContainer" containerID="3dc4ebd92de4bb835e794d26177880a5a5fb751d82a15df6e2224f35852c71bd" Jul 29 15:47:16.152394 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.152374 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b4cnv"] Jul 29 15:47:16.154234 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.154212 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4kzf8" event={"ID":"e64886a0-bd69-40f8-8ac3-b6184100d5d2","Type":"ContainerStarted","Data":"22d11907c4bedcd33f3d1258ff5b5397c65d069cfb79d9c5a18091579b2d1d26"} Jul 29 15:47:16.156914 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.156833 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76" event={"ID":"d1d31deb-30f5-4af3-abeb-1d20733a12d1","Type":"ContainerStarted","Data":"a4ae55109bb8f73600a340311bae1a1d49522ae681d50e0b40c337db7f177881"} Jul 29 15:47:16.187882 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.187829 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4kzf8" podStartSLOduration=1.993765651 podStartE2EDuration="7.187812874s" totalImagesPullingTime="5.194047223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:16.186751224 +0000 UTC m=+58.900785701" watchObservedRunningTime="2026-07-29 15:47:16.187812874 +0000 UTC m=+58.901847340" Jul 29 15:47:16.189817 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.189783 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fg9x\" (UniqueName: \"kubernetes.io/projected/141e3214-1ccf-4ebf-bb64-b1895c6a7402-kube-api-access-4fg9x\") pod \"insights-runtime-extractor-b4cnv\" (UID: \"141e3214-1ccf-4ebf-bb64-b1895c6a7402\") " pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:16.190188 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.190169 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/141e3214-1ccf-4ebf-bb64-b1895c6a7402-data-volume\") pod \"insights-runtime-extractor-b4cnv\" (UID: \"141e3214-1ccf-4ebf-bb64-b1895c6a7402\") " pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:16.190502 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.190484 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/141e3214-1ccf-4ebf-bb64-b1895c6a7402-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b4cnv\" (UID: \"141e3214-1ccf-4ebf-bb64-b1895c6a7402\") " pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:16.190672 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.190649 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/141e3214-1ccf-4ebf-bb64-b1895c6a7402-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b4cnv\" (UID: \"141e3214-1ccf-4ebf-bb64-b1895c6a7402\") " pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:16.190900 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.190881 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/141e3214-1ccf-4ebf-bb64-b1895c6a7402-crio-socket\") pod \"insights-runtime-extractor-b4cnv\" (UID: \"141e3214-1ccf-4ebf-bb64-b1895c6a7402\") " pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:16.227794 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.227689 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76" podStartSLOduration=2.303305709 podStartE2EDuration="7.227666754s" totalImagesPullingTime="4.924361045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:16.208198544 +0000 UTC m=+58.922233010" watchObservedRunningTime="2026-07-29 15:47:16.227666754 +0000 UTC m=+58.941701220" Jul 29 15:47:16.247724 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.247647 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-mr76j" podStartSLOduration=2.345007874 podStartE2EDuration="7.247630757s" totalImagesPullingTime="4.902622883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:16.227435816 +0000 UTC m=+58.941470282" watchObservedRunningTime="2026-07-29 15:47:16.247630757 +0000 UTC m=+58.961665214" Jul 29 15:47:16.248004 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.247927 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-ccdn7" podStartSLOduration=2.152769819 podStartE2EDuration="7.247920998s" totalImagesPullingTime="5.095151179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:16.246660957 +0000 UTC m=+58.960695423" watchObservedRunningTime="2026-07-29 15:47:16.247920998 +0000 UTC m=+58.961955511" Jul 29 15:47:16.266476 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.266417 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-cpw78" podStartSLOduration=2.39231764 podStartE2EDuration="7.266393401s" totalImagesPullingTime="4.874075761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:16.264311766 +0000 UTC m=+58.978346232" watchObservedRunningTime="2026-07-29 15:47:16.266393401 +0000 UTC m=+58.980427868" Jul 29 15:47:16.291473 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.291443 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/141e3214-1ccf-4ebf-bb64-b1895c6a7402-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b4cnv\" (UID: \"141e3214-1ccf-4ebf-bb64-b1895c6a7402\") " pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:16.291956 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.291486 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/141e3214-1ccf-4ebf-bb64-b1895c6a7402-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b4cnv\" (UID: \"141e3214-1ccf-4ebf-bb64-b1895c6a7402\") " pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:16.291956 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.291518 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/141e3214-1ccf-4ebf-bb64-b1895c6a7402-crio-socket\") pod \"insights-runtime-extractor-b4cnv\" (UID: \"141e3214-1ccf-4ebf-bb64-b1895c6a7402\") " pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:16.291956 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:16.291604 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:47:16.291956 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:16.291632 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:47:16.291956 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.291642 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fg9x\" (UniqueName: \"kubernetes.io/projected/141e3214-1ccf-4ebf-bb64-b1895c6a7402-kube-api-access-4fg9x\") pod \"insights-runtime-extractor-b4cnv\" (UID: \"141e3214-1ccf-4ebf-bb64-b1895c6a7402\") " pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:16.291956 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:16.291690 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/141e3214-1ccf-4ebf-bb64-b1895c6a7402-insights-runtime-extractor-tls podName:141e3214-1ccf-4ebf-bb64-b1895c6a7402 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:16.791671511 +0000 UTC m=+59.505705978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/141e3214-1ccf-4ebf-bb64-b1895c6a7402-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b4cnv" (UID: "141e3214-1ccf-4ebf-bb64-b1895c6a7402") : secret "insights-runtime-extractor-tls" not found Jul 29 15:47:16.291956 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:16.291712 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/141e3214-1ccf-4ebf-bb64-b1895c6a7402-kube-rbac-proxy-cm podName:141e3214-1ccf-4ebf-bb64-b1895c6a7402 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:16.791701522 +0000 UTC m=+59.505735982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/141e3214-1ccf-4ebf-bb64-b1895c6a7402-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b4cnv" (UID: "141e3214-1ccf-4ebf-bb64-b1895c6a7402") : configmap "kube-rbac-proxy" not found Jul 29 15:47:16.291956 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.291715 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/141e3214-1ccf-4ebf-bb64-b1895c6a7402-crio-socket\") pod \"insights-runtime-extractor-b4cnv\" (UID: \"141e3214-1ccf-4ebf-bb64-b1895c6a7402\") " pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:16.291956 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.291746 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/141e3214-1ccf-4ebf-bb64-b1895c6a7402-data-volume\") pod \"insights-runtime-extractor-b4cnv\" (UID: \"141e3214-1ccf-4ebf-bb64-b1895c6a7402\") " pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:16.292315 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.292097 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/141e3214-1ccf-4ebf-bb64-b1895c6a7402-data-volume\") pod \"insights-runtime-extractor-b4cnv\" (UID: \"141e3214-1ccf-4ebf-bb64-b1895c6a7402\") " pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:16.302614 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.302586 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fg9x\" (UniqueName: \"kubernetes.io/projected/141e3214-1ccf-4ebf-bb64-b1895c6a7402-kube-api-access-4fg9x\") pod \"insights-runtime-extractor-b4cnv\" (UID: \"141e3214-1ccf-4ebf-bb64-b1895c6a7402\") " pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:16.795449 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.795410 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/141e3214-1ccf-4ebf-bb64-b1895c6a7402-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b4cnv\" (UID: \"141e3214-1ccf-4ebf-bb64-b1895c6a7402\") " pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:16.795449 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:16.795450 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/141e3214-1ccf-4ebf-bb64-b1895c6a7402-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b4cnv\" (UID: \"141e3214-1ccf-4ebf-bb64-b1895c6a7402\") " pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:16.795736 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:16.795580 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:47:16.795736 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:16.795622 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:47:16.795736 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:16.795666 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/141e3214-1ccf-4ebf-bb64-b1895c6a7402-kube-rbac-proxy-cm podName:141e3214-1ccf-4ebf-bb64-b1895c6a7402 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:17.795643624 +0000 UTC m=+60.509678074 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/141e3214-1ccf-4ebf-bb64-b1895c6a7402-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b4cnv" (UID: "141e3214-1ccf-4ebf-bb64-b1895c6a7402") : configmap "kube-rbac-proxy" not found Jul 29 15:47:16.795736 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:16.795684 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/141e3214-1ccf-4ebf-bb64-b1895c6a7402-insights-runtime-extractor-tls podName:141e3214-1ccf-4ebf-bb64-b1895c6a7402 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:17.795675535 +0000 UTC m=+60.509709983 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/141e3214-1ccf-4ebf-bb64-b1895c6a7402-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b4cnv" (UID: "141e3214-1ccf-4ebf-bb64-b1895c6a7402") : secret "insights-runtime-extractor-tls" not found Jul 29 15:47:17.161750 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:17.161677 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndcms_5257faa4-46cf-45e5-b609-a414b4fd90af/console-operator/1.log" Jul 29 15:47:17.162159 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:17.162102 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndcms_5257faa4-46cf-45e5-b609-a414b4fd90af/console-operator/0.log" Jul 29 15:47:17.162159 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:17.162137 2554 generic.go:356] "Generic (PLEG): container finished" podID="5257faa4-46cf-45e5-b609-a414b4fd90af" containerID="4bb8d5f25144b0c8bbc25f85483446db11329e79af933e6dbcf87e92f2f40963" exitCode=255 Jul 29 15:47:17.162260 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:17.162236 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-ndcms" event={"ID":"5257faa4-46cf-45e5-b609-a414b4fd90af","Type":"ContainerDied","Data":"4bb8d5f25144b0c8bbc25f85483446db11329e79af933e6dbcf87e92f2f40963"} Jul 29 15:47:17.162329 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:17.162314 2554 scope.go:117] "RemoveContainer" containerID="3dc4ebd92de4bb835e794d26177880a5a5fb751d82a15df6e2224f35852c71bd" Jul 29 15:47:17.162999 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:17.162985 2554 scope.go:117] "RemoveContainer" containerID="4bb8d5f25144b0c8bbc25f85483446db11329e79af933e6dbcf87e92f2f40963" Jul 29 15:47:17.163160 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:17.163136 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-ndcms_openshift-console-operator(5257faa4-46cf-45e5-b609-a414b4fd90af)\"" pod="openshift-console-operator/console-operator-584dcb6b54-ndcms" podUID="5257faa4-46cf-45e5-b609-a414b4fd90af" Jul 29 15:47:17.403143 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:17.403102 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73aeab81-faab-4712-968c-ab8ee7b67e10-metrics-certs\") pod \"router-default-6f9fb4469f-8dzw8\" (UID: \"73aeab81-faab-4712-968c-ab8ee7b67e10\") " pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:17.403328 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:17.403157 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73aeab81-faab-4712-968c-ab8ee7b67e10-service-ca-bundle\") pod \"router-default-6f9fb4469f-8dzw8\" (UID: \"73aeab81-faab-4712-968c-ab8ee7b67e10\") " pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:17.403328 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:17.403249 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 15:47:17.403328 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:17.403300 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73aeab81-faab-4712-968c-ab8ee7b67e10-service-ca-bundle podName:73aeab81-faab-4712-968c-ab8ee7b67e10 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:25.40328715 +0000 UTC m=+68.117321592 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/73aeab81-faab-4712-968c-ab8ee7b67e10-service-ca-bundle") pod "router-default-6f9fb4469f-8dzw8" (UID: "73aeab81-faab-4712-968c-ab8ee7b67e10") : configmap references non-existent config key: service-ca.crt Jul 29 15:47:17.403328 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:17.403315 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73aeab81-faab-4712-968c-ab8ee7b67e10-metrics-certs podName:73aeab81-faab-4712-968c-ab8ee7b67e10 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:25.403308286 +0000 UTC m=+68.117342728 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73aeab81-faab-4712-968c-ab8ee7b67e10-metrics-certs") pod "router-default-6f9fb4469f-8dzw8" (UID: "73aeab81-faab-4712-968c-ab8ee7b67e10") : secret "router-metrics-certs-default" not found Jul 29 15:47:17.504636 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:17.504602 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2dfbf7d0-c804-4516-b8e7-926c7e521e6c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-b74zp\" (UID: \"2dfbf7d0-c804-4516-b8e7-926c7e521e6c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-b74zp" Jul 29 15:47:17.504807 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:17.504645 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-gtbm5\" (UID: \"9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gtbm5" Jul 29 15:47:17.504807 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:17.504760 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 15:47:17.504807 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:17.504777 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 15:47:17.504917 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:17.504833 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dfbf7d0-c804-4516-b8e7-926c7e521e6c-cluster-monitoring-operator-tls podName:2dfbf7d0-c804-4516-b8e7-926c7e521e6c nodeName:}" failed. No retries permitted until 2026-07-29 15:47:25.504813683 +0000 UTC m=+68.218848145 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2dfbf7d0-c804-4516-b8e7-926c7e521e6c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-b74zp" (UID: "2dfbf7d0-c804-4516-b8e7-926c7e521e6c") : secret "cluster-monitoring-operator-tls" not found Jul 29 15:47:17.504917 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:17.504853 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4-samples-operator-tls podName:9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:25.504844863 +0000 UTC m=+68.218879306 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4-samples-operator-tls") pod "cluster-samples-operator-6748489656-gtbm5" (UID: "9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4") : secret "samples-operator-tls" not found Jul 29 15:47:17.807082 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:17.807019 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/141e3214-1ccf-4ebf-bb64-b1895c6a7402-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b4cnv\" (UID: \"141e3214-1ccf-4ebf-bb64-b1895c6a7402\") " pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:17.807082 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:17.807051 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/141e3214-1ccf-4ebf-bb64-b1895c6a7402-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b4cnv\" (UID: \"141e3214-1ccf-4ebf-bb64-b1895c6a7402\") " pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:17.807245 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:17.807135 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:47:17.807245 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:17.807154 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:47:17.807245 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:17.807203 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/141e3214-1ccf-4ebf-bb64-b1895c6a7402-kube-rbac-proxy-cm podName:141e3214-1ccf-4ebf-bb64-b1895c6a7402 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:19.807183797 +0000 UTC m=+62.521218260 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/141e3214-1ccf-4ebf-bb64-b1895c6a7402-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b4cnv" (UID: "141e3214-1ccf-4ebf-bb64-b1895c6a7402") : configmap "kube-rbac-proxy" not found Jul 29 15:47:17.807245 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:17.807224 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/141e3214-1ccf-4ebf-bb64-b1895c6a7402-insights-runtime-extractor-tls podName:141e3214-1ccf-4ebf-bb64-b1895c6a7402 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:19.807213549 +0000 UTC m=+62.521247992 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/141e3214-1ccf-4ebf-bb64-b1895c6a7402-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b4cnv" (UID: "141e3214-1ccf-4ebf-bb64-b1895c6a7402") : secret "insights-runtime-extractor-tls" not found Jul 29 15:47:17.899783 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:17.899757 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pw9xr_d9d34b9d-2d38-4123-a642-3e433d36b23e/dns-node-resolver/0.log" Jul 29 15:47:18.033567 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:18.033515 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mfwv" Jul 29 15:47:18.167061 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:18.166981 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndcms_5257faa4-46cf-45e5-b609-a414b4fd90af/console-operator/1.log" Jul 29 15:47:18.167426 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:18.167313 2554 scope.go:117] "RemoveContainer" containerID="4bb8d5f25144b0c8bbc25f85483446db11329e79af933e6dbcf87e92f2f40963" Jul 29 15:47:18.167466 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:18.167454 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-ndcms_openshift-console-operator(5257faa4-46cf-45e5-b609-a414b4fd90af)\"" pod="openshift-console-operator/console-operator-584dcb6b54-ndcms" podUID="5257faa4-46cf-45e5-b609-a414b4fd90af" Jul 29 15:47:18.912492 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:18.912462 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wmtrp_f49f48c2-8c3b-4acb-91ea-88772241837e/node-ca/0.log" Jul 29 15:47:19.301474 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:19.301432 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2m6gl_51ff4873-720e-4b87-ab6e-9b54928d8fdc/serve-healthcheck-canary/0.log" Jul 29 15:47:19.826183 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:19.826141 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/141e3214-1ccf-4ebf-bb64-b1895c6a7402-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b4cnv\" (UID: \"141e3214-1ccf-4ebf-bb64-b1895c6a7402\") " pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:19.826183 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:19.826187 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/141e3214-1ccf-4ebf-bb64-b1895c6a7402-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b4cnv\" (UID: \"141e3214-1ccf-4ebf-bb64-b1895c6a7402\") " pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:19.826441 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:19.826263 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:47:19.826441 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:19.826308 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:47:19.826441 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:19.826322 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/141e3214-1ccf-4ebf-bb64-b1895c6a7402-kube-rbac-proxy-cm podName:141e3214-1ccf-4ebf-bb64-b1895c6a7402 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:23.826306964 +0000 UTC m=+66.540341407 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/141e3214-1ccf-4ebf-bb64-b1895c6a7402-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b4cnv" (UID: "141e3214-1ccf-4ebf-bb64-b1895c6a7402") : configmap "kube-rbac-proxy" not found Jul 29 15:47:19.826441 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:19.826387 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/141e3214-1ccf-4ebf-bb64-b1895c6a7402-insights-runtime-extractor-tls podName:141e3214-1ccf-4ebf-bb64-b1895c6a7402 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:23.826344069 +0000 UTC m=+66.540378512 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/141e3214-1ccf-4ebf-bb64-b1895c6a7402-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b4cnv" (UID: "141e3214-1ccf-4ebf-bb64-b1895c6a7402") : secret "insights-runtime-extractor-tls" not found Jul 29 15:47:19.931838 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:19.931805 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-bp5mr"] Jul 29 15:47:19.934844 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:19.934826 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-bp5mr" Jul 29 15:47:19.937925 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:19.937899 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 29 15:47:19.938045 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:19.937956 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 29 15:47:19.938172 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:19.938154 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-srnz2\"" Jul 29 15:47:19.938397 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:19.938377 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 29 15:47:19.938519 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:19.938503 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 29 15:47:19.947072 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:19.947053 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-bp5mr"] Jul 29 15:47:20.028398 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:20.028358 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hblt9\" (UniqueName: \"kubernetes.io/projected/fddce4f8-5bfd-4d11-bc41-a5c0ac031c99-kube-api-access-hblt9\") pod \"service-ca-658d7b7c78-bp5mr\" (UID: \"fddce4f8-5bfd-4d11-bc41-a5c0ac031c99\") " pod="openshift-service-ca/service-ca-658d7b7c78-bp5mr" Jul 29 15:47:20.028587 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:20.028442 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fddce4f8-5bfd-4d11-bc41-a5c0ac031c99-signing-cabundle\") pod \"service-ca-658d7b7c78-bp5mr\" (UID: \"fddce4f8-5bfd-4d11-bc41-a5c0ac031c99\") " pod="openshift-service-ca/service-ca-658d7b7c78-bp5mr" Jul 29 15:47:20.028587 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:20.028484 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fddce4f8-5bfd-4d11-bc41-a5c0ac031c99-signing-key\") pod \"service-ca-658d7b7c78-bp5mr\" (UID: \"fddce4f8-5bfd-4d11-bc41-a5c0ac031c99\") " pod="openshift-service-ca/service-ca-658d7b7c78-bp5mr" Jul 29 15:47:20.060528 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:20.060494 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-ndcms" Jul 29 15:47:20.060673 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:20.060567 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-ndcms" Jul 29 15:47:20.060903 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:20.060890 2554 scope.go:117] "RemoveContainer" containerID="4bb8d5f25144b0c8bbc25f85483446db11329e79af933e6dbcf87e92f2f40963" Jul 29 15:47:20.061061 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:20.061043 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-ndcms_openshift-console-operator(5257faa4-46cf-45e5-b609-a414b4fd90af)\"" pod="openshift-console-operator/console-operator-584dcb6b54-ndcms" podUID="5257faa4-46cf-45e5-b609-a414b4fd90af" Jul 29 15:47:20.129312 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:20.129191 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hblt9\" (UniqueName: \"kubernetes.io/projected/fddce4f8-5bfd-4d11-bc41-a5c0ac031c99-kube-api-access-hblt9\") pod \"service-ca-658d7b7c78-bp5mr\" (UID: \"fddce4f8-5bfd-4d11-bc41-a5c0ac031c99\") " pod="openshift-service-ca/service-ca-658d7b7c78-bp5mr" Jul 29 15:47:20.129491 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:20.129317 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fddce4f8-5bfd-4d11-bc41-a5c0ac031c99-signing-cabundle\") pod \"service-ca-658d7b7c78-bp5mr\" (UID: \"fddce4f8-5bfd-4d11-bc41-a5c0ac031c99\") " pod="openshift-service-ca/service-ca-658d7b7c78-bp5mr" Jul 29 15:47:20.129491 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:20.129354 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fddce4f8-5bfd-4d11-bc41-a5c0ac031c99-signing-key\") pod \"service-ca-658d7b7c78-bp5mr\" (UID: \"fddce4f8-5bfd-4d11-bc41-a5c0ac031c99\") " pod="openshift-service-ca/service-ca-658d7b7c78-bp5mr" Jul 29 15:47:20.129918 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:20.129895 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fddce4f8-5bfd-4d11-bc41-a5c0ac031c99-signing-cabundle\") pod \"service-ca-658d7b7c78-bp5mr\" (UID: \"fddce4f8-5bfd-4d11-bc41-a5c0ac031c99\") " pod="openshift-service-ca/service-ca-658d7b7c78-bp5mr" Jul 29 15:47:20.131683 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:20.131663 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fddce4f8-5bfd-4d11-bc41-a5c0ac031c99-signing-key\") pod \"service-ca-658d7b7c78-bp5mr\" (UID: \"fddce4f8-5bfd-4d11-bc41-a5c0ac031c99\") " pod="openshift-service-ca/service-ca-658d7b7c78-bp5mr" Jul 29 15:47:20.138892 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:20.138864 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hblt9\" (UniqueName: \"kubernetes.io/projected/fddce4f8-5bfd-4d11-bc41-a5c0ac031c99-kube-api-access-hblt9\") pod \"service-ca-658d7b7c78-bp5mr\" (UID: \"fddce4f8-5bfd-4d11-bc41-a5c0ac031c99\") " pod="openshift-service-ca/service-ca-658d7b7c78-bp5mr" Jul 29 15:47:20.243083 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:20.243047 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-bp5mr" Jul 29 15:47:20.376278 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:20.376243 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-bp5mr"] Jul 29 15:47:20.378938 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:47:20.378909 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfddce4f8_5bfd_4d11_bc41_a5c0ac031c99.slice/crio-97074c0412bd4b28faf529f0e579151f5b83eb174c860b12e5f183b372663d81 WatchSource:0}: Error finding container 97074c0412bd4b28faf529f0e579151f5b83eb174c860b12e5f183b372663d81: Status 404 returned error can't find the container with id 97074c0412bd4b28faf529f0e579151f5b83eb174c860b12e5f183b372663d81 Jul 29 15:47:21.177121 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:21.177075 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-bp5mr" event={"ID":"fddce4f8-5bfd-4d11-bc41-a5c0ac031c99","Type":"ContainerStarted","Data":"7fe5178b897d020afadc833b76b6a0dded4e7a176f4af823f0c5653aad7caeb2"} Jul 29 15:47:21.177300 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:21.177166 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-bp5mr" event={"ID":"fddce4f8-5bfd-4d11-bc41-a5c0ac031c99","Type":"ContainerStarted","Data":"97074c0412bd4b28faf529f0e579151f5b83eb174c860b12e5f183b372663d81"} Jul 29 15:47:21.197109 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:21.197048 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-bp5mr" podStartSLOduration=2.197031303 podStartE2EDuration="2.197031303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:47:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:21.196483444 +0000 UTC m=+63.910517911" watchObservedRunningTime="2026-07-29 15:47:21.197031303 +0000 UTC m=+63.911065768" Jul 29 15:47:23.561606 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:23.561566 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-original-pull-secret\") pod \"global-pull-secret-syncer-kdc28\" (UID: \"d5e53580-c891-4bd3-8a76-ffcd74cb4ac5\") " pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:47:23.562045 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:23.561632 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-metrics-certs\") pod \"network-metrics-daemon-jchg2\" (UID: \"92a38651-6bb4-4f5a-9d97-8ac79e1027f4\") " pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:47:23.564350 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:23.564326 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 15:47:23.564457 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:23.564414 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 15:47:23.572866 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:23.572841 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 29 15:47:23.573002 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:23.572906 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-metrics-certs podName:92a38651-6bb4-4f5a-9d97-8ac79e1027f4 nodeName:}" failed. No retries permitted until 2026-07-29 15:48:27.572890539 +0000 UTC m=+130.286924983 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-metrics-certs") pod "network-metrics-daemon-jchg2" (UID: "92a38651-6bb4-4f5a-9d97-8ac79e1027f4") : secret "metrics-daemon-secret" not found Jul 29 15:47:23.575039 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:23.575016 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5e53580-c891-4bd3-8a76-ffcd74cb4ac5-original-pull-secret\") pod \"global-pull-secret-syncer-kdc28\" (UID: \"d5e53580-c891-4bd3-8a76-ffcd74cb4ac5\") " pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:47:23.623853 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:23.623819 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kdc28" Jul 29 15:47:23.663082 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:23.663042 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nmp5\" (UniqueName: \"kubernetes.io/projected/73422f43-4d4a-4738-be77-ba5aff983673-kube-api-access-8nmp5\") pod \"network-check-target-fqgzw\" (UID: \"73422f43-4d4a-4738-be77-ba5aff983673\") " pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:47:23.666249 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:23.666210 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nmp5\" (UniqueName: \"kubernetes.io/projected/73422f43-4d4a-4738-be77-ba5aff983673-kube-api-access-8nmp5\") pod \"network-check-target-fqgzw\" (UID: \"73422f43-4d4a-4738-be77-ba5aff983673\") " pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:47:23.764872 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:23.764848 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kdc28"] Jul 29 15:47:23.767889 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:47:23.767859 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5e53580_c891_4bd3_8a76_ffcd74cb4ac5.slice/crio-6472cb6a1ac3a38f13d5b53e92c31d12876557d4a65acc4f77f7c02af2585f7c WatchSource:0}: Error finding container 6472cb6a1ac3a38f13d5b53e92c31d12876557d4a65acc4f77f7c02af2585f7c: Status 404 returned error can't find the container with id 6472cb6a1ac3a38f13d5b53e92c31d12876557d4a65acc4f77f7c02af2585f7c Jul 29 15:47:23.864668 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:23.864579 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/141e3214-1ccf-4ebf-bb64-b1895c6a7402-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b4cnv\" (UID: \"141e3214-1ccf-4ebf-bb64-b1895c6a7402\") " pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:23.864668 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:23.864617 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/141e3214-1ccf-4ebf-bb64-b1895c6a7402-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b4cnv\" (UID: \"141e3214-1ccf-4ebf-bb64-b1895c6a7402\") " pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:23.864850 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:23.864700 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:47:23.864850 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:23.864722 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:47:23.864850 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:23.864767 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/141e3214-1ccf-4ebf-bb64-b1895c6a7402-kube-rbac-proxy-cm podName:141e3214-1ccf-4ebf-bb64-b1895c6a7402 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:31.864751957 +0000 UTC m=+74.578786405 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/141e3214-1ccf-4ebf-bb64-b1895c6a7402-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b4cnv" (UID: "141e3214-1ccf-4ebf-bb64-b1895c6a7402") : configmap "kube-rbac-proxy" not found Jul 29 15:47:23.864850 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:23.864781 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/141e3214-1ccf-4ebf-bb64-b1895c6a7402-insights-runtime-extractor-tls podName:141e3214-1ccf-4ebf-bb64-b1895c6a7402 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:31.864775307 +0000 UTC m=+74.578809751 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/141e3214-1ccf-4ebf-bb64-b1895c6a7402-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b4cnv" (UID: "141e3214-1ccf-4ebf-bb64-b1895c6a7402") : secret "insights-runtime-extractor-tls" not found Jul 29 15:47:23.915454 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:23.915423 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9brzs\"" Jul 29 15:47:23.922861 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:23.922825 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:47:24.066428 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:24.066390 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/184a4db0-e00b-4e60-84bc-96dffd559d6e-metrics-tls\") pod \"dns-default-cdv86\" (UID: \"184a4db0-e00b-4e60-84bc-96dffd559d6e\") " pod="openshift-dns/dns-default-cdv86" Jul 29 15:47:24.066621 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:24.066458 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-registry-tls\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:47:24.066621 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:24.066562 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:47:24.066711 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:24.066630 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/184a4db0-e00b-4e60-84bc-96dffd559d6e-metrics-tls podName:184a4db0-e00b-4e60-84bc-96dffd559d6e nodeName:}" failed. No retries permitted until 2026-07-29 15:47:56.066612737 +0000 UTC m=+98.780647180 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/184a4db0-e00b-4e60-84bc-96dffd559d6e-metrics-tls") pod "dns-default-cdv86" (UID: "184a4db0-e00b-4e60-84bc-96dffd559d6e") : secret "dns-default-metrics-tls" not found Jul 29 15:47:24.066711 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:24.066635 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 15:47:24.066711 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:24.066653 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-794786757-89ml8: secret "image-registry-tls" not found Jul 29 15:47:24.066711 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:24.066707 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-registry-tls podName:78144aa9-485b-4141-af15-bec828994442 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:56.066689241 +0000 UTC m=+98.780723687 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-registry-tls") pod "image-registry-794786757-89ml8" (UID: "78144aa9-485b-4141-af15-bec828994442") : secret "image-registry-tls" not found Jul 29 15:47:24.072577 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:24.072531 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fqgzw"] Jul 29 15:47:24.074922 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:47:24.074899 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73422f43_4d4a_4738_be77_ba5aff983673.slice/crio-10df14eab9767cf275059cd67a5a21b0a2d921df7b7ae95f8647addbcefb65f1 WatchSource:0}: Error finding container 10df14eab9767cf275059cd67a5a21b0a2d921df7b7ae95f8647addbcefb65f1: Status 404 returned error can't find the container with id 10df14eab9767cf275059cd67a5a21b0a2d921df7b7ae95f8647addbcefb65f1 Jul 29 15:47:24.188425 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:24.188383 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fqgzw" event={"ID":"73422f43-4d4a-4738-be77-ba5aff983673","Type":"ContainerStarted","Data":"2a0569bf4a5d0efe8392945be672090b26451fedfc862bfc78c5a0f36ea26b3d"} Jul 29 15:47:24.188622 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:24.188447 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:47:24.188622 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:24.188467 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fqgzw" event={"ID":"73422f43-4d4a-4738-be77-ba5aff983673","Type":"ContainerStarted","Data":"10df14eab9767cf275059cd67a5a21b0a2d921df7b7ae95f8647addbcefb65f1"} Jul 29 15:47:24.189591 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:24.189568 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kdc28" event={"ID":"d5e53580-c891-4bd3-8a76-ffcd74cb4ac5","Type":"ContainerStarted","Data":"6472cb6a1ac3a38f13d5b53e92c31d12876557d4a65acc4f77f7c02af2585f7c"} Jul 29 15:47:24.223458 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:24.223412 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fqgzw" podStartSLOduration=67.223394566 podStartE2EDuration="1m7.223394566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:46:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:24.222224792 +0000 UTC m=+66.936259257" watchObservedRunningTime="2026-07-29 15:47:24.223394566 +0000 UTC m=+66.937429031" Jul 29 15:47:25.480533 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:25.480491 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73aeab81-faab-4712-968c-ab8ee7b67e10-metrics-certs\") pod \"router-default-6f9fb4469f-8dzw8\" (UID: \"73aeab81-faab-4712-968c-ab8ee7b67e10\") " pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:25.481003 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:25.480658 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 15:47:25.481003 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:25.480682 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73aeab81-faab-4712-968c-ab8ee7b67e10-service-ca-bundle\") pod \"router-default-6f9fb4469f-8dzw8\" (UID: \"73aeab81-faab-4712-968c-ab8ee7b67e10\") " pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:25.481003 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:25.480730 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73aeab81-faab-4712-968c-ab8ee7b67e10-metrics-certs podName:73aeab81-faab-4712-968c-ab8ee7b67e10 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:41.480710378 +0000 UTC m=+84.194744824 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73aeab81-faab-4712-968c-ab8ee7b67e10-metrics-certs") pod "router-default-6f9fb4469f-8dzw8" (UID: "73aeab81-faab-4712-968c-ab8ee7b67e10") : secret "router-metrics-certs-default" not found Jul 29 15:47:25.481003 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:25.480789 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73aeab81-faab-4712-968c-ab8ee7b67e10-service-ca-bundle podName:73aeab81-faab-4712-968c-ab8ee7b67e10 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:41.480775833 +0000 UTC m=+84.194810281 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/73aeab81-faab-4712-968c-ab8ee7b67e10-service-ca-bundle") pod "router-default-6f9fb4469f-8dzw8" (UID: "73aeab81-faab-4712-968c-ab8ee7b67e10") : configmap references non-existent config key: service-ca.crt Jul 29 15:47:25.582004 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:25.581966 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2dfbf7d0-c804-4516-b8e7-926c7e521e6c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-b74zp\" (UID: \"2dfbf7d0-c804-4516-b8e7-926c7e521e6c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-b74zp" Jul 29 15:47:25.582004 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:25.582009 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-gtbm5\" (UID: \"9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gtbm5" Jul 29 15:47:25.582242 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:25.582129 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 15:47:25.582242 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:25.582198 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dfbf7d0-c804-4516-b8e7-926c7e521e6c-cluster-monitoring-operator-tls podName:2dfbf7d0-c804-4516-b8e7-926c7e521e6c nodeName:}" failed. No retries permitted until 2026-07-29 15:47:41.582180772 +0000 UTC m=+84.296215226 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2dfbf7d0-c804-4516-b8e7-926c7e521e6c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-b74zp" (UID: "2dfbf7d0-c804-4516-b8e7-926c7e521e6c") : secret "cluster-monitoring-operator-tls" not found Jul 29 15:47:25.584688 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:25.584662 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-gtbm5\" (UID: \"9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gtbm5" Jul 29 15:47:25.638200 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:25.638169 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-b2mb7\"" Jul 29 15:47:25.645039 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:25.645002 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gtbm5" Jul 29 15:47:25.807506 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:25.807477 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gtbm5"] Jul 29 15:47:26.202327 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:26.202237 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gtbm5" event={"ID":"9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4","Type":"ContainerStarted","Data":"9925a5fe366fbba92b54fdc995ed771eec4f266cfa637ffecb8f8a8cd0752ef5"} Jul 29 15:47:29.215663 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:29.215562 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gtbm5" event={"ID":"9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4","Type":"ContainerStarted","Data":"8f8b9345813703da5d03e99e185f64c71a601b5c3b665912f6dbc3f1813d3ad2"} Jul 29 15:47:29.215663 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:29.215624 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gtbm5" event={"ID":"9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4","Type":"ContainerStarted","Data":"fa3b1d2b2926de1fa39669868330e4a35a405eef8e69a59cd031e658e5487902"} Jul 29 15:47:29.217098 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:29.217075 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kdc28" event={"ID":"d5e53580-c891-4bd3-8a76-ffcd74cb4ac5","Type":"ContainerStarted","Data":"ab62f3b631c6eb1733b1d6913cce6ab5db6c5f7d65d25e36ff581f05f3713209"} Jul 29 15:47:29.235583 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:29.235504 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gtbm5" podStartSLOduration=17.35198836 podStartE2EDuration="20.235485897s" totalImagesPullingTime="2.883497537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:29.234453522 +0000 UTC m=+71.948487988" watchObservedRunningTime="2026-07-29 15:47:29.235485897 +0000 UTC m=+71.949520401" Jul 29 15:47:29.249776 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:29.249704 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kdc28" podStartSLOduration=66.288341935 podStartE2EDuration="1m11.249687911s" totalImagesPullingTime="4.961345976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:46:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:29.249495654 +0000 UTC m=+71.963530122" watchObservedRunningTime="2026-07-29 15:47:29.249687911 +0000 UTC m=+71.963722376" Jul 29 15:47:31.943653 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:31.943610 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/141e3214-1ccf-4ebf-bb64-b1895c6a7402-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b4cnv\" (UID: \"141e3214-1ccf-4ebf-bb64-b1895c6a7402\") " pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:31.943653 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:31.943654 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/141e3214-1ccf-4ebf-bb64-b1895c6a7402-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b4cnv\" (UID: \"141e3214-1ccf-4ebf-bb64-b1895c6a7402\") " pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:31.944078 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:31.943779 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:47:31.944078 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:47:31.943837 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/141e3214-1ccf-4ebf-bb64-b1895c6a7402-insights-runtime-extractor-tls podName:141e3214-1ccf-4ebf-bb64-b1895c6a7402 nodeName:}" failed. No retries permitted until 2026-07-29 15:47:47.943821579 +0000 UTC m=+90.657856027 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/141e3214-1ccf-4ebf-bb64-b1895c6a7402-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b4cnv" (UID: "141e3214-1ccf-4ebf-bb64-b1895c6a7402") : secret "insights-runtime-extractor-tls" not found Jul 29 15:47:31.944177 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:31.944155 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/141e3214-1ccf-4ebf-bb64-b1895c6a7402-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b4cnv\" (UID: \"141e3214-1ccf-4ebf-bb64-b1895c6a7402\") " pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:34.896578 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:34.896527 2554 scope.go:117] "RemoveContainer" containerID="4bb8d5f25144b0c8bbc25f85483446db11329e79af933e6dbcf87e92f2f40963" Jul 29 15:47:35.240317 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:35.240284 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndcms_5257faa4-46cf-45e5-b609-a414b4fd90af/console-operator/1.log" Jul 29 15:47:35.240475 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:35.240388 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-ndcms" event={"ID":"5257faa4-46cf-45e5-b609-a414b4fd90af","Type":"ContainerStarted","Data":"633803768dd07cd4b4f93b493bcdc5dc8044ac64f45c6ec66f29352534c2f028"} Jul 29 15:47:35.240750 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:35.240730 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-ndcms" Jul 29 15:47:35.259772 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:35.259715 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-ndcms" podStartSLOduration=21.421641654 podStartE2EDuration="26.25969431s" totalImagesPullingTime="4.838052656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:35.257677695 +0000 UTC m=+77.971712160" watchObservedRunningTime="2026-07-29 15:47:35.25969431 +0000 UTC m=+77.973728776" Jul 29 15:47:36.240800 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:36.240758 2554 patch_prober.go:28] interesting pod/console-operator-584dcb6b54-ndcms container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.17:8443/readyz\": context deadline exceeded" start-of-body= Jul 29 15:47:36.241231 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:36.240825 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-584dcb6b54-ndcms" podUID="5257faa4-46cf-45e5-b609-a414b4fd90af" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.17:8443/readyz\": context deadline exceeded" Jul 29 15:47:36.524792 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:36.524704 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-ndcms" Jul 29 15:47:41.527248 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:41.527134 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73aeab81-faab-4712-968c-ab8ee7b67e10-metrics-certs\") pod \"router-default-6f9fb4469f-8dzw8\" (UID: \"73aeab81-faab-4712-968c-ab8ee7b67e10\") " pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:41.527248 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:41.527185 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73aeab81-faab-4712-968c-ab8ee7b67e10-service-ca-bundle\") pod \"router-default-6f9fb4469f-8dzw8\" (UID: \"73aeab81-faab-4712-968c-ab8ee7b67e10\") " pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:41.527866 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:41.527848 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73aeab81-faab-4712-968c-ab8ee7b67e10-service-ca-bundle\") pod \"router-default-6f9fb4469f-8dzw8\" (UID: \"73aeab81-faab-4712-968c-ab8ee7b67e10\") " pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:41.529515 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:41.529496 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73aeab81-faab-4712-968c-ab8ee7b67e10-metrics-certs\") pod \"router-default-6f9fb4469f-8dzw8\" (UID: \"73aeab81-faab-4712-968c-ab8ee7b67e10\") " pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:41.628086 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:41.628042 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2dfbf7d0-c804-4516-b8e7-926c7e521e6c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-b74zp\" (UID: \"2dfbf7d0-c804-4516-b8e7-926c7e521e6c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-b74zp" Jul 29 15:47:41.630390 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:41.630358 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2dfbf7d0-c804-4516-b8e7-926c7e521e6c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-b74zp\" (UID: \"2dfbf7d0-c804-4516-b8e7-926c7e521e6c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-b74zp" Jul 29 15:47:41.650806 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:41.650783 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tfpf7\"" Jul 29 15:47:41.659398 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:41.659381 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:41.781443 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:41.781418 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f9fb4469f-8dzw8"] Jul 29 15:47:41.783419 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:47:41.783384 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73aeab81_faab_4712_968c_ab8ee7b67e10.slice/crio-d3bcb8d1d84d45e6f31ed1bca91d630a492c8543f5d456d66df0170a01c1fd94 WatchSource:0}: Error finding container d3bcb8d1d84d45e6f31ed1bca91d630a492c8543f5d456d66df0170a01c1fd94: Status 404 returned error can't find the container with id d3bcb8d1d84d45e6f31ed1bca91d630a492c8543f5d456d66df0170a01c1fd94 Jul 29 15:47:41.790701 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:41.790683 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-prjhj\"" Jul 29 15:47:41.798970 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:41.798949 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-b74zp" Jul 29 15:47:41.929879 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:41.929845 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-b74zp"] Jul 29 15:47:41.933687 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:47:41.933664 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dfbf7d0_c804_4516_b8e7_926c7e521e6c.slice/crio-efa21bacd23f28dadb373d16a2edd40eeb4dbafe62430a841c21670bd16dc3f0 WatchSource:0}: Error finding container efa21bacd23f28dadb373d16a2edd40eeb4dbafe62430a841c21670bd16dc3f0: Status 404 returned error can't find the container with id efa21bacd23f28dadb373d16a2edd40eeb4dbafe62430a841c21670bd16dc3f0 Jul 29 15:47:42.263405 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:42.263370 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-b74zp" event={"ID":"2dfbf7d0-c804-4516-b8e7-926c7e521e6c","Type":"ContainerStarted","Data":"efa21bacd23f28dadb373d16a2edd40eeb4dbafe62430a841c21670bd16dc3f0"} Jul 29 15:47:42.264826 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:42.264804 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" event={"ID":"73aeab81-faab-4712-968c-ab8ee7b67e10","Type":"ContainerStarted","Data":"6481658836e5efd6eb257d073d4d62105132662792230373290935effc6fc7fd"} Jul 29 15:47:42.264916 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:42.264844 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" event={"ID":"73aeab81-faab-4712-968c-ab8ee7b67e10","Type":"ContainerStarted","Data":"d3bcb8d1d84d45e6f31ed1bca91d630a492c8543f5d456d66df0170a01c1fd94"} Jul 29 15:47:42.287622 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:42.287576 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" podStartSLOduration=33.287558247 podStartE2EDuration="33.287558247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:47:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:42.286532054 +0000 UTC m=+85.000566518" watchObservedRunningTime="2026-07-29 15:47:42.287558247 +0000 UTC m=+85.001592703" Jul 29 15:47:42.660047 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:42.659963 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:42.663136 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:42.663062 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:43.271865 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:43.271771 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:43.275445 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:43.275419 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6f9fb4469f-8dzw8" Jul 29 15:47:44.078900 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:44.078865 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-skpd5"] Jul 29 15:47:44.097015 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:44.096987 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-skpd5"] Jul 29 15:47:44.097185 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:44.097099 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-skpd5" Jul 29 15:47:44.100649 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:44.100623 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-lnx8t\"" Jul 29 15:47:44.100880 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:44.100865 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 29 15:47:44.251137 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:44.251096 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1782670f-879b-4673-81a7-411d638f7695-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-skpd5\" (UID: \"1782670f-879b-4673-81a7-411d638f7695\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-skpd5" Jul 29 15:47:44.275445 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:44.275408 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-b74zp" event={"ID":"2dfbf7d0-c804-4516-b8e7-926c7e521e6c","Type":"ContainerStarted","Data":"a956b4daf0e4824b0baecdc6de08cf923cae9d38549dd9a64d10c9989ff781ff"} Jul 29 15:47:44.294104 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:44.294050 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-b74zp" podStartSLOduration=33.672895233 podStartE2EDuration="35.294034441s" totalImagesPullingTime="1.621139208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:44.293412355 +0000 UTC m=+87.007446813" watchObservedRunningTime="2026-07-29 15:47:44.294034441 +0000 UTC m=+87.008068925" Jul 29 15:47:44.352193 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:44.352100 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1782670f-879b-4673-81a7-411d638f7695-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-skpd5\" (UID: \"1782670f-879b-4673-81a7-411d638f7695\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-skpd5" Jul 29 15:47:44.354526 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:44.354504 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1782670f-879b-4673-81a7-411d638f7695-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-skpd5\" (UID: \"1782670f-879b-4673-81a7-411d638f7695\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-skpd5" Jul 29 15:47:44.406658 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:44.406625 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-skpd5" Jul 29 15:47:44.541489 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:44.541464 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-skpd5"] Jul 29 15:47:44.543953 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:47:44.543927 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1782670f_879b_4673_81a7_411d638f7695.slice/crio-20a79f888c9754c66aced0dbbc2030ce4689de7309d0c86f813a7ebd2b1dcedf WatchSource:0}: Error finding container 20a79f888c9754c66aced0dbbc2030ce4689de7309d0c86f813a7ebd2b1dcedf: Status 404 returned error can't find the container with id 20a79f888c9754c66aced0dbbc2030ce4689de7309d0c86f813a7ebd2b1dcedf Jul 29 15:47:45.280219 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:45.280184 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-skpd5" event={"ID":"1782670f-879b-4673-81a7-411d638f7695","Type":"ContainerStarted","Data":"20a79f888c9754c66aced0dbbc2030ce4689de7309d0c86f813a7ebd2b1dcedf"} Jul 29 15:47:47.288439 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:47.288397 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-skpd5" event={"ID":"1782670f-879b-4673-81a7-411d638f7695","Type":"ContainerStarted","Data":"e90ceda197304f63a43b4bb517a1a0c08f1164287e394c8bceb456a57ec3e9e8"} Jul 29 15:47:47.288894 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:47.288598 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-skpd5" Jul 29 15:47:47.293364 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:47.293343 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-skpd5" Jul 29 15:47:47.311723 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:47.311670 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-skpd5" podStartSLOduration=1.417454222 podStartE2EDuration="3.311655836s" totalImagesPullingTime="1.894201614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:47.310593829 +0000 UTC m=+90.024628316" watchObservedRunningTime="2026-07-29 15:47:47.311655836 +0000 UTC m=+90.025690301" Jul 29 15:47:47.984694 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:47.984663 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/141e3214-1ccf-4ebf-bb64-b1895c6a7402-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b4cnv\" (UID: \"141e3214-1ccf-4ebf-bb64-b1895c6a7402\") " pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:47.986922 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:47.986898 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/141e3214-1ccf-4ebf-bb64-b1895c6a7402-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b4cnv\" (UID: \"141e3214-1ccf-4ebf-bb64-b1895c6a7402\") " pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:48.249395 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:48.249308 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d2ddt\"" Jul 29 15:47:48.257241 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:48.257223 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b4cnv" Jul 29 15:47:48.419649 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:48.419472 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b4cnv"] Jul 29 15:47:48.422427 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:47:48.422403 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod141e3214_1ccf_4ebf_bb64_b1895c6a7402.slice/crio-ed61c2f73bc5b92e3bd160e1a060fa513c4f0b98667ede8a72e57fabde0dc746 WatchSource:0}: Error finding container ed61c2f73bc5b92e3bd160e1a060fa513c4f0b98667ede8a72e57fabde0dc746: Status 404 returned error can't find the container with id ed61c2f73bc5b92e3bd160e1a060fa513c4f0b98667ede8a72e57fabde0dc746 Jul 29 15:47:49.298488 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:49.298445 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b4cnv" event={"ID":"141e3214-1ccf-4ebf-bb64-b1895c6a7402","Type":"ContainerStarted","Data":"ed61c2f73bc5b92e3bd160e1a060fa513c4f0b98667ede8a72e57fabde0dc746"} Jul 29 15:47:53.315407 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:53.315364 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b4cnv" event={"ID":"141e3214-1ccf-4ebf-bb64-b1895c6a7402","Type":"ContainerStarted","Data":"5c678fabc9886ad960951b53bd711f6f0583a80aa017d1d31d69f64a7b1db20c"} Jul 29 15:47:53.831950 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:53.831914 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-558cddfdcd-t7wfl"] Jul 29 15:47:53.834265 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:53.834239 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:47:53.837258 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:53.837236 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 15:47:53.837351 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:53.837276 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 29 15:47:53.838270 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:53.838245 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 15:47:53.838407 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:53.838285 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 15:47:53.838407 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:53.838332 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 29 15:47:53.838577 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:53.838447 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 15:47:53.838729 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:53.838708 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bzgb7\"" Jul 29 15:47:53.838790 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:53.838747 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 15:47:53.843061 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:53.843042 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 29 15:47:53.846633 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:53.846614 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-558cddfdcd-t7wfl"] Jul 29 15:47:53.932468 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:53.932434 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-service-ca\") pod \"console-558cddfdcd-t7wfl\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:47:53.932652 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:53.932494 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-console-config\") pod \"console-558cddfdcd-t7wfl\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:47:53.932652 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:53.932521 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-console-serving-cert\") pod \"console-558cddfdcd-t7wfl\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:47:53.932652 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:53.932600 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-trusted-ca-bundle\") pod \"console-558cddfdcd-t7wfl\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:47:53.932652 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:53.932622 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pwx2\" (UniqueName: \"kubernetes.io/projected/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-kube-api-access-2pwx2\") pod \"console-558cddfdcd-t7wfl\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:47:53.932786 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:53.932664 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-oauth-serving-cert\") pod \"console-558cddfdcd-t7wfl\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:47:53.932786 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:53.932696 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-console-oauth-config\") pod \"console-558cddfdcd-t7wfl\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:47:54.033377 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:54.033336 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-console-config\") pod \"console-558cddfdcd-t7wfl\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:47:54.033377 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:54.033374 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-console-serving-cert\") pod \"console-558cddfdcd-t7wfl\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:47:54.033634 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:54.033418 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-trusted-ca-bundle\") pod \"console-558cddfdcd-t7wfl\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:47:54.033634 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:54.033441 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pwx2\" (UniqueName: \"kubernetes.io/projected/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-kube-api-access-2pwx2\") pod \"console-558cddfdcd-t7wfl\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:47:54.033634 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:54.033466 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-oauth-serving-cert\") pod \"console-558cddfdcd-t7wfl\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:47:54.033634 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:54.033499 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-console-oauth-config\") pod \"console-558cddfdcd-t7wfl\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:47:54.033837 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:54.033719 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-service-ca\") pod \"console-558cddfdcd-t7wfl\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:47:54.034157 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:54.034132 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-console-config\") pod \"console-558cddfdcd-t7wfl\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:47:54.034310 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:54.034284 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-trusted-ca-bundle\") pod \"console-558cddfdcd-t7wfl\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:47:54.034310 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:54.034225 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-oauth-serving-cert\") pod \"console-558cddfdcd-t7wfl\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:47:54.034478 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:54.034372 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-service-ca\") pod \"console-558cddfdcd-t7wfl\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:47:54.035855 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:54.035836 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-console-serving-cert\") pod \"console-558cddfdcd-t7wfl\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:47:54.036013 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:54.035991 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-console-oauth-config\") pod \"console-558cddfdcd-t7wfl\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:47:54.043038 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:54.043014 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pwx2\" (UniqueName: \"kubernetes.io/projected/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-kube-api-access-2pwx2\") pod \"console-558cddfdcd-t7wfl\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:47:54.143914 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:54.143820 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:47:54.290201 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:54.290169 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-558cddfdcd-t7wfl"] Jul 29 15:47:54.292849 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:47:54.292814 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c5b0d2f_b7a0_4fd8_8c3a_b531fcf7075e.slice/crio-0c1bd349e5dd73c8917aea1362918f5195c732e150bad8d33ff0c3a5d0c7522f WatchSource:0}: Error finding container 0c1bd349e5dd73c8917aea1362918f5195c732e150bad8d33ff0c3a5d0c7522f: Status 404 returned error can't find the container with id 0c1bd349e5dd73c8917aea1362918f5195c732e150bad8d33ff0c3a5d0c7522f Jul 29 15:47:54.321505 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:54.321429 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558cddfdcd-t7wfl" event={"ID":"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e","Type":"ContainerStarted","Data":"0c1bd349e5dd73c8917aea1362918f5195c732e150bad8d33ff0c3a5d0c7522f"} Jul 29 15:47:55.195880 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:55.195844 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fqgzw" Jul 29 15:47:56.153681 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:56.153637 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/184a4db0-e00b-4e60-84bc-96dffd559d6e-metrics-tls\") pod \"dns-default-cdv86\" (UID: \"184a4db0-e00b-4e60-84bc-96dffd559d6e\") " pod="openshift-dns/dns-default-cdv86" Jul 29 15:47:56.154092 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:56.153725 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-registry-tls\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:47:56.156236 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:56.156205 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/184a4db0-e00b-4e60-84bc-96dffd559d6e-metrics-tls\") pod \"dns-default-cdv86\" (UID: \"184a4db0-e00b-4e60-84bc-96dffd559d6e\") " pod="openshift-dns/dns-default-cdv86" Jul 29 15:47:56.156385 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:56.156278 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-registry-tls\") pod \"image-registry-794786757-89ml8\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:47:56.393558 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:56.393514 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-p9xsx\"" Jul 29 15:47:56.400946 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:56.400917 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:47:56.430531 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:56.430500 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l689t\"" Jul 29 15:47:56.438369 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:56.438335 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cdv86" Jul 29 15:47:57.439568 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:57.439529 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-794786757-89ml8"] Jul 29 15:47:57.443357 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:47:57.443327 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78144aa9_485b_4141_af15_bec828994442.slice/crio-e98193800835bf75299bb3e9780953d9bb916410fe05b8bede7342e68f71a4e5 WatchSource:0}: Error finding container e98193800835bf75299bb3e9780953d9bb916410fe05b8bede7342e68f71a4e5: Status 404 returned error can't find the container with id e98193800835bf75299bb3e9780953d9bb916410fe05b8bede7342e68f71a4e5 Jul 29 15:47:57.457852 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:57.457822 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cdv86"] Jul 29 15:47:57.460897 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:47:57.460865 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod184a4db0_e00b_4e60_84bc_96dffd559d6e.slice/crio-d45dbc7a9f3bf52ee564bd6e96078536ad45812a58f8bfcdcf0e6d548c8cbccf WatchSource:0}: Error finding container d45dbc7a9f3bf52ee564bd6e96078536ad45812a58f8bfcdcf0e6d548c8cbccf: Status 404 returned error can't find the container with id d45dbc7a9f3bf52ee564bd6e96078536ad45812a58f8bfcdcf0e6d548c8cbccf Jul 29 15:47:58.342463 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:58.342419 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b4cnv" event={"ID":"141e3214-1ccf-4ebf-bb64-b1895c6a7402","Type":"ContainerStarted","Data":"dd80d76309c7102e455dad5c008add23f8b344ffd80847c5a180c3e20198e209"} Jul 29 15:47:58.343755 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:58.343723 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cdv86" event={"ID":"184a4db0-e00b-4e60-84bc-96dffd559d6e","Type":"ContainerStarted","Data":"d45dbc7a9f3bf52ee564bd6e96078536ad45812a58f8bfcdcf0e6d548c8cbccf"} Jul 29 15:47:58.345467 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:58.345441 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-794786757-89ml8" event={"ID":"78144aa9-485b-4141-af15-bec828994442","Type":"ContainerStarted","Data":"8e076b1e48c3057e2a617b7dfee6a1bda7104574cafa61c0704210e96a420f91"} Jul 29 15:47:58.345610 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:58.345485 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-794786757-89ml8" event={"ID":"78144aa9-485b-4141-af15-bec828994442","Type":"ContainerStarted","Data":"e98193800835bf75299bb3e9780953d9bb916410fe05b8bede7342e68f71a4e5"} Jul 29 15:47:58.345610 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:58.345580 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:47:58.369384 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:47:58.369314 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-794786757-89ml8" podStartSLOduration=100.36929431 podStartE2EDuration="1m40.36929431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:46:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:47:58.367464196 +0000 UTC m=+101.081498683" watchObservedRunningTime="2026-07-29 15:47:58.36929431 +0000 UTC m=+101.083328776" Jul 29 15:48:02.363238 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:02.363193 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b4cnv" event={"ID":"141e3214-1ccf-4ebf-bb64-b1895c6a7402","Type":"ContainerStarted","Data":"ac7a929bf29ff8587dc528774e9988e4637fadf0608ae79733192e069e8fd7be"} Jul 29 15:48:02.364991 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:02.364963 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cdv86" event={"ID":"184a4db0-e00b-4e60-84bc-96dffd559d6e","Type":"ContainerStarted","Data":"df426963bba6a79730b90f9ea2842dc2a64f2dd12cc47fbbbf3ea212ea667789"} Jul 29 15:48:02.365128 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:02.365016 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cdv86" event={"ID":"184a4db0-e00b-4e60-84bc-96dffd559d6e","Type":"ContainerStarted","Data":"0cc7b10b41575e557daeb524b00cf125a30f0b02ee2064136bff9c5b84b1a992"} Jul 29 15:48:02.365128 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:02.365042 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cdv86" Jul 29 15:48:02.366448 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:02.366426 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558cddfdcd-t7wfl" event={"ID":"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e","Type":"ContainerStarted","Data":"e2fe92101bb4b42b5b7bf121d7ec8a8233edd5f4df74e7366d5408fa1e062a97"} Jul 29 15:48:02.387407 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:02.387353 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-b4cnv" podStartSLOduration=33.005867703 podStartE2EDuration="46.387336582s" totalImagesPullingTime="13.381468879s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:47:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:48:02.385167598 +0000 UTC m=+105.099202066" watchObservedRunningTime="2026-07-29 15:48:02.387336582 +0000 UTC m=+105.101371047" Jul 29 15:48:02.406900 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:02.406846 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-558cddfdcd-t7wfl" podStartSLOduration=1.77058925 podStartE2EDuration="9.406828222s" totalImagesPullingTime="7.636238972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:47:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:48:02.406005664 +0000 UTC m=+105.120040128" watchObservedRunningTime="2026-07-29 15:48:02.406828222 +0000 UTC m=+105.120862687" Jul 29 15:48:02.428050 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:02.427898 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cdv86" podStartSLOduration=65.930545486 podStartE2EDuration="1m10.427880199s" totalImagesPullingTime="4.497334713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:48:02.427563557 +0000 UTC m=+105.141598012" watchObservedRunningTime="2026-07-29 15:48:02.427880199 +0000 UTC m=+105.141914664" Jul 29 15:48:03.061136 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:03.061092 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-794786757-89ml8"] Jul 29 15:48:04.144448 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:04.144397 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:48:04.144898 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:04.144472 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:48:04.149326 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:04.149305 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:48:04.377727 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:04.377695 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:48:07.562046 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.562011 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25"] Jul 29 15:48:07.565154 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.565133 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25" Jul 29 15:48:07.568089 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.568060 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 29 15:48:07.568435 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.568414 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 29 15:48:07.569558 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.569517 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 29 15:48:07.569682 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.569659 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 29 15:48:07.569836 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.569533 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-xk76z\"" Jul 29 15:48:07.581115 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.581078 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8qn5m"] Jul 29 15:48:07.583778 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.583754 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25"] Jul 29 15:48:07.583900 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.583863 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.586760 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.586738 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sghl4\"" Jul 29 15:48:07.586884 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.586784 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 29 15:48:07.586884 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.586738 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 29 15:48:07.586884 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.586738 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 29 15:48:07.665203 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.665161 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92c36da9-4743-46c7-9e08-19fb7c02feee-node-exporter-tls\") pod \"node-exporter-8qn5m\" (UID: \"92c36da9-4743-46c7-9e08-19fb7c02feee\") " pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.665203 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.665203 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0799fb8-a222-4cf6-b410-6b7707d3265b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-r6l25\" (UID: \"e0799fb8-a222-4cf6-b410-6b7707d3265b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25" Jul 29 15:48:07.665458 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.665224 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92c36da9-4743-46c7-9e08-19fb7c02feee-metrics-client-ca\") pod \"node-exporter-8qn5m\" (UID: \"92c36da9-4743-46c7-9e08-19fb7c02feee\") " pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.665458 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.665255 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e0799fb8-a222-4cf6-b410-6b7707d3265b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-r6l25\" (UID: \"e0799fb8-a222-4cf6-b410-6b7707d3265b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25" Jul 29 15:48:07.665458 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.665335 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0799fb8-a222-4cf6-b410-6b7707d3265b-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-r6l25\" (UID: \"e0799fb8-a222-4cf6-b410-6b7707d3265b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25" Jul 29 15:48:07.665458 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.665376 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e0799fb8-a222-4cf6-b410-6b7707d3265b-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-r6l25\" (UID: \"e0799fb8-a222-4cf6-b410-6b7707d3265b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25" Jul 29 15:48:07.665458 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.665434 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/92c36da9-4743-46c7-9e08-19fb7c02feee-node-exporter-accelerators-collector-config\") pod \"node-exporter-8qn5m\" (UID: \"92c36da9-4743-46c7-9e08-19fb7c02feee\") " pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.665458 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.665460 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx7qp\" (UniqueName: \"kubernetes.io/projected/e0799fb8-a222-4cf6-b410-6b7707d3265b-kube-api-access-dx7qp\") pod \"kube-state-metrics-56d9f944b4-r6l25\" (UID: \"e0799fb8-a222-4cf6-b410-6b7707d3265b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25" Jul 29 15:48:07.665837 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.665479 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92c36da9-4743-46c7-9e08-19fb7c02feee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8qn5m\" (UID: \"92c36da9-4743-46c7-9e08-19fb7c02feee\") " pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.665837 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.665567 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/92c36da9-4743-46c7-9e08-19fb7c02feee-root\") pod \"node-exporter-8qn5m\" (UID: \"92c36da9-4743-46c7-9e08-19fb7c02feee\") " pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.665837 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.665608 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92c36da9-4743-46c7-9e08-19fb7c02feee-sys\") pod \"node-exporter-8qn5m\" (UID: \"92c36da9-4743-46c7-9e08-19fb7c02feee\") " pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.665837 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.665637 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0799fb8-a222-4cf6-b410-6b7707d3265b-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-r6l25\" (UID: \"e0799fb8-a222-4cf6-b410-6b7707d3265b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25" Jul 29 15:48:07.665837 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.665671 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m55vs\" (UniqueName: \"kubernetes.io/projected/92c36da9-4743-46c7-9e08-19fb7c02feee-kube-api-access-m55vs\") pod \"node-exporter-8qn5m\" (UID: \"92c36da9-4743-46c7-9e08-19fb7c02feee\") " pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.665837 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.665710 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/92c36da9-4743-46c7-9e08-19fb7c02feee-node-exporter-textfile\") pod \"node-exporter-8qn5m\" (UID: \"92c36da9-4743-46c7-9e08-19fb7c02feee\") " pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.665837 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.665739 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/92c36da9-4743-46c7-9e08-19fb7c02feee-node-exporter-wtmp\") pod \"node-exporter-8qn5m\" (UID: \"92c36da9-4743-46c7-9e08-19fb7c02feee\") " pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.766875 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.766833 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/92c36da9-4743-46c7-9e08-19fb7c02feee-node-exporter-textfile\") pod \"node-exporter-8qn5m\" (UID: \"92c36da9-4743-46c7-9e08-19fb7c02feee\") " pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.766875 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.766875 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/92c36da9-4743-46c7-9e08-19fb7c02feee-node-exporter-wtmp\") pod \"node-exporter-8qn5m\" (UID: \"92c36da9-4743-46c7-9e08-19fb7c02feee\") " pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.767123 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.766893 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92c36da9-4743-46c7-9e08-19fb7c02feee-node-exporter-tls\") pod \"node-exporter-8qn5m\" (UID: \"92c36da9-4743-46c7-9e08-19fb7c02feee\") " pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.767123 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.767027 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/92c36da9-4743-46c7-9e08-19fb7c02feee-node-exporter-wtmp\") pod \"node-exporter-8qn5m\" (UID: \"92c36da9-4743-46c7-9e08-19fb7c02feee\") " pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.767123 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.767089 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0799fb8-a222-4cf6-b410-6b7707d3265b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-r6l25\" (UID: \"e0799fb8-a222-4cf6-b410-6b7707d3265b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25" Jul 29 15:48:07.767275 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.767138 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92c36da9-4743-46c7-9e08-19fb7c02feee-metrics-client-ca\") pod \"node-exporter-8qn5m\" (UID: \"92c36da9-4743-46c7-9e08-19fb7c02feee\") " pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.767275 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.767171 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e0799fb8-a222-4cf6-b410-6b7707d3265b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-r6l25\" (UID: \"e0799fb8-a222-4cf6-b410-6b7707d3265b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25" Jul 29 15:48:07.767275 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.767215 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0799fb8-a222-4cf6-b410-6b7707d3265b-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-r6l25\" (UID: \"e0799fb8-a222-4cf6-b410-6b7707d3265b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25" Jul 29 15:48:07.767275 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.767248 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e0799fb8-a222-4cf6-b410-6b7707d3265b-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-r6l25\" (UID: \"e0799fb8-a222-4cf6-b410-6b7707d3265b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25" Jul 29 15:48:07.767462 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.767295 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/92c36da9-4743-46c7-9e08-19fb7c02feee-node-exporter-textfile\") pod \"node-exporter-8qn5m\" (UID: \"92c36da9-4743-46c7-9e08-19fb7c02feee\") " pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.767462 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.767304 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/92c36da9-4743-46c7-9e08-19fb7c02feee-node-exporter-accelerators-collector-config\") pod \"node-exporter-8qn5m\" (UID: \"92c36da9-4743-46c7-9e08-19fb7c02feee\") " pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.767462 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:48:07.767351 2554 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 29 15:48:07.767462 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:48:07.767429 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0799fb8-a222-4cf6-b410-6b7707d3265b-kube-state-metrics-tls podName:e0799fb8-a222-4cf6-b410-6b7707d3265b nodeName:}" failed. No retries permitted until 2026-07-29 15:48:08.267409298 +0000 UTC m=+110.981443750 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e0799fb8-a222-4cf6-b410-6b7707d3265b-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-r6l25" (UID: "e0799fb8-a222-4cf6-b410-6b7707d3265b") : secret "kube-state-metrics-tls" not found Jul 29 15:48:07.767716 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.767352 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx7qp\" (UniqueName: \"kubernetes.io/projected/e0799fb8-a222-4cf6-b410-6b7707d3265b-kube-api-access-dx7qp\") pod \"kube-state-metrics-56d9f944b4-r6l25\" (UID: \"e0799fb8-a222-4cf6-b410-6b7707d3265b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25" Jul 29 15:48:07.767781 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.767713 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92c36da9-4743-46c7-9e08-19fb7c02feee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8qn5m\" (UID: \"92c36da9-4743-46c7-9e08-19fb7c02feee\") " pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.767781 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.767661 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e0799fb8-a222-4cf6-b410-6b7707d3265b-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-r6l25\" (UID: \"e0799fb8-a222-4cf6-b410-6b7707d3265b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25" Jul 29 15:48:07.767781 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.767770 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/92c36da9-4743-46c7-9e08-19fb7c02feee-root\") pod \"node-exporter-8qn5m\" (UID: \"92c36da9-4743-46c7-9e08-19fb7c02feee\") " pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.767922 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.767796 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92c36da9-4743-46c7-9e08-19fb7c02feee-metrics-client-ca\") pod \"node-exporter-8qn5m\" (UID: \"92c36da9-4743-46c7-9e08-19fb7c02feee\") " pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.767922 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.767811 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92c36da9-4743-46c7-9e08-19fb7c02feee-sys\") pod \"node-exporter-8qn5m\" (UID: \"92c36da9-4743-46c7-9e08-19fb7c02feee\") " pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.767922 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.767852 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0799fb8-a222-4cf6-b410-6b7707d3265b-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-r6l25\" (UID: \"e0799fb8-a222-4cf6-b410-6b7707d3265b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25" Jul 29 15:48:07.767922 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.767863 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92c36da9-4743-46c7-9e08-19fb7c02feee-sys\") pod \"node-exporter-8qn5m\" (UID: \"92c36da9-4743-46c7-9e08-19fb7c02feee\") " pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.768108 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.767930 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m55vs\" (UniqueName: \"kubernetes.io/projected/92c36da9-4743-46c7-9e08-19fb7c02feee-kube-api-access-m55vs\") pod \"node-exporter-8qn5m\" (UID: \"92c36da9-4743-46c7-9e08-19fb7c02feee\") " pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.768108 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.768009 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/92c36da9-4743-46c7-9e08-19fb7c02feee-node-exporter-accelerators-collector-config\") pod \"node-exporter-8qn5m\" (UID: \"92c36da9-4743-46c7-9e08-19fb7c02feee\") " pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.768108 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.768058 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/92c36da9-4743-46c7-9e08-19fb7c02feee-root\") pod \"node-exporter-8qn5m\" (UID: \"92c36da9-4743-46c7-9e08-19fb7c02feee\") " pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.768535 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.768514 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0799fb8-a222-4cf6-b410-6b7707d3265b-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-r6l25\" (UID: \"e0799fb8-a222-4cf6-b410-6b7707d3265b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25" Jul 29 15:48:07.768809 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.768789 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e0799fb8-a222-4cf6-b410-6b7707d3265b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-r6l25\" (UID: \"e0799fb8-a222-4cf6-b410-6b7707d3265b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25" Jul 29 15:48:07.769873 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.769844 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0799fb8-a222-4cf6-b410-6b7707d3265b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-r6l25\" (UID: \"e0799fb8-a222-4cf6-b410-6b7707d3265b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25" Jul 29 15:48:07.769981 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.769923 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92c36da9-4743-46c7-9e08-19fb7c02feee-node-exporter-tls\") pod \"node-exporter-8qn5m\" (UID: \"92c36da9-4743-46c7-9e08-19fb7c02feee\") " pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.770069 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.770050 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92c36da9-4743-46c7-9e08-19fb7c02feee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8qn5m\" (UID: \"92c36da9-4743-46c7-9e08-19fb7c02feee\") " pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.779442 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.779408 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m55vs\" (UniqueName: \"kubernetes.io/projected/92c36da9-4743-46c7-9e08-19fb7c02feee-kube-api-access-m55vs\") pod \"node-exporter-8qn5m\" (UID: \"92c36da9-4743-46c7-9e08-19fb7c02feee\") " pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.779529 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.779444 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx7qp\" (UniqueName: \"kubernetes.io/projected/e0799fb8-a222-4cf6-b410-6b7707d3265b-kube-api-access-dx7qp\") pod \"kube-state-metrics-56d9f944b4-r6l25\" (UID: \"e0799fb8-a222-4cf6-b410-6b7707d3265b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25" Jul 29 15:48:07.894039 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:07.893963 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8qn5m" Jul 29 15:48:07.905687 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:48:07.905660 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92c36da9_4743_46c7_9e08_19fb7c02feee.slice/crio-7e57a730094309cd8f3a5b2c4b06fcf2e8ccde4c35a97bb90bea655ccd5df828 WatchSource:0}: Error finding container 7e57a730094309cd8f3a5b2c4b06fcf2e8ccde4c35a97bb90bea655ccd5df828: Status 404 returned error can't find the container with id 7e57a730094309cd8f3a5b2c4b06fcf2e8ccde4c35a97bb90bea655ccd5df828 Jul 29 15:48:08.272904 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:08.272861 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0799fb8-a222-4cf6-b410-6b7707d3265b-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-r6l25\" (UID: \"e0799fb8-a222-4cf6-b410-6b7707d3265b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25" Jul 29 15:48:08.275078 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:08.275050 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0799fb8-a222-4cf6-b410-6b7707d3265b-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-r6l25\" (UID: \"e0799fb8-a222-4cf6-b410-6b7707d3265b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25" Jul 29 15:48:08.389270 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:08.389219 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8qn5m" event={"ID":"92c36da9-4743-46c7-9e08-19fb7c02feee","Type":"ContainerStarted","Data":"7e57a730094309cd8f3a5b2c4b06fcf2e8ccde4c35a97bb90bea655ccd5df828"} Jul 29 15:48:08.475512 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:08.475472 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25" Jul 29 15:48:08.630572 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:08.630451 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25"] Jul 29 15:48:08.746940 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:48:08.746897 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0799fb8_a222_4cf6_b410_6b7707d3265b.slice/crio-a1a7fb0ebb9aad682b64777a179946c92ef81b32efe557d6f850372e03797c64 WatchSource:0}: Error finding container a1a7fb0ebb9aad682b64777a179946c92ef81b32efe557d6f850372e03797c64: Status 404 returned error can't find the container with id a1a7fb0ebb9aad682b64777a179946c92ef81b32efe557d6f850372e03797c64 Jul 29 15:48:09.394649 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:09.394614 2554 generic.go:356] "Generic (PLEG): container finished" podID="92c36da9-4743-46c7-9e08-19fb7c02feee" containerID="1ad9b5b985f2dd989e9af6ef51e729a8652823a50282dd7d49852c6ce5ee3d62" exitCode=0 Jul 29 15:48:09.394838 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:09.394700 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8qn5m" event={"ID":"92c36da9-4743-46c7-9e08-19fb7c02feee","Type":"ContainerDied","Data":"1ad9b5b985f2dd989e9af6ef51e729a8652823a50282dd7d49852c6ce5ee3d62"} Jul 29 15:48:09.396002 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:09.395976 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25" event={"ID":"e0799fb8-a222-4cf6-b410-6b7707d3265b","Type":"ContainerStarted","Data":"a1a7fb0ebb9aad682b64777a179946c92ef81b32efe557d6f850372e03797c64"} Jul 29 15:48:10.405213 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:10.405159 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25" event={"ID":"e0799fb8-a222-4cf6-b410-6b7707d3265b","Type":"ContainerStarted","Data":"6e58a2655fd5c8465ce2878dbabc430b56cdaacbe4e23bed03f8c314f9704ee8"} Jul 29 15:48:10.405213 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:10.405212 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25" event={"ID":"e0799fb8-a222-4cf6-b410-6b7707d3265b","Type":"ContainerStarted","Data":"1862ceccd6f5def2bba6133e72a5d3d6028e0889a59ad1e4c01b0503c2193e1d"} Jul 29 15:48:10.409171 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:10.409103 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8qn5m" event={"ID":"92c36da9-4743-46c7-9e08-19fb7c02feee","Type":"ContainerStarted","Data":"ddd41f493cb52d3296e052b410c9b518b4bdae5c1a7f0deabbd55e7814342773"} Jul 29 15:48:10.409171 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:10.409144 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8qn5m" event={"ID":"92c36da9-4743-46c7-9e08-19fb7c02feee","Type":"ContainerStarted","Data":"c4bd71dba7765f37887b3071122f6883b8366371d182c47efb4798f3991e67fe"} Jul 29 15:48:10.434173 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:10.434113 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8qn5m" podStartSLOduration=2.502453259 podStartE2EDuration="3.434094162s" totalImagesPullingTime="868.333964ms" totalInitContainerRuntime="63.306939ms" isStatefulPod=true podCreationTimestamp="2026-07-29 15:48:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:48:10.433270021 +0000 UTC m=+113.147304491" watchObservedRunningTime="2026-07-29 15:48:10.434094162 +0000 UTC m=+113.148128629" Jul 29 15:48:11.419932 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:11.419891 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25" event={"ID":"e0799fb8-a222-4cf6-b410-6b7707d3265b","Type":"ContainerStarted","Data":"d525013db6a5237ff1858ba9f7781b4dcd5c517b24f7f3b5253cf22b619d8b85"} Jul 29 15:48:11.442103 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:11.442056 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r6l25" podStartSLOduration=2.958686595 podStartE2EDuration="4.442042504s" totalImagesPullingTime="1.483355909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:48:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:48:11.440421952 +0000 UTC m=+114.154456417" watchObservedRunningTime="2026-07-29 15:48:11.442042504 +0000 UTC m=+114.156076968" Jul 29 15:48:11.942058 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:11.942028 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-d78fdf688-tn727"] Jul 29 15:48:11.945385 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:11.945361 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d78fdf688-tn727" Jul 29 15:48:11.949802 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:11.949775 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 29 15:48:11.949929 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:11.949809 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 29 15:48:11.949929 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:11.949816 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5qrmw\"" Jul 29 15:48:11.950045 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:11.949930 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 29 15:48:11.950045 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:11.949928 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 29 15:48:11.950136 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:11.950071 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cijer7p50obu8\"" Jul 29 15:48:11.955257 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:11.955237 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d78fdf688-tn727"] Jul 29 15:48:12.004218 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:12.004186 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/add0f40a-33c2-4c2d-ac81-3f57abf90de0-secret-metrics-server-client-certs\") pod \"metrics-server-d78fdf688-tn727\" (UID: \"add0f40a-33c2-4c2d-ac81-3f57abf90de0\") " pod="openshift-monitoring/metrics-server-d78fdf688-tn727" Jul 29 15:48:12.004218 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:12.004219 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/add0f40a-33c2-4c2d-ac81-3f57abf90de0-metrics-server-audit-profiles\") pod \"metrics-server-d78fdf688-tn727\" (UID: \"add0f40a-33c2-4c2d-ac81-3f57abf90de0\") " pod="openshift-monitoring/metrics-server-d78fdf688-tn727" Jul 29 15:48:12.004446 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:12.004243 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/add0f40a-33c2-4c2d-ac81-3f57abf90de0-secret-metrics-server-tls\") pod \"metrics-server-d78fdf688-tn727\" (UID: \"add0f40a-33c2-4c2d-ac81-3f57abf90de0\") " pod="openshift-monitoring/metrics-server-d78fdf688-tn727" Jul 29 15:48:12.004446 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:12.004260 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/add0f40a-33c2-4c2d-ac81-3f57abf90de0-audit-log\") pod \"metrics-server-d78fdf688-tn727\" (UID: \"add0f40a-33c2-4c2d-ac81-3f57abf90de0\") " pod="openshift-monitoring/metrics-server-d78fdf688-tn727" Jul 29 15:48:12.004446 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:12.004372 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/add0f40a-33c2-4c2d-ac81-3f57abf90de0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d78fdf688-tn727\" (UID: \"add0f40a-33c2-4c2d-ac81-3f57abf90de0\") " pod="openshift-monitoring/metrics-server-d78fdf688-tn727" Jul 29 15:48:12.004618 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:12.004465 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/add0f40a-33c2-4c2d-ac81-3f57abf90de0-client-ca-bundle\") pod \"metrics-server-d78fdf688-tn727\" (UID: \"add0f40a-33c2-4c2d-ac81-3f57abf90de0\") " pod="openshift-monitoring/metrics-server-d78fdf688-tn727" Jul 29 15:48:12.004618 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:12.004496 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk57w\" (UniqueName: \"kubernetes.io/projected/add0f40a-33c2-4c2d-ac81-3f57abf90de0-kube-api-access-pk57w\") pod \"metrics-server-d78fdf688-tn727\" (UID: \"add0f40a-33c2-4c2d-ac81-3f57abf90de0\") " pod="openshift-monitoring/metrics-server-d78fdf688-tn727" Jul 29 15:48:12.105557 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:12.105519 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/add0f40a-33c2-4c2d-ac81-3f57abf90de0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d78fdf688-tn727\" (UID: \"add0f40a-33c2-4c2d-ac81-3f57abf90de0\") " pod="openshift-monitoring/metrics-server-d78fdf688-tn727" Jul 29 15:48:12.105718 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:12.105600 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/add0f40a-33c2-4c2d-ac81-3f57abf90de0-client-ca-bundle\") pod \"metrics-server-d78fdf688-tn727\" (UID: \"add0f40a-33c2-4c2d-ac81-3f57abf90de0\") " pod="openshift-monitoring/metrics-server-d78fdf688-tn727" Jul 29 15:48:12.105718 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:12.105687 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk57w\" (UniqueName: \"kubernetes.io/projected/add0f40a-33c2-4c2d-ac81-3f57abf90de0-kube-api-access-pk57w\") pod \"metrics-server-d78fdf688-tn727\" (UID: \"add0f40a-33c2-4c2d-ac81-3f57abf90de0\") " pod="openshift-monitoring/metrics-server-d78fdf688-tn727" Jul 29 15:48:12.105827 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:12.105737 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/add0f40a-33c2-4c2d-ac81-3f57abf90de0-secret-metrics-server-client-certs\") pod \"metrics-server-d78fdf688-tn727\" (UID: \"add0f40a-33c2-4c2d-ac81-3f57abf90de0\") " pod="openshift-monitoring/metrics-server-d78fdf688-tn727" Jul 29 15:48:12.105827 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:12.105767 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/add0f40a-33c2-4c2d-ac81-3f57abf90de0-metrics-server-audit-profiles\") pod \"metrics-server-d78fdf688-tn727\" (UID: \"add0f40a-33c2-4c2d-ac81-3f57abf90de0\") " pod="openshift-monitoring/metrics-server-d78fdf688-tn727" Jul 29 15:48:12.105827 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:12.105790 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/add0f40a-33c2-4c2d-ac81-3f57abf90de0-secret-metrics-server-tls\") pod \"metrics-server-d78fdf688-tn727\" (UID: \"add0f40a-33c2-4c2d-ac81-3f57abf90de0\") " pod="openshift-monitoring/metrics-server-d78fdf688-tn727" Jul 29 15:48:12.105827 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:12.105806 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/add0f40a-33c2-4c2d-ac81-3f57abf90de0-audit-log\") pod \"metrics-server-d78fdf688-tn727\" (UID: \"add0f40a-33c2-4c2d-ac81-3f57abf90de0\") " pod="openshift-monitoring/metrics-server-d78fdf688-tn727" Jul 29 15:48:12.106228 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:12.106199 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/add0f40a-33c2-4c2d-ac81-3f57abf90de0-audit-log\") pod \"metrics-server-d78fdf688-tn727\" (UID: \"add0f40a-33c2-4c2d-ac81-3f57abf90de0\") " pod="openshift-monitoring/metrics-server-d78fdf688-tn727" Jul 29 15:48:12.106364 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:12.106316 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/add0f40a-33c2-4c2d-ac81-3f57abf90de0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d78fdf688-tn727\" (UID: \"add0f40a-33c2-4c2d-ac81-3f57abf90de0\") " pod="openshift-monitoring/metrics-server-d78fdf688-tn727" Jul 29 15:48:12.106761 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:12.106741 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/add0f40a-33c2-4c2d-ac81-3f57abf90de0-metrics-server-audit-profiles\") pod \"metrics-server-d78fdf688-tn727\" (UID: \"add0f40a-33c2-4c2d-ac81-3f57abf90de0\") " pod="openshift-monitoring/metrics-server-d78fdf688-tn727" Jul 29 15:48:12.108115 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:12.108087 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/add0f40a-33c2-4c2d-ac81-3f57abf90de0-client-ca-bundle\") pod \"metrics-server-d78fdf688-tn727\" (UID: \"add0f40a-33c2-4c2d-ac81-3f57abf90de0\") " pod="openshift-monitoring/metrics-server-d78fdf688-tn727" Jul 29 15:48:12.108115 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:12.108109 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/add0f40a-33c2-4c2d-ac81-3f57abf90de0-secret-metrics-server-tls\") pod \"metrics-server-d78fdf688-tn727\" (UID: \"add0f40a-33c2-4c2d-ac81-3f57abf90de0\") " pod="openshift-monitoring/metrics-server-d78fdf688-tn727" Jul 29 15:48:12.108216 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:12.108189 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/add0f40a-33c2-4c2d-ac81-3f57abf90de0-secret-metrics-server-client-certs\") pod \"metrics-server-d78fdf688-tn727\" (UID: \"add0f40a-33c2-4c2d-ac81-3f57abf90de0\") " pod="openshift-monitoring/metrics-server-d78fdf688-tn727" Jul 29 15:48:12.113717 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:12.113691 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk57w\" (UniqueName: \"kubernetes.io/projected/add0f40a-33c2-4c2d-ac81-3f57abf90de0-kube-api-access-pk57w\") pod \"metrics-server-d78fdf688-tn727\" (UID: \"add0f40a-33c2-4c2d-ac81-3f57abf90de0\") " pod="openshift-monitoring/metrics-server-d78fdf688-tn727" Jul 29 15:48:12.254781 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:12.254710 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d78fdf688-tn727" Jul 29 15:48:12.372773 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:12.372741 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cdv86" Jul 29 15:48:12.404475 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:48:12.404442 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadd0f40a_33c2_4c2d_ac81_3f57abf90de0.slice/crio-1464021918ef117cd035c6b0c737a4010666eb2da29d5da356604df457b1317e WatchSource:0}: Error finding container 1464021918ef117cd035c6b0c737a4010666eb2da29d5da356604df457b1317e: Status 404 returned error can't find the container with id 1464021918ef117cd035c6b0c737a4010666eb2da29d5da356604df457b1317e Jul 29 15:48:12.409302 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:12.409244 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d78fdf688-tn727"] Jul 29 15:48:12.425375 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:12.425346 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d78fdf688-tn727" event={"ID":"add0f40a-33c2-4c2d-ac81-3f57abf90de0","Type":"ContainerStarted","Data":"1464021918ef117cd035c6b0c737a4010666eb2da29d5da356604df457b1317e"} Jul 29 15:48:13.067700 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:13.067673 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:48:14.434502 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:14.434403 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d78fdf688-tn727" event={"ID":"add0f40a-33c2-4c2d-ac81-3f57abf90de0","Type":"ContainerStarted","Data":"6696dd9c63d1b58f28584536765f0eb2901e57554c808203f51c59fc4df5fc3b"} Jul 29 15:48:14.454759 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:14.454701 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-d78fdf688-tn727" podStartSLOduration=1.724179703 podStartE2EDuration="3.454685468s" totalImagesPullingTime="1.730505765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:48:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:48:14.454368565 +0000 UTC m=+117.168403030" watchObservedRunningTime="2026-07-29 15:48:14.454685468 +0000 UTC m=+117.168719933" Jul 29 15:48:22.464283 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:22.464247 2554 generic.go:356] "Generic (PLEG): container finished" podID="d1d31deb-30f5-4af3-abeb-1d20733a12d1" containerID="a4ae55109bb8f73600a340311bae1a1d49522ae681d50e0b40c337db7f177881" exitCode=0 Jul 29 15:48:22.464709 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:22.464319 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76" event={"ID":"d1d31deb-30f5-4af3-abeb-1d20733a12d1","Type":"ContainerDied","Data":"a4ae55109bb8f73600a340311bae1a1d49522ae681d50e0b40c337db7f177881"} Jul 29 15:48:22.464709 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:22.464657 2554 scope.go:117] "RemoveContainer" containerID="a4ae55109bb8f73600a340311bae1a1d49522ae681d50e0b40c337db7f177881" Jul 29 15:48:22.982895 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:22.982860 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-558cddfdcd-t7wfl"] Jul 29 15:48:23.470946 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:23.470870 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76" event={"ID":"d1d31deb-30f5-4af3-abeb-1d20733a12d1","Type":"ContainerStarted","Data":"016c7de6572a06d94f528c45c66f37827162897dc7d68b09dd9efe53acab73af"} Jul 29 15:48:27.649923 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:27.649882 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-metrics-certs\") pod \"network-metrics-daemon-jchg2\" (UID: \"92a38651-6bb4-4f5a-9d97-8ac79e1027f4\") " pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:48:27.652362 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:27.652337 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92a38651-6bb4-4f5a-9d97-8ac79e1027f4-metrics-certs\") pod \"network-metrics-daemon-jchg2\" (UID: \"92a38651-6bb4-4f5a-9d97-8ac79e1027f4\") " pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:48:27.820344 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:27.820315 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mdhwr\"" Jul 29 15:48:27.828529 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:27.828506 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jchg2" Jul 29 15:48:27.969683 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:27.969650 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jchg2"] Jul 29 15:48:27.972978 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:48:27.972950 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92a38651_6bb4_4f5a_9d97_8ac79e1027f4.slice/crio-fc69ff9d9dbd0deca39dbfa7c496c1e0d9522719b5929f485439a83c741e9210 WatchSource:0}: Error finding container fc69ff9d9dbd0deca39dbfa7c496c1e0d9522719b5929f485439a83c741e9210: Status 404 returned error can't find the container with id fc69ff9d9dbd0deca39dbfa7c496c1e0d9522719b5929f485439a83c741e9210 Jul 29 15:48:28.080438 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.080367 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-794786757-89ml8" podUID="78144aa9-485b-4141-af15-bec828994442" containerName="registry" containerID="cri-o://8e076b1e48c3057e2a617b7dfee6a1bda7104574cafa61c0704210e96a420f91" gracePeriod=30 Jul 29 15:48:28.101609 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:48:28.101574 2554 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78144aa9_485b_4141_af15_bec828994442.slice/crio-8e076b1e48c3057e2a617b7dfee6a1bda7104574cafa61c0704210e96a420f91.scope\": RecentStats: unable to find data in memory cache]" Jul 29 15:48:28.304229 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.304205 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:48:28.456676 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.456580 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/78144aa9-485b-4141-af15-bec828994442-registry-certificates\") pod \"78144aa9-485b-4141-af15-bec828994442\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " Jul 29 15:48:28.456676 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.456644 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-bound-sa-token\") pod \"78144aa9-485b-4141-af15-bec828994442\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " Jul 29 15:48:28.456676 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.456673 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/78144aa9-485b-4141-af15-bec828994442-image-registry-private-configuration\") pod \"78144aa9-485b-4141-af15-bec828994442\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " Jul 29 15:48:28.456950 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.456706 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/78144aa9-485b-4141-af15-bec828994442-installation-pull-secrets\") pod \"78144aa9-485b-4141-af15-bec828994442\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " Jul 29 15:48:28.456950 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.456730 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-registry-tls\") pod \"78144aa9-485b-4141-af15-bec828994442\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " Jul 29 15:48:28.456950 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.456848 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/78144aa9-485b-4141-af15-bec828994442-ca-trust-extracted\") pod \"78144aa9-485b-4141-af15-bec828994442\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " Jul 29 15:48:28.456950 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.456903 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkps4\" (UniqueName: \"kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-kube-api-access-jkps4\") pod \"78144aa9-485b-4141-af15-bec828994442\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " Jul 29 15:48:28.456950 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.456935 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/78144aa9-485b-4141-af15-bec828994442-trusted-ca\") pod \"78144aa9-485b-4141-af15-bec828994442\" (UID: \"78144aa9-485b-4141-af15-bec828994442\") " Jul 29 15:48:28.457450 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.457404 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78144aa9-485b-4141-af15-bec828994442-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "78144aa9-485b-4141-af15-bec828994442" (UID: "78144aa9-485b-4141-af15-bec828994442"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:48:28.457886 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.457855 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78144aa9-485b-4141-af15-bec828994442-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "78144aa9-485b-4141-af15-bec828994442" (UID: "78144aa9-485b-4141-af15-bec828994442"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:48:28.459821 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.459794 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "78144aa9-485b-4141-af15-bec828994442" (UID: "78144aa9-485b-4141-af15-bec828994442"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:48:28.459926 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.459830 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78144aa9-485b-4141-af15-bec828994442-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "78144aa9-485b-4141-af15-bec828994442" (UID: "78144aa9-485b-4141-af15-bec828994442"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:48:28.459926 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.459912 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78144aa9-485b-4141-af15-bec828994442-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "78144aa9-485b-4141-af15-bec828994442" (UID: "78144aa9-485b-4141-af15-bec828994442"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:48:28.461594 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.460199 2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/78144aa9-485b-4141-af15-bec828994442-registry-certificates\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jul 29 15:48:28.461594 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.460231 2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/78144aa9-485b-4141-af15-bec828994442-image-registry-private-configuration\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jul 29 15:48:28.461594 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.460249 2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/78144aa9-485b-4141-af15-bec828994442-installation-pull-secrets\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jul 29 15:48:28.461594 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.460263 2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-registry-tls\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jul 29 15:48:28.461594 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.460257 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-kube-api-access-jkps4" (OuterVolumeSpecName: "kube-api-access-jkps4") pod "78144aa9-485b-4141-af15-bec828994442" (UID: "78144aa9-485b-4141-af15-bec828994442"). InnerVolumeSpecName "kube-api-access-jkps4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:48:28.461594 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.460276 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/78144aa9-485b-4141-af15-bec828994442-trusted-ca\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jul 29 15:48:28.461594 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.460752 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "78144aa9-485b-4141-af15-bec828994442" (UID: "78144aa9-485b-4141-af15-bec828994442"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:48:28.467437 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.467412 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78144aa9-485b-4141-af15-bec828994442-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "78144aa9-485b-4141-af15-bec828994442" (UID: "78144aa9-485b-4141-af15-bec828994442"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:48:28.490731 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.490691 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jchg2" event={"ID":"92a38651-6bb4-4f5a-9d97-8ac79e1027f4","Type":"ContainerStarted","Data":"fc69ff9d9dbd0deca39dbfa7c496c1e0d9522719b5929f485439a83c741e9210"} Jul 29 15:48:28.491842 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.491816 2554 generic.go:356] "Generic (PLEG): container finished" podID="78144aa9-485b-4141-af15-bec828994442" containerID="8e076b1e48c3057e2a617b7dfee6a1bda7104574cafa61c0704210e96a420f91" exitCode=0 Jul 29 15:48:28.491942 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.491870 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-794786757-89ml8" Jul 29 15:48:28.491998 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.491869 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-794786757-89ml8" event={"ID":"78144aa9-485b-4141-af15-bec828994442","Type":"ContainerDied","Data":"8e076b1e48c3057e2a617b7dfee6a1bda7104574cafa61c0704210e96a420f91"} Jul 29 15:48:28.491998 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.491985 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-794786757-89ml8" event={"ID":"78144aa9-485b-4141-af15-bec828994442","Type":"ContainerDied","Data":"e98193800835bf75299bb3e9780953d9bb916410fe05b8bede7342e68f71a4e5"} Jul 29 15:48:28.492088 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.492005 2554 scope.go:117] "RemoveContainer" containerID="8e076b1e48c3057e2a617b7dfee6a1bda7104574cafa61c0704210e96a420f91" Jul 29 15:48:28.502555 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.502351 2554 scope.go:117] "RemoveContainer" containerID="8e076b1e48c3057e2a617b7dfee6a1bda7104574cafa61c0704210e96a420f91" Jul 29 15:48:28.502823 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:48:28.502788 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e076b1e48c3057e2a617b7dfee6a1bda7104574cafa61c0704210e96a420f91\": container with ID starting with 8e076b1e48c3057e2a617b7dfee6a1bda7104574cafa61c0704210e96a420f91 not found: ID does not exist" containerID="8e076b1e48c3057e2a617b7dfee6a1bda7104574cafa61c0704210e96a420f91" Jul 29 15:48:28.502929 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.502833 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e076b1e48c3057e2a617b7dfee6a1bda7104574cafa61c0704210e96a420f91"} err="failed to get container status \"8e076b1e48c3057e2a617b7dfee6a1bda7104574cafa61c0704210e96a420f91\": rpc error: code = NotFound desc = could not find container \"8e076b1e48c3057e2a617b7dfee6a1bda7104574cafa61c0704210e96a420f91\": container with ID starting with 8e076b1e48c3057e2a617b7dfee6a1bda7104574cafa61c0704210e96a420f91 not found: ID does not exist" Jul 29 15:48:28.517041 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.517016 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-794786757-89ml8"] Jul 29 15:48:28.520849 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.520826 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-794786757-89ml8"] Jul 29 15:48:28.560959 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.560924 2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/78144aa9-485b-4141-af15-bec828994442-ca-trust-extracted\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jul 29 15:48:28.560959 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.560956 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkps4\" (UniqueName: \"kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-kube-api-access-jkps4\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jul 29 15:48:28.560959 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:28.560971 2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/78144aa9-485b-4141-af15-bec828994442-bound-sa-token\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jul 29 15:48:29.497278 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:29.497244 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jchg2" event={"ID":"92a38651-6bb4-4f5a-9d97-8ac79e1027f4","Type":"ContainerStarted","Data":"0db2cc5adca0a78d8e02b9c78c6217a2494f85303cf47ddbf94b923e63ff0d9e"} Jul 29 15:48:29.497707 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:29.497298 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jchg2" event={"ID":"92a38651-6bb4-4f5a-9d97-8ac79e1027f4","Type":"ContainerStarted","Data":"dfe7c9988990dc34799ad3912fa83c7796ab3212350353ad1045163eeb53d318"} Jul 29 15:48:29.515167 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:29.515119 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jchg2" podStartSLOduration=131.47345661 podStartE2EDuration="2m12.515102644s" totalImagesPullingTime="1.041646034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:48:29.514339882 +0000 UTC m=+132.228374350" watchObservedRunningTime="2026-07-29 15:48:29.515102644 +0000 UTC m=+132.229137109" Jul 29 15:48:29.901411 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:29.901335 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78144aa9-485b-4141-af15-bec828994442" path="/var/lib/kubelet/pods/78144aa9-485b-4141-af15-bec828994442/volumes" Jul 29 15:48:32.255313 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:32.255278 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-d78fdf688-tn727" Jul 29 15:48:32.255722 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:32.255340 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-d78fdf688-tn727" Jul 29 15:48:36.532027 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:36.531994 2554 generic.go:356] "Generic (PLEG): container finished" podID="5b5c5993-07f9-4c76-b552-108228b1dfa8" containerID="578c8a6a01dddc1248fc7903a52630f91760143e8a411e7c500dc635637b74b1" exitCode=0 Jul 29 15:48:36.532489 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:36.532065 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-cpw78" event={"ID":"5b5c5993-07f9-4c76-b552-108228b1dfa8","Type":"ContainerDied","Data":"578c8a6a01dddc1248fc7903a52630f91760143e8a411e7c500dc635637b74b1"} Jul 29 15:48:36.532489 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:36.532439 2554 scope.go:117] "RemoveContainer" containerID="578c8a6a01dddc1248fc7903a52630f91760143e8a411e7c500dc635637b74b1" Jul 29 15:48:36.533498 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:36.533477 2554 generic.go:356] "Generic (PLEG): container finished" podID="e64886a0-bd69-40f8-8ac3-b6184100d5d2" containerID="22d11907c4bedcd33f3d1258ff5b5397c65d069cfb79d9c5a18091579b2d1d26" exitCode=0 Jul 29 15:48:36.533604 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:36.533553 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4kzf8" event={"ID":"e64886a0-bd69-40f8-8ac3-b6184100d5d2","Type":"ContainerDied","Data":"22d11907c4bedcd33f3d1258ff5b5397c65d069cfb79d9c5a18091579b2d1d26"} Jul 29 15:48:36.533827 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:36.533814 2554 scope.go:117] "RemoveContainer" containerID="22d11907c4bedcd33f3d1258ff5b5397c65d069cfb79d9c5a18091579b2d1d26" Jul 29 15:48:37.539132 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:37.539087 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-cpw78" event={"ID":"5b5c5993-07f9-4c76-b552-108228b1dfa8","Type":"ContainerStarted","Data":"78aa794e58595b7e3ea49e4264664a4bbd67af3e39320ffe97eea512ec2c8b3d"} Jul 29 15:48:37.540841 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:37.540819 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4kzf8" event={"ID":"e64886a0-bd69-40f8-8ac3-b6184100d5d2","Type":"ContainerStarted","Data":"e5ae12ea0bb9276d14d663ba526cad8bd4decb6b145521486314a3366fdaa7f3"} Jul 29 15:48:48.003423 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.003358 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-558cddfdcd-t7wfl" podUID="0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e" containerName="console" containerID="cri-o://e2fe92101bb4b42b5b7bf121d7ec8a8233edd5f4df74e7366d5408fa1e062a97" gracePeriod=15 Jul 29 15:48:48.261193 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.261127 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:48:48.317050 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.317019 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-console-serving-cert\") pod \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " Jul 29 15:48:48.317226 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.317100 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pwx2\" (UniqueName: \"kubernetes.io/projected/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-kube-api-access-2pwx2\") pod \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " Jul 29 15:48:48.317226 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.317124 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-console-oauth-config\") pod \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " Jul 29 15:48:48.317226 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.317150 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-trusted-ca-bundle\") pod \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " Jul 29 15:48:48.317226 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.317195 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-service-ca\") pod \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " Jul 29 15:48:48.317422 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.317245 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-console-config\") pod \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " Jul 29 15:48:48.317422 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.317374 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-oauth-serving-cert\") pod \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\" (UID: \"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e\") " Jul 29 15:48:48.317681 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.317610 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-console-config" (OuterVolumeSpecName: "console-config") pod "0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e" (UID: "0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:48:48.317681 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.317666 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-service-ca" (OuterVolumeSpecName: "service-ca") pod "0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e" (UID: "0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:48:48.317854 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.317680 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e" (UID: "0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:48:48.317894 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.317869 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e" (UID: "0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:48:48.319308 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.319280 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e" (UID: "0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:48:48.319506 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.319486 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e" (UID: "0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:48:48.319622 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.319584 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-kube-api-access-2pwx2" (OuterVolumeSpecName: "kube-api-access-2pwx2") pod "0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e" (UID: "0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e"). InnerVolumeSpecName "kube-api-access-2pwx2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:48:48.418941 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.418908 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pwx2\" (UniqueName: \"kubernetes.io/projected/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-kube-api-access-2pwx2\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jul 29 15:48:48.418941 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.418938 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-console-oauth-config\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jul 29 15:48:48.418941 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.418947 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-trusted-ca-bundle\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jul 29 15:48:48.419161 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.418957 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-service-ca\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jul 29 15:48:48.419161 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.418966 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-console-config\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jul 29 15:48:48.419161 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.418974 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-oauth-serving-cert\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jul 29 15:48:48.419161 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.418982 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e-console-serving-cert\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jul 29 15:48:48.586769 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.586688 2554 generic.go:356] "Generic (PLEG): container finished" podID="0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e" containerID="e2fe92101bb4b42b5b7bf121d7ec8a8233edd5f4df74e7366d5408fa1e062a97" exitCode=0 Jul 29 15:48:48.586769 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.586737 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558cddfdcd-t7wfl" Jul 29 15:48:48.586934 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.586771 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558cddfdcd-t7wfl" event={"ID":"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e","Type":"ContainerDied","Data":"e2fe92101bb4b42b5b7bf121d7ec8a8233edd5f4df74e7366d5408fa1e062a97"} Jul 29 15:48:48.586934 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.586863 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558cddfdcd-t7wfl" event={"ID":"0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e","Type":"ContainerDied","Data":"0c1bd349e5dd73c8917aea1362918f5195c732e150bad8d33ff0c3a5d0c7522f"} Jul 29 15:48:48.586934 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.586888 2554 scope.go:117] "RemoveContainer" containerID="e2fe92101bb4b42b5b7bf121d7ec8a8233edd5f4df74e7366d5408fa1e062a97" Jul 29 15:48:48.597057 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.597038 2554 scope.go:117] "RemoveContainer" containerID="e2fe92101bb4b42b5b7bf121d7ec8a8233edd5f4df74e7366d5408fa1e062a97" Jul 29 15:48:48.597351 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:48:48.597329 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2fe92101bb4b42b5b7bf121d7ec8a8233edd5f4df74e7366d5408fa1e062a97\": container with ID starting with e2fe92101bb4b42b5b7bf121d7ec8a8233edd5f4df74e7366d5408fa1e062a97 not found: ID does not exist" containerID="e2fe92101bb4b42b5b7bf121d7ec8a8233edd5f4df74e7366d5408fa1e062a97" Jul 29 15:48:48.597415 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.597361 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2fe92101bb4b42b5b7bf121d7ec8a8233edd5f4df74e7366d5408fa1e062a97"} err="failed to get container status \"e2fe92101bb4b42b5b7bf121d7ec8a8233edd5f4df74e7366d5408fa1e062a97\": rpc error: code = NotFound desc = could not find container \"e2fe92101bb4b42b5b7bf121d7ec8a8233edd5f4df74e7366d5408fa1e062a97\": container with ID starting with e2fe92101bb4b42b5b7bf121d7ec8a8233edd5f4df74e7366d5408fa1e062a97 not found: ID does not exist" Jul 29 15:48:48.609242 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.609210 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-558cddfdcd-t7wfl"] Jul 29 15:48:48.613396 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:48.613364 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-558cddfdcd-t7wfl"] Jul 29 15:48:49.900328 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:49.900295 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e" path="/var/lib/kubelet/pods/0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e/volumes" Jul 29 15:48:52.260902 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:52.260872 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-d78fdf688-tn727" Jul 29 15:48:52.264744 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:48:52.264697 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-d78fdf688-tn727" Jul 29 15:49:31.884333 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:31.884299 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm"] Jul 29 15:49:31.884902 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:31.884684 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e" containerName="console" Jul 29 15:49:31.884902 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:31.884703 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e" containerName="console" Jul 29 15:49:31.884902 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:31.884725 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78144aa9-485b-4141-af15-bec828994442" containerName="registry" Jul 29 15:49:31.884902 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:31.884731 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="78144aa9-485b-4141-af15-bec828994442" containerName="registry" Jul 29 15:49:31.884902 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:31.884795 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c5b0d2f-b7a0-4fd8-8c3a-b531fcf7075e" containerName="console" Jul 29 15:49:31.884902 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:31.884804 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="78144aa9-485b-4141-af15-bec828994442" containerName="registry" Jul 29 15:49:31.889376 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:31.889354 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" Jul 29 15:49:31.891942 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:31.891920 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 29 15:49:31.892052 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:31.891994 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-m2jtr\"" Jul 29 15:49:31.892052 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:31.892012 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 29 15:49:31.892052 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:31.892012 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 29 15:49:31.892346 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:31.892328 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 29 15:49:31.892411 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:31.892349 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 29 15:49:31.905229 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:31.905192 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 29 15:49:31.906896 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:31.906874 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm"] Jul 29 15:49:31.986202 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:31.986147 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdd55716-dca0-4809-9895-ce0033527f88-telemeter-trusted-ca-bundle\") pod \"telemeter-client-58bdbf9fb7-4ggcm\" (UID: \"bdd55716-dca0-4809-9895-ce0033527f88\") " pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" Jul 29 15:49:31.986382 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:31.986223 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bdd55716-dca0-4809-9895-ce0033527f88-secret-telemeter-client\") pod \"telemeter-client-58bdbf9fb7-4ggcm\" (UID: \"bdd55716-dca0-4809-9895-ce0033527f88\") " pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" Jul 29 15:49:31.986382 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:31.986255 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrjlx\" (UniqueName: \"kubernetes.io/projected/bdd55716-dca0-4809-9895-ce0033527f88-kube-api-access-qrjlx\") pod \"telemeter-client-58bdbf9fb7-4ggcm\" (UID: \"bdd55716-dca0-4809-9895-ce0033527f88\") " pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" Jul 29 15:49:31.986382 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:31.986286 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdd55716-dca0-4809-9895-ce0033527f88-serving-certs-ca-bundle\") pod \"telemeter-client-58bdbf9fb7-4ggcm\" (UID: \"bdd55716-dca0-4809-9895-ce0033527f88\") " pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" Jul 29 15:49:31.986382 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:31.986306 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bdd55716-dca0-4809-9895-ce0033527f88-telemeter-client-tls\") pod \"telemeter-client-58bdbf9fb7-4ggcm\" (UID: \"bdd55716-dca0-4809-9895-ce0033527f88\") " pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" Jul 29 15:49:31.986382 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:31.986358 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bdd55716-dca0-4809-9895-ce0033527f88-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-58bdbf9fb7-4ggcm\" (UID: \"bdd55716-dca0-4809-9895-ce0033527f88\") " pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" Jul 29 15:49:31.986583 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:31.986395 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bdd55716-dca0-4809-9895-ce0033527f88-federate-client-tls\") pod \"telemeter-client-58bdbf9fb7-4ggcm\" (UID: \"bdd55716-dca0-4809-9895-ce0033527f88\") " pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" Jul 29 15:49:31.986583 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:31.986418 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bdd55716-dca0-4809-9895-ce0033527f88-metrics-client-ca\") pod \"telemeter-client-58bdbf9fb7-4ggcm\" (UID: \"bdd55716-dca0-4809-9895-ce0033527f88\") " pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" Jul 29 15:49:32.087654 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:32.087613 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bdd55716-dca0-4809-9895-ce0033527f88-metrics-client-ca\") pod \"telemeter-client-58bdbf9fb7-4ggcm\" (UID: \"bdd55716-dca0-4809-9895-ce0033527f88\") " pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" Jul 29 15:49:32.087856 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:32.087776 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdd55716-dca0-4809-9895-ce0033527f88-telemeter-trusted-ca-bundle\") pod \"telemeter-client-58bdbf9fb7-4ggcm\" (UID: \"bdd55716-dca0-4809-9895-ce0033527f88\") " pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" Jul 29 15:49:32.087856 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:32.087830 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bdd55716-dca0-4809-9895-ce0033527f88-secret-telemeter-client\") pod \"telemeter-client-58bdbf9fb7-4ggcm\" (UID: \"bdd55716-dca0-4809-9895-ce0033527f88\") " pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" Jul 29 15:49:32.087968 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:32.087857 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrjlx\" (UniqueName: \"kubernetes.io/projected/bdd55716-dca0-4809-9895-ce0033527f88-kube-api-access-qrjlx\") pod \"telemeter-client-58bdbf9fb7-4ggcm\" (UID: \"bdd55716-dca0-4809-9895-ce0033527f88\") " pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" Jul 29 15:49:32.087968 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:32.087916 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdd55716-dca0-4809-9895-ce0033527f88-serving-certs-ca-bundle\") pod \"telemeter-client-58bdbf9fb7-4ggcm\" (UID: \"bdd55716-dca0-4809-9895-ce0033527f88\") " pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" Jul 29 15:49:32.087968 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:32.087934 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bdd55716-dca0-4809-9895-ce0033527f88-telemeter-client-tls\") pod \"telemeter-client-58bdbf9fb7-4ggcm\" (UID: \"bdd55716-dca0-4809-9895-ce0033527f88\") " pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" Jul 29 15:49:32.087968 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:32.087963 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bdd55716-dca0-4809-9895-ce0033527f88-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-58bdbf9fb7-4ggcm\" (UID: \"bdd55716-dca0-4809-9895-ce0033527f88\") " pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" Jul 29 15:49:32.088160 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:32.087994 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bdd55716-dca0-4809-9895-ce0033527f88-federate-client-tls\") pod \"telemeter-client-58bdbf9fb7-4ggcm\" (UID: \"bdd55716-dca0-4809-9895-ce0033527f88\") " pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" Jul 29 15:49:32.088499 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:32.088474 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bdd55716-dca0-4809-9895-ce0033527f88-metrics-client-ca\") pod \"telemeter-client-58bdbf9fb7-4ggcm\" (UID: \"bdd55716-dca0-4809-9895-ce0033527f88\") " pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" Jul 29 15:49:32.088702 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:32.088599 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdd55716-dca0-4809-9895-ce0033527f88-serving-certs-ca-bundle\") pod \"telemeter-client-58bdbf9fb7-4ggcm\" (UID: \"bdd55716-dca0-4809-9895-ce0033527f88\") " pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" Jul 29 15:49:32.088702 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:32.088676 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdd55716-dca0-4809-9895-ce0033527f88-telemeter-trusted-ca-bundle\") pod \"telemeter-client-58bdbf9fb7-4ggcm\" (UID: \"bdd55716-dca0-4809-9895-ce0033527f88\") " pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" Jul 29 15:49:32.090667 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:32.090638 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bdd55716-dca0-4809-9895-ce0033527f88-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-58bdbf9fb7-4ggcm\" (UID: \"bdd55716-dca0-4809-9895-ce0033527f88\") " pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" Jul 29 15:49:32.090750 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:32.090706 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bdd55716-dca0-4809-9895-ce0033527f88-telemeter-client-tls\") pod \"telemeter-client-58bdbf9fb7-4ggcm\" (UID: \"bdd55716-dca0-4809-9895-ce0033527f88\") " pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" Jul 29 15:49:32.090804 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:32.090788 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bdd55716-dca0-4809-9895-ce0033527f88-federate-client-tls\") pod \"telemeter-client-58bdbf9fb7-4ggcm\" (UID: \"bdd55716-dca0-4809-9895-ce0033527f88\") " pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" Jul 29 15:49:32.090907 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:32.090887 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bdd55716-dca0-4809-9895-ce0033527f88-secret-telemeter-client\") pod \"telemeter-client-58bdbf9fb7-4ggcm\" (UID: \"bdd55716-dca0-4809-9895-ce0033527f88\") " pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" Jul 29 15:49:32.095691 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:32.095664 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrjlx\" (UniqueName: \"kubernetes.io/projected/bdd55716-dca0-4809-9895-ce0033527f88-kube-api-access-qrjlx\") pod \"telemeter-client-58bdbf9fb7-4ggcm\" (UID: \"bdd55716-dca0-4809-9895-ce0033527f88\") " pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" Jul 29 15:49:32.199423 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:32.199336 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" Jul 29 15:49:32.353662 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:32.353634 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm"] Jul 29 15:49:32.355185 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:49:32.355151 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdd55716_dca0_4809_9895_ce0033527f88.slice/crio-c55724c91376c4fffe215d88a6db42bce19be789b213bd79bbcccc8751669389 WatchSource:0}: Error finding container c55724c91376c4fffe215d88a6db42bce19be789b213bd79bbcccc8751669389: Status 404 returned error can't find the container with id c55724c91376c4fffe215d88a6db42bce19be789b213bd79bbcccc8751669389 Jul 29 15:49:32.758486 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:32.758446 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" event={"ID":"bdd55716-dca0-4809-9895-ce0033527f88","Type":"ContainerStarted","Data":"c55724c91376c4fffe215d88a6db42bce19be789b213bd79bbcccc8751669389"} Jul 29 15:49:34.770411 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:34.770378 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" event={"ID":"bdd55716-dca0-4809-9895-ce0033527f88","Type":"ContainerStarted","Data":"f28b958baf6499c0e707df6a7966998f3020250b87bfb1083e71308048491542"} Jul 29 15:49:35.776428 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:35.776387 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" event={"ID":"bdd55716-dca0-4809-9895-ce0033527f88","Type":"ContainerStarted","Data":"637dc077ae4d2f0fc8455836215d0a6201e8f8f57520c7624eff69e7f86a7e3c"} Jul 29 15:49:35.776834 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:35.776458 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" event={"ID":"bdd55716-dca0-4809-9895-ce0033527f88","Type":"ContainerStarted","Data":"93b359f7b0fb1095e2cd0fd83c969bfd7ebc6f7eb7bb6617a11fbec9f8099e79"} Jul 29 15:49:35.800605 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:35.800535 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-58bdbf9fb7-4ggcm" podStartSLOduration=1.755594933 podStartE2EDuration="4.800518819s" totalImagesPullingTime="3.044923886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:49:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:49:35.79877066 +0000 UTC m=+198.512805124" watchObservedRunningTime="2026-07-29 15:49:35.800518819 +0000 UTC m=+198.514553283" Jul 29 15:49:36.463639 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.463605 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bdb64d47c-5pb9h"] Jul 29 15:49:36.467026 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.467001 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:49:36.469970 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.469949 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 29 15:49:36.471765 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.471177 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 15:49:36.471765 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.471190 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 15:49:36.471765 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.471192 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 15:49:36.471765 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.471329 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bzgb7\"" Jul 29 15:49:36.471765 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.471490 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 15:49:36.471765 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.471516 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 15:49:36.471765 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.471604 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 29 15:49:36.477104 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.477080 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 29 15:49:36.479020 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.478998 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bdb64d47c-5pb9h"] Jul 29 15:49:36.632875 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.632838 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3008dbd-81ae-46bf-9a8d-53971004f43a-oauth-serving-cert\") pod \"console-bdb64d47c-5pb9h\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:49:36.633046 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.632890 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3008dbd-81ae-46bf-9a8d-53971004f43a-console-oauth-config\") pod \"console-bdb64d47c-5pb9h\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:49:36.633046 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.632955 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3008dbd-81ae-46bf-9a8d-53971004f43a-console-config\") pod \"console-bdb64d47c-5pb9h\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:49:36.633046 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.632996 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3008dbd-81ae-46bf-9a8d-53971004f43a-trusted-ca-bundle\") pod \"console-bdb64d47c-5pb9h\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:49:36.633046 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.633030 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3008dbd-81ae-46bf-9a8d-53971004f43a-console-serving-cert\") pod \"console-bdb64d47c-5pb9h\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:49:36.633178 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.633060 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3008dbd-81ae-46bf-9a8d-53971004f43a-service-ca\") pod \"console-bdb64d47c-5pb9h\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:49:36.633178 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.633089 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6xxn\" (UniqueName: \"kubernetes.io/projected/d3008dbd-81ae-46bf-9a8d-53971004f43a-kube-api-access-p6xxn\") pod \"console-bdb64d47c-5pb9h\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:49:36.733775 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.733743 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3008dbd-81ae-46bf-9a8d-53971004f43a-oauth-serving-cert\") pod \"console-bdb64d47c-5pb9h\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:49:36.733934 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.733791 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3008dbd-81ae-46bf-9a8d-53971004f43a-console-oauth-config\") pod \"console-bdb64d47c-5pb9h\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:49:36.733934 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.733823 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3008dbd-81ae-46bf-9a8d-53971004f43a-console-config\") pod \"console-bdb64d47c-5pb9h\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:49:36.733934 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.733840 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3008dbd-81ae-46bf-9a8d-53971004f43a-trusted-ca-bundle\") pod \"console-bdb64d47c-5pb9h\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:49:36.733934 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.733868 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3008dbd-81ae-46bf-9a8d-53971004f43a-console-serving-cert\") pod \"console-bdb64d47c-5pb9h\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:49:36.733934 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.733892 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3008dbd-81ae-46bf-9a8d-53971004f43a-service-ca\") pod \"console-bdb64d47c-5pb9h\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:49:36.733934 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.733912 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6xxn\" (UniqueName: \"kubernetes.io/projected/d3008dbd-81ae-46bf-9a8d-53971004f43a-kube-api-access-p6xxn\") pod \"console-bdb64d47c-5pb9h\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:49:36.734647 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.734620 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3008dbd-81ae-46bf-9a8d-53971004f43a-oauth-serving-cert\") pod \"console-bdb64d47c-5pb9h\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:49:36.734774 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.734620 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3008dbd-81ae-46bf-9a8d-53971004f43a-console-config\") pod \"console-bdb64d47c-5pb9h\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:49:36.734774 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.734733 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3008dbd-81ae-46bf-9a8d-53971004f43a-service-ca\") pod \"console-bdb64d47c-5pb9h\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:49:36.735025 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.735002 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3008dbd-81ae-46bf-9a8d-53971004f43a-trusted-ca-bundle\") pod \"console-bdb64d47c-5pb9h\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:49:36.736264 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.736243 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3008dbd-81ae-46bf-9a8d-53971004f43a-console-oauth-config\") pod \"console-bdb64d47c-5pb9h\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:49:36.736361 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.736332 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3008dbd-81ae-46bf-9a8d-53971004f43a-console-serving-cert\") pod \"console-bdb64d47c-5pb9h\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:49:36.742659 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.742639 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6xxn\" (UniqueName: \"kubernetes.io/projected/d3008dbd-81ae-46bf-9a8d-53971004f43a-kube-api-access-p6xxn\") pod \"console-bdb64d47c-5pb9h\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:49:36.779343 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.779316 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:49:36.910994 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:36.910937 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bdb64d47c-5pb9h"] Jul 29 15:49:36.913114 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:49:36.913088 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3008dbd_81ae_46bf_9a8d_53971004f43a.slice/crio-86ab542d706eaceb2f77d141d3524b17ec8841bf47790d47271d8ba647eb3a9d WatchSource:0}: Error finding container 86ab542d706eaceb2f77d141d3524b17ec8841bf47790d47271d8ba647eb3a9d: Status 404 returned error can't find the container with id 86ab542d706eaceb2f77d141d3524b17ec8841bf47790d47271d8ba647eb3a9d Jul 29 15:49:37.786966 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:37.786934 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bdb64d47c-5pb9h" event={"ID":"d3008dbd-81ae-46bf-9a8d-53971004f43a","Type":"ContainerStarted","Data":"40d8b0f1ffc0620577b3fedaf352db344de7baece17f37d8eb012c96dc0af03b"} Jul 29 15:49:37.787420 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:37.786985 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bdb64d47c-5pb9h" event={"ID":"d3008dbd-81ae-46bf-9a8d-53971004f43a","Type":"ContainerStarted","Data":"86ab542d706eaceb2f77d141d3524b17ec8841bf47790d47271d8ba647eb3a9d"} Jul 29 15:49:37.807351 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:37.807293 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bdb64d47c-5pb9h" podStartSLOduration=1.8072778170000001 podStartE2EDuration="1.807277817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:49:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:49:37.806006972 +0000 UTC m=+200.520041437" watchObservedRunningTime="2026-07-29 15:49:37.807277817 +0000 UTC m=+200.521312325" Jul 29 15:49:46.780047 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:46.780005 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:49:46.780491 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:46.780101 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:49:46.785108 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:46.785086 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:49:46.825911 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:49:46.825886 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:51:17.738173 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:17.738144 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndcms_5257faa4-46cf-45e5-b609-a414b4fd90af/console-operator/1.log" Jul 29 15:51:17.742443 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:17.742424 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndcms_5257faa4-46cf-45e5-b609-a414b4fd90af/console-operator/1.log" Jul 29 15:51:17.757585 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:17.757562 2554 kubelet.go:1648] "Image garbage collection succeeded" Jul 29 15:51:19.573592 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:19.573528 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bdb64d47c-5pb9h"] Jul 29 15:51:44.592929 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:44.592872 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-bdb64d47c-5pb9h" podUID="d3008dbd-81ae-46bf-9a8d-53971004f43a" containerName="console" containerID="cri-o://40d8b0f1ffc0620577b3fedaf352db344de7baece17f37d8eb012c96dc0af03b" gracePeriod=15 Jul 29 15:51:44.833142 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:44.833118 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:51:44.942307 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:44.942225 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3008dbd-81ae-46bf-9a8d-53971004f43a-service-ca\") pod \"d3008dbd-81ae-46bf-9a8d-53971004f43a\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " Jul 29 15:51:44.942307 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:44.942269 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3008dbd-81ae-46bf-9a8d-53971004f43a-console-oauth-config\") pod \"d3008dbd-81ae-46bf-9a8d-53971004f43a\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " Jul 29 15:51:44.942307 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:44.942289 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3008dbd-81ae-46bf-9a8d-53971004f43a-console-config\") pod \"d3008dbd-81ae-46bf-9a8d-53971004f43a\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " Jul 29 15:51:44.942307 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:44.942307 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3008dbd-81ae-46bf-9a8d-53971004f43a-console-serving-cert\") pod \"d3008dbd-81ae-46bf-9a8d-53971004f43a\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " Jul 29 15:51:44.942660 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:44.942359 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3008dbd-81ae-46bf-9a8d-53971004f43a-trusted-ca-bundle\") pod \"d3008dbd-81ae-46bf-9a8d-53971004f43a\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " Jul 29 15:51:44.942660 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:44.942374 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6xxn\" (UniqueName: \"kubernetes.io/projected/d3008dbd-81ae-46bf-9a8d-53971004f43a-kube-api-access-p6xxn\") pod \"d3008dbd-81ae-46bf-9a8d-53971004f43a\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " Jul 29 15:51:44.942660 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:44.942406 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3008dbd-81ae-46bf-9a8d-53971004f43a-oauth-serving-cert\") pod \"d3008dbd-81ae-46bf-9a8d-53971004f43a\" (UID: \"d3008dbd-81ae-46bf-9a8d-53971004f43a\") " Jul 29 15:51:44.942800 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:44.942656 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3008dbd-81ae-46bf-9a8d-53971004f43a-console-config" (OuterVolumeSpecName: "console-config") pod "d3008dbd-81ae-46bf-9a8d-53971004f43a" (UID: "d3008dbd-81ae-46bf-9a8d-53971004f43a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:51:44.942800 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:44.942719 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3008dbd-81ae-46bf-9a8d-53971004f43a-service-ca" (OuterVolumeSpecName: "service-ca") pod "d3008dbd-81ae-46bf-9a8d-53971004f43a" (UID: "d3008dbd-81ae-46bf-9a8d-53971004f43a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:51:44.942887 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:44.942864 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3008dbd-81ae-46bf-9a8d-53971004f43a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d3008dbd-81ae-46bf-9a8d-53971004f43a" (UID: "d3008dbd-81ae-46bf-9a8d-53971004f43a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:51:44.942939 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:44.942921 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3008dbd-81ae-46bf-9a8d-53971004f43a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d3008dbd-81ae-46bf-9a8d-53971004f43a" (UID: "d3008dbd-81ae-46bf-9a8d-53971004f43a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:51:44.944465 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:44.944441 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3008dbd-81ae-46bf-9a8d-53971004f43a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d3008dbd-81ae-46bf-9a8d-53971004f43a" (UID: "d3008dbd-81ae-46bf-9a8d-53971004f43a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:51:44.944825 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:44.944801 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3008dbd-81ae-46bf-9a8d-53971004f43a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d3008dbd-81ae-46bf-9a8d-53971004f43a" (UID: "d3008dbd-81ae-46bf-9a8d-53971004f43a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:51:44.944825 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:44.944813 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3008dbd-81ae-46bf-9a8d-53971004f43a-kube-api-access-p6xxn" (OuterVolumeSpecName: "kube-api-access-p6xxn") pod "d3008dbd-81ae-46bf-9a8d-53971004f43a" (UID: "d3008dbd-81ae-46bf-9a8d-53971004f43a"). InnerVolumeSpecName "kube-api-access-p6xxn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:51:45.043185 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:45.043154 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3008dbd-81ae-46bf-9a8d-53971004f43a-console-config\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jul 29 15:51:45.043185 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:45.043178 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3008dbd-81ae-46bf-9a8d-53971004f43a-console-serving-cert\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jul 29 15:51:45.043185 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:45.043188 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3008dbd-81ae-46bf-9a8d-53971004f43a-trusted-ca-bundle\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jul 29 15:51:45.043380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:45.043196 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6xxn\" (UniqueName: \"kubernetes.io/projected/d3008dbd-81ae-46bf-9a8d-53971004f43a-kube-api-access-p6xxn\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jul 29 15:51:45.043380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:45.043205 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3008dbd-81ae-46bf-9a8d-53971004f43a-oauth-serving-cert\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jul 29 15:51:45.043380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:45.043213 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3008dbd-81ae-46bf-9a8d-53971004f43a-service-ca\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jul 29 15:51:45.043380 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:45.043220 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3008dbd-81ae-46bf-9a8d-53971004f43a-console-oauth-config\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jul 29 15:51:45.264487 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:45.264452 2554 generic.go:356] "Generic (PLEG): container finished" podID="d3008dbd-81ae-46bf-9a8d-53971004f43a" containerID="40d8b0f1ffc0620577b3fedaf352db344de7baece17f37d8eb012c96dc0af03b" exitCode=0 Jul 29 15:51:45.264683 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:45.264501 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bdb64d47c-5pb9h" Jul 29 15:51:45.264683 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:45.264552 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bdb64d47c-5pb9h" event={"ID":"d3008dbd-81ae-46bf-9a8d-53971004f43a","Type":"ContainerDied","Data":"40d8b0f1ffc0620577b3fedaf352db344de7baece17f37d8eb012c96dc0af03b"} Jul 29 15:51:45.264683 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:45.264601 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bdb64d47c-5pb9h" event={"ID":"d3008dbd-81ae-46bf-9a8d-53971004f43a","Type":"ContainerDied","Data":"86ab542d706eaceb2f77d141d3524b17ec8841bf47790d47271d8ba647eb3a9d"} Jul 29 15:51:45.264683 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:45.264626 2554 scope.go:117] "RemoveContainer" containerID="40d8b0f1ffc0620577b3fedaf352db344de7baece17f37d8eb012c96dc0af03b" Jul 29 15:51:45.278069 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:45.278050 2554 scope.go:117] "RemoveContainer" containerID="40d8b0f1ffc0620577b3fedaf352db344de7baece17f37d8eb012c96dc0af03b" Jul 29 15:51:45.278335 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:51:45.278316 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40d8b0f1ffc0620577b3fedaf352db344de7baece17f37d8eb012c96dc0af03b\": container with ID starting with 40d8b0f1ffc0620577b3fedaf352db344de7baece17f37d8eb012c96dc0af03b not found: ID does not exist" containerID="40d8b0f1ffc0620577b3fedaf352db344de7baece17f37d8eb012c96dc0af03b" Jul 29 15:51:45.278396 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:45.278348 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40d8b0f1ffc0620577b3fedaf352db344de7baece17f37d8eb012c96dc0af03b"} err="failed to get container status \"40d8b0f1ffc0620577b3fedaf352db344de7baece17f37d8eb012c96dc0af03b\": rpc error: code = NotFound desc = could not find container \"40d8b0f1ffc0620577b3fedaf352db344de7baece17f37d8eb012c96dc0af03b\": container with ID starting with 40d8b0f1ffc0620577b3fedaf352db344de7baece17f37d8eb012c96dc0af03b not found: ID does not exist" Jul 29 15:51:45.290311 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:45.290284 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bdb64d47c-5pb9h"] Jul 29 15:51:45.293522 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:45.293493 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bdb64d47c-5pb9h"] Jul 29 15:51:45.900594 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:51:45.900562 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3008dbd-81ae-46bf-9a8d-53971004f43a" path="/var/lib/kubelet/pods/d3008dbd-81ae-46bf-9a8d-53971004f43a/volumes" Jul 29 15:52:18.390181 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:18.390148 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-pztvb"] Jul 29 15:52:18.390601 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:18.390437 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3008dbd-81ae-46bf-9a8d-53971004f43a" containerName="console" Jul 29 15:52:18.390601 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:18.390447 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3008dbd-81ae-46bf-9a8d-53971004f43a" containerName="console" Jul 29 15:52:18.390601 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:18.390496 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3008dbd-81ae-46bf-9a8d-53971004f43a" containerName="console" Jul 29 15:52:18.394455 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:18.394438 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-pztvb" Jul 29 15:52:18.397153 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:18.397134 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 29 15:52:18.397260 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:18.397154 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-pq5jr\"" Jul 29 15:52:18.397260 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:18.397158 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 29 15:52:18.407324 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:18.407304 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-pztvb"] Jul 29 15:52:18.511983 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:18.511949 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf2jg\" (UniqueName: \"kubernetes.io/projected/99024f99-9e25-46f5-a551-2c58b185479f-kube-api-access-bf2jg\") pod \"cert-manager-operator-controller-manager-56b4598547-pztvb\" (UID: \"99024f99-9e25-46f5-a551-2c58b185479f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-pztvb" Jul 29 15:52:18.512141 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:18.512013 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99024f99-9e25-46f5-a551-2c58b185479f-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-pztvb\" (UID: \"99024f99-9e25-46f5-a551-2c58b185479f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-pztvb" Jul 29 15:52:18.612849 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:18.612806 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99024f99-9e25-46f5-a551-2c58b185479f-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-pztvb\" (UID: \"99024f99-9e25-46f5-a551-2c58b185479f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-pztvb" Jul 29 15:52:18.613010 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:18.612882 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf2jg\" (UniqueName: \"kubernetes.io/projected/99024f99-9e25-46f5-a551-2c58b185479f-kube-api-access-bf2jg\") pod \"cert-manager-operator-controller-manager-56b4598547-pztvb\" (UID: \"99024f99-9e25-46f5-a551-2c58b185479f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-pztvb" Jul 29 15:52:18.613209 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:18.613191 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99024f99-9e25-46f5-a551-2c58b185479f-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-pztvb\" (UID: \"99024f99-9e25-46f5-a551-2c58b185479f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-pztvb" Jul 29 15:52:18.623514 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:18.623494 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf2jg\" (UniqueName: \"kubernetes.io/projected/99024f99-9e25-46f5-a551-2c58b185479f-kube-api-access-bf2jg\") pod \"cert-manager-operator-controller-manager-56b4598547-pztvb\" (UID: \"99024f99-9e25-46f5-a551-2c58b185479f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-pztvb" Jul 29 15:52:18.703343 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:18.703263 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-pztvb" Jul 29 15:52:18.838052 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:18.837805 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-pztvb"] Jul 29 15:52:18.841322 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:52:18.841295 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99024f99_9e25_46f5_a551_2c58b185479f.slice/crio-a16369037080e3a1d8e78bbbc1444983f2ac46db75be6bce0e8ecacb7150bc2a WatchSource:0}: Error finding container a16369037080e3a1d8e78bbbc1444983f2ac46db75be6bce0e8ecacb7150bc2a: Status 404 returned error can't find the container with id a16369037080e3a1d8e78bbbc1444983f2ac46db75be6bce0e8ecacb7150bc2a Jul 29 15:52:18.844647 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:18.844626 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 15:52:19.392389 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:19.392352 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-pztvb" event={"ID":"99024f99-9e25-46f5-a551-2c58b185479f","Type":"ContainerStarted","Data":"a16369037080e3a1d8e78bbbc1444983f2ac46db75be6bce0e8ecacb7150bc2a"} Jul 29 15:52:23.412249 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:23.412207 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-pztvb" event={"ID":"99024f99-9e25-46f5-a551-2c58b185479f","Type":"ContainerStarted","Data":"32cd05eb2270450554ff1f50144c4049f2e22f675e3df3bf5f28d61c0c019c09"} Jul 29 15:52:26.357926 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:26.357865 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-pztvb" podStartSLOduration=4.780157482 podStartE2EDuration="8.357844202s" totalImagesPullingTime="3.57768672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:52:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:52:23.462484048 +0000 UTC m=+366.176518513" watchObservedRunningTime="2026-07-29 15:52:26.357844202 +0000 UTC m=+369.071878668" Jul 29 15:52:26.359549 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:26.359517 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-thlhw"] Jul 29 15:52:26.362768 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:26.362754 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-thlhw" Jul 29 15:52:26.365887 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:26.365867 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-zdc9j\"" Jul 29 15:52:26.367090 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:26.367070 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 29 15:52:26.367169 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:26.367094 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 29 15:52:26.373703 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:26.373683 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-thlhw"] Jul 29 15:52:26.482783 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:26.482742 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q2vw\" (UniqueName: \"kubernetes.io/projected/6e4e560f-feec-427e-a5b7-81d59a70720e-kube-api-access-2q2vw\") pod \"cert-manager-cainjector-559cdd8c87-thlhw\" (UID: \"6e4e560f-feec-427e-a5b7-81d59a70720e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-thlhw" Jul 29 15:52:26.482947 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:26.482816 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6e4e560f-feec-427e-a5b7-81d59a70720e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-thlhw\" (UID: \"6e4e560f-feec-427e-a5b7-81d59a70720e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-thlhw" Jul 29 15:52:26.584107 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:26.584068 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q2vw\" (UniqueName: \"kubernetes.io/projected/6e4e560f-feec-427e-a5b7-81d59a70720e-kube-api-access-2q2vw\") pod \"cert-manager-cainjector-559cdd8c87-thlhw\" (UID: \"6e4e560f-feec-427e-a5b7-81d59a70720e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-thlhw" Jul 29 15:52:26.584260 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:26.584125 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6e4e560f-feec-427e-a5b7-81d59a70720e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-thlhw\" (UID: \"6e4e560f-feec-427e-a5b7-81d59a70720e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-thlhw" Jul 29 15:52:26.611683 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:26.611616 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6e4e560f-feec-427e-a5b7-81d59a70720e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-thlhw\" (UID: \"6e4e560f-feec-427e-a5b7-81d59a70720e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-thlhw" Jul 29 15:52:26.611827 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:26.611806 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q2vw\" (UniqueName: \"kubernetes.io/projected/6e4e560f-feec-427e-a5b7-81d59a70720e-kube-api-access-2q2vw\") pod \"cert-manager-cainjector-559cdd8c87-thlhw\" (UID: \"6e4e560f-feec-427e-a5b7-81d59a70720e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-thlhw" Jul 29 15:52:26.679476 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:26.679442 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-thlhw" Jul 29 15:52:26.821717 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:26.821676 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-thlhw"] Jul 29 15:52:26.823147 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:52:26.823116 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e4e560f_feec_427e_a5b7_81d59a70720e.slice/crio-4fe6b94c903e3d3f191397960426ad62c3d04c0ec275d91911a2f8acf83437fb WatchSource:0}: Error finding container 4fe6b94c903e3d3f191397960426ad62c3d04c0ec275d91911a2f8acf83437fb: Status 404 returned error can't find the container with id 4fe6b94c903e3d3f191397960426ad62c3d04c0ec275d91911a2f8acf83437fb Jul 29 15:52:27.429073 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:27.429038 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-thlhw" event={"ID":"6e4e560f-feec-427e-a5b7-81d59a70720e","Type":"ContainerStarted","Data":"4fe6b94c903e3d3f191397960426ad62c3d04c0ec275d91911a2f8acf83437fb"} Jul 29 15:52:29.970139 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:29.970103 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-25j6l"] Jul 29 15:52:29.974594 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:29.974572 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-25j6l" Jul 29 15:52:29.978257 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:29.978235 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-lvjnf\"" Jul 29 15:52:29.988295 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:29.988272 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-25j6l"] Jul 29 15:52:30.113580 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:30.113521 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m8qk\" (UniqueName: \"kubernetes.io/projected/c6fa1bbb-1c15-4c43-94a2-3e0a244871c3-kube-api-access-4m8qk\") pod \"cert-manager-webhook-6486ffd997-25j6l\" (UID: \"c6fa1bbb-1c15-4c43-94a2-3e0a244871c3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-25j6l" Jul 29 15:52:30.113751 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:30.113651 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6fa1bbb-1c15-4c43-94a2-3e0a244871c3-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-25j6l\" (UID: \"c6fa1bbb-1c15-4c43-94a2-3e0a244871c3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-25j6l" Jul 29 15:52:30.214757 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:30.214715 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6fa1bbb-1c15-4c43-94a2-3e0a244871c3-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-25j6l\" (UID: \"c6fa1bbb-1c15-4c43-94a2-3e0a244871c3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-25j6l" Jul 29 15:52:30.214919 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:30.214782 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m8qk\" (UniqueName: \"kubernetes.io/projected/c6fa1bbb-1c15-4c43-94a2-3e0a244871c3-kube-api-access-4m8qk\") pod \"cert-manager-webhook-6486ffd997-25j6l\" (UID: \"c6fa1bbb-1c15-4c43-94a2-3e0a244871c3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-25j6l" Jul 29 15:52:30.225184 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:30.225159 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6fa1bbb-1c15-4c43-94a2-3e0a244871c3-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-25j6l\" (UID: \"c6fa1bbb-1c15-4c43-94a2-3e0a244871c3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-25j6l" Jul 29 15:52:30.225393 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:30.225372 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m8qk\" (UniqueName: \"kubernetes.io/projected/c6fa1bbb-1c15-4c43-94a2-3e0a244871c3-kube-api-access-4m8qk\") pod \"cert-manager-webhook-6486ffd997-25j6l\" (UID: \"c6fa1bbb-1c15-4c43-94a2-3e0a244871c3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-25j6l" Jul 29 15:52:30.284217 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:30.284177 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-25j6l" Jul 29 15:52:30.427374 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:30.427328 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-25j6l"] Jul 29 15:52:30.430934 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:52:30.430907 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6fa1bbb_1c15_4c43_94a2_3e0a244871c3.slice/crio-8a7ef10e3ecac9cf4016f47683ca4f9dfe1806f7b2b56828ecd1cbb0c8c95d4a WatchSource:0}: Error finding container 8a7ef10e3ecac9cf4016f47683ca4f9dfe1806f7b2b56828ecd1cbb0c8c95d4a: Status 404 returned error can't find the container with id 8a7ef10e3ecac9cf4016f47683ca4f9dfe1806f7b2b56828ecd1cbb0c8c95d4a Jul 29 15:52:30.442185 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:30.442149 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-25j6l" event={"ID":"c6fa1bbb-1c15-4c43-94a2-3e0a244871c3","Type":"ContainerStarted","Data":"8a7ef10e3ecac9cf4016f47683ca4f9dfe1806f7b2b56828ecd1cbb0c8c95d4a"} Jul 29 15:52:34.463372 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:34.463335 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-thlhw" event={"ID":"6e4e560f-feec-427e-a5b7-81d59a70720e","Type":"ContainerStarted","Data":"b9941f8b081f8381d5d7e029e84b151cc24826fa903297689997db41ff6a6588"} Jul 29 15:52:34.464768 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:34.464746 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-25j6l" event={"ID":"c6fa1bbb-1c15-4c43-94a2-3e0a244871c3","Type":"ContainerStarted","Data":"cda80a29645714df4288bcfc98ef4c7a493444e2803ab1ae516f9baad98f0417"} Jul 29 15:52:34.464895 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:34.464859 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-25j6l" Jul 29 15:52:34.479899 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:34.479861 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-thlhw" podStartSLOduration=1.432380685 podStartE2EDuration="8.479834876s" totalImagesPullingTime="7.047454191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:52:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:52:34.479189755 +0000 UTC m=+377.193224219" watchObservedRunningTime="2026-07-29 15:52:34.479834876 +0000 UTC m=+377.193869342" Jul 29 15:52:34.496630 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:34.496590 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-25j6l" podStartSLOduration=2.051207416 podStartE2EDuration="5.496565252s" totalImagesPullingTime="3.445357836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:52:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:52:34.49499736 +0000 UTC m=+377.209031827" watchObservedRunningTime="2026-07-29 15:52:34.496565252 +0000 UTC m=+377.210599719" Jul 29 15:52:40.471454 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:52:40.471424 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-25j6l" Jul 29 15:53:12.962393 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:12.962356 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-56f7c7fb9c-x42j7"] Jul 29 15:53:12.964628 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:12.964610 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-56f7c7fb9c-x42j7" Jul 29 15:53:12.968618 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:12.968594 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jul 29 15:53:12.968738 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:12.968709 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\"" Jul 29 15:53:12.969967 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:12.969944 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\"" Jul 29 15:53:12.970083 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:12.969989 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jul 29 15:53:12.970083 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:12.970054 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-wgd2s\"" Jul 29 15:53:12.970195 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:12.970100 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\"" Jul 29 15:53:12.979375 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:12.979350 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-56f7c7fb9c-x42j7"] Jul 29 15:53:13.060106 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:13.060063 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/73318301-4995-43c9-9ddf-8a66f391a85b-manager-config\") pod \"jobset-controller-manager-56f7c7fb9c-x42j7\" (UID: \"73318301-4995-43c9-9ddf-8a66f391a85b\") " pod="openshift-jobset-operator/jobset-controller-manager-56f7c7fb9c-x42j7" Jul 29 15:53:13.060280 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:13.060132 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jv46\" (UniqueName: \"kubernetes.io/projected/73318301-4995-43c9-9ddf-8a66f391a85b-kube-api-access-5jv46\") pod \"jobset-controller-manager-56f7c7fb9c-x42j7\" (UID: \"73318301-4995-43c9-9ddf-8a66f391a85b\") " pod="openshift-jobset-operator/jobset-controller-manager-56f7c7fb9c-x42j7" Jul 29 15:53:13.060280 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:13.060155 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73318301-4995-43c9-9ddf-8a66f391a85b-cert\") pod \"jobset-controller-manager-56f7c7fb9c-x42j7\" (UID: \"73318301-4995-43c9-9ddf-8a66f391a85b\") " pod="openshift-jobset-operator/jobset-controller-manager-56f7c7fb9c-x42j7" Jul 29 15:53:13.060280 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:13.060188 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73318301-4995-43c9-9ddf-8a66f391a85b-metrics-certs\") pod \"jobset-controller-manager-56f7c7fb9c-x42j7\" (UID: \"73318301-4995-43c9-9ddf-8a66f391a85b\") " pod="openshift-jobset-operator/jobset-controller-manager-56f7c7fb9c-x42j7" Jul 29 15:53:13.161340 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:13.161293 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jv46\" (UniqueName: \"kubernetes.io/projected/73318301-4995-43c9-9ddf-8a66f391a85b-kube-api-access-5jv46\") pod \"jobset-controller-manager-56f7c7fb9c-x42j7\" (UID: \"73318301-4995-43c9-9ddf-8a66f391a85b\") " pod="openshift-jobset-operator/jobset-controller-manager-56f7c7fb9c-x42j7" Jul 29 15:53:13.161340 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:13.161343 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73318301-4995-43c9-9ddf-8a66f391a85b-cert\") pod \"jobset-controller-manager-56f7c7fb9c-x42j7\" (UID: \"73318301-4995-43c9-9ddf-8a66f391a85b\") " pod="openshift-jobset-operator/jobset-controller-manager-56f7c7fb9c-x42j7" Jul 29 15:53:13.161584 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:13.161377 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73318301-4995-43c9-9ddf-8a66f391a85b-metrics-certs\") pod \"jobset-controller-manager-56f7c7fb9c-x42j7\" (UID: \"73318301-4995-43c9-9ddf-8a66f391a85b\") " pod="openshift-jobset-operator/jobset-controller-manager-56f7c7fb9c-x42j7" Jul 29 15:53:13.161584 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:13.161401 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/73318301-4995-43c9-9ddf-8a66f391a85b-manager-config\") pod \"jobset-controller-manager-56f7c7fb9c-x42j7\" (UID: \"73318301-4995-43c9-9ddf-8a66f391a85b\") " pod="openshift-jobset-operator/jobset-controller-manager-56f7c7fb9c-x42j7" Jul 29 15:53:13.162202 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:13.162179 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/73318301-4995-43c9-9ddf-8a66f391a85b-manager-config\") pod \"jobset-controller-manager-56f7c7fb9c-x42j7\" (UID: \"73318301-4995-43c9-9ddf-8a66f391a85b\") " pod="openshift-jobset-operator/jobset-controller-manager-56f7c7fb9c-x42j7" Jul 29 15:53:13.163946 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:13.163927 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73318301-4995-43c9-9ddf-8a66f391a85b-metrics-certs\") pod \"jobset-controller-manager-56f7c7fb9c-x42j7\" (UID: \"73318301-4995-43c9-9ddf-8a66f391a85b\") " pod="openshift-jobset-operator/jobset-controller-manager-56f7c7fb9c-x42j7" Jul 29 15:53:13.164049 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:13.164008 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73318301-4995-43c9-9ddf-8a66f391a85b-cert\") pod \"jobset-controller-manager-56f7c7fb9c-x42j7\" (UID: \"73318301-4995-43c9-9ddf-8a66f391a85b\") " pod="openshift-jobset-operator/jobset-controller-manager-56f7c7fb9c-x42j7" Jul 29 15:53:13.170690 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:13.170670 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jv46\" (UniqueName: \"kubernetes.io/projected/73318301-4995-43c9-9ddf-8a66f391a85b-kube-api-access-5jv46\") pod \"jobset-controller-manager-56f7c7fb9c-x42j7\" (UID: \"73318301-4995-43c9-9ddf-8a66f391a85b\") " pod="openshift-jobset-operator/jobset-controller-manager-56f7c7fb9c-x42j7" Jul 29 15:53:13.274292 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:13.274260 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-56f7c7fb9c-x42j7" Jul 29 15:53:13.429515 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:13.429488 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-56f7c7fb9c-x42j7"] Jul 29 15:53:13.431781 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:53:13.431753 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73318301_4995_43c9_9ddf_8a66f391a85b.slice/crio-92b87313f66b11978c90f28479b44bff154cc06cf8af82d81a15af856d0b3c57 WatchSource:0}: Error finding container 92b87313f66b11978c90f28479b44bff154cc06cf8af82d81a15af856d0b3c57: Status 404 returned error can't find the container with id 92b87313f66b11978c90f28479b44bff154cc06cf8af82d81a15af856d0b3c57 Jul 29 15:53:13.637032 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:13.636945 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-56f7c7fb9c-x42j7" event={"ID":"73318301-4995-43c9-9ddf-8a66f391a85b","Type":"ContainerStarted","Data":"92b87313f66b11978c90f28479b44bff154cc06cf8af82d81a15af856d0b3c57"} Jul 29 15:53:16.652980 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:16.652940 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-56f7c7fb9c-x42j7" event={"ID":"73318301-4995-43c9-9ddf-8a66f391a85b","Type":"ContainerStarted","Data":"7bee9dbc9623b567bbf45dddc3680f72c288a710b9931c851c97f4e42891c170"} Jul 29 15:53:16.653414 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:16.653041 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-56f7c7fb9c-x42j7" Jul 29 15:53:16.673758 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:16.673710 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-56f7c7fb9c-x42j7" podStartSLOduration=2.002074321 podStartE2EDuration="4.673693258s" totalImagesPullingTime="2.671618937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:53:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:53:16.671783647 +0000 UTC m=+419.385818116" watchObservedRunningTime="2026-07-29 15:53:16.673693258 +0000 UTC m=+419.387727723" Jul 29 15:53:27.662971 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:53:27.662930 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-56f7c7fb9c-x42j7" Jul 29 15:54:03.014822 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:54:03.014782 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-z5f4l"] Jul 29 15:54:03.021423 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:54:03.021401 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-z5f4l" Jul 29 15:54:03.024128 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:54:03.024105 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"kube-root-ca.crt\"" Jul 29 15:54:03.024447 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:54:03.024427 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"trainer-operator-system\"/\"trainer-operator-controller-manager-dockercfg-hzj4s\"" Jul 29 15:54:03.025311 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:54:03.025296 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"openshift-service-ca.crt\"" Jul 29 15:54:03.030993 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:54:03.030968 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-z5f4l"] Jul 29 15:54:03.086596 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:54:03.086557 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdhg9\" (UniqueName: \"kubernetes.io/projected/9c6bef36-c373-4c90-b653-636f09de6916-kube-api-access-rdhg9\") pod \"trainer-operator-controller-manager-56f5b7fd56-z5f4l\" (UID: \"9c6bef36-c373-4c90-b653-636f09de6916\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-z5f4l" Jul 29 15:54:03.086786 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:54:03.086608 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c6bef36-c373-4c90-b653-636f09de6916-tmp\") pod \"trainer-operator-controller-manager-56f5b7fd56-z5f4l\" (UID: \"9c6bef36-c373-4c90-b653-636f09de6916\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-z5f4l" Jul 29 15:54:03.086786 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:54:03.086680 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/9c6bef36-c373-4c90-b653-636f09de6916-manifests-work\") pod \"trainer-operator-controller-manager-56f5b7fd56-z5f4l\" (UID: \"9c6bef36-c373-4c90-b653-636f09de6916\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-z5f4l" Jul 29 15:54:03.188161 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:54:03.188121 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdhg9\" (UniqueName: \"kubernetes.io/projected/9c6bef36-c373-4c90-b653-636f09de6916-kube-api-access-rdhg9\") pod \"trainer-operator-controller-manager-56f5b7fd56-z5f4l\" (UID: \"9c6bef36-c373-4c90-b653-636f09de6916\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-z5f4l" Jul 29 15:54:03.188319 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:54:03.188171 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c6bef36-c373-4c90-b653-636f09de6916-tmp\") pod \"trainer-operator-controller-manager-56f5b7fd56-z5f4l\" (UID: \"9c6bef36-c373-4c90-b653-636f09de6916\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-z5f4l" Jul 29 15:54:03.188319 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:54:03.188297 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/9c6bef36-c373-4c90-b653-636f09de6916-manifests-work\") pod \"trainer-operator-controller-manager-56f5b7fd56-z5f4l\" (UID: \"9c6bef36-c373-4c90-b653-636f09de6916\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-z5f4l" Jul 29 15:54:03.188580 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:54:03.188533 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c6bef36-c373-4c90-b653-636f09de6916-tmp\") pod \"trainer-operator-controller-manager-56f5b7fd56-z5f4l\" (UID: \"9c6bef36-c373-4c90-b653-636f09de6916\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-z5f4l" Jul 29 15:54:03.188631 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:54:03.188614 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/9c6bef36-c373-4c90-b653-636f09de6916-manifests-work\") pod \"trainer-operator-controller-manager-56f5b7fd56-z5f4l\" (UID: \"9c6bef36-c373-4c90-b653-636f09de6916\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-z5f4l" Jul 29 15:54:03.201493 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:54:03.201465 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdhg9\" (UniqueName: \"kubernetes.io/projected/9c6bef36-c373-4c90-b653-636f09de6916-kube-api-access-rdhg9\") pod \"trainer-operator-controller-manager-56f5b7fd56-z5f4l\" (UID: \"9c6bef36-c373-4c90-b653-636f09de6916\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-z5f4l" Jul 29 15:54:03.332265 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:54:03.332168 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-z5f4l" Jul 29 15:54:03.462103 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:54:03.462068 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-z5f4l"] Jul 29 15:54:03.464219 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:54:03.464195 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c6bef36_c373_4c90_b653_636f09de6916.slice/crio-57918038be62325ef6963b83b9d4cf703a6647a8100e982878fcdc7dc8fb96b2 WatchSource:0}: Error finding container 57918038be62325ef6963b83b9d4cf703a6647a8100e982878fcdc7dc8fb96b2: Status 404 returned error can't find the container with id 57918038be62325ef6963b83b9d4cf703a6647a8100e982878fcdc7dc8fb96b2 Jul 29 15:54:03.852645 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:54:03.852609 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-z5f4l" event={"ID":"9c6bef36-c373-4c90-b653-636f09de6916","Type":"ContainerStarted","Data":"57918038be62325ef6963b83b9d4cf703a6647a8100e982878fcdc7dc8fb96b2"} Jul 29 15:54:06.870163 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:54:06.870122 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-z5f4l" event={"ID":"9c6bef36-c373-4c90-b653-636f09de6916","Type":"ContainerStarted","Data":"51c21c737264b01505cfab9bcc8c39d782b5f3fa339a98438292551a7c3b1fd2"} Jul 29 15:54:06.870580 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:54:06.870190 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-z5f4l" Jul 29 15:54:06.902074 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:54:06.902024 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-z5f4l" podStartSLOduration=2.06854534 podStartE2EDuration="4.902009607s" totalImagesPullingTime="2.833464267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:54:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:54:06.898281471 +0000 UTC m=+469.612315935" watchObservedRunningTime="2026-07-29 15:54:06.902009607 +0000 UTC m=+469.616044116" Jul 29 15:54:17.877291 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:54:17.877262 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-z5f4l" Jul 29 15:55:31.437023 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:55:31.436943 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-z5f4l"] Jul 29 15:55:31.437523 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:55:31.437141 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-z5f4l" podUID="9c6bef36-c373-4c90-b653-636f09de6916" containerName="manager" containerID="cri-o://51c21c737264b01505cfab9bcc8c39d782b5f3fa339a98438292551a7c3b1fd2" gracePeriod=10 Jul 29 15:55:31.688873 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:55:31.688810 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-z5f4l" Jul 29 15:55:31.730483 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:55:31.730451 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/9c6bef36-c373-4c90-b653-636f09de6916-manifests-work\") pod \"9c6bef36-c373-4c90-b653-636f09de6916\" (UID: \"9c6bef36-c373-4c90-b653-636f09de6916\") " Jul 29 15:55:31.730698 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:55:31.730559 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c6bef36-c373-4c90-b653-636f09de6916-tmp\") pod \"9c6bef36-c373-4c90-b653-636f09de6916\" (UID: \"9c6bef36-c373-4c90-b653-636f09de6916\") " Jul 29 15:55:31.730698 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:55:31.730593 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdhg9\" (UniqueName: \"kubernetes.io/projected/9c6bef36-c373-4c90-b653-636f09de6916-kube-api-access-rdhg9\") pod \"9c6bef36-c373-4c90-b653-636f09de6916\" (UID: \"9c6bef36-c373-4c90-b653-636f09de6916\") " Jul 29 15:55:31.730845 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:55:31.730819 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c6bef36-c373-4c90-b653-636f09de6916-tmp" (OuterVolumeSpecName: "tmp") pod "9c6bef36-c373-4c90-b653-636f09de6916" (UID: "9c6bef36-c373-4c90-b653-636f09de6916"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:55:31.732369 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:55:31.732341 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c6bef36-c373-4c90-b653-636f09de6916-manifests-work" (OuterVolumeSpecName: "manifests-work") pod "9c6bef36-c373-4c90-b653-636f09de6916" (UID: "9c6bef36-c373-4c90-b653-636f09de6916"). InnerVolumeSpecName "manifests-work". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:55:31.732843 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:55:31.732819 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c6bef36-c373-4c90-b653-636f09de6916-kube-api-access-rdhg9" (OuterVolumeSpecName: "kube-api-access-rdhg9") pod "9c6bef36-c373-4c90-b653-636f09de6916" (UID: "9c6bef36-c373-4c90-b653-636f09de6916"). InnerVolumeSpecName "kube-api-access-rdhg9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:55:31.831782 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:55:31.831743 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdhg9\" (UniqueName: \"kubernetes.io/projected/9c6bef36-c373-4c90-b653-636f09de6916-kube-api-access-rdhg9\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jul 29 15:55:31.831782 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:55:31.831777 2554 reconciler_common.go:299] "Volume detached for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/9c6bef36-c373-4c90-b653-636f09de6916-manifests-work\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jul 29 15:55:31.831782 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:55:31.831789 2554 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c6bef36-c373-4c90-b653-636f09de6916-tmp\") on node \"ip-10-0-140-163.ec2.internal\" DevicePath \"\"" Jul 29 15:55:32.237274 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:55:32.237239 2554 generic.go:356] "Generic (PLEG): container finished" podID="9c6bef36-c373-4c90-b653-636f09de6916" containerID="51c21c737264b01505cfab9bcc8c39d782b5f3fa339a98438292551a7c3b1fd2" exitCode=0 Jul 29 15:55:32.237274 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:55:32.237278 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-z5f4l" event={"ID":"9c6bef36-c373-4c90-b653-636f09de6916","Type":"ContainerDied","Data":"51c21c737264b01505cfab9bcc8c39d782b5f3fa339a98438292551a7c3b1fd2"} Jul 29 15:55:32.237522 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:55:32.237290 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-z5f4l" Jul 29 15:55:32.237522 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:55:32.237319 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-z5f4l" event={"ID":"9c6bef36-c373-4c90-b653-636f09de6916","Type":"ContainerDied","Data":"57918038be62325ef6963b83b9d4cf703a6647a8100e982878fcdc7dc8fb96b2"} Jul 29 15:55:32.237522 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:55:32.237341 2554 scope.go:117] "RemoveContainer" containerID="51c21c737264b01505cfab9bcc8c39d782b5f3fa339a98438292551a7c3b1fd2" Jul 29 15:55:32.247412 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:55:32.247391 2554 scope.go:117] "RemoveContainer" containerID="51c21c737264b01505cfab9bcc8c39d782b5f3fa339a98438292551a7c3b1fd2" Jul 29 15:55:32.247731 ip-10-0-140-163 kubenswrapper[2554]: E0729 15:55:32.247709 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51c21c737264b01505cfab9bcc8c39d782b5f3fa339a98438292551a7c3b1fd2\": container with ID starting with 51c21c737264b01505cfab9bcc8c39d782b5f3fa339a98438292551a7c3b1fd2 not found: ID does not exist" containerID="51c21c737264b01505cfab9bcc8c39d782b5f3fa339a98438292551a7c3b1fd2" Jul 29 15:55:32.247800 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:55:32.247739 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51c21c737264b01505cfab9bcc8c39d782b5f3fa339a98438292551a7c3b1fd2"} err="failed to get container status \"51c21c737264b01505cfab9bcc8c39d782b5f3fa339a98438292551a7c3b1fd2\": rpc error: code = NotFound desc = could not find container \"51c21c737264b01505cfab9bcc8c39d782b5f3fa339a98438292551a7c3b1fd2\": container with ID starting with 51c21c737264b01505cfab9bcc8c39d782b5f3fa339a98438292551a7c3b1fd2 not found: ID does not exist" Jul 29 15:55:32.255831 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:55:32.255805 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-z5f4l"] Jul 29 15:55:32.259563 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:55:32.259529 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-z5f4l"] Jul 29 15:55:33.900900 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:55:33.900866 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c6bef36-c373-4c90-b653-636f09de6916" path="/var/lib/kubelet/pods/9c6bef36-c373-4c90-b653-636f09de6916/volumes" Jul 29 15:56:17.772924 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:17.772874 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndcms_5257faa4-46cf-45e5-b609-a414b4fd90af/console-operator/1.log" Jul 29 15:56:17.775762 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:17.775737 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndcms_5257faa4-46cf-45e5-b609-a414b4fd90af/console-operator/1.log" Jul 29 15:56:30.737922 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:30.737889 2554 ???:1] "http: TLS handshake error from 10.0.141.213:46040: EOF" Jul 29 15:56:30.740752 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:30.740724 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kdc28_d5e53580-c891-4bd3-8a76-ffcd74cb4ac5/global-pull-secret-syncer/0.log" Jul 29 15:56:30.848863 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:30.848833 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-w22f7_49da76ad-4692-4991-a6b4-6df2e9632377/konnectivity-agent/0.log" Jul 29 15:56:30.916379 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:30.916343 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-163.ec2.internal_d42b23c9b787526dd3bbeea8c76488c3/haproxy/0.log" Jul 29 15:56:35.064261 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:35.064224 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-b74zp_2dfbf7d0-c804-4516-b8e7-926c7e521e6c/cluster-monitoring-operator/0.log" Jul 29 15:56:35.091676 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:35.091633 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-r6l25_e0799fb8-a222-4cf6-b410-6b7707d3265b/kube-state-metrics/0.log" Jul 29 15:56:35.113157 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:35.113126 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-r6l25_e0799fb8-a222-4cf6-b410-6b7707d3265b/kube-rbac-proxy-main/0.log" Jul 29 15:56:35.134618 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:35.134594 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-r6l25_e0799fb8-a222-4cf6-b410-6b7707d3265b/kube-rbac-proxy-self/0.log" Jul 29 15:56:35.166111 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:35.166088 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-d78fdf688-tn727_add0f40a-33c2-4c2d-ac81-3f57abf90de0/metrics-server/0.log" Jul 29 15:56:35.219848 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:35.219824 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8qn5m_92c36da9-4743-46c7-9e08-19fb7c02feee/node-exporter/0.log" Jul 29 15:56:35.243778 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:35.243744 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8qn5m_92c36da9-4743-46c7-9e08-19fb7c02feee/kube-rbac-proxy/0.log" Jul 29 15:56:35.263079 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:35.263061 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8qn5m_92c36da9-4743-46c7-9e08-19fb7c02feee/init-textfile/0.log" Jul 29 15:56:35.776431 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:35.776399 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-skpd5_1782670f-879b-4673-81a7-411d638f7695/prometheus-operator-admission-webhook/0.log" Jul 29 15:56:35.810308 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:35.810285 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-58bdbf9fb7-4ggcm_bdd55716-dca0-4809-9895-ce0033527f88/telemeter-client/0.log" Jul 29 15:56:35.833795 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:35.833771 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-58bdbf9fb7-4ggcm_bdd55716-dca0-4809-9895-ce0033527f88/reload/0.log" Jul 29 15:56:35.857206 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:35.857183 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-58bdbf9fb7-4ggcm_bdd55716-dca0-4809-9895-ce0033527f88/kube-rbac-proxy/0.log" Jul 29 15:56:37.574175 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:37.574145 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndcms_5257faa4-46cf-45e5-b609-a414b4fd90af/console-operator/1.log" Jul 29 15:56:37.582400 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:37.582376 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndcms_5257faa4-46cf-45e5-b609-a414b4fd90af/console-operator/2.log" Jul 29 15:56:37.850533 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:37.850442 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vcsgn/perf-node-gather-daemonset-4qsdg"] Jul 29 15:56:37.850877 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:37.850857 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c6bef36-c373-4c90-b653-636f09de6916" containerName="manager" Jul 29 15:56:37.850959 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:37.850879 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c6bef36-c373-4c90-b653-636f09de6916" containerName="manager" Jul 29 15:56:37.851011 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:37.850979 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c6bef36-c373-4c90-b653-636f09de6916" containerName="manager" Jul 29 15:56:37.854161 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:37.854136 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-4qsdg" Jul 29 15:56:37.857086 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:37.857065 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vcsgn\"/\"openshift-service-ca.crt\"" Jul 29 15:56:37.857185 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:37.857084 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vcsgn\"/\"default-dockercfg-bs4j9\"" Jul 29 15:56:37.858038 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:37.858020 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vcsgn\"/\"kube-root-ca.crt\"" Jul 29 15:56:37.866287 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:37.866263 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vcsgn/perf-node-gather-daemonset-4qsdg"] Jul 29 15:56:37.891037 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:37.891012 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9088f943-bf93-4c55-a4cc-0d88f957d263-lib-modules\") pod \"perf-node-gather-daemonset-4qsdg\" (UID: \"9088f943-bf93-4c55-a4cc-0d88f957d263\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-4qsdg" Jul 29 15:56:37.891180 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:37.891056 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55kcd\" (UniqueName: \"kubernetes.io/projected/9088f943-bf93-4c55-a4cc-0d88f957d263-kube-api-access-55kcd\") pod \"perf-node-gather-daemonset-4qsdg\" (UID: \"9088f943-bf93-4c55-a4cc-0d88f957d263\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-4qsdg" Jul 29 15:56:37.891180 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:37.891075 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9088f943-bf93-4c55-a4cc-0d88f957d263-sys\") pod \"perf-node-gather-daemonset-4qsdg\" (UID: \"9088f943-bf93-4c55-a4cc-0d88f957d263\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-4qsdg" Jul 29 15:56:37.891180 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:37.891161 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9088f943-bf93-4c55-a4cc-0d88f957d263-podres\") pod \"perf-node-gather-daemonset-4qsdg\" (UID: \"9088f943-bf93-4c55-a4cc-0d88f957d263\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-4qsdg" Jul 29 15:56:37.891320 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:37.891212 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9088f943-bf93-4c55-a4cc-0d88f957d263-proc\") pod \"perf-node-gather-daemonset-4qsdg\" (UID: \"9088f943-bf93-4c55-a4cc-0d88f957d263\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-4qsdg" Jul 29 15:56:37.992359 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:37.992316 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9088f943-bf93-4c55-a4cc-0d88f957d263-proc\") pod \"perf-node-gather-daemonset-4qsdg\" (UID: \"9088f943-bf93-4c55-a4cc-0d88f957d263\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-4qsdg" Jul 29 15:56:37.992588 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:37.992380 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9088f943-bf93-4c55-a4cc-0d88f957d263-lib-modules\") pod \"perf-node-gather-daemonset-4qsdg\" (UID: \"9088f943-bf93-4c55-a4cc-0d88f957d263\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-4qsdg" Jul 29 15:56:37.992588 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:37.992424 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55kcd\" (UniqueName: \"kubernetes.io/projected/9088f943-bf93-4c55-a4cc-0d88f957d263-kube-api-access-55kcd\") pod \"perf-node-gather-daemonset-4qsdg\" (UID: \"9088f943-bf93-4c55-a4cc-0d88f957d263\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-4qsdg" Jul 29 15:56:37.992588 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:37.992442 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9088f943-bf93-4c55-a4cc-0d88f957d263-sys\") pod \"perf-node-gather-daemonset-4qsdg\" (UID: \"9088f943-bf93-4c55-a4cc-0d88f957d263\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-4qsdg" Jul 29 15:56:37.992588 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:37.992462 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9088f943-bf93-4c55-a4cc-0d88f957d263-proc\") pod \"perf-node-gather-daemonset-4qsdg\" (UID: \"9088f943-bf93-4c55-a4cc-0d88f957d263\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-4qsdg" Jul 29 15:56:37.992588 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:37.992481 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9088f943-bf93-4c55-a4cc-0d88f957d263-podres\") pod \"perf-node-gather-daemonset-4qsdg\" (UID: \"9088f943-bf93-4c55-a4cc-0d88f957d263\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-4qsdg" Jul 29 15:56:37.992588 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:37.992570 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9088f943-bf93-4c55-a4cc-0d88f957d263-sys\") pod \"perf-node-gather-daemonset-4qsdg\" (UID: \"9088f943-bf93-4c55-a4cc-0d88f957d263\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-4qsdg" Jul 29 15:56:37.992588 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:37.992588 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9088f943-bf93-4c55-a4cc-0d88f957d263-podres\") pod \"perf-node-gather-daemonset-4qsdg\" (UID: \"9088f943-bf93-4c55-a4cc-0d88f957d263\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-4qsdg" Jul 29 15:56:37.992856 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:37.992594 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9088f943-bf93-4c55-a4cc-0d88f957d263-lib-modules\") pod \"perf-node-gather-daemonset-4qsdg\" (UID: \"9088f943-bf93-4c55-a4cc-0d88f957d263\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-4qsdg" Jul 29 15:56:38.001497 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:38.001478 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55kcd\" (UniqueName: \"kubernetes.io/projected/9088f943-bf93-4c55-a4cc-0d88f957d263-kube-api-access-55kcd\") pod \"perf-node-gather-daemonset-4qsdg\" (UID: \"9088f943-bf93-4c55-a4cc-0d88f957d263\") " pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-4qsdg" Jul 29 15:56:38.163987 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:38.163879 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-4qsdg" Jul 29 15:56:38.297304 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:38.297278 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vcsgn/perf-node-gather-daemonset-4qsdg"] Jul 29 15:56:38.300188 ip-10-0-140-163 kubenswrapper[2554]: W0729 15:56:38.300162 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9088f943_bf93_4c55_a4cc_0d88f957d263.slice/crio-6700eaae992c4b6f0298a9236ef44993c9e863cd3a3fbc14642daf31474e5944 WatchSource:0}: Error finding container 6700eaae992c4b6f0298a9236ef44993c9e863cd3a3fbc14642daf31474e5944: Status 404 returned error can't find the container with id 6700eaae992c4b6f0298a9236ef44993c9e863cd3a3fbc14642daf31474e5944 Jul 29 15:56:38.533041 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:38.533007 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-4qsdg" event={"ID":"9088f943-bf93-4c55-a4cc-0d88f957d263","Type":"ContainerStarted","Data":"5535418b1b2419432e4c8f77d7db2bd0ff709acfb682fdf089b86cd44e2e77cd"} Jul 29 15:56:38.533214 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:38.533061 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-4qsdg" event={"ID":"9088f943-bf93-4c55-a4cc-0d88f957d263","Type":"ContainerStarted","Data":"6700eaae992c4b6f0298a9236ef44993c9e863cd3a3fbc14642daf31474e5944"} Jul 29 15:56:38.533214 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:38.533087 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-4qsdg" Jul 29 15:56:38.552182 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:38.552139 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-4qsdg" podStartSLOduration=1.552126652 podStartE2EDuration="1.552126652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:56:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:56:38.55127375 +0000 UTC m=+621.265308214" watchObservedRunningTime="2026-07-29 15:56:38.552126652 +0000 UTC m=+621.266161117" Jul 29 15:56:38.581463 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:38.581440 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-mr76j_acf996c0-566b-4eda-ba21-2542c991a168/volume-data-source-validator/0.log" Jul 29 15:56:39.476114 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:39.476080 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cdv86_184a4db0-e00b-4e60-84bc-96dffd559d6e/dns/0.log" Jul 29 15:56:39.502104 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:39.502074 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cdv86_184a4db0-e00b-4e60-84bc-96dffd559d6e/kube-rbac-proxy/0.log" Jul 29 15:56:39.616140 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:39.616107 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pw9xr_d9d34b9d-2d38-4123-a642-3e433d36b23e/dns-node-resolver/0.log" Jul 29 15:56:40.095063 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:40.095028 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wmtrp_f49f48c2-8c3b-4acb-91ea-88772241837e/node-ca/0.log" Jul 29 15:56:40.832827 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:40.832796 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f9fb4469f-8dzw8_73aeab81-faab-4712-968c-ab8ee7b67e10/router/0.log" Jul 29 15:56:41.176170 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:41.176087 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2m6gl_51ff4873-720e-4b87-ab6e-9b54928d8fdc/serve-healthcheck-canary/0.log" Jul 29 15:56:41.568931 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:41.568883 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-cpw78_5b5c5993-07f9-4c76-b552-108228b1dfa8/insights-operator/0.log" Jul 29 15:56:41.569203 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:41.569187 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-cpw78_5b5c5993-07f9-4c76-b552-108228b1dfa8/insights-operator/1.log" Jul 29 15:56:41.658154 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:41.658122 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b4cnv_141e3214-1ccf-4ebf-bb64-b1895c6a7402/kube-rbac-proxy/0.log" Jul 29 15:56:41.678945 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:41.678917 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b4cnv_141e3214-1ccf-4ebf-bb64-b1895c6a7402/exporter/0.log" Jul 29 15:56:41.701901 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:41.701872 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b4cnv_141e3214-1ccf-4ebf-bb64-b1895c6a7402/extractor/0.log" Jul 29 15:56:43.366924 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:43.366879 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-controller-manager-56f7c7fb9c-x42j7_73318301-4995-43c9-9ddf-8a66f391a85b/manager/0.log" Jul 29 15:56:44.547467 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:44.547440 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vcsgn/perf-node-gather-daemonset-4qsdg" Jul 29 15:56:47.083334 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:47.083303 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76_d1d31deb-30f5-4af3-abeb-1d20733a12d1/kube-storage-version-migrator-operator/1.log" Jul 29 15:56:47.084898 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:47.084875 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-zlb76_d1d31deb-30f5-4af3-abeb-1d20733a12d1/kube-storage-version-migrator-operator/0.log" Jul 29 15:56:48.311922 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:48.311894 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6q78m_52405e2b-d7e9-42f3-a9ae-609e02a252a2/kube-multus-additional-cni-plugins/0.log" Jul 29 15:56:48.333198 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:48.333163 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6q78m_52405e2b-d7e9-42f3-a9ae-609e02a252a2/egress-router-binary-copy/0.log" Jul 29 15:56:48.354378 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:48.354346 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6q78m_52405e2b-d7e9-42f3-a9ae-609e02a252a2/cni-plugins/0.log" Jul 29 15:56:48.377076 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:48.377043 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6q78m_52405e2b-d7e9-42f3-a9ae-609e02a252a2/bond-cni-plugin/0.log" Jul 29 15:56:48.402694 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:48.402661 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6q78m_52405e2b-d7e9-42f3-a9ae-609e02a252a2/routeoverride-cni/0.log" Jul 29 15:56:48.422449 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:48.422410 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6q78m_52405e2b-d7e9-42f3-a9ae-609e02a252a2/whereabouts-cni-bincopy/0.log" Jul 29 15:56:48.443303 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:48.443277 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6q78m_52405e2b-d7e9-42f3-a9ae-609e02a252a2/whereabouts-cni/0.log" Jul 29 15:56:48.649650 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:48.649615 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-shxwt_b3f46689-73a1-44b7-b437-339c9aaac015/kube-multus/0.log" Jul 29 15:56:48.762606 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:48.762575 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jchg2_92a38651-6bb4-4f5a-9d97-8ac79e1027f4/network-metrics-daemon/0.log" Jul 29 15:56:48.780335 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:48.780305 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jchg2_92a38651-6bb4-4f5a-9d97-8ac79e1027f4/kube-rbac-proxy/0.log" Jul 29 15:56:49.505288 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:49.505256 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mfwv_46a6b55c-7a78-40b3-8adf-69daad654fda/ovn-controller/0.log" Jul 29 15:56:49.520691 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:49.520664 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mfwv_46a6b55c-7a78-40b3-8adf-69daad654fda/ovn-acl-logging/0.log" Jul 29 15:56:49.546021 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:49.545995 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mfwv_46a6b55c-7a78-40b3-8adf-69daad654fda/kube-rbac-proxy-node/0.log" Jul 29 15:56:49.566319 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:49.566291 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mfwv_46a6b55c-7a78-40b3-8adf-69daad654fda/kube-rbac-proxy-ovn-metrics/0.log" Jul 29 15:56:49.583593 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:49.583565 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mfwv_46a6b55c-7a78-40b3-8adf-69daad654fda/northd/0.log" Jul 29 15:56:49.603775 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:49.603752 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mfwv_46a6b55c-7a78-40b3-8adf-69daad654fda/nbdb/0.log" Jul 29 15:56:49.624074 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:49.624048 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mfwv_46a6b55c-7a78-40b3-8adf-69daad654fda/sbdb/0.log" Jul 29 15:56:49.676448 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:49.676424 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mfwv_46a6b55c-7a78-40b3-8adf-69daad654fda/ovnkube-controller/0.log" Jul 29 15:56:51.008361 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:51.008317 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7d88cb55d8-ccdn7_a5d66c78-cfc3-436a-b338-6934d8d86b22/check-endpoints/0.log" Jul 29 15:56:51.031268 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:51.031237 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-fqgzw_73422f43-4d4a-4738-be77-ba5aff983673/network-check-target-container/0.log" Jul 29 15:56:51.963960 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:51.963931 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-2pzcs_f64e1ce6-4c88-4b72-b669-e4cf22ffc766/iptables-alerter/0.log" Jul 29 15:56:52.611782 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:52.611752 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-x9fkz_e1a7d3d7-8923-4451-b404-573d7c07b438/tuned/0.log" Jul 29 15:56:54.288237 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:54.288178 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-gtbm5_9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4/cluster-samples-operator/0.log" Jul 29 15:56:54.307874 ip-10-0-140-163 kubenswrapper[2554]: I0729 15:56:54.307843 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-gtbm5_9c44c6a4-b249-46a6-bd8b-4cda3b9c0bc4/cluster-samples-operator-watch/0.log"